Quite a few different options available actually for this.
For an all in one, very low power option you could consider AMD Hudson, basic mATX or mini-ITX motherboard, integrated APU (CPU & Radeon HD6310) with HDMI out. Plays 1080p video and Blu-Ray rip MKV's perfectly fine. I use the Asus E350M1-I Deluxe (passive heatsink and built in wifi and bluetooth) in my HTPC and it works great with Windows 7 and XBMC for movies/tv shows and music.
For a bit more CPU power could look at getting a basic AMD Llano A6 and FM1 motherboard or Intel 1155/H67 motherboard/ basic Pentium G530/620. Will make browsing a bit smoother and the system feel a little quicker.
For case have a search for the "Vision Media Center Case," decent budget HTPC case with PSU and infra-red remote which works out of the box with Windows Media Center and XBMC.