If an unreliable shifting house would work, House of Leaves by Mark Danielewski. The writing is very much love it or hate it for a lot of people, but the idea fits.

Edit: Oh! And House of Windows by John Langan. No relation despite the similar titles.