Through unspoken agreement, the gnomes have settled only my ceiling. Now a whole village’s worth of houses and bridges is dangling from it