Maybe all your floor boards were lying, scattered on top of the stone floor of your house, serving no purpose, so they took them?
Maybe they had rot, and so, knidly, the men/man took them away, to prepare new ones.
It'll probably a shit answer about poo or something, won't it?