I hadn't thought of it either. For us, the territory outside of the Walls was foreign enough, let alone other worlds. But, well, here we are...

To be honest with you, I'm not sure if we're from Earth. Our maps are too incomplete to tell if we're just in the middle of a much larger world, or if there isn't all that much to it.