Welcome to the forum @Summersay415!
My guess is that this is a limitation due to floating point numbers and precision. The farther away you get from origin ((0, 0, 0)), the precision of floats becomes flaky and that can lead to all sorts of problems. There is a proposal to add double precision floats in Godot, which would make it possible to have much larger worlds.
