Exactly. 50 years of sci-fi movies have conditioned us to picture everything in space being right on top of each other. Space is really, really roomy, and collisions suck. You'll put things as far apart as you can just to reduce the chances of collisions due to unexpected drift.
I still remember the shock I felt when I found out that even in the thickest part of Sol's main asteroid belt, it is essentially never possible to stand on one asteroid and see another with the naked eye (unless it's in orbit around the one you're on).