Think of how many ships are out there in the ocean. Now imagine how much bigger space is.

Of course speed and debris is a factor, but fact is - space is huge and we don't have that many satellites.