Is KVM Equipment Necessary

Couldn't you just remote access into your server from elsewhere? This would save you the hassle and cost of buying/installing/maintaing the KVM equipment?

In the rare case where you have no network access but need access to the server, then you could directly plug keyboard, monitor, and mouse into the server directly, right?

And in cases where you do have network access, couldn't you just plug in your laptop into the network in the colocation facility or wherever and remote access to the servers sitting two feet away from you?