Yes, both computers need to have Internet access if they're in different locations. For computers in the same network, the Internet access it not necessary as the LAN provides basic communication among computers, but if you plan to use two computers that have different IPs, then it's absolutely necessary to have Internet connection.
