The simplest method would be to accomplish this through DNS, though you have some caching issues with this approach.
Another way would be to use a load balancer to decide where to send the traffic. LVS (www.linuxvirtualserver.org) works admirably for this task. Of course now all of your...