1 Domain + 2 IPs = Duplicate Content Penalty

I have several websites setup as follows:

- uploaded on host 1 at dedicated IP 111.111.111.111

- and also uploaded at host 2 (backup host) at dedicated IP 222.222.222.222

The dns A-record constantly points at host 1 (IP 111.111.111.111); in case that host fails, I manually switch the dns A-record to host 2 (IP 222.222.222.222).

Being dedicated IPs, I can simply type them in my browser's address window, and I see the index page of my website.

So, in fact, my site can be accessed via 3 urls: my_site.com, 111.111.111.111 and 222.222.222.222.

The question is: will that get me into trouble with Google and other search engines that may see there a duplicate content at 3 different urls and penalize me for that? If yes, how can I avoid it?