Lights Out in Rio

November 10, 2009 Jim Cowie


When the power goes out to a large part of Brazil, as happened last night shortly after 10pm, it’s going to have an impact on telecommunications.

When power drops, there’s an immediate shock to the Internet routing system. You can see it clearly in this plot, which shows the number of South American networks affected by serious instability or unreachability in the previous 15-minute window.


By compiling the routing traffic we collected from all over the world during this period of time, it’s possible to pinpoint the time of the failure in the Brazilian electric grid (10:26pm, or 00:26 UTC). From an essentially negligible background level, the number of affected networks vaults to more than 150 within seconds. Following the classic pattern of widespread power failures, the number of freshly affected networks drops over time as backup power kicks in, and then there are ‘echoes’ of new failures as the backup power suffers its own problems.

br-earth-ren_wm.jpg   ihp-sa-ren-names_wm.jpg

These are some screenshots from our KML-based regional outage visualizer, and our Internet Health Portal tool. As you can see, Brazil took the largest hit, but we also saw Paraguayan and Uruguayan networks out as a result of the largest regional power outage to hit Brazil and its neighbors in several years.

Inevitably, speculation will fly fast and furious about the cause. Media reports this week suggested that hackers may have taken down the Brazilian grid in 2005 and 2007. Brazil says it simply wasn’t so. Was tonight a sardonic repeat performance, in response to Sunday’s 60 Minutes coverage?

The post Lights Out in Rio appeared first on Dyn Research.


About the Author

Jim Cowie

Jim Cowie is the Chief Scientist at Dyn. Previously, Jim was the founder and CTO of Renesys, the Internet Intelligence Authority, which Dyn acquired in 2014.

Follow on Twitter More Content by Jim Cowie
Previous Article
IP Backbone: Hard sell, not so much
IP Backbone: Hard sell, not so much

Think you’re too busy to blog? Think again. Or just ask your boss. After...

Next Article
Staring Into The Gorge: Router Exploits
Staring Into The Gorge: Router Exploits

I’m writing this blog entry from the campground at Vermont’s beautiful...