Working day and night…
Written by Jerome Pietri on
Last night, 5 of us were on deck after a difficult wake up call in the middle of the night. Regardless of the time, Greg / Pierre-Laurent / Dumè / Seb and I were up from 2 am until 4, in the aftermath of a BGP incident.
When BGP breaks down
"Major network failures have a lot in common with police investigations, it is very difficult to learn the specifics before the case is actually closed, but let’s just say that the cleanup of our routers’ configuration was a little too thorough so that the computing lines directing towards our networks were deleted, isolating our servers from the rest of the world."
Pierre Laurent Medori, who still didn’t get a night's sleep, approves!
It took an hour, in the middle of the night, for the system to be operational again, for the most part, but a few connectivity issues still remain as of now, for some service providers or countries, the issues are currently being resolved. We are still in close touch with the housing support of our provider.