At 7pm on 1/4/2023, we noticed a widespread network outage effecting the entirety of our ASN. We began to investigate and found issues with how a partner provider issued a blackhole for us. We worked to negate the blackholing, which in turn resulted in stuck routes throughout the DFZ. After working through some of the issues with stuck blackholed routes, we began to notice some issues presenting with IXPs we have presence in, likely stemming to the blackholing. After collective hours of our team and other contributors, we were able to rebuild our network into it's normal state. During the time without protection enabled, we were hit with a 6gbps DDOS attack which slowed the process. At the time of writing, all network infrastructure has been restored, ixps have all been brought back up, downstreams are being transited.

We appologize about any inconvenience caused.