Solana experienced a network failure due to an error in transaction processing
Due to a failure in processing durable transactions nonces, the Solana network was unable to play new blocks on June 1. This led to a consensus breach within the blockchain. The network developers temporarily suspended such transactions and asked validators to restart the network.
Mainnet Beta Validators: Please follow the restart instructions linked below, and upgrade 1.9.x to 1.9.28 – If you are on 1.10.x please upgrade to 1.10.23https://t.co/gBAOPrpnNe— Solana Status (@SolanaStatus) June 1, 2022
Durable transactions nonces are mostly used on popular cryptocurrency exchanges. They are used for token holders who use automatic transaction signing settings.
One validator noted that the problem with this type of transaction has been known for a long time. Such a bug was observed on May 28, but it did not affect the cluster. Publication from catalogue CryptoDeFix.
We had already observed an incidence of this error on our validator last Saturday which we reported, at that time it didn't affect the broader cluster.— Laine | stakewiz.com (@laine_sa_) June 1, 2022
From our logs we could quickly tell this was the same bug. Solana Labs engineers confirmed this from their nodes as well.
The network downtime took 4 hours and 10 minutes. Now the blockchain works stably, some block reviewers have problems with correct display of block release times and transactions.