I admit: I don’t pay attention to my Linux servers like I should. They have lulled me into a false sense of security due to their stability. This morning, though, my monitoring app sent an email to me. A snippet:

The VM XXXXXX has exceeded the notification threshold (90) for CPU Usage by averaging 90.8% for the last 2 hours.

Yikes!

Log on.

1
: top

What the? mysqld sitting at 87%. Um, ok…

1
2
3
4
5
6
7
8
9
10
11
: sudo mysqladmin shutdown

Can't shutdown process mysqld
Can't shutdown process mysqld
Can't shutdown process mysqld
Can't shutdown process mysqld
Can't shutdown process mysqld
Can't shutdown process mysqld
Can't shutdown process mysqld
Can't shutdown process mysqld
...

Wow. Reboot. All is well.

Yep, mysqld choked on the leap second.

Stupid leap second. Stupid mysql.

Time to switch to SQL Server Azure.