I had something to do with the server node we were on.
While technically a VPS, Virtual Private Server, there are still shared resources.
Apparently someone on the server was sending spam and causing the Spam Assasin service to overload. I complained to the host, they banned the guy but it hasn't seemed to have helped.
They moved us to a totally new server node today. Tell me if problems persist.