Mail server load

As of 13:30 on January 12, 2004 the University mail server had received over 40,000 messages that were rejected or deferred based on the anti-spam rules. In an attempt to reduce this unnecessary load, the mail exchange (MX) records for the mail server in the external DNS were commented out. This will help to send all smtp traffic to the anti-virus gateway. Secondly, the ups-benjamin and mailserver objects were removed from the pix’s smtp group.

Cbord Odyssey unresponsive to registers

The Cbord server reported to not be responding to inquiries from the cash registers at approximately 12:30 PST. Upon inspection of the server, it was discovered that pcAnywhere was hung waiting for a connection. We received a VFEP error when tring to access the Odyssey Control panel.

It is our belief that C-Bord support encountered errors when doing routine maintenance that hung the server.

RESOLUTION: We rebooted the Odyssey server and had the cash registers re-inquire.

Corporate Time slow

Serveral users have recently reported slow response from the Corporate Time server. During the course of our investigation of the problem, several orphaned ssh process were found on Big Ben and the log files were found to be quite large.

The orphaned processes were dealt with at 16:00 PST. The Corporate Time service was stopped at approximately 20:30 PST. The log files were rotated and the service restarted. The University web server was restarted to allow users to access the Corporate Time web interface.

Internet Connection Instability II

The University’s internet connection was inoperable this morning from about 7 AM until about 10:30 AM. The problem was isolated to the PIX firewall. A number of logged outbound connection attemps (ca. 97000) from forged class A source addresses to a destination in Northern California were discovered. The sheer number of such attempts constituted a denial of service situation for the firewall.

The true source of the connection attempts was traced to a student computer in Todd/Phibbs. The students network port was inactivated, and the firewall was rebooted. This restored internet service.
Continue reading