The mailer functionality serving Cascade and CRM has been migrated off of Camano, and onto Orcas. This involved a DNS change for cascademail.pugetsound.edu and a small amount of code change in Cascade.
Maintenance completed at 11:30am with no unexpected outages. Cascade was back online by 10:30am.
Between 8:00 AM and noon on Sunday, February 21st outages of Cascade are expected as we perform important infrastructure maintenance.
CRM will be down for the next 15 minutes for a switch reboot.
Both Crm11ip instance and Crm App had to be restarted due to the exceeded processes on the databasee. The problem was caused by the returning mails sent last week.
We discovered that the CRM email bounce-backs were not being processed, resulting in a very full mailbox. Nick renamed the inbox, essentially cleaning out the mailbox, thinking that maybe the box was too full to process the messages properly. This appears to have fixed the problem. We will look into whether these are being cleaned out properly when the bounceback is processed (or, being marked for deletion but then never deleted).
We also discovered that messages were being routed to the Junk email mailbox. CRM only processes bounce-backs found in the Inbox. We suspect that our use of Outlook to access the bounces email account has caused this to occur. We will look into using a tool other than Outlook for accessing this IMAP account.
On 9/18 from 5:30 to 6:30 AM we will migrate BJP and other applications on the Camano server to a new LUN. This work is needed to decomission our older and soon to be unsupported disk array.
BJP and CRM applications will be offline for the duration of this change.
CRM, the system for sending campus-wide bulk messages, has experience an unexpected outage.
Technology Services is currently working to resolve the issue.
Service was restored to CRM at 3:59 pm.