Today at approximately 4pm the server orion.ups.edu (also known as tock.ups.edu) crashed and rebooted. Everything seems to have came back properly, but unexpected behavior may be experienced. Please contact TechHelp at x8585 if you experience problems with Orion.
[Complete] Maintenance Window 12/20/09
Updated 12/20/09 @ 11:15 AM
As of 11:00 AM all services are back online, earlier than expected. Please contact TechHelp at x8585 if you see any problems with university services.
The next production maintenance window is Sunday, December 20, from 8:00 AM to 5:00 PM.
From 8:00 AM to Noon, all services may be intermittently or entirely unavailable, including:
- Personal and departmental file shares (on Alexandria and Merlin2)
- Database Applications: Cascade, FAMIS, Millennium, and Banner
BJP bounced – 12/3/2009
BJP was modified to error appropriately when a runrep command fails. BJP was stopped and restarted at 12:30 pm for the new code to take effect.
Resolved: Mail list services unavailable (listhost.ups.edu)
As of noon today all mail list services are back online. Please contact TechHelp at x8585 if you continue to experience problems with lists.
Early this morning our mail list server had a problem and is not working properly. We are working on resolving the issue, but it is not likely to be resolved before 5pm today. We will update this post as we have more information.
[Resolved] ResNet Internet Disruptions 12/3/09
The ResNet internet connection was down from 12:00 midnight to 3:00 AM this morning. Service has been restored.
wiki.ups.edu moved to new server, userweb.pugetsound.edu
Today between 5pm and 6pm wiki.ups.edu was moved over to userweb.pugetsound.edu. No problems were encountered, but please let us know if you encounter issues.
Nick Webb x3185
Crm restarted 12/1/2009
Both Crm11ip instance and Crm App had to be restarted due to the exceeded processes on the databasee. The problem was caused by the returning mails sent last week.
Installed CpuOct2009 Patch 11/29/2009
Installed Oracle Critical Patch, CpuOct2009, on Cascade, Banner, Famis, Millennium, and Rman databases.
Orcas Reboot 11/23/09 @ 5:30am
Orcas needs a reboot to properly configure VMWare tools, the misconfiguration is causing performance issues on Orcas. All services will be available by 6am.
BJP migrated to Orcas – 11/17/2009
BJP was migrated off of Camano, onto Orcas
CRM bounce-backs weren’t processing
We discovered that the CRM email bounce-backs were not being processed, resulting in a very full mailbox. Nick renamed the inbox, essentially cleaning out the mailbox, thinking that maybe the box was too full to process the messages properly. This appears to have fixed the problem. We will look into whether these are being cleaned out properly when the bounceback is processed (or, being marked for deletion but then never deleted).
We also discovered that messages were being routed to the Junk email mailbox. CRM only processes bounce-backs found in the Inbox. We suspect that our use of Outlook to access the bounces email account has caused this to occur. We will look into using a tool other than Outlook for accessing this IMAP account.
Maintenance Window 11/29/09
All production databases were patched successfully. If you experience any issues with Puget Sound systems, please contact TechHelp at (253) 879-8585.
The next production maintenance window is Sunday, November 29th, from 8:00 AM to noon. From 8:00 AM to noon, all database services may be intermittently or entirely unavailable, including: Cascade, FAMIS, Millennium, and Banner.
[Complete] Maintenance Window 10/25/09
Updated 10/25/2009 @ noon — All production servers were patched successfully. If you experience any issues with Puget Sound systems, please contact TechHelp at (253) 879-8585.
The next production maintenance window is Sunday, October 25th, from 8:00 AM to noon.
From 8:00 AM to Noon, all services may be intermittently or entirely unavailable, including:
- Personal and departmental file shares (on Alexandria and Merlin2)
- Database Applications: Cascade, FAMIS, Millennium, and Banner
Maintenance Detail 10/25/2009
The following systems were patched today between 8am and noon:
- sthelens
- baker
- Tahoma
- userweb
- purgatory
- styx
- hades
- gehenna
- moodle
- quixote
- mysql
- oraweb
- orcas
- vmhost1
- Alexandria
- BE1
- BE2
- BE3
- CBORDFSS (VENDOR DC)
- CLTACC1
- CLTACC2
- CMS
- DHCP-1
- DM-1 to DM-8
- EPO
- FE1
- FE2
- ILLIAD
- INTCHK (VM)
- KEEPER
- KRONOS (VENDOR DC)
- LENEL (VENDOR Security)
- MAURY2
- MBS1
- MBS2
- MBS3
- MEDIA
- MERLIN2
- MICROS (VENDOR DC)
- MSPROJECT
- ODYSSEY (VENDOR DC)
- PROJECTS
- SANJUAN
- UPSCA03
- VASHON
- VERONICA
- VIAWARP (VM)
- VMMON (VM for now)
- WEBSERVER1
- WEBSERVER2
- CISCOWORKS (VM)
[Complete] PreProduction Maintenance Window 10/15/2009
This month, on 10/15/2009 from 7am to 9pm we performed our monthly patch maintenance for PreProduction servers. We patched the following systems:
- VMhost2
- Pilchuck
- Lummi
- Web
- moodle2
- kickstart
- Exdev
- Fidalgo
- Galaxy
- Ketron
- Portal
- VS0