Installed Oracle Critical Patch, CpuOct2009, on Cascade, Banner, Famis, Millennium, and Rman databases.
Orcas Reboot 11/23/09 @ 5:30am
Orcas needs a reboot to properly configure VMWare tools, the misconfiguration is causing performance issues on Orcas. All services will be available by 6am.
BJP migrated to Orcas – 11/17/2009
BJP was migrated off of Camano, onto Orcas
CRM bounce-backs weren’t processing
We discovered that the CRM email bounce-backs were not being processed, resulting in a very full mailbox. Nick renamed the inbox, essentially cleaning out the mailbox, thinking that maybe the box was too full to process the messages properly. This appears to have fixed the problem. We will look into whether these are being cleaned out properly when the bounceback is processed (or, being marked for deletion but then never deleted).
We also discovered that messages were being routed to the Junk email mailbox. CRM only processes bounce-backs found in the Inbox. We suspect that our use of Outlook to access the bounces email account has caused this to occur. We will look into using a tool other than Outlook for accessing this IMAP account.
Maintenance Window 11/29/09
All production databases were patched successfully. If you experience any issues with Puget Sound systems, please contact TechHelp at (253) 879-8585.
The next production maintenance window is Sunday, November 29th, from 8:00 AM to noon. From 8:00 AM to noon, all database services may be intermittently or entirely unavailable, including: Cascade, FAMIS, Millennium, and Banner.
[Complete] Maintenance Window 10/25/09
Updated 10/25/2009 @ noon — All production servers were patched successfully. If you experience any issues with Puget Sound systems, please contact TechHelp at (253) 879-8585.
The next production maintenance window is Sunday, October 25th, from 8:00 AM to noon.
From 8:00 AM to Noon, all services may be intermittently or entirely unavailable, including:
- Personal and departmental file shares (on Alexandria and Merlin2)
- Database Applications: Cascade, FAMIS, Millennium, and Banner
Maintenance Detail 10/25/2009
The following systems were patched today between 8am and noon:
- sthelens
- baker
- Tahoma
- userweb
- purgatory
- styx
- hades
- gehenna
- moodle
- quixote
- mysql
- oraweb
- orcas
- vmhost1
- Alexandria
- BE1
- BE2
- BE3
- CBORDFSS (VENDOR DC)
- CLTACC1
- CLTACC2
- CMS
- DHCP-1
- DM-1 to DM-8
- EPO
- FE1
- FE2
- ILLIAD
- INTCHK (VM)
- KEEPER
- KRONOS (VENDOR DC)
- LENEL (VENDOR Security)
- MAURY2
- MBS1
- MBS2
- MBS3
- MEDIA
- MERLIN2
- MICROS (VENDOR DC)
- MSPROJECT
- ODYSSEY (VENDOR DC)
- PROJECTS
- SANJUAN
- UPSCA03
- VASHON
- VERONICA
- VIAWARP (VM)
- VMMON (VM for now)
- WEBSERVER1
- WEBSERVER2
- CISCOWORKS (VM)
[Complete] PreProduction Maintenance Window 10/15/2009
This month, on 10/15/2009 from 7am to 9pm we performed our monthly patch maintenance for PreProduction servers. We patched the following systems:
- VMhost2
- Pilchuck
- Lummi
- Web
- moodle2
- kickstart
- Exdev
- Fidalgo
- Galaxy
- Ketron
- Portal
- VS0
[Resolved] Exchange Email Unavailable for Users EJ-LB
As of 9:00pm 10/13/09 all users have complete access to their email once again. Some messages into and out of these users accounts may be delayed as the system catches up.
Update as of 4:45PM 10/13/09
The outage of email for users EJ-LB continues as we run a database recovery process on the affected volume/users. The process could take up to 18 hours, completing by mid-morning Wednesday (10am).
This post will be updated as more information is available.
Exchange Email is unavailable for users with usernames starting with EJ-LB. Currently there is not a time estimate of when email for these users will be available again, but this post will be updated when the issue is corrected.
Aruba Wireless Controller License and software upgrade
10/10/2009 The Aruba wirless controller was upgraded and additional new licensing applied starting at 4:30am. The controller was rebooted at 5:20am. The process is complete at 5:30am. Monitoring until 6:00am shows all access points are functioning properly.
[Resolved] Email Unavailable for Students and Technology Services Users L-S
Update at 11:06 AM
All users now have access to their email and Calendars. Please contact TechHelp if you continue to see problems.
Updated at 9:29 AM
Email is still unavailable for Students and Technology Services users starting with the letters L through S and Technology Services continues to work the problem. We now expect the problem to be resolved by 12 noon, while doing everything we can to resolve the issue more quickly. Watch this post for more information as it becomes available.
At this time some users are unable to access their email and calendars via Outlook, Webmail, and by other means. Technology Services has identified the problem and expects resolution by 9:30am.
[Resolved] Email Unavailable for L-S Users
Update at 4:25PM
All users should have complete access to their email once again. Some messages into and out of these users accounts may be delayed as the system catches up.
At this time Students and Technology Services staff members with usernames beginning in the letters L through S may not be able to access their email and calendars. Technology Services is aware of the problem and is working quickly to resolve the issue. We expect email to be accessible to all users by 6pm this evening and will update this post as conditions change.
Camano LUN Migration – 9/18 5:30-6:30AM
On 9/18 from 5:30 to 6:30 AM we will migrate BJP and other applications on the Camano server to a new LUN. This work is needed to decomission our older and soon to be unsupported disk array.
BJP and CRM applications will be offline for the duration of this change.
[Complete] Maintenance Window 9/27/09
Updated 9/27/2009 at 2:30pm
All maintenance is completed as planned without any unexpected problems. Most services were available by noon and all services are available as of 2:30pm.
The next production maintenance window is Sunday, September 27th, from 8:00 AM to 4:00 PM.
All services may be intermittently or entirely unavailable from 8:00 AM to 4:00 PM, including:
- Personal and departmental file shares (on Alexandria and Merlin2)
- Database Applications: Cascade, FAMIS, Millennium, and Banner
Scheduled Telephone Service Disruption 9/13/09
On Sunday morning, 9/13/09, beginning at 7:00 PM, Telephone Services will be performing maintenance on off-campus telephone connections. The outage may interrupt all off-campus telephone calls for up to 30 minutes. This work will not affect telephone service within the college, itself, or cellular service.
Questions, contact phones@pugetsound.edu.