On February 17th from 5:30-6AM batteries in our EMC CX400 Disk Array will be replaced. This is a fully redundant system and no outage is expected. However, as with any change, there is always a risk of outage. If a problem arises with the change, the following services may be impacted:
email
CRM
Database Services (FAMIS, Banner, Millennium, etc.)
Please note that Cascade will not be affected.
Cascade’s batch processing system went down unexpectedly at 11:15 am. We are working to restore this service.
Batch processing service was restored at 11:51 am.
Campus email text:
Saturday, January 10, Technology Services will be performing important updates on our database systems. There will be two groups of outages:
5 AM until 8 PM – Cascade and Cascade Web will be unavailable.
9 AM until Noon – Banner, Famis, Basis, and Millennium will be unavailable.
Email, network files and shares, and other network services will not be impacted.
Details:
Cascade database is switching to new hardware and upgrading to 10g. Administrative toolset is being upgraded to 10g and deployed on new hardware.
Banner, Famis, Basis, and Millennium will be patched to make them compatible with 10g.
Cascade Batch Processing system was down for approximate 30 minutes, from 3:00 pm to 3:30 pm.
The Installation of the new storage array and SAN to support upgrades of the database and email systems was completed with the reboots of all database servers from 5:30 to 6:30 AM this morning. CRM was restored at 7:45 AM. The extended timeframe was necessary to ensure that all existing and new LUNs had redundant paths to their hosts in the SAN.
Saturday, October 25, Technology Services will be performing important updates on our database systems and storage area network. This will impact our database and email systems. In order to minimize service disruption, there will be two groups of outages:
Network files and shares, and other network services will not be impacted.
Service has been restored to all central database systems (Cascade, Cascade Web, Banner, Famis, Millennium, Basis and CRM) as of 3pm. Please contact the Help Desk, 253.879.8585 or helpdesk@ups.edu, if you continue to experience problems.
All central database systems are unavailable. This service disruption began at 11AM today and services impacted include: Cascade, Cascade Web, Banner, Famis, Basis, CRM and Millennium. Technology Services has determined the source of the disruption to be a power outage and is working with Facilities Services to resolve as quickly as possible.
UPDATE AS OF 2PM:
Stable power has been restored and Technology Services is now focused on restarting and verifying the database systems. Every effort is being made to restore services as quickly as possible. Our earliest continuation of service is estimated at 3pm today.
At 6 AM this morning, a reload of the core switch caused a failure of the network interfaces on the Cascade Web server. This in turn caused the Cascade web interface to be unavailable from 6 to 8:15 this morning. The server was rebooted and recovered, restoring service at approximately 8:15.
Other affected servers were grace, camano, and crystal, all of which were rebooted to restore service at 7:30 AM. Batch job processing was affected between 6 and 7:30 AM.
BJP was down for a short period of time due to unknown causes. It went down about 2:55 p.m. and was back up by 3:17 p.m.
BJP was down temporarily on May 7th from about 7:30 pm – 8:30 pm. It took itself down, we could find no evidence of a problem, so we restarted it and it seemed to work fine.
Email sent to liaisons:
Thursday April 17, Information Services will be performing critical changes on our database systems to improve recent performance concerns.
Access to all database systems including Cascade, Cascade Web, Banner, Famis, Basis and Millennium will be unavailable from 5:30 AM until 6 AM Thursday.
If you have questions or concerns regarding this outage, please contact Jenifer Brauen by telephone at ext. 2725, 253.879.2725, or via email at jbrauen@ups.edu. Thank you for understanding our need to conduct critical systems work.
Thank you.
– Jenifer Brauen
Camano failed due to process and memory overload caused by a failure to properly process bounceback messages from CRM.
Changed the category 4 passwords on Cascade (schemas), bjp, and their dependents throughopout the system.
3 changes have been moved to production today:
1-bug fix to kill job routine
2-bug fix to calling of runrep commands
3-support for duplex printing