Cascade Web and Cascade Web Forms went down approximately 2:30 p.m. this afternoon. We are investigating the problem and will have it back up as soon as we can.
Services were restored at about 4 p.m. Causes are unknown at this time but we will continue to investigate what happened.
Today at approximately 4pm the server orion.ups.edu (also known as tock.ups.edu) crashed and rebooted. Everything seems to have came back properly, but unexpected behavior may be experienced. Please contact TechHelp at x8585 if you experience problems with Orion.
As of noon today all mail list services are back online. Please contact TechHelp at x8585 if you continue to experience problems with lists.
Early this morning our mail list server had a problem and is not working properly. We are working on resolving the issue, but it is not likely to be resolved before 5pm today. We will update this post as we have more information.
The ResNet internet connection was down from 12:00 midnight to 3:00 AM this morning. Service has been restored.
As of 9:00pm 10/13/09 all users have complete access to their email once again. Some messages into and out of these users accounts may be delayed as the system catches up.
Update as of 4:45PM 10/13/09
The outage of email for users EJ-LB continues as we run a database recovery process on the affected volume/users. The process could take up to 18 hours, completing by mid-morning Wednesday (10am).
This post will be updated as more information is available.
Exchange Email is unavailable for users with usernames starting with EJ-LB. Currently there is not a time estimate of when email for these users will be available again, but this post will be updated when the issue is corrected.
Update at 11:06 AM
All users now have access to their email and Calendars. Please contact TechHelp if you continue to see problems.
Updated at 9:29 AM
Email is still unavailable for Students and Technology Services users starting with the letters L through S and Technology Services continues to work the problem. We now expect the problem to be resolved by 12 noon, while doing everything we can to resolve the issue more quickly. Watch this post for more information as it becomes available.
At this time some users are unable to access their email and calendars via Outlook, Webmail, and by other means. Technology Services has identified the problem and expects resolution by 9:30am.
Update at 4:25PM
All users should have complete access to their email once again. Some messages into and out of these users accounts may be delayed as the system catches up.
At this time Students and Technology Services staff members with usernames beginning in the letters L through S may not be able to access their email and calendars. Technology Services is aware of the problem and is working quickly to resolve the issue. We expect email to be accessible to all users by 6pm this evening and will update this post as conditions change.
Do to the unscheduled extended outage this morning the following servers were affected during the outage (Camano, Grace, Crystal, Rainier, and Whidbey). This temporarily caused Cascade and other services to be unaccessible. The outage was extended from 06:30 am to 08:00 am, all services to these servers are back online and accessible now.
The Millennium database was down this morning for a few hours because the archiver was stuck because the archive logs have not been getting purged like they should.
Space was cleared on the drive so archiving could resume and the database would be accessible again, and we will follow up on the log purging issue so this doesn’t happen again.
CRM, the system for sending campus-wide bulk messages, has experience an unexpected outage.
Technology Services is currently working to resolve the issue.
Service was restored to CRM at 3:59 pm.
During routine service Sunday night, August 2nd, the voicemail server experienced an unexpected problem which resulted in an unscheduled service disruption from approximately 6:30-7:30pm. All functionality was restored around 7:30pm.
Web forms was down this morning which included Cascade, Famis and Banner (a separate announcement has been posted to the Help Desk site for public viewing).
Patches were applied on the sanjuan server yesterday, and it wasn’t working after that. Paul fixed something in the configuration and bounced the server and now it’s working again.
[Update 6/1/2009 7:53 AM] Service has been restored.
Cascade, Banner and Famis web forms are experiencing errors. TS is working on this problem and will update with a resolution time when we know more.
Webmail was unavailable for about 15 minutes at 8:30 PM tonight. Technology Services staff was notified and has resolved the problem.
Technology Services are researching the cause and will update as additional information has become available. This affects CASCADE and BANNER.
Form Server is working again.