[Update 2/22/11 6:37 AM] Maintenance is completed and all services have been restored.
Some Puget Sound online services, including Cascade, Banner, pugetsound.jobs, LoggerJobs, and the Online Service Desk may be temporarily disrupted between 5:30 and 6:00 AM on Tuesday, February 22, as required maintenance is performed.
An update will be posted when maintenance is completed. Thank you for your patience!
The fiber issues have been resolved and normal network connectivity has been restored.
Network connectivity to the Facilities Complex may be sporadic this morning due to the work in preparation for the demolition of South Hall building A. Technology Services will be attempting to reroute the connection in the next hour.
Pre-Production Maintenance has been completed: After database refreshes, all dev/test services should now be back online, maintenance is complete.
[Update 2:24 PM] Service has been restored, and Moodle is available once again.
Moodle is currently unavailable, and we are working to restore service as quickly as possible. We will post updates as we have them. Thank you for your patience!
[Update 2/8/11 6:31 AM] Maintenance is completed and all services have been restored.
The university’s online services may be temporarily disrupted between 5:00 and 6:00 AM on Tuesday, February 8, as required maintenance is performed. During this time, intermittent outages may occur with such services as Internet connectivity, e-mail, Cascade, Banner, Famis, Kronos, Sequoia, VPN, and others.
An update will be posted when maintenance is completed. Thank you for your patience!
I will be upgrading the IOS on our Core Router (Cisco 6905) at 5:00am tomorrow morning (Tuesday Feb 8th).
The upgrade is to enable a new 10GB interface slot card.
All preparations are already in place, so I expect the downtimes to be short (5-10min each) and intermittent between 5:00-6:00am.
During the downtimes, all inter network-connectivity will be disabled. There will be no access to any services or resources during this time.
This will include but not limited to: email, internet, databases, VPN, etc.
[Update 2:56 PM] Internet service has now been restored to residential buildings. Thank you.
Internet service to all university residential buildings is currently unavailable due to a major fiber cut on the network of our service provider, Integra Telecom. Integra is working to restore service as quickly as possible, and we are looking at ways to mitigate the situation locally. We will post updates as we have them.
This outage does not affect Internet service to the university’s academic and administrative buildings.
Thank you for your patience.
[Updated] Webmail access has been restored for all Puget Sound e-mailers. The outage only affected a portion of the Exchange users. All email services are fully restore and functional.
After patch maintenance it was discovered that OWA access was unavailable. Microsoft has been called and a ticket has been opened. Services will be returned to normal as soon as possible.
Viawarp, a credit card processing system, is the last production system using VLAN98 and this needs to change for future use of this VLAN and for implementation of new features on VMware.
The IP on Viawarp was changed this morning from 5:30-6am from 192.124.98.151 to 10.98.0.95.
Starting Monday, 1/24/2011 at 8am, TS will being migrating the sthelens server from McIntyre to Wyatt. This move is required in order to provide redundancy and disaster recovery capabilities for our most important database services.
For the duration of Monday and Tuesday, January 24th and 25th, sthelens will be offline for this change.
The impact of this change is that should a production database fail, it will need to be manually restored in place, versus switching to sthelens, a relatively small risk.
Cascade Release 11.2 was installed on February 9, 2011. This release included the following features and fixes:
Updated at 11:27am 1/30/2011: All maintenance complete.
The next production maintenance window is Sunday, January 30th, from 8:00 AM to noon.
From 8:00 AM to noon, all services may be intermittently or entirely unavailable, including:
Completion of the DHCP Server Maintenance will occur 01/11/11 from 5:30 AM to 6:30 AM. We expect no disruption in service.
Domain Controller & DHCP Server Maintenance will occur on 01/06/11 from 5:30 AM to 6:30 AM
From 5:30 AM to 6:30 AM, Domain Controller & DHCP services are expected to be fully available during maintenance.
INVOLVING: K20
CURRENT EVENT START : 12/13/10 22:22 PST
CURRENT EVENT STOP : 12/14/10 16:18 PST
SUMMARY:
This notice is being sent to all K-20 customers.
The network outage involving WSIPC (and serveral other nearby K-20 sites) appears to have been fixed as of 16:18 this evening. The circuit provider ran a new section of fiber cable around the broken portion to bring them back up. We do not yet know whether that new fiber path is temporary or permanent. (If it’s temporary, there may be a planned outage in the future when they move the circuits back to the original fiber.)
WSIPC’s DNS servers are answering DNS queries again. Their other services should be back up too.
=================================================================
K20 Network Operations Network Operations Center
noc@wa-k20.net 888-934-5551
=================================================================
DETAILED OUTAGE HISTORY
K20 Area Wide
FIRST DOWN: 12/13/10 22:22
LAST UP: 12/14/10 16:18 PST
TOTAL DOWN TIME: 17 hours 56 minutes
TOGGLES:
12/13/10 22:22 – 12/14/10 16:18 PST