[Updated] Webmail access has been restored for all Puget Sound e-mailers. The outage only affected a portion of the Exchange users. All email services are fully restore and functional.
After patch maintenance it was discovered that OWA access was unavailable. Microsoft has been called and a ticket has been opened. Services will be returned to normal as soon as possible.
Viawarp, a credit card processing system, is the last production system using VLAN98 and this needs to change for future use of this VLAN and for implementation of new features on VMware.
The IP on Viawarp was changed this morning from 5:30-6am from 192.124.98.151 to 10.98.0.95.
Starting Monday, 1/24/2011 at 8am, TS will being migrating the sthelens server from McIntyre to Wyatt. This move is required in order to provide redundancy and disaster recovery capabilities for our most important database services.
For the duration of Monday and Tuesday, January 24th and 25th, sthelens will be offline for this change.
The impact of this change is that should a production database fail, it will need to be manually restored in place, versus switching to sthelens, a relatively small risk.
Cascade Release 11.2 was installed on February 9, 2011. This release included the following features and fixes:
Updated at 11:27am 1/30/2011: All maintenance complete.
The next production maintenance window is Sunday, January 30th, from 8:00 AM to noon.
From 8:00 AM to noon, all services may be intermittently or entirely unavailable, including:
Completion of the DHCP Server Maintenance will occur 01/11/11 from 5:30 AM to 6:30 AM. We expect no disruption in service.
Domain Controller & DHCP Server Maintenance will occur on 01/06/11 from 5:30 AM to 6:30 AM
From 5:30 AM to 6:30 AM, Domain Controller & DHCP services are expected to be fully available during maintenance.
INVOLVING: K20
CURRENT EVENT START : 12/13/10 22:22 PST
CURRENT EVENT STOP : 12/14/10 16:18 PST
SUMMARY:
This notice is being sent to all K-20 customers.
The network outage involving WSIPC (and serveral other nearby K-20 sites) appears to have been fixed as of 16:18 this evening. The circuit provider ran a new section of fiber cable around the broken portion to bring them back up. We do not yet know whether that new fiber path is temporary or permanent. (If it’s temporary, there may be a planned outage in the future when they move the circuits back to the original fiber.)
WSIPC’s DNS servers are answering DNS queries again. Their other services should be back up too.
=================================================================
K20 Network Operations Network Operations Center
noc@wa-k20.net 888-934-5551
=================================================================
DETAILED OUTAGE HISTORY
K20 Area Wide
FIRST DOWN: 12/13/10 22:22
LAST UP: 12/14/10 16:18 PST
TOTAL DOWN TIME: 17 hours 56 minutes
TOGGLES:
12/13/10 22:22 – 12/14/10 16:18 PST
FYI – K20 Announcement of fiber damage from the storm. No issues have been reported yet as a result.
INVOLVING: K20
CURRENT EVENT START : 12/13/10 22:22 PST
CURRENT EVENT STOP : ?
SUMMARY:
This notice is being sent to all K20 customers. We probably should have sent this notice sooner.
WSIPC is part of a 14 site outage caused by a fiber break which occurred last night at 22:22 pm. That specific outage is being tracked in our ticket 940112.
As many customers have noticed, WSIPC services such as hosted DNS, email, and some applications such as Skyward and Citrix are affected.
These WSIPC services will be down until the outage can be resolved. At this time, the fiber provider is working on providing an alternate path for the affected transport circuits but there is still no ETR at this time.
=================================================================
K20 Network Operations Network Operations Center
noc@wa-k20.net 888-934-5551
=================================================================
DETAILED OUTAGE HISTORY
K20 Area Wide
FIRST DOWN: 12/13/10 22:22 PST
LAST UP: ?
TOTAL DOWN TIME: 15 hours 10 minutes
TOGGLES:
12/13/10 22:22 PST – ?
The next production maintenance window is Sunday, February 27th, from 8:00 AM to noon.
On Wednesday 12/22/2010, we will migrate the server moodle.pugetsound.edu to VMware. The server will be offline for the duration of the move.
Cascade Release 10.12 was installed on December 8, 2010. This release included the following features and fixes:
This was a small release due to holiday schedules. For the same reason, the January release was small and dedicated to internal technology needs.
Some inconsistencies in services such as VPN, webmail, and workstation authentication late (about 10:30-11:30 PM) on Sunday night, although no emergency calls were received. TS staff were dispatched to the campus at 11 PM.
This is resolved as of about midnight Sunday/Monday night after resetting select servers’ certificate information.
Update at Noon on 11/28/10: Maintenance is complete as of 11:30AM this morning, ahead of schedule.
The next production maintenance window is Sunday, November 28th, from 8:00 AM to 4:00 PM.
From 8:00 AM to 4:00 PM, all services may be intermittently or entirely unavailable, including: