Updated at 11:27am 1/30/2011: All maintenance complete.
The next production maintenance window is Sunday, January 30th, from 8:00 AM to noon.
From 8:00 AM to noon, all services may be intermittently or entirely unavailable, including:
Completion of the DHCP Server Maintenance will occur 01/11/11 from 5:30 AM to 6:30 AM. We expect no disruption in service.
Domain Controller & DHCP Server Maintenance will occur on 01/06/11 from 5:30 AM to 6:30 AM
From 5:30 AM to 6:30 AM, Domain Controller & DHCP services are expected to be fully available during maintenance.
INVOLVING: K20
CURRENT EVENT START : 12/13/10 22:22 PST
CURRENT EVENT STOP : 12/14/10 16:18 PST
SUMMARY:
This notice is being sent to all K-20 customers.
The network outage involving WSIPC (and serveral other nearby K-20 sites) appears to have been fixed as of 16:18 this evening. The circuit provider ran a new section of fiber cable around the broken portion to bring them back up. We do not yet know whether that new fiber path is temporary or permanent. (If it’s temporary, there may be a planned outage in the future when they move the circuits back to the original fiber.)
WSIPC’s DNS servers are answering DNS queries again. Their other services should be back up too.
=================================================================
K20 Network Operations Network Operations Center
noc@wa-k20.net 888-934-5551
=================================================================
DETAILED OUTAGE HISTORY
K20 Area Wide
FIRST DOWN: 12/13/10 22:22
LAST UP: 12/14/10 16:18 PST
TOTAL DOWN TIME: 17 hours 56 minutes
TOGGLES:
12/13/10 22:22 – 12/14/10 16:18 PST
FYI – K20 Announcement of fiber damage from the storm. No issues have been reported yet as a result.
INVOLVING: K20
CURRENT EVENT START : 12/13/10 22:22 PST
CURRENT EVENT STOP : ?
SUMMARY:
This notice is being sent to all K20 customers. We probably should have sent this notice sooner.
WSIPC is part of a 14 site outage caused by a fiber break which occurred last night at 22:22 pm. That specific outage is being tracked in our ticket 940112.
As many customers have noticed, WSIPC services such as hosted DNS, email, and some applications such as Skyward and Citrix are affected.
These WSIPC services will be down until the outage can be resolved. At this time, the fiber provider is working on providing an alternate path for the affected transport circuits but there is still no ETR at this time.
=================================================================
K20 Network Operations Network Operations Center
noc@wa-k20.net 888-934-5551
=================================================================
DETAILED OUTAGE HISTORY
K20 Area Wide
FIRST DOWN: 12/13/10 22:22 PST
LAST UP: ?
TOTAL DOWN TIME: 15 hours 10 minutes
TOGGLES:
12/13/10 22:22 PST – ?
The next production maintenance window is Sunday, February 27th, from 8:00 AM to noon.
On Wednesday 12/22/2010, we will migrate the server moodle.pugetsound.edu to VMware. The server will be offline for the duration of the move.
Cascade Release 10.12 was installed on December 8, 2010. This release included the following features and fixes:
This was a small release due to holiday schedules. For the same reason, the January release was small and dedicated to internal technology needs.
Some inconsistencies in services such as VPN, webmail, and workstation authentication late (about 10:30-11:30 PM) on Sunday night, although no emergency calls were received. TS staff were dispatched to the campus at 11 PM.
This is resolved as of about midnight Sunday/Monday night after resetting select servers’ certificate information.
Update at Noon on 11/28/10: Maintenance is complete as of 11:30AM this morning, ahead of schedule.
The next production maintenance window is Sunday, November 28th, from 8:00 AM to 4:00 PM.
From 8:00 AM to 4:00 PM, all services may be intermittently or entirely unavailable, including:
A problem with our webmail server caused inbound mail to be delayed, possibly for as much as 3 hours. The situation has been resolved as of 4 PM.
[Update 2:50 PM] Service has been restored. The disruption occurred due to a local equipment issue at the offices of the K-20 Education Network, the source of the Internet connection for the university’s academic and administrative buildings.
The university’s Internet connection is temporarily unavailable. We are working to assure service is restored as soon as possible and will post updates as they become available.
A new point to point vpn was setup for DataLogistic consulting on K-20 ASA.
Assess allowed to 207.207.101.0/24 and 10.98.0.0/22
VMHOST4 has a bad onboard NIC, which requires swapping the motherboard to fix. Dell should be on site at 8 AM on Friday to swap it out. VMware can handle the overage by migrating VMs to other servers, no outage is expected.