FYI – K20 Announcement of fiber damage from the storm.  No issues have been reported yet as a result.

INVOLVING: K20

CURRENT EVENT START  : 12/13/10 22:22 PST

CURRENT EVENT STOP   : ?

 SUMMARY:

  This notice is being sent to all K20 customers.  We probably should have sent this notice sooner.

  WSIPC is part of a 14 site outage caused by a fiber break which occurred last night at 22:22 pm.  That specific outage is being tracked in our ticket 940112.

  As many customers have noticed, WSIPC services such as hosted DNS, email, and some applications such as Skyward and Citrix are affected.

  These WSIPC services will be down until the outage can be resolved.  At this time, the fiber provider is working on providing an alternate path for the affected transport circuits but there is still no ETR at this time.

 =================================================================

K20 Network Operations                  Network Operations Center

noc@wa-k20.net                                     888-934-5551

=================================================================

                     DETAILED OUTAGE HISTORY

 K20 Area Wide

  FIRST DOWN: 12/13/10 22:22 PST

 LAST UP: ?

 TOTAL DOWN TIME: 15 hours 10 minutes

  TOGGLES:

    12/13/10 22:22 PST – ?

Production Maintenance Window 2/27/11 from 8:00 AM to Noon

The next production maintenance window is Sunday, February 27th, from 8:00 AM to noon.

From 8:00 AM to noon, all services may be intermittently or entirely unavailable, including:
  • E-mail
  • Database Applications: Cascade, FAMIS, Millennium, and Banner
  • Web services such as www.pugetsound.edu, cs.pugetsound.edu, and Moodle
  • Personal and departmental file shares (on Alexandria and Merlin2)

Cascade Release 10.12 – 12.8.2010

Cascade Release 10.12 was installed on December 8, 2010. This release included the following features and fixes:

  • Fix Survey Database Views For Usernames (tracker CAS-121)
  • Add Missing Qualified Students to Dean’s List Display (tracker CAS-142)
  • Clarify Faculty Instruction Text for Student Alert Group (tracker CAS-159)

This was a small release due to holiday schedules. For the same reason, the January release was small and dedicated to internal technology needs.

Pre-Production Maintenance 02/17/2011 from 7:00am to 9:00am

On Thursday February 17th from 7:00 AM – 9:00 AM the following pre-production servers may be unavailable due to maintenance:
lummi
hope
decatur
squaxin
shaw
pilchuck
moodle2
kickstart
mysqldev
maharadev
ldaprelay-dev
tomcat-dev
EXDEV
FIDALGO
ISIS
OSIRIS
KETRON
PORTAL
VS0
ATHABASCADEV
HELPDESKACD
Furthermore, Oracle systems may be unavailable starting at 5:00 AM:
bjp for ridge and summit
Clean address for ridge and summit
Job submission
OAS on hope and deactur
Oracle Forms on Fidalgo

[RESOLVED] Webmail/VPN/Windows Authentication Problems 11/14/10

Some inconsistencies in services such as VPN, webmail, and workstation authentication late (about 10:30-11:30 PM) on Sunday night, although no emergency calls were received. TS staff were dispatched to the campus at 11 PM.

This is resolved as of about midnight Sunday/Monday night after resetting select servers’ certificate information.

[Complete] Production Maintenance Window 11/28/10 from 8:00 AM to 4:00 PM

Update at Noon on 11/28/10:  Maintenance is complete as of 11:30AM this morning, ahead of schedule.

The next production maintenance window is Sunday, November 28th, from 8:00 AM to 4:00 PM.

From 8:00 AM to 4:00 PM, all services may be intermittently or entirely unavailable, including:

  • E-mail
  • Database Applications: Cascade, FAMIS, Millennium, and Banner
  • Web services such as www.pugetsound.edu, cs.pugetsound.edu, and Moodle
  • Personal and departmental file shares (on Alexandria and Merlin2)

[Resolved] Internet Access Disrupted 11/09/10

[Update 2:50 PM] Service has been restored. The disruption occurred due to a local equipment issue at the offices of the K-20 Education Network, the source of the Internet connection for the university’s academic and administrative buildings.

The university’s Internet connection is temporarily unavailable. We are working to assure service is restored as soon as possible and will post updates as they become available.

[Complete] Legacy DNS to be Retired 10/25/2010 at 5:30 AM

This change was completed without incident at 5:30am this morning. We continue to monitor key services for any reliance on this retired DNS system.

At 5:30 AM on Monday, October 25th, our legacy DNS servers will be turned off (houdini.ups.edu 192.124.98.110; babel.ups.edu 192.124.98.111). These servers have been effectively retired for about six months.  Any computers with these DNS servers set within the university network should immediately be changed to 207.207.101.4 & 207.207.101.6.

DHCP has been handing out these new DNS IPs for months, and only users who set the entries statically will be affected – should be very few users; we’ve watched the logs to make sure no large population was using the old service.

[Completed] Residential Internet – Emergency Maintenance Scheduled

[Updated 12:20 AM] The maintenance was completed successfully, and all connections have been restored.

Integra Telecomm has informed us that Emergency Maintenance has been scheduled for our Residential Internet Connection. It is scheduled to start at 12:00 AM (midnight). The outage is scheduled to be 15-20 minutes in duration. Please plan accordingly. All on-campus network access will still be available, but no off-campus Internet access will be available. 

This will also cause a loss of VPN access to the campus network.

[Resolved] E-mail Service Disruptions 10/13/10

[Updated 11:23 AM] Service has now been restored to all users. Again, we appreciate your patience. For any questions or concerns, please contact the Service Desk at 253.879.8585 or servicedesk@pugetsound.edu.

[Updated 10:45 AM] Some users with usernames A to LB are now experiencing issues. We are working to restore service and will provide an update soon.

[Updated 9:35 AM] Service has been restored, though initially some users may experience slow performance. We appreciate your patience!

Some users with usernames starting in LC to Z are experiencing intermittent problems connecting to campus e-mail. This problem is affecting some users but not all. Our team is working to resolve this issue as soon as possible. We will post updates as they become available.