Due to configuration errors at the Internet Service Provider (Integra Telecom), VPN connections were not working from 6:00 to 7:20 AM. The VPN has been restored.
Emergency Power Repairs are complete 3/21/2009
The emergency power repairs have been completed, and all systems have been restored to normal.
Increased Connection Limits – Cascade Web
In response to yesterday’s Cascade Web problem, the following changes were made to the production Application Server (As10gr2p) to accommodate increased connections due to ViewsFlash deployment.
- MaxClient 500 (from 150) on Http Server
- LoadLImit 200 (from 100) on WebCache
Firefox can now access Discoverer and ViewsFlash
3/19/2009
The value of mod_osso_url in the production application server was changed from “https://cascade.ups.edu:443” to “https://cascade.ups.edu”.
This fixes the problem where ViewsFlash or Discoverer could not be accessed via Firefox. (A space appeared at the end of the url.)
We tested the new configuration, using Firefox to directly access ViewsFlash, Discoverer, Portal, Cascade Web, and oiddas.
Single Sign-On Fixed for Portal and Discoverer
3/13/2009
The maximum SSO session duration value (not the inactivity timeout) had previously been set incorrectly to 0.5 hours, which was treated as 0, preventing the SSO cookie from maintaining a session.
This value was set to the normal value of 8 hours.
[Completed] ResNet Bandwidth Upgrade 3/24/09
[Update 3/24/09 6:00 AM] The bandwidth upgrade on the ResNet Internet connection is complete. ResNet now has a 100 Mbps connection to the Internet. Enjoy!
On Tuesday morning, 3/24/09, from 5:30 AM to 6:00 AM the Internet connection for the college’s residential network will be upgraded from 45 Mbps to 100 Mbps (a two-fold increase). The Resnet Internet connection will be unavailable during this time.
The upgraded connection will feature not only a 100 Mbps bandwidth, but also a new traffic shaping model, based on bandwidth, rather than type of traffic. This should reduce many of the application problems we have seen over the past few years.
[Complete] Multiple Services affected by emergency electrical work 3/21/09
[Update 3/21/09 10:13 AM] The emergency power repairs have been completed, and all systems have been restored to normal.
Due to emergency electrical work in the server room, the following services will be unavailable from 8:00 AM to 1:00 PM Saturday, 3/21/09:
• Moodle
• itech.ups.edu Web site
• ASUPS Web server and file server
• Sophos PureMessage quarantine Web site (mail delivery will be unaffected)
• Kronos server (electronic time cards)
[Completed] FAMIS unavailable due to upgrade 3/20 to 3/21/09
[Update 3/21/09 1:30 PM] The Famis upgrade was successfully complete and has been fully tested. Famis services have returned to full operation.
FAMIS, the Facilities Services database, will be upgraded on March 20th and 21st. FAMIS will be unavailable beginning at 4:30 PM on Friday, March 20, and will be available by 5:00 PM on Saturday, March 21.
[Resolved] Cascade Web application server is unavailable
[Update 3/19/09 4:20 PM] Services have been restored. The application services were stopped and restarted. Root cause analysis in underway.
The application server that hosts Cascade is currently unavailable. Other services impacted are Cascade, Portal, Discoverer, CRM, and Views Flash Survey. TS is aware of the problem and it is being investigated.
Successful test of changing CA on production integration server
3/19/2009 11:30am – 12:30pm
Pavan and Jeff disabled the sync profiles and stopped the integration and directory servers on whidbey to install the 1024-bit certificates from rapidssl. We started the servers and enabled the sync profiles, then verified that a change to displayname in OID synced to AD and a password change in AD synced to OID.
We then reversed the process to re-install the previously functioning verisign certificates, and verified that the sync was again working successfully.
Web Site Navigation Not Displaying
[Update 3/6/09 10:41 AM] This error has been resolved; however,
The right navigation on academic departments and programs pages linked from http://www.ups.edu/academicdepartments.xml is not displaying at this time. The missing navigation on these pages includes links to departmental and program Web sites. The problem has been referred to the vendor of our content management system, Ingeniux, and they promise a solution today.
We will add temporary links to the department and program Web sites until this issue is resolved.
CMS maintenance required
I am shutting down the CMS server in order to perform needed maintenance on the system. This is required because some pages are missing their navigation. Folks who use the CMS will only be affected for a few minutes; however, publishing will be slow for the next 90 minutes.
The next scheduled CMS will be the afternoon of March 26.
[Completed] Gehenna Server Off-Line 3/5/09
Gehenna is experiencing a physical memory issue and will be off-line 3/5/09 between 6:45 AM and 7:30 AM for maintenance and troubleshooting. There is no expected impact to campus users as services will be re-routed to another server.
Banner/Cascade Web Forms Server bounced at 2:10 p.m.
Due to problems on the forms server, we had to bounce it at 2:10 p.m. this afternoon. This kicks all current users off, so I sent an email to them alerting them of the situation. This affected all users in Banner Web Forms and Cascade Web Forms.
We are actively researching the problem and want to get it fixed soon.
[Resolved] Alexandria Shares Offline Saturday 2/28/09
On Saturday, February 28th from 6-8am, Alexandria will be offline for storage expansion and maintenance. During the outage, student home directories (H: drive) and department shares will be inaccessible.
This change is required to expand the amount of disk space available on Alexandria and to improve backup performance.
[Update 2/28/2009 @ 8:00am] Normal service on Alexandria was restored by 7:15am this morning.