[Resolved] Incoming E-mail Disrupted

[Update 04/21/2009 03:17 PM] E-mail service has been restored. All mail will be delivered shortly.

Mail inbound to pugetsound.edu has been disrupted. We are working to restore service. No mail has been lost, and all mail will be delivered. We will update you as soon as possible.

Reports Server bounced

Cascade and FAMIS users reported issues receiving their reports that are run through the reports server. Users received an error message saying that job ###### wouldn’t run. When we looked in the reports server (past jobs), that particular job_id did not show up (it was a future job_id!).

Resolution: bounced reports server

[Resolved] CRM database error, a couple mass emails adversely affected

A database error occurred in CRM about 11:30 am on 4/15/2009. DST was alerted to the problem, a table that was unable to extend, and fixed it about noon. A couple of email campaigns were in-progress and were adversely affected:
1. A message from the President’s office going to faculty, staff and students was sent out twice, but the records indicated it only went out once.
2. A message that was being created by Admission was in the middle of generating the target group and got stuck there. Every attempt to resolve it failed so the solution was to copy the schedule without the target group, re-create the target group and then the email was sent out successfully.

Mil9ip Instance Performance Tuning

Performed Mil9ip tuning on 4/7/2008, based the test on mildemo instance with Sean Vincent.  According to Sean, this tuning improved the performance of Millennium dramatically.  The tuning includes the follwing changes in the parameter file.

·         optimizer_mode=FIRST_ROWS from CHOOSE

·         increased shared_pool_size, pga_aggregate_target size, and sga_max_size

mail attribute no longer synced from OID to AD

AD must have sole control of its “mail” attribute to properly provision e-mail accounts. OID –> AD synchronization had included this, and the provisioning system (privcmd) had been filling this with any known e-mail address. This prevented new pugetsound domain accounts from being enabled when the e-mail address was not in the ups.edu domain, as is the case for most new students.

The mapping file was changed to no longer update the “mail” attribute when synchronizing from OID to AD.

[resolved] Application Servers Dev and Test not responding

The Oracle listener on Albert stopped functioning 3/26/2009 around 9:15 or 9:30am, which caused all Oracle databases on the machine to stop responding.

This affected development and test application servers. Specifically Registrar staff testing was interrupted. No production services were affected.

The listener was bounced and service restored after about 20-30 minutes.

Cascade Web minor improvements installed

The following minor changes were installed 3/25/2009 10:30am, with no disruption:

  • Cascade Home page now includes “Technical Problems” link
  • Password Change page now includes buttons when using tab key to navigate
  • Typo in error message was fixed
  • Format of initial password was changed so it includes mixed case instead of symbol