Investigating - The Mothra and Rice production database servers are under high load. As a result, services dependent upon either Mothra or Rice may be experiencing degraded performance.

System administrators are aware of the cause and are monitoring the situation.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 31, 10:38 PDT
Banner ? Operational
Box ? Operational
Cable TV Operational
CAS ? Operational
Computing Accounts ? Operational
Cyrus Email ? Operational
DaFIS ? Operational
Data Center Colocation Operational
DavisMail ? Operational
DHCP ? Operational
DNS ? Operational
Email Lists ? Operational
Email Routing ? Operational
FGS ? Operational
Geckomail ? Operational
IAM ? Operational
Kerberos ? Operational
KFS ? Operational
Kuali Rice ? Degraded Performance
LDAP ? Operational
MyInfoVault ? Operational
MyTravel Operational
MyUCDavis Employee ? Operational
myUCDavis ? Operational
Network ? Operational
Network Time ? Operational
Radio Operational
SAN & DCFS ? Operational
ServiceNow ? Operational
Shibboleth ? Operational
Smartsite ? Operational
Software Website ? Operational
TRS ? Operational
uConnect DS ? Operational
uConnect Cloud ? Operational
uConnect eFax ? Operational
uConnect Lync ? Operational
uConnect On-Premise ? Operational
UC Davis Home Site ? Operational
Virtualization ? Operational
Voice ? Operational
Web CMS ? Operational
Web Hosting ? Operational
Wireless ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Scheduled Maintenance
Purpose:
This will affect the HVAC steam condensate, fire and security alarms, network 21, HVAC telecom, all lighting and electrical power. To tap into a buss feeder for a panel feed. Requested by Marvin LeBlanc, BMS Electrical Shop, cell 681-1911. Reference job # 2416416EL2 – C004 & C005.

Impact:
Data connectivity will be lost if UPS batteries are depleted.

Buildings:
OLSON
SPROUL

VLANs:
GEN-ACAD-1
GEN-ACAD-2-FW
HVAC-2-FW
IT-INFO-RES-10
IT-INFO-RES-12
IT-INFO-RES-14
IT-INFO-RES-15
IT-INFO-RES-17-FW
LANG-LIT-1-DMZ
LANG-LIT-1-FW
LANGUAGE-LAB-1-FW
MOOBILENET(X)
O&M:UTILITIES-1
SOC-SCI-ADM-1-FW

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Aug 28, 10:41 PDT
Purpose:
To apply quarterly released critical patches to Oracle databases on iris (SIS, EDMS)

Affected:
- Banner production database (SIS)
- EDMS production database
- Applications relying on direct access to Banner (SIS)
- Banner forms (INB)
- Banner SISWeb
- Online Student Services Portal
- SISDocs
- SmartSite

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Aug 31, 08:58 PDT
System Metrics Month Week Day
www.ucdavis.edu uptime
Fetching
smartsite.ucdavis.edu uptime
Fetching
my.ucdavis.edu uptime
Fetching
www.ucdavis.edu response time
Fetching
smartsite.ucdavis.edu response time
Fetching
my.ucdavis.edu response time
Fetching
Past Incidents
Aug 31, 2015
Resolved - This issue has been resolved and successfully passed the monitoring stage. All Banner services are expected to remain at normal levels.
Aug 31, 16:13 PDT
Monitoring - Banner system administrators have applied a fix by rebooting critical web resources. They do not expect further issues, and will monitor the service until a root cause can be identified.
Aug 31, 15:11 PDT
Investigating - Banner is currently experiencing an outage. Staff are investigating the issue.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 31, 14:55 PDT
Aug 30, 2015

No incidents reported.

Aug 29, 2015
Resolved - The vendor of our campus voicemail system identified and remedied the source of the trouble. System functionality has been restored..
Aug 29, 10:05 PDT
Investigating - The campus voicemail system is currently experiencing troubles. Calls to voicemail subscriber boxes and campus automated attendants are not completing. NOC programmers are currently investigating the issue.
----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 29, 09:17 PDT
Completed - The scheduled maintenance has been completed.
Aug 29, 08:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 28, 22:00 PDT
Scheduled - Purpose:
SmartSite will perform an update on the system.

Impact:
SmartSite will be unavailable during the maintenance window. There should be no impact after the update.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 24, 09:59 PDT
Aug 28, 2015
Completed - The scheduled maintenance has been completed.
Aug 28, 07:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 28, 06:00 PDT
Scheduled - Purpose:
Electrical (Panels DBC, D1A, D1F, D1G, D2A). This will affect the lights and outlet in the following rooms only:
100, 102, 104, 104A, 105, 106, 107, 109, 120, 102A, 108, 122, 128, 130, 145, 202, 204, 210, 212, 214, 215, 216, 220, 222, 225, 226, 228, 230, 232, 234, 243, 245, 130 and 145 also the irrigation control, the HVAC controls, outside lights and Arboretum, the sewer lift pump, the TCP panel mechanical room, and the steam condensate pumps. To replace main breaker in panel D1G. Requested by Gerry Ownby, 4G18, BMS Electric Shop, Cell 979-1567, Reference job # 2571871-C032


Impact:
Data connectivity will be lost if UPS batteries are depleted.

Building:
WRIGHT HALL

VLANs:
DRAMATIC-ART-1-FW
DRAMATIC-ART-2-FW
HVAC-2-FW
O&M:UTILITIES-1
WLS-UNMANAGED-1


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 27, 13:20 PDT
Completed - The scheduled maintenance has been completed.
Aug 28, 07:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 28, 06:00 PDT
Scheduled - Purpose:
To replace a defective 100 G card on the science DMZ router.

Impact:
The science DMZ networks will be down during the card replacement.

Locations Affected:
128.120.80.0/21
169.237.229.0/26
2607:f810:330::/44
2607:f810:f30::/44
VLANs
1650-1679 GENI research
1706 COE-HPC-CLUSTER
1707 PHYSICS-5
1853 GENI-SHARE-1-NR

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 26, 11:11 PDT
Completed - The scheduled maintenance has been completed.
Aug 28, 06:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 28, 00:00 PDT
Scheduled - Purpose:
Additional fiber splicing of previously severed & not in use fibers will take place in downtown Sacramento.

Impact:
No impact is expected. Nevertheless, fibers being worked on are adjacent to currently in service fibers carrying network traffic between UCD & UCDMC.

Locations Affected:
No locations affected. Potential loss of diversity in event of egregious accident.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 27, 12:49 PDT
Aug 27, 2015
Resolved - Security devices have been adjusted to eliminate some false positives. It is unclear that this is a final resolution for this issue, however all outstanding complaints have been resolved. If any issues persist, please contact the help desk to have the case examined.
Aug 27, 13:17 PDT
Investigating - Personnel have been notified that some users outside of campus are unable to reach some UC Davis resources. The NOC has not been able to replicate the issue, but are investigating the complaints.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 26, 15:37 PDT
Resolved - The FIS Decision Support database has been restored. Systems Operations will work closely with Oracle support services to understand the root cause of the failure and work to prevent future occurrences.

Issue first noticed: 8/27/2015 @ 11:07am

Issue resolved: 8/27/2015 @ 12:58pm
Aug 27, 13:12 PDT
Update - Systems and Database administrators continue to troubleshoot the issue with Decision Support Database Server. The issue has been escalated as Severity 1 to Oracle Systems Engineers.
Aug 27, 13:11 PDT
Investigating - The FIS decision support database service is currently unavailable. Systems Operations staff are aware of the issue and are working to restore service.

Issue first noticed: 8/27/2015 @ 11:07am

Impact: Access to FIS Decision Support service is not available.

Specific services impacted:
·FIS Reporting from dafisds.ucdavis.edu (fisds.ucdavis.edu)
·Direct DS Database Access
·Impacts to subsidiary campus applications relying on real-time DS data

An update will be sent within an hour or when a resolution is reached, whichever comes first.
Aug 27, 11:47 PDT
Aug 26, 2015
Resolved - The ServiceNow team has resolved the issue with the Service Hub page and individuals can again submit tickets via the site. Administrators adjusted security parameters regarding the ServiceHub to allow continued functionality.
Aug 26, 12:16 PDT
Investigating - The "submit a ticket" feature in the Service Hub is currently not working. No support groups are listed so users are unable to select on, and since this is a required field users are unable to submit a ticket. Staff are investigating the issue.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 26, 10:51 PDT
Aug 25, 2015
Completed - The scheduled maintenance has been completed.
Aug 25, 23:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 25, 19:00 PDT
Scheduled - Purpose:
To apply quarterly vendor security patches, and development release 3.10.

Impact:
ServiceNow will continue regular service during the maintenance. Some Service Hub features may be temporarily unavailable.

Affected Services:
ServiceNow production instance (http://ucdavisit.service-now.com)

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 19, 10:58 PDT
Completed - The scheduled maintenance has been completed.
Aug 25, 07:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 25, 06:00 PDT
Scheduled - Purpose:
Upgrading Wireless Authentication Servers to latest vendor recommended version

Impact:
None Expected. Servers will be upgraded individually - allowing Authentication to continue during the maintenance window.

Locations Affected:
Servers upgraded provide authentication for:
eduroam
moobilenetx
ucd-guest

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 19, 13:59 PDT
Aug 24, 2015
Resolved - all circuits between UCD & UCDMC as well as CENIC circuits are back up
Aug 24, 16:03 PDT
Monitoring - Multiple cuts have been located & repairs are under way. Some paths have been repaired. Work is continuing to repair all paths.
Aug 24, 10:44 PDT
Identified - Impact: None expected. Traffic between UCD and UCDMC will re-route via other paths.

Locations Affected: Loss of diversity for both campuses.

Status: An optical fiber cabling assembly which provides a network path between UCD Campus to UCDHS in Sacramento was inadvertently severed in downtown Sacramento at approximately 23:00 on Friday, Aug. 21. As a result, we have lost redundancy on some of our connections, but otherwise we remain fully operational. NOC staff are working with multiple vendors and multiple organizations to determine the course of action for repairs and service restoration. At this moment, there isn't a time estimate for restoring the diversity.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 22, 11:45 PDT
Aug 23, 2015

No incidents reported.

Aug 22, 2015
Completed - The scheduled maintenance has been completed.
Aug 22, 08:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 21, 22:00 PDT
Scheduled - Purpose:
SmartSite will perform a major system update on the application hardware.

Impact:
SmartSite will be unavailable during the maintenance window. There should be no impact after the update.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jul 3, 05:23 PDT
Aug 21, 2015
Completed - The scheduled maintenance has been completed.
Aug 21, 22:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 21, 18:00 PDT
Scheduled - Purpose:
Skype for Business provides better integration with Skype and is the most current version of Microsoft’s Instant Messaging software.

Impact:
All Lync services will be unavailable during upgraded. After upgrade users using Lync 2013 client with most recent update installed will now get the Skype for Business UI.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 7, 12:07 PDT
Aug 20, 2015
Completed - The scheduled maintenance has been completed.
Aug 20, 06:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 20, 03:00 PDT
Scheduled - Purpose:
Upgrade WDM equipment to latest vendor recommended code version.

Impact:
Non expected. Ring topology provides physical path and network link diversity.

Locations Affected:
All links between UCD and UCDHS.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 13, 10:47 PDT
Completed - The scheduled maintenance has been completed.
Aug 20, 00:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 19, 20:01 PDT
Scheduled - Purpose:
Microsoft released an out of band emergency update for a security flaw in Internet Explorer yesterday. Since this is a critical update, we will be updating our servers outside our normal patch time.

Impact:
There may be some brief disconnects during failover of systems.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 19, 12:25 PDT
Aug 19, 2015
The FIS Decision support database service was restored at approximately 14:36. The cause of the system failure is under investigation. The Systems Operations team will continue to closely monitor the service.

Issue first noticed: 8/19/2015 @ 14:20
Issue resolved: 8/19/2015 @ 14:35

Thank you for your patience,

A&FS Systems Operations
Aug 19, 15:19 PDT
Aug 18, 2015
Completed - The scheduled maintenance has been completed.
Aug 18, 08:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 18, 07:00 PDT
Scheduled - Purpose:
Moving AP's to new controller hardware.

Impact:
Brief loss of wireless network connectivity as the AP's join the new controller.

Affected:
Wireless network connectivity in the following buildings will be affected:

EMERSON
OXFORD COMMONS
PRIMERO COMMUNITY
PRIMERO LAUREL
PRIMERO MAGNOLIA
PRIMERO MANZANITA
PRIMERO SPRUCE
REGAN CAMPO
REGAN CENT
REGAN INDIO
REGAN NOVA
REGAN PALOMA
REGAN RIENDA
REGAN SERENO
REGAN TALARA
TERCERO CAMPBELL
TERCERO COMMONS
TERCERO CURRANT
TERCERO HAWTHORNE
TERCERO KEARNEY
TERCERO LABEN
TERCERO LIVE OAK
TERCERO MAHOGANY
TERCERO PINE
TERCERO POTTER
TERCERO SCRUB OAK
TERCERO SEQUOIA
TERCERO WALL
THOREAU
WEBSTER

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 11, 07:48 PDT
Aug 17, 2015
Resolved - The uConnect team has resolved the login page issue. An automated task was found in the old ADFS environment that ran an updated the federation certificate that is used for trust relationship. Administrators removed this automated task and re-enabled the current environments certificate used for trust relationship.
Aug 17, 14:48 PDT
Monitoring - The uConnect team have made adjustments to the login page and the page should be functioning normally. The uConnect team continues to monitor the page.
Aug 17, 13:51 PDT
Investigating - Customers are reporting issues with login page for Office365, including slow load times and plain text versions of the page being displayed. Actually authentication is not affected and forcing a refresh on the page will often resolve the issue. Staff are investigating the issue.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 17, 11:40 PDT