Update - The vendor repairs were unsuccessful last night. The maintenance vendor remains engaged and repair work to the system is currently ongoing.
Aug 25, 10:05 PDT
Update - The maintenance vendor for our 800MHz trunked radio system will be performing necessary repairs to our system Wednesday, August 24th beginning at 6:00pm and continuing throughout the night until completed. During this window, radio users may experience brief periods of status tones, failsoft, or out-of-range messages. During failsoft, the radios will continue to function, but users will see a failsoft message in the display, a soft beep every 10 seconds, and may hear traffic from other departments. Please keep radio traffic to a minimum if possible.
Aug 23, 15:06 PDT
Monitoring - In an effort to restore service, technicians are currently backing up the system and starting early tomorrow morning will be loading code into system. These efforts will not be service impacting.
Aug 22, 16:24 PDT
Identified - The 800 MHz radio is currently experiencing a lack of redundancy as well as a reduction in capacity.
Aug 19, 16:37 PDT
Banner ? Operational
Box ? Operational
Cable TV Operational
CAS ? Operational
Computing Accounts ? Operational
Crashplan Backup Service Operational
Cyrus Email ? Operational
Data Center Colocation Operational
DavisMail ? Operational
DHCP ? Operational
DNS ? Operational
Duo Multifactor Authentication Operational
Email Lists ? Operational
Email Routing ? Operational
FGS ? Operational
Geckomail ? Operational
IAM ? Operational
Kerberos ? Operational
KFS ? Operational
Kuali Rice ? Operational
LDAP ? Operational
MyInfoVault ? Operational
MyTravel Operational
MyUCDavis Employee ? Operational
myUCDavis ? Operational
Network ? Operational
Network Time ? Operational
Radio Service (800MHz) Degraded Performance
SAN & DCFS ? Operational
ServiceNow ? Operational
Shibboleth ? Operational
Smartsite ? Operational
Software Website ? Operational
Television Service Operational
TRS ? Operational
uConnect DS ? Operational
uConnect Cloud ? Operational
uConnect eFax ? Operational
uConnect Lync ? Operational
uConnect On-Premise ? Operational
UC Davis Home Site ? Operational
Virtualization ? Operational
Voicemail Operational
Voice Telephone System ? Operational
Web CMS ? Operational
Web Hosting ? Operational
Wireless ? Operational
Canvas ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Scheduled Maintenance
Purpose:
This will affect ALL electrical power to both buildings. To install breaker. Requested by George Jones, Utilities High Voltage, cell 681 - 7318. Reference job # 1087418 – E001 – E164

Impact:
Data connectivity will be lost if UPS batteries are depleted.

Affected:
BUILDINGS:
SILO SOUTH
TB 24 (BIKE BARN)

VLANs:
ASUCD-1-FW
FOOD-SERVICE-1-FW
HVAC-2-FW
WIRELESS
REC-HALL-2-FW
STUDENT-AFFRS-1-FW
WLS-UNMANAGED-1


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Aug 23, 11:09 PDT
Purpose:
NOC staff will be replacing a switch fabric modules and one interface module in core CDF 1 router per vendor recommendation.

Impact:
Minimal impact expected - Active connections will re-route to alternate paths when interface module is replaced.

Locations Affected:
BUILDINGS:
CMPS DATACTR
CTR NEUROSCI
DV 1460 DREW
DV 1560 DREW
DV 1616 DVNC
DV 1632 DVNC
DV 1633 DVNC
DV 1850 RSPD
NEUROSCI BLD
UNIV EXT BLD
UNIV SVCS BL


VLANs:
ACTG&FINAC-1-FW
ACTG&FINAC-2-DMZ
ACTG&FINAC-2-FW
ACTG&FINAC-3-FW
ACTG&FINAC-5-FW
ALUMNI-AFFRS-1-FW
ALUMNI-AFFRS-2
ALUMNI-AFFRS-3
CASHIER-1-FW
CTR-NEUROSCI-1-FW
CTR-NEUROSCI-3-FW
CTR-NEUROSCI-5-FW
CTR-NEUROSCI-DMZ
DC&CLIENT-SVC-12-FW
DC&CLIENT-SVC-15-FW
DC&CLIENT-SVC-16-17-DMZ
DC&CLIENT-SVC-36-DMZ
DC&CLIENT-SVC-45
DC&CLIENT-SVC-9-FW
DNS-2
DEVAR-PCI-1-NR
FAC-ADV-INST-1-DMZ
FAC-ADV-INST-1-FW
HVAC-2-FW
INFO-TECH-SVCS-2-NR
IT-COMMUNRES-13-FW
IT-CRETV-3-FW
M-COM-HEALTH-1-FW
M-COM-HEALTH-2-FW
M-NEUROLOGY-1-FW
M-NEUROSURG-1
M-NEUROSURG-2
MOOBILENET(X)
NEAT-ORU-1-FW
NMR-1-DMZ
NMR-FACILITY-1-FW
O&M:UTILITIES-1
RADIO-INTEROP-1-FW
U-EXTENSION-1-FW
U-EXTENSION-2-DMZ
U-EXTENSION-2-FW
U-EXTENSION-3-DMZ
U-EXTENSION-3-FW
U-EXTENSION-4-DMZ
U-EXTENSION-4-FW
U-EXTENSION-5-FW
U-EXTENSION-6-DMZ
U-EXTENSION-6-FW
U-RELATIONS-1-4-DMZ
U-RELATIONS-1-FW
U-RELATIONS-4-FW
VC-RESEARCH-1-DMZ
VC-RESEARCH-1-FW
VC-RESEARCH-2
VC-RESEARCH-3-DMZ
VC-RESEARCH-3-FW
VC-RESEARCH-4-NR
VC-RESEARCH-5
VC-RESEARCH-6
VC-RESEARCH-7-FW

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Aug 26, 14:55 PDT
Planned Maintenance: ServiceNow Aug 31, 19:00-23:00 PDT
Purpose:

ServiceNow may be unavailable while the instance is upgraded. Expected downtime is less than 2 hours. Full release notes are available at: http://kb.ucdavis.edu/?id=1124

Impact:

ServiceNow production instance (http://ucdavisit.service-now.com)

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Aug 26, 18:30 PDT
Planned Maintenance: ServiceNow Sep 1, 19:00-21:00 PDT
Purpose:

ServiceNow will be updating the SSL certificate on all ServiceNow instances.

Impact:

Production Instance - http://ucdavisit.service-now.com

No downtime is expected

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Aug 19, 12:21 PDT
System Metrics Month Week Day
www.ucdavis.edu uptime
Fetching
smartsite.ucdavis.edu uptime
Fetching
my.ucdavis.edu uptime
Fetching
www.ucdavis.edu response time
Fetching
smartsite.ucdavis.edu response time
Fetching
my.ucdavis.edu response time
Fetching
Past Incidents
Aug 30, 2016

No incidents reported today.

Aug 29, 2016

No incidents reported.

Aug 28, 2016

No incidents reported.

Aug 27, 2016

No incidents reported.

Aug 26, 2016

No incidents reported.

Aug 25, 2016
Resolved - The voicemail system vendor has corrected the issue. All voicemail messages should now be accessible for playback.
Aug 25, 08:35 PDT
Identified - The vendor has identified the source of the problem and is working to resolve the issue.
Aug 24, 17:02 PDT
Investigating - Some campus voice mail users are receiving unexpected announcements from the system, when attempting to retrieve the voice mail messages over the phone. The vendor has been contacted.
Aug 24, 09:57 PDT
Aug 24, 2016
Resolved - The redundant controller has been replaced. High availability has been restored.
Aug 24, 00:58 PDT
Identified - We experienced loss of high availability on the Quest SAN during routine maintenance. A redundant controller did not return after reboot. We are awaiting parts and expect full redundancy by 0200 tomorrow, 08/24/2016

Impact:
No services are affected with this loss of redundancy. Data Center services are vulnerable to a second failure.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 23, 20:24 PDT
Aug 23, 2016
Completed - The scheduled maintenance has been completed.
Aug 23, 19:31 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 23, 17:31 PDT
Scheduled - Description:
Quest SSD SAN Maintenance

Purpose:
Upgrade SAN OS version to prevent unscheduled controller failovers and patch security vulnerabilities.

Impact:
The OS upgrade requires a reboot of each controller. The controllers are redundant and clients should see no impact.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 17, 10:51 PDT
Aug 22, 2016
Completed - SAN maintenance at the Data Center has completed.
Aug 22, 18:24 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 22, 17:31 PDT
Scheduled - Description:
Data Center SSD SAN Maintenance

Purpose:
Upgrade SAN OS version to prevent unscheduled controller failovers and patch security vulnerabilities.

Impact:
The OS upgrade requires a reboot of each controller. The controllers are redundant and clients should see no impact.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 17, 10:49 PDT
Aug 21, 2016

No incidents reported.

Aug 20, 2016
Completed - The scheduled maintenance has been completed.
Aug 20, 00:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 19, 23:01 PDT
Scheduled - ServiceNow will be transferring the production instance to a high availability data center. Though the maintenance window is scheduled for one hour, expected service interruption will be approximately 15 minutes.
Aug 12, 22:23 PDT
Aug 19, 2016
Completed - The scheduled maintenance has been completed.
Aug 19, 06:45 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 19, 05:45 PDT
Scheduled - Purpose:
Performing the monthly test of the Telecom Building backup power generator.

Impact:
None expected. All power should automatically switch over to the generator power during the test.

Locations Affected:
-Campus and Resnet data networks
-Connectivity to the Internet
-Voice services including voicemail

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 15, 11:43 PDT
Aug 18, 2016
Completed - The scheduled maintenance has been completed.
Aug 18, 06:01 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 18, 03:01 PDT
Scheduled - Purpose:
Perform comprehensive failover testing of redundant paths between Davis/Sacramento campuses and external sites.

Impact:
Loss of connectivity may be experienced if an issue is discovered during the maintenance window. In the event this should occur, connections between the Davis/Sacramento campus and external sites will experience multiple interruptions in service while work is performed to resolve the issue.

Affected:
128.120.0.0/16
152.79.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 12, 12:58 PDT
Completed - The scheduled maintenance has been completed.
Aug 18, 06:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 18, 05:01 PDT
Scheduled - Purpose:
Reboot the Campus Wired Network traffic management device. Configure the traffic management device for Campus Wireless and ResNet Networks.

Impact:
Traffic bypass will be enabled on the device, for the Campus Wired Network, while the reboot is performed. The device will be inserted between the Davis Border Network and the Campus Wireless and ResNet Networks. Brief periods of slower than normal performance to/from external sites may be experienced during the maintenance window.

Locations Affected:
128.120.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 15, 11:45 PDT
Completed - The scheduled maintenance has been completed.
Aug 18, 03:01 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 18, 01:00 PDT
Scheduled - Purpose:
Install vendor recommended software version on the Sacramento Campus border router.

Impact:
Traffic will utilize connections to the Davis Campus border router while the software upgrade is performed.

Affected:
152.79.0.0/16

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 12, 12:56 PDT
Aug 17, 2016
Resolved - ServiceNow engineers have resolved the issue and the ServiceNow List views are functioning as normal.
Aug 17, 10:55 PDT
Monitoring - Update: ServiceNow List views have been restored as of Saturday, and have not reverted. ServiceNow engineers are working to determine a root cause of the issue. We will continue to monitor the behavior of the service at this time.
Aug 15, 11:48 PDT
Identified - ServiceNow engineers have identified the source of the issue, and are working toward a solution. At this time, default table list view layouts may continue to behave unexpectedly while the service is being restored. Ticket data has not been affected.
Aug 12, 16:28 PDT
Investigating - IT Service Management has received additional reports of modified list views associated with the degradation reported this morning. The customer-facing ServiceHub “My Help Status” view issue has been resolved. As a work-around solution, ServiceNow Users can modify the list view to return the view to the preferred order. Initial research indicates customized views are not impacted. ServiceNow is working with IET on the issue.

Affected Services:

ServiceNow
----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Aug 12, 11:34 PDT
Aug 16, 2016

No incidents reported.