Investigating - Impact:
None, temporary loss of redundancy and the routes re-converged.

Locations Affected:
Temporary loss of redundancy.

Status:
NOC personnel are investigating with the vendor.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
May 30, 18:26 PDT
AggieBuy   ? Operational
AggieDash   Operational
AggieFeed   ? Operational
AggieTravel   Operational
Banner   ? Operational
Box   ? Operational
Cable TV   Operational
Canvas   ? Operational
CAS   ? Operational
Computing Accounts   ? Operational
Crashplan Backup Service   Operational
Data Center Colocation   Operational
DavisMail   ? Operational
DHCP   ? Operational
DNS   ? Operational
Duo Multifactor Authentication   Operational
Email Lists   ? Operational
Email Routing   ? Operational
FGS   ? Operational
FISDS   ? Operational
IAM   ? Operational
IT Catalog   ? Operational
Kerberos   ? Operational
KFS   ? Operational
Kuali Rice   ? Operational
LDAP   ? Operational
MyInfoVault   ? Operational
myUCDavis   ? Operational
Network   ? Operational
Network Time   ? Operational
Payweb/PPSDS   ? Operational
Qualtrics   ? Operational
Radio Service (800MHz)   Operational
SAN & DCFS   ? Operational
ServiceNow   ? Operational
Shibboleth   ? Operational
SiteFarm   Operational
Smartsite   ? Operational
Software Website   ? Operational
Television Service   Operational
TRS   ? Operational
uConnect Active Directory   ? Operational
uConnect ADFS   ? Operational
uConnect eFax   ? Operational
uConnect Exchange On-prem   ? Operational
uConnect Office 365   ? Operational
uConnect Skype for Business   ? Operational
UC Davis Home Site   ? Operational
Virtualization   ? Operational
Voicemail   Operational
Voice Telephone System   ? Operational
Web CMS   ? Operational
Web Hosting   ? Operational
Wireless   ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
Purpose:
During finals week, the main ResNet router lost some redundancy. With finals over, the main ResNet router will be restored to full redundancy.

Impact:
Ideally, the system can be re-formed with no impact.
However mulitple 5 minute outages may be experienced if reboots are needed to merge the system back together.

Affected:
All ResNet buildings' wired and wireless connectivity.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 13, 17:56 PDT
Purpose:
To replace 120/208 power transformer. Requested by Derek Fraley, Utilities High Voltage Shop. Reference Task ID # 1438091 – G048

Impact:
Data connectivity will be lost if UPS batteries are depleted.

Affected:
BUILDING:
TUPPER HALL

VLANs:
ACU-1-FW
DEAN-MED-ADM-11-NR
DEAN-MED-ADM-12-FW
DEAN-MED-ADM-13-FW
DEAN-MED-ADM-4-FW
DEAN-MED-ADM-5-FW
DEAN-MED-ADM-6-FW
DEAN-MED-ADM-8-FW
DEAN-MED-ADM-9-FW
DEAN-VETMED-1-FW
DEAN-VETMED-2-FW
HVAC-2-FW
IT-COMMUNRES-13-FW
IT-CRETV-3-FW
SAFETY-SVCS-2-FW
VM-ACADPROGS-1-FW
VM-GEN-I&R-6-FW
VM-MED&EPIDM-2-FW
VM-PATHOLOGY-1-FW
VM-RESEARCH-1-FW
WATER-1-NR
WIRELESS
WLS-UNMANAGED-1


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 12, 12:22 PDT
Purpose:
Configure traffic management system with a new traffic map.

Impact:
There is no expected impact to clients.

Affected:
128.120.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 7, 22:10 PDT
Purpose:
Deactivate legacy "allow-all" CAS Registry rule.

Impact:
Services using CAS for SSO in the last year should have been added to the CAS Service Registry. Users and CAS-protected applications should generally notice no errors or degradation.

http://kb.ucdavis.edu/?id=1282 has details on how to search for and 'claim' CAS-protected services, manage existing services, add new ones, etc. using the CAS Service Registry Management application.

CAS-protected services that are new or only rarely use CAS may not have been logged and added to the Registry. Users of unregistered services will see "Application Not Authorized to Use CAS". Please refer (the site administrator) to the Knowledge Base article. Those requiring assistance may contact IT Express (ithelp@ucdavis.edu) or post a question to the 'ucdavis' Slack on channel #casregistry.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 13, 17:37 PDT
Purpose:
Add one network to Campus Datacenter firewall and one network to the Quest Datacenter firewal for the uConnect service.

Impact:
No loss in connectivity is expected

Affected:
Directly Affected VLANs:
UCONN-CDC-6-AZR
UCONN-QDC-6-AZR

Indirectly Potentially Affected VLANs:
ADFS-1-FW
DC&CLIENT-SVC-49-FW
DC&CLIENT-SVC-4-FW
DC&CLIENT-SVC-2-FW
DC&CLIENT-SVC-1-FW
DC&CLIENT-SVC-83-DMZ
DC&CLIENT-SVC-16-FW
DC&CLIENT-SVC-17-FW
DC&CLIENT-SVC-119-FW
DC&CLIENT-SVC-97-FW
DC&CLIENT-SVC-100
DC&CLIENT-SVC-101
CLOUD_SERVICE
DC&CLIENT-SVC-73-FW
UCONN-CDC-1-FW
UCONN-CDC-2-FW
UCONN-CDC-3-FW
UCONN-CDC-4-FW
UCONN-CDC-5-FW
UCONN-CDC-6-FW
UCONN-CDC-7-FW
UCONN-CDC-8-FW
UCONN-CDC-1-AZR
UCONN-CDC-2-AZR
UCONN-CDC-3-AZR
UCONN-CDC-4-AZR
UCONN-CDC-5-AZR
DC&CLIENT-SVC-75-FW
DC&CLIENT-SVC-76-FW
DC&CLIENT-SVC-104-FW
DC&CLIENT-SVC-77-FW
DATA-CENTER
VOIP-MGC-3
DC&CLIENT-SVC-121-FW
DC&CLIENT-SVC-120-FW
DC&CLIENT-SVC-140-FW
DC&CLIENT-SVC-111-FW
DC&CLIENT-SVC-102
DC&CLIENT-SVC-103
DC&CLIENT-SVC-141-FW
DC&CLIENT-SVC-142-FW
VOIP-ESXI-2
DC-PRIVATE-DISTR-RCVRY


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 13, 17:57 PDT
Purpose:
VLAN ACTG&FINAC-5-FW will be moved from one set of interfaces to another on the Datacenter Colocation router.

Impact:
No loss in connectivity is expected.

Affected:
Directly Affected VLAN:
ACTG&FINAC-5-FW

Indirectly Affected VLANs:
PHYS-PLANT-4-FW
PHYS-PLANT-5-FW
ADMIN-&-RESRC-MGMT-1-FW
HR&RISK-MGMT-6-FW
POLICE-3-FW
CASHIER-1-FW
PHYS-PLANT-6-FW
PHYS-PLANT-1-FW
PHYS-PLANT-2-FW
PHYS-PLANT-3-FW
WASTEWATER-1-FW
ACTG&FINAC-1-FW
ACTG&FINAC-2-FW
ACTG&FINAC-3-FW
ACTG&FINAC-5-FW

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 13, 17:55 PDT
Purpose:
Upgrade SiteFarm to 4.1.0

Impact:
No downtime is expected.

Affected:
All web sites hosted on Acquia Site Factory

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 14, 15:23 PDT
Purpose:
To replace 480/277 volt power transformer. Requested by Derek Fraley, 4G18, High Voltage. Reference task #143891 – G Zones.

Impact:
Data connectivity will be lost if UPS batteries are depleted.

Affected:
BUILDINGS:
Tupper Hall/G048
Schalm Hall/G068
Medical Sciences I C/G050
Medical Sciences I B/G049

VLANs:
ACU-1-FW
DEAN-MED-ADM-1-FW
DEAN-MED-ADM-11-NR
DEAN-MED-ADM-12-FW
DEAN-MED-ADM-13-FW
DEAN-MED-ADM-4-FW
DEAN-MED-ADM-5-FW
DEAN-MED-ADM-6-FW
DEAN-MED-ADM-8-FW
DEAN-MED-ADM-9-FW
DEAN-VETMED-1-FW
DEAN-VETMED-16
DEAN-VETMED-2-FW
GEN-ACAD-1
GEN-ACAD-2-FW
HOUSING-9-NR
HVAC-2-FW
IT-COMMUNRES-13-FW
IT-CRETV-3-FW
LIBRARY-13-FW
LIBRARY-4-FW
LIBRARY-5-FW
M-COM-HEALTH-1-FW
M-COM-HEALTH-2-FW
O&M:UTILITIES-1
SAFETY-SVCS-2-FW
STU-HLTH-SVCS-3-NR
STU-HLTH-SVCS-4-NR
VH-ADMIN-1-FW
VM-ACADPROGS-1-FW
VM-CENT-SERV-1-FW
VM-GEN-I&R-1-FW
VM-GEN-I&R-6-FW
VM-MED&EPIDM-2-FW
VM-PATHOLOGY-1-FW
VM-RESEARCH-1-FW
WATER-1-NR
WIRELESS
WLS-UNMANAGED-1


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 12, 12:18 PDT
Purpose:
Enable eBGP Equal-Cost Multipath (ECMP) load balanced routing for CENIC's two OAK-DC 10GE circuits.

Impact:
There is no expected impact to clients.

Affected:
128.120.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Jun 7, 22:14 PDT
Past Incidents
Jun 17, 2018

No incidents reported today.

Jun 16, 2018
Completed - The scheduled maintenance has been completed.
Jun 16, 18:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 16, 07:30 PDT
Scheduled - Purpose:
Maintenance. Requested by George Jones, Utilities High Voltage, Reference Task ID # 1585540 – H Zones.

Impact:
Data connectivity will be lost once UPS batteries are depleted.

Affected:
BUILDINGS:
ARS S-1
CALIFORNIA RAPTOR TRAILER
CENTER FOR EQUESTRIAN HEALTH

VLANs:
ANML-RES-SVC-1-FW
VH-ADMIN-1-FW
VM-RESEARCH-1-FW


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 12, 10:08 PDT
Completed - The scheduled maintenance has been completed.
Jun 16, 10:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 16, 07:00 PDT
Scheduled - Purpose:
Monthly Microsoft update installation and routine maintenance tasks.

Impact:
Servers will be rebooted. Service will be unavailable during the window.

Affected Services:
Bannerconnect Only (Bannerconnect.ucdavis.edu)

Servers:
BannerTSCB
BannerTS1
BannerTS2

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 13, 17:30 PDT
Jun 15, 2018

No incidents reported.

Jun 14, 2018
Completed - The scheduled maintenance has been completed.
Jun 14, 23:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 14, 18:00 PDT
Scheduled - Purpose:
Application and Database patching and routine maintenance tasks

Impact:
System administrators will patch the Oracle Identity Manager and SmartSite applications and databases, during which time the services will be unavailable.

Affected:
Oracle Identity Manager, SmartSite

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 6, 10:20 PDT
Jun 13, 2018
Completed - The scheduled maintenance has been completed.
Jun 13, 23:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 13, 21:00 PDT
Scheduled - Purpose:
Vendors have identified a bug causing system hangs in our private cloud environment. This maintenance will allow us to patch the servers as recommended by the vendor.

Impact:
No impact to any services is expected.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 13, 17:53 PDT
Jun 12, 2018
Completed - The scheduled maintenance has been completed.
Jun 12, 21:01 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 12, 17:00 PDT
Scheduled - Purpose:
Increase the logging level on some private cloud hosts in order to further trace a system problem in the private cloud environment.

Impact:
No impact to any services is expected.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 12, 15:59 PDT
Jun 11, 2018
Resolved - There have been no new incidents of email accounts failing to be properly created over the weekend.
Jun 11, 09:14 PDT
Monitoring - Microsoft has released a patch and mailboxes are starting to be provisioned.
Jun 8, 14:36 PDT
Update - Microsoft has identified an issue with their services and are working to restore them.
Jun 8, 09:24 PDT
Identified - uConnect is currently experiencing a problem provisioning new mailboxes in Office 365. The incident started at 2pm on Thursday 6/7 and is causing any mailboxes created since this time to be unavailable. Mail delivered to affected users is being accepted and stored. Administrators are working with Microsoft to resolve the issue.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 8, 07:04 PDT
Jun 10, 2018

No incidents reported.

Jun 9, 2018

No incidents reported.

Jun 7, 2018
Completed - The scheduled maintenance has been completed.
Jun 7, 07:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 7, 07:01 PDT
Scheduled - Purpose:
Deploy changes for upcoming Service Registry.

Impact:
Users and CAS-protected applications should notice no errors or degradation.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 5, 09:42 PDT
Jun 6, 2018
Completed - The scheduled maintenance has been completed.
Jun 6, 23:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 6, 18:00 PDT
Scheduled - Purpose:
ServiceNow administrators will apply a standard change to perform ServiceNow maintenance and application form changes.

Impact:
ServiceNow is not expected to experience any downtime.
Response times may be slower during the scheduled change window.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
May 23, 17:39 PDT
Completed - The scheduled maintenance has been completed.
Jun 6, 19:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 6, 17:00 PDT
Scheduled - Purpose:
CENIC NOC and Cisco TAC will troubleshoot an IPv6 BGP session instability issue with the OAK-DC 2nd 10GE circuit.

Impact:
Impact limited to IPv6 traffic utilizing the CENIC OAK-DC 2nd 10GE circuit. Intermittent connectivity to external sites may be experienced for IPv6 only hosts. Dual-homed hosts (IPv4 and IPv6) should fall back to IPv4 when IPv6 is not available

Affected:
2607:f810::/36
----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 6, 13:54 PDT
Completed - The scheduled maintenance has been completed.
Jun 6, 09:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 6, 06:00 PDT
Scheduled - Purpose:
For construction.

Additional:
Requested by Gerry Ownby, 4G18, BMS Electrical Shop, Reference Task ID # 1585228 – G129

Processed by:
Jeff Stokes, Utility Shutdown Desk, Customer Support Center, Ext. 752-1655, e-mail: facilities@ucdavis.edu

Impact:
Data connectivity will be lost once UPS batteries are depleted.

Affected:
BUILDINGS:
SCHAAL AQUATICS CENTER


VLANs:
HVAC-2-FW
INTRCOL-ATHL-1-FW
INTRCOL-ATHL-4-NR
MU-GENERAL-1
O&M:UTILITIES-1


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 5, 13:09 PDT
Jun 5, 2018
Completed - The scheduled maintenance has been completed.
Jun 5, 19:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 5, 17:00 PDT
Scheduled - Purpose:
CENIC NOC and Cisco TAC will troubleshoot an IPv6 BGP session instability issue with the OAK-DC 2nd 10GE circuit.

Impact:
Impact limited to IPv6 traffic utilizing the CENIC OAK-DC 2nd 10GE circuit. Intermittent connectivity to external sites may be experienced for IPv6 only hosts. Dual-homed hosts (IPv4 and IPv6) should fall back to IPv4 when IPv6 is not available.

Affected:
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 5, 16:09 PDT
Completed - The scheduled maintenance has been completed.
Jun 5, 18:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 5, 17:00 PDT
Scheduled - Purpose:
Move ADFS-1-FW route from Campus Datacenter to Quest Datacenter.

Impact:
There should be no impact. ADFS-1-FW is not currently in service. Other subnets are routed to the same firewalls, but they should not be affected by this change.

Affected VLANs:
ADFS-1-FW
DC&CLIENT-SVC-49-FW
DC&CLIENT-SVC-4-FW
DC&CLIENT-SVC-2-FW
DC&CLIENT-SVC-1-FW
DC&CLIENT-SVC-83-DMZ
DC&CLIENT-SVC-16-FW
DC&CLIENT-SVC-17-FW
DC&CLIENT-SVC-119-FW
DC&CLIENT-SVC-97-FW
DC&CLIENT-SVC-100
DC&CLIENT-SVC-101
CLOUD_SERVICE
DC&CLIENT-SVC-73-FW
UCONN-CDC-1-FW
UCONN-CDC-2-FW
UCONN-CDC-3-FW
UCONN-CDC-4-FW
UCONN-CDC-5-FW
UCONN-CDC-6-FW
UCONN-CDC-7-FW
UCONN-CDC-8-FW
UCONN-CDC-1-AZR
UCONN-CDC-2-AZR
UCONN-CDC-3-AZR
UCONN-CDC-4-AZR
UCONN-CDC-5-AZR
DC&CLIENT-SVC-75-FW
DC&CLIENT-SVC-76-FW
DC&CLIENT-SVC-104-FW
DC&CLIENT-SVC-77-FW
DATA-CENTER
VOIP-MGC-3
DC&CLIENT-SVC-121-FW
DC&CLIENT-SVC-120-FW
DC&CLIENT-SVC-140-FW
DC&CLIENT-SVC-111-FW
DC&CLIENT-SVC-102
DC&CLIENT-SVC-103
DC&CLIENT-SVC-141-FW
DC&CLIENT-SVC-142-FW
VOIP-ESXI-2
DC-PRIVATE-DISTR-RCVRY


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
May 30, 16:21 PDT
Completed - The scheduled maintenance has been completed.
Jun 5, 09:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 5, 08:00 PDT
Scheduled - Purpose:
We will be sequentially updating the access points in the 24-hour room at Shields Library.

Impact:
None expected. Clients could potentially have a brief loss of connectivity if their machine doesn't roam as expected.

Locations Affected:
Any users in or around the 24-hour room at Shield library.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
May 30, 16:15 PDT
Jun 4, 2018
Completed - The scheduled maintenance has been completed.
Jun 4, 18:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 4, 17:00 PDT
Scheduled - Purpose:
Replace failed hardware

Impact:
None expected. The hardware is redundant.

Affected:
Potentially will affect all VM clients using NSX networking

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 4, 12:16 PDT
Resolved - After Cenic moved the port on their equipment, the link has been stable. The issue is resolved.
Jun 4, 15:07 PDT
Monitoring - NOC has identified and resolved the issue but will be continuing to monitor it
Jun 3, 23:27 PDT
Investigating - Impact: Minimal. Temporary loss of redundancy
Locations Affected: Temporary loss of redundancy
Status: NOC Investigating

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Jun 3, 14:38 PDT