UC Davis Status

Network Degradation: Intermittent WiFi issues

Investigating - From approximately 11:30 AM until noon today, there was a cluster peering error on the wireless network controllers.

The issue self-resolved once the cluster stabilized. Intermittent WiFi issues could have occurred during this event.

The NOC is investigating the root cause and is committed to providing wireless network stability.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 23, 2024 - 14:49 PDT

Adobe Operational

AggieBudget Operational

AggieBuy Operational

AggieCloud: Account Management Operational

AggieCloud AWS Operational

AggieCloud Azure Operational

AggieDash Operational

AggieFeed Operational

AggieService Operational

AggieExpense Operational

AggieVideo Operational

APHID Operational

ASIS Operational

ATR portal Operational

Banner Operational

Box Operational

Cable TV Operational

Canvas Operational

CAS Operational

Computing Accounts Operational

Crashplan Backup Service Operational

Data Center Colocation Operational

DavisMail Operational

DHCP Operational

DNS Operational

DocuSign Operational

Duo Multifactor Authentication Operational

Email Lists Operational

Email Routing Operational

Faculty Sites Services Operational

Final Grading System (FGS) direct web access Operational

GS Commencement Operational

GS eDocs Operational

GS GradHub Operational

GS GradTrack$ Operational

GS LAMB Operational

GS PRM Operational

GS SPA Operational

GS ProgramsManager Operational

GS Stats Operational

FISDS Operational

IAM Operational

IT Catalog Operational

Kerberos Operational

KFS Operational

LDAP Operational

Lecture Capture Operational

MyAwards Operational

MyInfoVault Operational

myUCDavis Operational

Network Operational

Network Time Operational

OASIS Operational

Privileged Account Management Operational

Pinnacle Operational

Qualtrics Operational

Radio Service (800MHz) Operational

SAN & DCFS Operational

SRCE Operational

ServiceNow Operational

Shibboleth Operational

SiteFarm Operational

Software Website Operational

Television Service Operational

TRS Operational

uConnect Active Directory Operational

uConnect ADFS Operational

uConnect Exchange On-prem Operational

uConnect Office 365 Operational

UC Davis Home Site Operational

UCD Mobile Operational

Virtualization Operational

Voicemail Operational

Voice Telephone System Operational

VPN Operational

Web Hosting Operational

Wireless Degraded Performance

Zoom Operational

Photo Rosters Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

Scheduled Maintenance

Network Maintenance: Prepare BDF42-1 and BDF42-2 for the NOC firewalls Apr 24, 2024 17:00-20:00 PDT

Purpose: Prepare BDF42-1 and BDF42-2 for the NOC firewalls

Impact: No impact is expected for the existing networks as we are preparing for new vlans for the NOC firewalls.

Locations Affected:
BUILDINGs:
TELCOM

VLANs:
ACU-1-FW
AGSQR-OFC-1-FW
AGSQR-PRTNRS-1-FW
ANIMAL-SCI-1-FW
ANIMAL-SCI-2
ANTHROPOLOGY-1-FW
ASUCD-1-FW
ASUCD-4-FW
BFTV-3-NR
BOOKSTORE-1-FW
BOOKSTORE-2
CABA-1-FW
CENIC-OOB-MGMT-1-NR
CHANCELLOR-4
CHANCELLOR-8-FW
CO-OPS-1
CRU-PCI-1
CTR-CMP-MED-4-DMZ
CTR-CMP-MED-4-FW
CTR-CMP-MED-5-FW
CULTURE-STDS-1-FW
DC&CLIENT-SVC-109-FW
DC&CLIENT-SVC-112-FW
DC&CLIENT-SVC-136-FW
DC&CLIENT-SVC-137-FW
DC&CLIENT-SVC-156-FW
DC&CLIENT-SVC-160-FW
DC&CLIENT-SVC-42
DC&CLIENT-SVC-43
DC&CLIENT-SVC-94
DC&CLIENT-SVC-95
DC&CLIENT-SVC-96
DC-NOC-VM-1-DMZ
DEAN-AG-2-FW
DEAN-AG-3-FW
DEAN-AG-8-FW
DEAN-MED-ADM-6-FW
DESIGN-2-FW
DNS-1
ECO-3-NR
ENV-STUDIES-2
FISHBOWL-TV-BOXES
GEN-ACAD-1
GEN-ACAD-2-FW
GENOME-CTR-9-FW
HVAC-2-FW
INFOBLOX-LAB-1
INTRCOL-ATHL-1-FW
ISO-LAB-1-FW
IT-COMMUNRES-2-FW
IT-COMMUNRES-4-FW
IT-COMMUNRES-8-FW
IT-CRETV-2-FW
IT-CRETV-3-FW
LAWR-1-FW
LAWR-3
MOUSE-BIO-1-DMZ
MU-GENERAL-1
MU-GENERAL-2
NET4-FW-TEST
NET4-TEST3-1-DMZ
NET4-TEST3-1-FW
NET4-TEST3-2-FW
NOC-1-FW
NOC-10-NR
NOC-11-NR
NOC-2
NOC-3-NR
NOC-5-FW
NOC-6-VPN
NOC-7-FW
NOC-8-FW
NOC-9-DMZ
NOC-GUEST
O&M:UTILITIES-1
OCM-1-FW
PARKING-SVCS-1-FW
PARKING-SVCS-2-FW
PD-VIDEO-1-NR
PHYS-PLANT-3-FW
PLANT-SCIENCES-2-FW
PLANT-SCIENCES-4-FW
POWER-1-NR
RADIO-INTEROP-1-FW
REC-HALL-4
REPRO-4-FW
SAC-RADIO-1
SAC-RADIO-2
SAC-RADIO-3
SAC-RADIO-4
SAC-RADIO-5
SAC-RADIO-6
SET-TOP-BOX-1
SIP-2
SOC-SCI-DSS-4-FW
U-EXTENSION-1-FW
U-EXTENSION-4-FW
U-EXTENSION-5-FW
U-EXTENSION-6-FW
UCD-MNRC-1
VIT&ENOL-1-FW
VOIP-ESXI-1
VOIP-ISR-4
VOIP-ISR-5
VOIP-ISR-NOC-PRIMARY
VOIP-MGMT-1
VOIP-VM-PRI-1
VOIP-VM-PRI-2
WATER-1-NR
WIRELESS
WLS-UNMANAGED-1

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 21, 2024 - 11:08 PDT

Planned Maintenance: F5 Load-Balancer Apr 24, 2024 20:00-22:00 PDT

Purpose:
Update load balancers at NOC

Impact / Affected Services: Load balancers at NOC will be unavailable for a short time. This will cause a brief degradation of DNS on campus.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 19, 2024 - 10:49 PDT

Planned Maintenance: Banner Forms Apr 27, 2024 07:00-10:00 PDT

Scheduled - Purpose:

The following banner modules will be installed:

Financial Aid 8.48.1 and 9.43.0.2

The upgrade objects have been tested and validated in both DEV and TEST. Communication will happen on Slack in #iet-banner.

Impact:

All services dependent on our Banner ‘production’ server will not be available.

Affected:

- Banner prod database (SIS)
- Banner forms
- Banner SISWeb
- MyUCD
- Applications relying on direct access to Banner (SIS)

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 18, 2024 - 16:51 PDT

Planned Maintenance: ServiceNow Apr 27, 2024 09:00-17:00 PDT

Purpose:

ServiceNow administrators will implement new security features to the Service Hub and ServiceNow Platform. The release notes are located here: https://kb.ucdavis.edu/?id=10714.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 22, 2024 - 16:22 PDT

Network Maintenance: Sacramento Border Router May 6, 2024 02:00-06:00 PDT

Purpose:
Update software on the Sacramento Border Router to the current vendor recommended version.

Impact:
Traffic will be routed via alternate paths when the software update is performed. Clients may experience a brief period of slow network response when switching between normal and alternate paths. Existing sessions may reset when network traffic is diverted to the alternate routing path (Davis), and a second time when network traffic is returned to the normal path (Sacramento). Davis Campus backup connections to the Sacramento Border Router will be unavailable while the software update is performed. Novogene at UCDH will be unavailable while the software update is performed.

Affected:
128.120.0.0/16
152.79.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Feb 01, 2024 - 15:52 PST

Past Incidents

Apr 24, 2024

Network Maintenance: UC Davis HPR circuit via UCDH

Completed - The scheduled maintenance has been completed.
Apr 24, 01:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 24, 00:01 PDT

Scheduled - Purpose:
CENIC NOC-731615 UC Davis Maintenance.
CENIC engineers will work with remote hands at UCDH to replace the optical transceiver.

Impact:
Loss of CalREN High Performance Research path redundancy during the scheduled maintenance window.

Affected:
CalREN High Performance Research via Sacramento (UC Davis - HPR-L3-UCDV1-SACR2-10G-1118)

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 18, 07:12 PDT

Apr 23, 2024

Unresolved incident: Network Degradation: Intermittent WiFi issues.

Apr 22, 2024

Network Maintenance: Davis Border Router

Completed - The scheduled maintenance has been completed.
Apr 22, 06:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 22, 02:00 PDT

Scheduled - Purpose:
Update software on the Davis Border Router to the current vendor recommended version.

Impact:
Traffic will be routed via alternate paths when the software update is performed. Clients may experience a brief period of slow network response when switching between normal and alternate paths. Existing sessions may reset when network traffic is diverted to the alternate routing path (Sacramento), and a second time when network traffic is returned to the normal path (Davis). Sacramento Campus backup connections to the Davis Border Router will be unavailable while the software update is performed. External DNS servers DNS-ONE and DNS-TWO will be unavailable while the software update is performed.

Affected:
128.120.0.0/16
152.79.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Feb 21, 15:54 PST

Apr 21, 2024

Planned Maintenance: Campus Home Site

Completed - The scheduled maintenance has been completed.
Apr 21, 08:30 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 21, 08:00 PDT

Scheduled - Purpose: Minor code updates

Impact: No downtime is expected.

Affected: Campus Home Site at www.ucdavis.edu

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 15, 11:54 PDT

Apr 20, 2024

Planned Maintenance: Electrical Utility Shutdown - Transportation and Parking Services / D098

Completed - The scheduled maintenance has been completed.
Apr 20, 18:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 20, 17:00 PDT

Scheduled - Purpose:
Simulate power outage to building and test generator and UPS systems

Requested By:
Ryan Burgess, UTIL High Voltage
Phone: 530-304-3184, Cell: 530-304-3184, Task ID: 2673458

Impact:
All electrical

Affected Buildings:
FIRE&POLICE
GRTHCHMBR BD
PAVILION PARKING STRUC
TAPS

Affected VLANs:
ARM-ALARMS-1-FW
ARM-ALARMS-1-NR
CHANCELLOR-5-FW
DOE-1-FW
EOC-1-FW
EOC-2-FW
FIRE-DEPT-1-FW
FIRE-DEPT-2-FW
FOA-PD-CLIENT-1-FW
HVAC-2-FW
INFO-TECH-SVCS-2-NR
IT-CRETV-2-FW
O&M:UTILITIES-1
PARKING-SVCS-1-FW
PARKING-SVCS-2-FW
PARKING-SVCS-3-FW
PD-AUDIO-1-DMZ
PD-VIDEO-1-FW
PD-VIDEO-1-NR
PHYS-PLANT-2-FW
PLANT-BIOLOGY-3-NR
POLICE-4-FW
POLICE-911-DMZ
POWER-1-NR
SAC-RADIO-1
SAC-RADIO-2
SAC-RADIO-3
SAC-RADIO-4
SAC-RADIO-5
SAC-RADIO-6
SET-TOP-BOX-1
SHRD-SVC-CTR-1-FW
VC-RESEARCH-7-FW
WIRELESS

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 10, 08:47 PDT

Apr 19, 2024

Planned Maintenance: Faculty Sites SSL Certs Update

Completed - The scheduled maintenance has been completed.
Apr 19, 08:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 19, 07:30 PDT

Scheduled - Purpose:
Update Faculty Sites

Impact:
No downtime is expected.

Affected:
All web sites hosted on Faculty Sites

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 17, 12:39 PDT

Apr 18, 2024

Planned Maintenance: Faculty Sites Update

Completed - The scheduled maintenance has been completed.
Apr 18, 08:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 18, 07:30 PDT

Scheduled - Purpose: Update Faculty Sites

Impact: No downtime is expected.

Affected: All web sites hosted on Faculty Sites

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 15, 14:13 PDT

Apr 17, 2024

International Student Service Outage

Resolved - System Administrators resolved this issue.
Apr 17, 22:23 PDT

Investigating - International Student Service is currently experiencing an outage. System Administrators are investigating the issue.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 13, 09:27 PDT

Planned Maintenance: Electrical Utility Shutdown - UC Davis Coffee Center / E180

Completed - The scheduled maintenance has been completed.
Apr 17, 08:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 17, 07:00 PDT

Scheduled - Purpose:
Complete power outage to test HVAC controls and generator/inverter

Requested By:
Ryan Burgess, UTIL High Voltage
Phone: 530-304-3184, Cell: 530-304-3184, Task ID: 2486625

Impact:
All electrical to the building

Affected Buildings:
UC DAVIS COFFEE CENTER

Affected VLANs:
ENG-CHEM&MAT-2-FW
ENG-MCH&AERO-2
ENG-MCH&AERO-4
HVAC-2-FW
INST-TRNS-ST-1
INST-TRNS-ST-2-FW
O&M:UTILITIES-1
PHYS-PLANT-3-FW
WATER-1-NR
WIRELESS

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 10, 08:45 PDT

Apr 16, 2024

No incidents reported.

Apr 15, 2024

No incidents reported.

Apr 14, 2024

No incidents reported.

Apr 13, 2024

Apr 12, 2024

No incidents reported.

Apr 11, 2024

Planned Maintenance: AggieService

Completed - The scheduled maintenance has been completed.
Apr 11, 19:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 11, 17:00 PDT

Scheduled - Purpose:
AggieService Department and Division Accounts ETL Subgraph Update & Bug Fix. Front end Forms API user Updates.

Impact:
No anticipated downtime for AggieService.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 9, 15:49 PDT

Planned Maintenance: AggieCloud: Account Management Application

Completed - The scheduled maintenance has been completed.
Apr 11, 18:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 11, 17:00 PDT

Scheduled - Purpose:
Bugfix release 1.5.1 for AggieCloud Management Application Groups Management service

Impact:
No downtime anticipated

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 9, 16:29 PDT

Data Center Network Issues

Resolved - Data Center and NOC staff have worked with clients to resolve all networking issues.
Apr 11, 12:00 PDT

Monitoring - Services have been restored and the services are being monitored. Please contact IT Express if you feel you have any outstanding issues.
Apr 1, 09:25 PDT

Identified - On Saturday, Mar 30, 2024, Data Center and NOC staff upgraded the firewalls at both Data Centers. The upgrade was overall successful, but we are still troubleshooting a couple of VLANs that are not behaving properly. Staff continue to work to resolve the issues.

Known problems are:
Sunapsis
vcenter at quest
some KFS services
Grad Studies we servers
Mar 31, 00:44 PDT

Apr 10, 2024

Network Maintenance: DNS

Completed - The scheduled maintenance has been completed.
Apr 10, 20:00 PDT

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 10, 18:00 PDT

Scheduled - Purpose:
Remove expired 237.169.in-addr.arpa. DNSSEC DS records from ARIN.

Impact:
Risk is low and no impact expected.

Affected:
169.237.0.0/16

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Mar 22, 15:57 PDT

Outage: AggieCloud: Accounts Management Application

Resolved - The service is functioning normally again
Apr 10, 13:48 PDT

Update - We are continuing to investigate this issue.
Apr 10, 13:47 PDT

Investigating - The Accounts Management Application for AggieCloud experiencing intermittent errors in the applications and staff are working to restore service

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 10, 13:47 PDT