Update - We are still waiting for resolution from the vendor. Additionally, campus call centers have been reported to be affected by this degradation.
Apr 18, 10:39 PDT
Investigating - Jabber is currently experiencing a degradation. Staff are investigating the issue. Clients are not able to login to the jabber desktop client. System administrators are working with the vendor to resolve the issue.

Impacted service is voice telephone system

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 8, 11:05 PDT
AggieBuy ? Operational
AggieDash Operational
AggieFeed ? Operational
AggieTravel Operational
ATR portal ? Operational
Banner ? Operational
Box ? Operational
Cable TV Operational
Canvas ? Operational
CAS ? Operational
Computing Accounts ? Operational
Crashplan Backup Service Operational
Data Center Colocation Operational
DavisMail ? Operational
DHCP ? Operational
DNS ? Operational
Duo Multifactor Authentication Operational
Email Lists ? Operational
Email Routing ? Operational
FGS ? Operational
FISDS ? Operational
IAM ? Operational
IT Catalog ? Operational
Kerberos ? Operational
KFS ? Operational
LDAP ? Operational
MyInfoVault ? Operational
myUCDavis ? Operational
Network ? Operational
Network Time ? Operational
Payweb/PPSDS ? Operational
Pinnacle Operational
Qualtrics ? Operational
Radio Service (800MHz) Operational
SAN & DCFS ? Operational
SRCE ? Operational
ServiceNow ? Operational
Shibboleth ? Operational
SiteFarm Operational
Software Website ? Operational
Television Service Operational
TRS ? Operational
uConnect Active Directory ? Operational
uConnect ADFS ? Operational
uConnect Exchange On-prem ? Operational
uConnect Office 365 ? Operational
UC Davis Home Site ? Operational
Virtualization ? Operational
Voicemail Operational
Voice Telephone System ? Degraded Performance
Web Hosting ? Operational
Wireless ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
Purpose:
Modify remote monitoring settings.

Impact:
No expected impact. No controller reboot required. This is a monitoring content change only.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 17, 15:37 PDT
Planned Maintenance: SiteFarm Apr 21, 17:00-21:00 PDT
Purpose: Upgrade SiteFarm

Impact: No downtime is expected.

Affected: All web sites hosted on Acquia Site Factory


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 17, 15:00 PDT
Purpose:
Configure IPv6 MLD version 2 on the Davis Border Router for the CENIC SVL-HPR and OAK-DC circuits.

Impact:
Risk is moderate due to work on the primary network paths to external sites.
If an issue is discovered during implementation, an outage lasting no more than 20 minutes may be experienced while troubleshooting and/or rollback is performed.

Locations Affected:
128.120.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 17, 15:28 PDT
Planned Maintenance: ServiceNow Apr 24, 18:00-23:30 PDT
Purpose: Service now administrators will apply updates and patches to the Service Hub.

Impact: No downtime is required. All services will remain operational during this update


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 16, 17:07 PDT
Purpose:
Add a new VLAN and router interface to Colocation to use
ports allocated to their new/future firewall. Also the
route for CFO-SERVER-1-FW will be pointed to the new
firewall.

Impact:
The ports, firewall, and subnets are not currently in use
so no outage is anticipated.

Affected:
Directly Affected Networks:
FOA-1-DMZ tag 1980 169.237.243.96/29
CFO-SERVER-1-FW 1728 169.237.179.64/26


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 17, 17:50 PDT
Planned Maintenance: ServiceNow Apr 27, 17:00-23:00 PDT
Purpose: ServiceNow will apply a patch to Performance Analytics to correct a space issue that happens when legacy data is migrated to a new table.

Impact: No downtime expected. All services will remain operational during this update


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Posted on Apr 5, 14:07 PDT
Past Incidents
Apr 19, 2019

No incidents reported today.

Apr 18, 2019
Resolved - A single host in the Data Center Private Cloud service experienced an outage causing the following Virtual Machines to reboot and migrate to another host.

security-center
Davis-HCX-Interconnect
iso-logger-3
EX6
proxy22
CNPRC-PCS-9
CROCKER-NUCLEAR-PCS-VPN
AzproxSec4
pong_clone
BeyondTrust
tex6
scom22
LFR-DLR-0
CampusComp-VTEP02-0
DAVIS-HCX-Interconnect-WANOPT
ISO-SPIR_PRODDB01
barnacle_restore

Resolved: At 12:13, the servers hosted on the failed blade were unavailable for a few minutes while they were rebooted on a new host. Administrators removed the failed host from service. All services are now fully restored.
Apr 18, 14:23 PDT
Apr 17, 2019
Resolved - Google has resolved the sign-in degradation. More information available here: https://status.cloud.google.com/incident/cloud-iam/19001
Apr 17, 17:29 PDT
Investigating - DavisMail is experiencing authentication issues. We will update the status as more information becomes available from Google.
Apr 17, 15:48 PDT
Apr 16, 2019
Completed - This planned maintenance has been cancelled. The change is being rescheduled to a future date.
Apr 16, 17:10 PDT
Scheduled - Purpose:
ServiceNow will apply London Patch 6 as part of the quarterly patch program.

Impact:
No downtime is required. All services will remain operational during this update.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Mar 19, 17:13 PDT
Completed - The scheduled maintenance has been completed.
Apr 16, 14:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 16, 09:01 PDT
Scheduled - Purpose:
An underground copper cable splice needs to be sealed with a new splice case.

Impact:
Potential for service interruption to voice services to MRAK, Chem Annex and Physical
Sciences buildings.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 15, 14:11 PDT
Resolved - Banner Admins have resolved the Banner degradation.
Apr 16, 10:28 PDT
Identified - Banner is now available to all users.

Banner Admins are not finished with their full resolution and are still doing some work.
Apr 15, 13:30 PDT
Investigating - Some/most users are not able to log into Banner. Users are reporting being kicked off and cannot get back in.
Banner admins are researching the problem.
Apr 15, 11:57 PDT
Completed - The scheduled maintenance has been completed.
Apr 16, 08:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 16, 07:00 PDT
Scheduled - Purpose: Scheduled maintenance.

Impact / Affected Services: No impact expected.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 15, 00:04 PDT
Completed - The scheduled maintenance has been completed.
Apr 16, 06:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 15, 18:00 PDT
Scheduled - Purpose:
VoIP ISR configuration for Quest

Impact:
The VoIP system is designed to be redundant, however the reconfiguration and upgrades may cause brief service outages to subscribers phones. Additionally, the Unity Voicemail system and Jabber may be unavailable for brief periods of time during the maintenance window. The Finesse ACD (Call-Center) application however, will be unavailable during the maintenance window.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 11, 09:10 PDT
Apr 15, 2019
Completed - The scheduled maintenance has been completed.
Apr 15, 20:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 15, 18:00 PDT
Scheduled - Purpose:
One of the VoIP ISR is physically being moved from the NOC
to Quest and requires network configuration

Impact:
The device being moved is currently powered off and not
providing service so there should be no outage associated
with this move.

Affected:
Networks:

VOIP-ISR-6
172.20.4.124/30
172.20.4.102/32
172.20.4.227/32

VOIP-ISR-8
172.20.4.244/30
172.20.4.103/32
172.20.4.226/32

Buildings:
TELCOM/NOC
QUEST DATACENTER


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 11, 10:00 PDT
Completed - The scheduled maintenance has been completed.
Apr 15, 17:15 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 15, 17:00 PDT
Scheduled - Purpose: A minor change in CAS Sever configuration is needed.

Impact: CAS servers will be restarted to pick up new configuration, but no outage is expected and users should not be impacted.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 8, 09:04 PDT
Apr 14, 2019

No incidents reported.

Apr 13, 2019
Completed - The scheduled maintenance has been completed.
Apr 13, 10:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 13, 07:00 PDT
Scheduled - Purpose:
During recurring maintenance - http://kb.ucdavis.edu/?id=0180 - monthly Microsoft update installation and routine maintenance tasks will be performed.

Impact:
Servers will be rebooted. Service will be unavailable during the window.

Affected Services:
Bannerconnect Only (Bannerconnect.ucdavis.edu)

Servers:
BannerTSCB
BannerTS1
BannerTS2

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 12, 08:53 PDT
Apr 12, 2019
Resolved - The MyUCDavis service has remained stable following the fix and MyUCDavis admins are resolving this issue.
Apr 12, 14:10 PDT
Monitoring - Admins are monitoring issues with myUCDavis being inaccessible for some users.
Apr 8, 12:05 PDT
Resolved - MyUCDavis admins have resolved the issue with MyUCDavis.
Apr 12, 14:09 PDT
Monitoring - A fix has been applied and MyUCDavis has been restored. Admins will continue to monitor the results.
Apr 12, 10:40 PDT
Update - MyUCDavis is currently in maintenance mode and unavailable to users while the issues are being investigated.
Apr 12, 10:25 PDT
Investigating - We have received reports of Inside MyUCDavis displaying incorrect information after logging in. The MyUCDavis team is currently investigating.



----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 12, 09:32 PDT
Resolved - MyUCDavis admins have resolved the issue with MyUCDavis.
Apr 12, 14:08 PDT
Monitoring - A fix has been applied and Canvas has been restored. Admins will continue to monitor the results.
Apr 12, 10:40 PDT
Investigating - Canvas login page is currently unavailable due actions taken to address the MyUCDavis issues. Administrators are working to restore the ability to login. Users who were already logged in can continue to use the service without issue.
Apr 12, 10:18 PDT
Resolved - Network engineers report that the service has remained stable following the fix, and resolved this issue.
Apr 12, 06:54 PDT
Monitoring - A fix has been implemented to resolve issues with Eduroam. Network engineers will continue to monitor wireless services.
Apr 9, 11:26 PDT
Update - We are continuing to investigate this issue.
Apr 3, 15:01 PDT
Investigating - The Network Operations Center is currently investigating reports of intermittent connectivity with Eduroam and are working with Aruba to resolve.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 3, 14:33 PDT
Apr 11, 2019
Completed - The scheduled maintenance has been completed.
Apr 11, 19:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 11, 17:30 PDT
Scheduled - Purpose:
Enable automated client upgrades to version 6.8.6.

Impact:
During the maintenance, adding new CrashPlan clients will not be available. Existing desktop clients will be able to continue backing up their systems. New client versions will be pushed out to desktops after the server maintenance.

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 8, 12:21 PDT
Completed - The scheduled maintenance has been completed.
Apr 11, 17:16 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 11, 17:00 PDT
Scheduled - Purpose: An updated version of the CAS Management Application will be deployed.

Impact: CAS Management Application will be down for a few minutes for server restart.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 8, 09:01 PDT
Resolved - The UC Administrative System File Transfer Service was degraded today between 11:42AM - 12:00PM.

Impact: Any scheduled transfers were unable to be processed and were delayed until the issue was resolved.

The service is now fully functional.
Apr 11, 12:46 PDT
Completed - The scheduled maintenance has been completed.
Apr 11, 12:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 11, 11:00 PDT
Scheduled - Purpose:
OS patching

Impact:
Intermittent service availability

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 9, 10:14 PDT
Apr 10, 2019

No incidents reported.

Apr 9, 2019
Completed - The scheduled maintenance has been completed.
Apr 9, 06:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 8, 18:00 PDT
Scheduled - Purpose: The VoIP system is designed to be redundant, however the reconfiguration and upgrades may cause brief service outages to subscribers phones. Additionally, the Unity Voicemail system and Jabber may be unavailable for brief periods of time during the maintenance window. The Finesse ACD (Call-Center) application however, will be unavailable during the maintenance window.

Impact: Campus VoIP system.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 4, 11:32 PDT
Apr 8, 2019
Resolved - The ATR portal experienced a partial outage, some features were not working properly, such as the NAM search tool. Staff identified the issue and service has been fully restored.
Apr 8, 09:54 PDT
Identified - ATR is currently experiencing an outage. Staff are investigating the issue.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 8, 09:50 PDT
Apr 7, 2019

No incidents reported.

Apr 6, 2019
Completed - The scheduled maintenance has been completed.
Apr 6, 10:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 6, 07:00 PDT
Scheduled - Purpose:
Implement change to traffic management for the Davis Campus network.

Impact:
Expected impact, clients may experience a brief period of slow network response when switching between normal and alternate paths.
Worse anticipated scenario, Gigamon-1 and/or Gigamon-2 will not pass all traffic as intended or stop passing all traffic, resulting in a network outage lasting no more than 20 minutes.

Affected:
128.120.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Mar 4, 16:28 PST
Resolved - Administrators have restored functionality of embedded Kaltura videos in UC Davis Canvas.
Apr 6, 09:24 PDT
Investigating - Canvas is currently experiencing degraded service.
Embedded Kaltura videos in course sites are currently returning errors. System administrators are investigating the issue.


----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Apr 6, 08:07 PDT
Completed - The scheduled maintenance has been completed.
Apr 6, 06:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 6, 04:00 PDT
Scheduled - Purpose:
Configure CENIC OAK-DC 2 x 10G circuits as a Link Aggregation Group.

Impact:
No impact expected. If an issue is discovered during implementation, a network outage lasting up to 20 minutes may be experienced while troubleshooting and/or configuration rollback is performed.

Affected:
128.120.0.0/16
168.150.0.0/17
169.237.0.0/16
2607:f810::/36

----------------------------
IT Express Service Desk
ithelp@ucdavis.edu
530.754.HELP (4357)
Mar 4, 16:30 PST
Apr 5, 2019

No incidents reported.