Service Degraded: RIS Compute
Investigating - RIS is investigating an issue with slow performance on the RIS Compute Service. The service is working but running slower than expected.

Teams are working with IBM to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Sep 16, 11:03 CDT

About This Site

WashU IT's Service Dashboard gives you real-time updates on system performance issues. If you require assistance, please call our Service Desk at 314-933-3333.

Uptime over the past 90 days. View historical uptime.
Administrative & Enterprise Systems Partial Outage
90 days ago
99.73 % uptime
Today
Administrative Information System (AIS) Operational
Alumni and Development Information System (ADIS) Operational
Human Resources Management System (HRMS) Operational
Research Management System (RMS) Operational
Student Information System (SIS) Operational
Vended Applications ? Partial Outage
Cognos Reporting Operational
Marketplace Operational
Vended Applications (Inc. LAMPS) ? Operational
Workday ? Operational
90 days ago
100.0 % uptime
Today
SUBS Awards ? Operational
90 days ago
100.0 % uptime
Today
Bear Bucks ? Operational
90 days ago
89.7 % uptime
Today
Clinical Operational
Enterprise Client Virtualization (ECV) Operational
EPIC Operational
Follow Me Desktop (FMD) Operational
Vended Applications Operational
Clinical Remote Access Operational
Clinical Websites Operational
Communications & Collaboration Operational
Email Operational
Office 365 Operational
Skype / Teams Operational
Maestro mass communication system Operational
Zoom Operational
Box File Storage System ? Operational
Computing and Printing Operational
E-Fax Operational
PaperCut Printing Operational
WashU Cloud Storage Operational
Azure Hosted Infrastructure Operational
WashU IT Private Cloud Computing ? Operational
IT Infrastructure Components ? Operational
JAMF Apple Device Management System ? Operational
File Services Operational
IT Management Operational
Software Licensing Operational
Network & Connectivity Operational
90 days ago
99.89 % uptime
Today
Internet Operational
Internet 2 Operational
Phone Operational
VPN Operational
WIFI Operational
Washington University Research Network (WURN) Operational
Vendor Services (Spectrum, AT&T, etc.) ? Operational
Network Services ? Operational
90 days ago
99.89 % uptime
Today
Research Degraded Performance
Compute Degraded Performance
Storage Operational
Security Operational
Identity Management System (IDM Wustl Key) Operational
Spam Filter Operational
Duo Two-Factor Authentication ? Operational
Teaching & Learning Operational
Canvas Operational
Learn@Work Operational
Kaltura ? Operational
Curriculum Management Applications ? Operational
EMS (Event Management System) ? Operational
University Websites Operational
WashU IT Hosted Websites Operational
Externally Hosted Websites Operational
BJC Devices and Services Operational
BJC Network Connectivity ? Operational
BJC Clinical Applications Operational
Pharmacy POS Machines ? Operational
BJC Phone System Operational
BJC Handheld Supply Scanners (ATPAR) ? Operational
Cloud Services Operational
Google Operational
Engineering School Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Past Incidents
Oct 17, 2021

No incidents reported today.

Oct 16, 2021

No incidents reported.

Oct 15, 2021

No incidents reported.

Oct 14, 2021
Service Outage: Bear Bucks Website Login Errors
Resolved - WashU IT Engineers have resolved the issues affecting the Bear Bucks website. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
Oct 14, 15:55 CDT
Update - Technical teams are investigating an issue with the Bear Bucks website not allowing users to log in. Users are encountering several different errors, including "Error/ PLAN INVALID" and "An attempt to establish a Bear Bucks account has failed." Technical teams are still working on doing a database/code rollback.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 14, 09:26 CDT
Update - Technical teams are investigating an issue with the Bear Bucks website not allowing users to log in. Users are encountering several different errors, including "Error/ PLAN INVALID" and "An attempt to establish a Bear Bucks account has failed." Technical teams are still working on restoring service and expect to have another status update around 9am on Thursday morning.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 13, 12:45 CDT
Update - Technical teams are investigating an issue with the Bear Bucks website not allowing users to log in. Users are encountering several different errors, including "Error/ PLAN INVALID" and "An attempt to establish a Bear Bucks account has failed." Technical teams are investigating Workday integration issues..

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 12, 14:31 CDT
Investigating - Technical teams are investigating an issue with the Bear Bucks website not allowing users to log in. Users are encountering several different errors, including "Error/ PLAN INVALID" and "An attempt to establish a Bear Bucks account has failed." Technical teams are investigating Workday integration issues..

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 12, 14:25 CDT
Oct 13, 2021
Service Restored: Wustl Key-Enabled Logins Failing
Resolved - WashU IT Engineers have resolved an issue with Wustl Key-enabled Logins which was occurring intermittently from approximately 5am until 8:30am. Database issues and problems with the automated failover process caused people to receive error messages when trying to log into applications with their Wustl key.

If you continue to experience further issues, please contact us at 314-933-3333. We appreciate your patience during this incident.
Oct 13, 05:00 CDT
Oct 12, 2021
Service Outage (BJC): VDI/Citrix Connectivity Issues
Resolved - BJC Technical teams identified and resolved an issue which was affecting VDI and Citrix connectivity, including FMD/ECV. A technical problem occurred which should have triggered an automatic failover to another Data Center, but the automated failover did not occur. Manual failover was performed and services have been restored.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 12, 09:00 CDT
Oct 11, 2021
Planned Service Maintenance: Printing/PaperCut
Completed - The scheduled maintenance has been completed.
Oct 11, 22:30 CDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 11, 17:30 CDT
Scheduled - Washington University Information Technology will perform maintenance on the PaperCut system through which Students, Faculty, and Staff print. This will cause printing/PaperCut to be unavailable on Monday, October 11, between 5:30pm and 10:30pm. Please plan your printing needs accordingly.

Note: This will NOT affect the ability to print from within EPIC.

Frequently Asked PaperCut Maintenance Questions:
- Will this affect my balance?
No. This maintenance will not affect your balance.
- What happens if I submit a job during the maintenance window?
Your print job will be held in the print queue and can be released afterward.
- Can I Print during the maintenance window?
No, you cannot print during the maintenance window.
- If I submit a print job before the maintenance window will it still be there afterward?
The print job should be held in the print queue and can be released afterward.

CHG0038094
Oct 7, 10:48 CDT
Service Outage (BJC): VDI/Citrix Connectivity Issues
Resolved - BJC IT teams have resolved the firewall/network issues which were impacting services (including FMD/ECV). If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
Oct 11, 14:12 CDT
Update - BJC Technical teams are investigating server issues which are impacting multiple applications and services, including VDI/Citrix. The vendor has been engaged for assistance with troubleshooting and diagnosis.

During the course of troubleshooting, BJC technical teams have identified the root cause issue as an issue on two firewalls, and the team has performed an emergency change to correct that issue, and now the firewalls and the network appear stable.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 11, 13:45 CDT
Update - BJC Technical teams are investigating server issues which are impacting multiple applications and services, including VDI/Citrix. The vendor has been engaged for assistance with troubleshooting and diagnosis. Several small configuration problems have been identified and resolved but they did not make a substantial impact to the ongoing VDI/Citrix issues.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 11, 12:04 CDT
Update - BJC Technical teams are investigating server issues which are impacting multiple applications and services, including VDI/Citrix. The vendor has been engaged for assistance with troubleshooting and diagnosis. Potential corrective actions have been implemented but the issue remains active.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 11, 10:54 CDT
Investigating - BJC Technical teams are investigating server issues which are impacting multiple applications and services, including VDI/Citrix. The vendor has been engaged for assistance with troubleshooting and diagnosis.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 11, 10:08 CDT
Oct 10, 2021
Planed Service Maintenance: KnowledgeLake
Completed - The scheduled maintenance has been completed.
Oct 10, 16:00 CDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 9, 12:02 CDT
Scheduled - Washington University Information Technology will perform scheduled KnowledgeLake maintenance on the weekend of Saturday and Sunday, October 9 and 10, with services available on Monday, October 11.

This maintenance will cause KnowledgeLake searching, indexing, uploading, and scanning to be unavailable from Saturday October 9 at Noon until Sunday October 10 at 4:00pm.


Have questions? Email us at 7c2cef7b.gowustl.onmicrosoft.com@amer.teams.ms (Microsoft Teams email address)
Oct 7, 09:06 CDT
Oct 9, 2021
Network Maintenance: Multiple Buildings on the Medical Campus
Completed - The scheduled maintenance has been completed.
Oct 9, 00:00 CDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 8, 22:01 CDT
Scheduled - Washington University Information Technology will perform network maintenance in multiple buildings across the Medical Campus, which will cause the Network, Phone, WashU WiFi, and remote access to devices located in the buildings listed below to be unavailable for approximately 15 minutes on October 8, between 10:00pm and Midnight.

The impacted buildings and specific floors are listed below:
- 4444 Forest Park | All floors
- Barnes West Professional Building 3 | All floors
- Bernard Becker Medical Library | Basement
- Center for Advanced Medicine (CAM) | 13th floor
- Center for Outpatient Health (COH) | 9th & 10th floor
- Clinical Sciences Research Building (CSRB) | 6th floor
- Couch Biomedical Research Building | Lower level
- East Building | 2nd & 3rd floors
- Farrell Learning and Teaching Center (FLTC) | 5th floor
- McDonnell Medical Sciences Building | 8th floor
- McMillan Hospital | 2nd floor
- Mid Campus Center | Basement, EOC, and WUSM Protective Services
- Steven & Susan Lipstein BJC Institute of Health | 3rd & 5th floors
- West Building | 4th floor
- Wohl Clinic | 2nd floor
- Wohl Hospital | 7th floor

CHG0038145
Oct 7, 17:28 CDT
Oct 8, 2021
Oct 7, 2021

No incidents reported.

Oct 6, 2021

No incidents reported.

Oct 5, 2021
Service Outage: ECV Login Remote Desktop Error
Resolved - The Epic One team has identified the issue affecting ECV connections and has restored service. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
Oct 5, 12:42 CDT
Investigating - EPIC One is investigating an issue affecting ECV logins. ECV users are getting an error:

"The task you are trying to do can't be completed because Remote Desktop Services is currently busy. Please try again in a few minutes. Other users should still be able to log on."

BJC technical teams are working to resolve the issue and have put a potential fix in place. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 5, 10:26 CDT
Service Outage (Vendor): Charter Spectrum
Resolved - WashU IT Engineers have confirmed that the issue affecting Internet and VPN on Monday was a result of a configuration problem with the service vendor (Charter Spectrum). The issue was resolved on Monday evening and technical teams have not observed any instabilities in our Internet connections since then. If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
Oct 5, 02:26 CDT
Identified - WashU IT has identified that a Global DNS service outage is causing issues with many Internet websites and applications, and has contributed to service outages at WashU throughout the past few hours. We will continue to monitor the environment until the issues are resolved.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 4, 14:16 CDT
Investigating - WashU IT is investigating an issue affecting Internet and VPN connectivity. Additional details will be provided when they are available.

Teams are working to resolve the issue. Please call 314-933-3333 if you have any questions. We appreciate your patience as we work to restore service.
Oct 4, 12:05 CDT
Oct 4, 2021
Service Restored: SIS Database Unavailable
Resolved - WashU IT Engineers detected issues with the SIS Database which caused some services to be unavailable. Service impacted include:

BearBucks
WebSTAC
WebFAC
WuAchieve
WebAdvising
SISDocs

Ongoing issues related to Internet connectivity caused the SIS Database to fail over to a secondary server. Database connections have been restored and all services are now available.

If you continue to experience further issues, please contact us at 314-933-3333.

We appreciate your patience during this incident.
Oct 4, 14:02 CDT
Oct 3, 2021

No incidents reported.

← Incident History Powered by Atlassian Statuspage