With every webpage loaded, email sent, or video streamed, network traffic takes a complex journey…
This morning, Microsoft Teams suffered an outage with users unable to access Microsoft Teams unless they were using the Teams client. Users trying to navigate to https://teams.microsoft.com were unable to get there with various 500 HTTP errors.
Editor’s Note: This outage lasted about 2 hours including the time to roll out a fix, Exoprise customers knew of the issue around 35 minutes before Microsoft.
Exoprise proactive monitoring first detected the outage in North America starting at 7:20 AM EDT. Our customers were notified by proactive alerts and informed external customers to download the Teams client or switched to alternative meeting methods.
The ticket can be found here: TM612617: Users may be unable to access Microsoft Teams using web browsers
Proactive notification arrives 30 minutes before Office 365 service status.
We will update this page as we detect changes in the infrastructure or have more to update.
June 28, 2023 at 10:51 AM EDT
Final status: We’ve confirmed impact has recovered for most users. For a subset of impacted users, please see updates under TM612830 for additional remediation efforts underway.
Scope of impact: Impact was specific to users who are served through the affected infrastructure and were not using a cached desktop build.
Start time: Wednesday, June 28, 2023 at 6:53 AM EDT
End time: Wednesday, June 28, 2023 at 8:55 AM EDT
Preliminary root cause: A recent configuration change has inadvertently resulted in impact.
Next steps:
– We’re reviewing our configuration procedures to better identify similar issues during our development and testing cycles.
A PIR will be published within 5 business days.
June 28, 2023 at 10:05 AM EDT
Title: Users may be unable to access the Microsoft Teams service
User impact: Users may be unable to access the Microsoft Teams service.
More info: Users may be unable to load Microsoft Teams via the “teams.microsoft.com” web page and desktop app.
Users may see an “Operation failed with unexpected error” message.
While we were focused on remediation, users with access to a desktop build that is cached, may not experience the impact.
Current status: We’ve confirmed by monitoring service telemetry that the impact has resolved for most users. We’re continuing to review system logs to determine if further mitigation actions are required for the remaining impacted users.
Editor’s Note: We can confirm that our proactive monitoring began recovery at this point, but, as is typical, fixes take time to deploy globally for many of our international customers.
Scope of impact: Impact is specific to users who are served through the affected infrastructure and are not using a cached desktop build.
June 28, 2023 at 9:09 AM EDT · Quick update
Current status: We’ve initiated reverting the configuration change which resulted in impact. Early monitoring of service telemetry indicates we’re seeing availability improving in America, Asia-Pacific and Europe, Middle East and Africa regions.
This quick update is designed to give the latest information on this issue.
June 28, 2023 at 8:50 AM EDT · Quick update
Current status: We’re reviewing a recent authentication configuration change which may have unexpectedly resulted in impact. We’re determining our next steps to resolve the impact.
This quick update is designed to give the latest information on this issue.
June 28, 2023 at 8:17 AM EDT
Title: Users may be unable to access Microsoft Teams service
User impact: Users may be unable to access Microsoft Teams service.
More info: Users may be unable to load Microsoft Teams via the “teams.microsoft.com” web page and desktop app.
Users may see an “Operation failed with unexpected error” message.
While we’re focused on remediation, users with access to a desktop build that is cached, may not experience the impact.
Current status: We’re reviewing application logs to identify the root cause and determine a mitigation plan.
Scope of impact: Impact is specific to users who are served through the affected infrastructure and are not using a cached desktop build.
June 28, 2023 at 7:43 AM EDT
Title: Users may be unable to access Microsoft Teams using web browsers
User impact: Users may be unable to access Microsoft Teams using web browsers.
More info: Specifically, users may be unable to load the “teams.microsoft.com” web page and see the error message “Operation failed with unexpected error.”
Current status: We’re reviewing service monitoring telemetry to determine our next troubleshooting steps.
Scope of impact: Impact is specific to any user who is served through the affected infrastructure.