tag:rovo.status.atlassian.com,2005:/historyRovo Status - Incident History2025-02-26T11:05:44ZRovotag:rovo.status.atlassian.com,2005:Incident/231649772024-12-12T07:26:42Z2024-12-13T04:28:12ZOpenAI's API is returning 5xx for GPT models<p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>07:26</var> UTC</small><br><strong>Resolved</strong> - Between 3:16pm PST and 7:38pm PST, we experienced an outage for Rovo and all AI features across Atlassian Products. The issue has been resolved and the service is operating normally.</p><p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>03:50</var> UTC</small><br><strong>Update</strong> - We are witnessing significant recovery of the services. We will continue to monitor the situation closely.</p><p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>02:35</var> UTC</small><br><strong>Update</strong> - We are actively communicating with the affected AI Service provider and closely monitoring the ongoing outage situation. While we have observed some signs of recovery, the majority of API calls are still resulting in errors.<br /><br />We have successfully restored the Smart Answers in Search feature by rerouting requests to an alternative model.<br /><br />All other Atlassian Intelligence capabilities and Rovo remain unavailable at this time due to the ongoing AI Service provider outage.</p><p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>00:47</var> UTC</small><br><strong>Investigating</strong> - We have reached out to our AI Service Provider and they are actively working on restoring the API.<br /><br />Additionally, we are working on routing the traffic for Smart answers in Search capability to another model.<br /> <br />We will provide more details within the next hour.</p>tag:rovo.status.atlassian.com,2005:Incident/230741122024-12-05T02:38:08Z2024-12-05T02:38:08ZAI features degraded<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>02:38</var> UTC</small><br><strong>Resolved</strong> - Between 12:13 AM UTC to 01:30 AM UTC, we experienced a degraded experience for AI features in Confluence, Jira Service Management, Jira, and Rovo. The issue has been resolved and the service is operating normally.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>01:32</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with AI features that is impacting all Rovo and Enterprise and Premium Confluence, Jira Service Management and Jira customers. We will provide more details within the next hour.</p>tag:rovo.status.atlassian.com,2005:Incident/228918112024-11-27T05:39:46Z2024-11-27T05:39:46Z3P Search failing intermittently<p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>05:39</var> UTC</small><br><strong>Resolved</strong> - The issue has been resolved and the service is operating normally.</p><p><small>Nov <var data-var='date'>19</var>, <var data-var='time'>05:54</var> UTC</small><br><strong>Investigating</strong> - We are actively exploring different approaches and continue to work on resolving the intermittent failures affecting some users in the 3P search for Rovo.</p><p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>22:03</var> UTC</small><br><strong>Identified</strong> - We are actively working on resolving the issues with the 3P Search for Rovo. Our team is currently implementing a fix to alleviate the problem.</p><p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>20:36</var> UTC</small><br><strong>Update</strong> - We are investigating intermittent errors with 3P Search that is impacting Rovo Cloud customers. We will provide more details within the next hour.</p><p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>20:34</var> UTC</small><br><strong>Investigating</strong> - We are investigating intermittent errors while performing 3P search. We will provide more details once we identify the root cause.</p>tag:rovo.status.atlassian.com,2005:Incident/213017472024-07-29T23:28:16Z2024-07-29T23:28:16ZSome products are hard down<p><small>Jul <var data-var='date'>29</var>, <var data-var='time'>23:28</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'> 3</var>, <var data-var='time'>21:45</var> UTC</small><br><strong>Monitoring</strong> - We have mitigated the problem and continue looking into the root cause.<br />The outage was between 8:08pm 03/07 UTC - 08:31pm 03/07 UTC<br />We are now monitoring closely.</p><p><small>Jul <var data-var='date'> 3</var>, <var data-var='time'>20:51</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with <FUNCTIONALITY IMPACTED> that is impacting <SOME/ALL> Atlassian, Atlassian Partners, Atlassian Support, Confluence, Jira Work Management, Jira Service Management, Jira, Opsgenie, Atlassian Developer, Atlassian (deprecated), Trello, Atlassian Bitbucket, Guard, Jira Align, Jira Product Discovery, Atlas, Atlassian Analytics, and Rovo Cloud customers. We will provide more details within the next hour.</p>