tag:status.greenhouse.io,2005:/historyGreenhouse Status - Incident History2024-11-27T14:05:35ZGreenhousetag:status.greenhouse.io,2005:Incident/229637702024-11-26T05:30:28Z2024-11-26T05:30:30ZErrors connecting to Outlook 365<p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>05:30</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>18:47</var> UTC</small><br><strong>Identified</strong> - Microsoft has posted that "Users may be unable to access or use some Microsoft 365 services and features" and we believe this is related to the errors users are seeing. Users with access to the Microsoft Admin Center can view Microsoft's incident status page at https://portal.office.com/Adminportal/Home#/servicehealth/:/alerts/MO941162</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>16:34</var> UTC</small><br><strong>Investigating</strong> - We're investigating reports of users not being able to retrieve their Outlook 365 calendars when scheduling interviews in Greenhouse Recruiting. We're also seeing errors when sending scheduled emails via Outlook 365 from GHSA and Interseller.</p>tag:status.greenhouse.io,2005:Incident/229042422024-11-20T00:04:09Z2024-11-20T00:04:11ZUnable to select some users in User Type offer fields during offer generation process<p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>00:04</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>19</var>, <var data-var='time'>23:40</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'>19</var>, <var data-var='time'>23:24</var> UTC</small><br><strong>Identified</strong> - We've identified an issue where some users are unable to be selected during the offer generation process. We are deploying a fix.</p>tag:status.greenhouse.io,2005:Incident/228681542024-11-18T18:29:33Z2024-11-18T18:29:33ZDelayed Sourcing Quality Data (EU silo)<p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>18:29</var> UTC</small><br><strong>Resolved</strong> - The data refresh process is operating and the sourcing quality data is up-to-date.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>13:43</var> UTC</small><br><strong>Identified</strong> - The sourcing quality data being presented in the job dashboard widget is as of November 12. We are working on restoring the data refresh process.</p>tag:status.greenhouse.io,2005:Incident/228896092024-11-18T01:30:00Z2024-11-18T15:53:58ZIssue with submitting applications on some job boards<p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>01:30</var> UTC</small><br><strong>Resolved</strong> - Due to an issue with location auto-complete functionality on some job boards, job-seekers were not able to submit applications. Only job posts that required the location field on job board integration options 1-4 were affected by the issue. The incident lasted from about November 17 around 8:30 PM EST to November 18 6:05 AM EST. We've fully resolved issue and notified the job-seekers who reached out to us of the resolution.</p>tag:status.greenhouse.io,2005:Incident/228418512024-11-13T14:46:02Z2024-11-13T14:46:02ZNo data showing in the job dashboard "Candidate Source Breakdown" widget (EU)<p><small>Nov <var data-var='date'>13</var>, <var data-var='time'>14:46</var> UTC</small><br><strong>Resolved</strong> - The sourcing quality data as of November 12 are available and being displayed in the job dashboard widget. We are working on resuming the data refresh process. We will separately keep track of and notify customers when the data refreshes resume.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>19:09</var> UTC</small><br><strong>Identified</strong> - We have identified the root cause of the missing data and have implemented a temporary remediation. Impacted EU customers should start seeing the widget get populated with data. We are working on a more permanent fix.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>17:04</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating the issue.</p>tag:status.greenhouse.io,2005:Incident/227625492024-11-05T19:56:10Z2024-11-07T19:03:22ZIntermittent Outages<p><small>Nov <var data-var='date'> 5</var>, <var data-var='time'>19:56</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 4</var>, <var data-var='time'>18:15</var> UTC</small><br><strong>Update</strong> - Greenhouse is continuing to monitor the remediation that was put in place. All systems have been stable since 12:50 PM EST (17:50 AM UTC) on November 4th.</p><p><small>Nov <var data-var='date'> 4</var>, <var data-var='time'>18:10</var> UTC</small><br><strong>Monitoring</strong> - There were 6 periods of 3 minutes of downtime today for all Greenhouse products. The root cause has been identified and remediation has been put in place. All systems have been stable since 12:50PM Eastern time (17:50 UTC). We are continuing to monitor our systems.</p><p><small>Nov <var data-var='date'> 4</var>, <var data-var='time'>17:50</var> UTC</small><br><strong>Update</strong> - Greenhouse is continuing to experience periodic but brief outages. We are investigating the root cause.</p><p><small>Nov <var data-var='date'> 4</var>, <var data-var='time'>16:39</var> UTC</small><br><strong>Investigating</strong> - Greenhouse is currently experiencing intermittent outages on all silos. We are investigating.</p>tag:status.greenhouse.io,2005:Incident/226234142024-11-02T14:00:02Z2024-11-02T14:00:02Z[Scheduled] Greenhouse Recruiting Maintenance<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>14:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>13:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>21:06</var> UTC</small><br><strong>Scheduled</strong> - We will be performing Greenhouse Recruiting maintenance on Saturday, November 2nd at 13:00 UTC.<br /><br />Overview of maintenance:<br />During this time, Greenhouse Recruiting may experience intermittent availability issues.<br /><br />We apologize for the inconvenience and thank you for your understanding and patience as we work to ensure the continued reliability of Greenhouse.<br /><br />Please feel free to reach out via our Help Center with any questions or concerns: https://support.greenhouse.io</p>tag:status.greenhouse.io,2005:Incident/226604212024-10-24T23:43:35Z2024-10-24T23:43:36ZPerformance Degradation: Visual Pipeline<p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>23:43</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>22:50</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>22:21</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>21:55</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing issues with Candidate Visual Pipeline. Users may notice a delay in the visual pipeline being updated after moving a candidate to a new stage. Our team is actively investigating the issue and working to restore full functionality as quickly as possible.</p>tag:status.greenhouse.io,2005:Incident/226597672024-10-24T20:59:56Z2024-10-24T20:59:56ZThird-party Service Disruption: Calendly<p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>20:59</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>20:44</var> UTC</small><br><strong>Monitoring</strong> - The issue appears to be resolved. We are continuing to monitor.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>20:23</var> UTC</small><br><strong>Investigating</strong> - We are aware of an issue causing a partial disruption with services utilizing a Calendly integration. Our team is currently investigating.</p>tag:status.greenhouse.io,2005:Incident/226585622024-10-24T19:30:24Z2024-10-24T19:30:25ZIssues accessing Live Chat support<p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>19:30</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>18:08</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing a partial disruption affecting "Request Help Icon" which allows the initiation of live chat support. Our team is investigating the issue and working to restore full functionality. We apologize for any inconvenience and will provide updates as we have more information. In the meantime support tickets can be submitted through our support page at https://support.greenhouse.io/hc/en-us</p>tag:status.greenhouse.io,2005:Incident/226192042024-10-21T18:23:19Z2024-10-21T18:23:19ZPartial Service Disruption<p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>18:23</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>15:19</var> UTC</small><br><strong>Identified</strong> - The issue has been identified, and a fix is being implemented.</p><p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>13:24</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing a partial disruption affecting the ability of Job Admins to merge candidates in Greenhouse Recruiting. Our team is investigating the issue and working to restore full functionality. We apologize for any inconvenience and will provide updates as we have more information.</p>tag:status.greenhouse.io,2005:Incident/223832502024-10-08T06:41:16Z2024-10-08T06:41:17Z[Scheduled] Greenhouse Job Boards Maintenance<p><small>Oct <var data-var='date'> 8</var>, <var data-var='time'>06:41</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 8</var>, <var data-var='time'>01:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>21:19</var> UTC</small><br><strong>Scheduled</strong> - We will be performing Greenhouse Job Boards maintenance on Tuesday October 8, 2024 from 01:00 to 03:00 UTC.<br /><br />Overview of maintenance:<br />During this time, Greenhouse Job Boards may experience intermittent availability issues. We apologize for the inconvenience and thank you for your understanding and patience as we work to ensure the continued reliability of Greenhouse.<br /><br />Please feel free to reach out via our Help Center with any questions or concerns: https://support.greenhouse.io</p>tag:status.greenhouse.io,2005:Incident/223972562024-10-04T20:54:39Z2024-10-04T20:54:39ZPartial Service Disruption<p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>20:54</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>19:09</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>18:55</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>18:53</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing a partial disruption affecting multi-select custom fields. Our team is investigating the issue and working to restore full functionality. We apologize for any inconvenience and will provide updates as we have more information.</p>tag:status.greenhouse.io,2005:Incident/222739892024-09-24T20:27:46Z2024-09-24T20:27:46ZPartial Service Disruption<p><small>Sep <var data-var='date'>24</var>, <var data-var='time'>20:27</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>24</var>, <var data-var='time'>19:58</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Sep <var data-var='date'>24</var>, <var data-var='time'>19:28</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing a partial disruption affecting the Candidate Source Breakdown & Quality tool in Greenhouse Recruiting. Our team is investigating the issue and working to restore full functionality. We apologize for any inconvenience and will provide updates as we have more information.</p>tag:status.greenhouse.io,2005:Incident/221982412024-09-20T02:41:26Z2024-09-20T02:41:26ZGreenhouse Recruiting Maintenance - Silo 3<p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>02:41</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>01:02</var> UTC</small><br><strong>Update</strong> - Scheduled maintenance is still in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>01:02</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>17</var>, <var data-var='time'>19:39</var> UTC</small><br><strong>Scheduled</strong> - We will be performing Greenhouse Recruiting maintenance from 01:00 UTC to 03:00 UTC on September 20, 2024.<br /><br />During this time, Greenhouse Recruiting may experience intermittent availability issues. We apologize for the inconvenience and thank you for your understanding and patience as we work to ensure the continued reliability of Greenhouse.<br /><br />Please feel free to reach out via our Help Center with any questions or concerns: https://support.greenhouse.io</p>tag:status.greenhouse.io,2005:Incident/221371522024-09-14T23:01:21Z2024-09-14T23:01:22ZGreenhouse Sourcing Automation maintenance<p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>23:01</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>17:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>21:13</var> UTC</small><br><strong>Scheduled</strong> - We will be performing scheduled maintenance on Greenhouse Sourcing Automation from 17:00 UTC to 19:00 UTC on September 14, 2024. During this time, Greenhouse Sourcing Automation may experience intermittent availability issues. We apologize for any inconvenience and appreciate your understanding.</p>tag:status.greenhouse.io,2005:Incident/221164202024-09-10T05:40:07Z2024-09-10T05:40:08ZPerformance Degradation<p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>05:40</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>05:20</var> UTC</small><br><strong>Identified</strong> - We have identified the source of the performance degradation and are working to resolve.</p><p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>04:20</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing issues with Greenhouse Recruiting. Users may notice occasional errors or delays when loading pages throughout the application. Our team is actively investigating the issue and working to restore full functionality as quickly as possible.</p>tag:status.greenhouse.io,2005:Incident/220547942024-09-04T23:33:53Z2024-09-04T23:33:54ZErrors when viewing some rejected candidates<p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>23:33</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>21:17</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>21:04</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating reports of errors when loading rejected candidates that had a rejection email sent or scheduled earlier today.</p>tag:status.greenhouse.io,2005:Incident/219477582024-08-28T20:28:54Z2024-08-28T20:28:54ZBIC: Stale Data In Some Tables<p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>20:28</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>15:30</var> UTC</small><br><strong>Identified</strong> - We have identified that the following tables may contain stale data and are in the process of updating the data:<br />- agency_question_custom_fields<br />- application_custom_fields<br />- candidate_custom_fields<br />- candidate_phone_numbers<br />- eeoc_responses<br />- hiring_team<br />- job_custom_fields<br />- offer_custom_fields<br />- opening_custom_fields<br />- referral_question_custom_fields<br />- rejection_question_custom_fields<br />- survey_builder_answers<br />- user_attribute_custom_fields</p>tag:status.greenhouse.io,2005:Incident/219333232024-08-27T20:34:41Z2024-08-27T20:34:42ZInterviewer availability not visible<p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>20:34</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved</p><p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>20:27</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results</p><p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>19:04</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented</p><p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>18:35</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with interviewer schedules not appearing when requesting candidate availability</p>tag:status.greenhouse.io,2005:Incident/219144012024-08-27T11:46:21Z2024-08-27T11:46:22ZJobs table in BIC may have duplicate records<p><small>Aug <var data-var='date'>27</var>, <var data-var='time'>11:46</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>26</var>, <var data-var='time'>15:39</var> UTC</small><br><strong>Investigating</strong> - There are some duplicate job records on the `jobs` table in BIC with different department_ids.</p>tag:status.greenhouse.io,2005:Incident/218422282024-08-23T13:25:30Z2024-08-23T13:25:31ZIssues with LinkedIn RSC 1-Click export<p><small>Aug <var data-var='date'>23</var>, <var data-var='time'>13:25</var> UTC</small><br><strong>Resolved</strong> - LinkedIn has confirmed that the underlying issue has been resolved. All previously "pending" LinkedIn RSC exports should have been caught up.</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>16:40</var> UTC</small><br><strong>Identified</strong> - LinkedIn RSC exports are not appearing in Greenhouse. Candidate profiles are getting stuck in "pending" state. We’re in communication with the LinkedIn team to resolve this.</p>tag:status.greenhouse.io,2005:Incident/216851052024-08-08T18:13:05Z2024-08-08T18:13:05ZBIC: Stale Data In Some Tables<p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>18:13</var> UTC</small><br><strong>Resolved</strong> - Data on all silos have been refreshed.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>14:24</var> UTC</small><br><strong>Monitoring</strong> - Silos are currently being caught up to the most recent data, including yesterday.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>13:36</var> UTC</small><br><strong>Identified</strong> - We have identified the issue and are in the process of repopulating BIC tables.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>13:26</var> UTC</small><br><strong>Investigating</strong> - We have been made aware that some tables in BIC do not include yesterday's data. We are investigating.</p>tag:status.greenhouse.io,2005:Incident/215016352024-07-23T18:14:15Z2024-07-23T18:14:15ZBIC Stale data in some tables<p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>18:14</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>17:52</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>15:48</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>15:26</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>15:03</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>15:01</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>13:00</var> UTC</small><br><strong>Identified</strong> - We have identified that the following tables may contain stale data and are in the process of updating the data:<br />- agency_question_custom_fields<br />- application_custom_fields<br />- candidate_custom_fields<br />- job_custom_fields<br />- offer_custom_fields<br />- opening_custom_fields<br />- referral_question_custom_fields<br />- rejection_question_custom_fields<br />- user_attribute_custom_fields<br />- job_posts</p>tag:status.greenhouse.io,2005:Incident/215038192024-07-23T17:14:54Z2024-07-23T17:14:54ZSome data not updating as expected for users<p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>17:14</var> UTC</small><br><strong>Resolved</strong> - Our system has returned to its normal operating status.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>16:44</var> UTC</small><br><strong>Monitoring</strong> - We briefly experienced an issue where some data was not updating as expected for users. We've remediated the issue and continue to monitor the situation.</p>