tag:status.happyco.com,2005:/historyHappyCo Status - Incident History2024-03-28T12:50:56ZHappyCotag:status.happyco.com,2005:Incident/201334732024-03-01T17:51:29Z2024-03-01T17:51:29ZYardi Integration Service Outage<p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>17:51</var> UTC</small><br><strong>Resolved</strong> - We have successfully re-run outstanding failed jobs.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>16:51</var> UTC</small><br><strong>Update</strong> - We have completed working through asset import/export as well as task export failures, and now moving onto task import failed jobs.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>16:26</var> UTC</small><br><strong>Update</strong> - We are continuing to work through the backlog of previously failed API requests and making steady progress.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>15:44</var> UTC</small><br><strong>Monitoring</strong> - We've implemented a fix and are currently working through the backlog of failed API calls to bring our data up-to-date across all Yardi instances.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>15:23</var> UTC</small><br><strong>Identified</strong> - This outage currently only affects Yardi; no other PMS integrations are impacted.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>15:22</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.happyco.com,2005:Incident/199672262024-02-12T19:33:30Z2024-02-12T19:33:30ZCall Complete Web Interface Unavailable<p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>19:33</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. Thank you for your patience.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>17:36</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented, and we are monitoring the results.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>16:40</var> UTC</small><br><strong>Identified</strong> - We have identified the issue and are investigating.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>14:55</var> UTC</small><br><strong>Investigating</strong> - Customers are unable to access features of Call Complete via the web.<br /><br />We are actively investigating this issue.</p>tag:status.happyco.com,2005:Incident/194200292023-12-12T19:22:58Z2023-12-12T19:22:58ZDegraded system performance<p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>19:22</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>18:53</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>18:31</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing degraded performance across our API's and services. Customers will experience intermittent failures to requests to HappyCo systems.</p>tag:status.happyco.com,2005:Incident/166591482023-03-27T13:06:46Z2023-03-27T13:06:46ZUncheduled maintenance<p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>13:06</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>07:04</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>07:04</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>06:55</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p>tag:status.happyco.com,2005:Incident/94380562022-03-01T20:53:40Z2022-03-01T20:53:40ZInsights is experiencing degraded performance<p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>20:53</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>19:29</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p>tag:status.happyco.com,2005:Incident/93556112022-02-18T23:40:19Z2022-02-18T23:40:19ZInsights is experiencing degraded performance<p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>23:40</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>21:38</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue. Insights is currently out of sync and some dashboards may not be presenting live data.</p>tag:status.happyco.com,2005:Incident/93462402022-02-18T07:55:42Z2022-02-18T07:55:42ZIncreased error rates<p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>07:55</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>07:13</var> UTC</small><br><strong>Monitoring</strong> - The upgrade has been completed and we are monitoring the results.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>07:02</var> UTC</small><br><strong>Update</strong> - Upgrade is in progress - services will be unavailable briefly during this time.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>05:17</var> UTC</small><br><strong>Identified</strong> - We have identified a cause, and have scheduled a priority upgrade at 2:00am EST. During the upgrade, the system will be offline for approximately 15 minutes.</p><p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>21:18</var> UTC</small><br><strong>Investigating</strong> - We are receiving reports of increased error rates across our services. We are currently investigating.</p>tag:status.happyco.com,2005:Incident/81270152021-10-01T09:01:32Z2021-10-01T09:01:32ZReport downloading issues<p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>09:01</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>05:02</var> UTC</small><br><strong>Identified</strong> - We are aware of an issue preventing users from downloading newly created reports. We have determined the cause of the issue and are working on a resolution.<br /><br />Please note that pre-existing reports are unaffected.</p>tag:status.happyco.com,2005:Incident/74458502021-07-09T23:16:39Z2021-07-09T23:16:39ZInsights is experiencing degraded performance<p><small>Jul <var data-var='date'> 9</var>, <var data-var='time'>23:16</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'> 9</var>, <var data-var='time'>17:00</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>19:24</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>19:06</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>18:45</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.happyco.com,2005:Incident/69082062021-05-03T22:28:36Z2021-05-03T22:28:36ZHappyCo Platform Unavailable<p><small>May <var data-var='date'> 3</var>, <var data-var='time'>22:28</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'> 3</var>, <var data-var='time'>21:59</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>May <var data-var='date'> 3</var>, <var data-var='time'>21:47</var> UTC</small><br><strong>Investigating</strong> - Our teams are aware of the issue and are working to restore service as quickly as possible</p>tag:status.happyco.com,2005:Incident/68928982021-05-02T07:26:42Z2021-05-02T07:26:42ZScheduled outage - planned maintenance<p><small>May <var data-var='date'> 2</var>, <var data-var='time'>07:26</var> UTC</small><br><strong>Resolved</strong> - Maintenance has been completed. All services are restored</p><p><small>May <var data-var='date'> 2</var>, <var data-var='time'>07:11</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>May <var data-var='date'> 2</var>, <var data-var='time'>07:10</var> UTC</small><br><strong>Investigating</strong> - HappyCo services are currently down to allow for planned maintenance to be completed. Services will be restored shortly.</p>tag:status.happyco.com,2005:Incident/66607232021-04-01T22:30:00Z2021-04-02T00:25:54ZRealPage integrations are down.<p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>22:30</var> UTC</small><br><strong>Resolved</strong> - This issue has been resolved.</p>tag:status.happyco.com,2005:Incident/66579722021-04-01T19:52:03Z2021-04-01T19:52:03ZYardi integrations are down.<p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>19:52</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>19:37</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>19:15</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Apr <var data-var='date'> 1</var>, <var data-var='time'>18:55</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.happyco.com,2005:Incident/61886462021-02-04T05:08:21Z2021-02-04T05:08:21ZBI database upgrade<p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>05:08</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>05:04</var> UTC</small><br><strong>Verifying</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>05:01</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>02:59</var> UTC</small><br><strong>Scheduled</strong> - We will be upgrading servers to increase capacity. Insights and some dashboards may be unavailable during the maintenance window.</p>tag:status.happyco.com,2005:Incident/60788642021-01-21T17:09:45Z2021-01-21T17:09:45ZUnable to share properties when using business inspection templates<p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>17:09</var> UTC</small><br><strong>Resolved</strong> - Some customers were experiencing issues with templates and are unable to assign business templates to properties.<br /><br />The issue was limited to a small subset of customers with Business Templates enabled.<br /><br />This incident has been resolved. We’ve implemented the solution, and our customers are no longer experiencing this issue.<br /><br />We’re really sorry to have held up customers today!</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>16:31</var> UTC</small><br><strong>Investigating</strong> - Some customers are experiencing issues with global templates and are unable to assign new templates to properties.<br /><br />We're aware of the issue and are working on it urgently.<br /><br />This does not affect any templates that have already been assigned and does not affect creating and completing inspections.<br /><br />We're really sorry to be holding you up today! Please know our teams are working hard to get everything up and running, and we will update you in 1 hour with the latest information.</p>tag:status.happyco.com,2005:Incident/56314702020-11-22T22:31:17Z2020-12-02T04:18:08ZMobile App<p><small>Nov <var data-var='date'>22</var>, <var data-var='time'>22:31</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>22</var>, <var data-var='time'>22:15</var> UTC</small><br><strong>Investigating</strong> - Companies that have been migrated to Global templates are unable to start scheduled inspections on their devices</p>tag:status.happyco.com,2005:Incident/56153902020-11-20T19:14:05Z2020-11-20T19:14:05ZProblem opening inspections in mobile apps<p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>19:14</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>18:23</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>16:08</var> UTC</small><br><strong>Investigating</strong> - A few customers may be unable to open scheduled inspections on their mobile device, receiving an error message: "infrastructure. network error 0"</p>tag:status.happyco.com,2005:Incident/53918242020-10-22T22:46:42Z2020-10-22T22:46:42ZPotential service disruption<p><small>Oct <var data-var='date'>22</var>, <var data-var='time'>22:46</var> UTC</small><br><strong>Resolved</strong> - The service disruption on the HappyCo platform has been resolved.</p><p><small>Oct <var data-var='date'>22</var>, <var data-var='time'>22:46</var> UTC</small><br><strong>Investigating</strong> - We've seen a potential disruption in the HappyCo platform. We're investigating it!</p>tag:status.happyco.com,2005:Incident/49615182020-08-28T22:03:47Z2020-12-01T06:17:26ZPotential service disruption<p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>22:03</var> UTC</small><br><strong>Resolved</strong> - The service disruption on the HappyCo platform has been resolved.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>17:28</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>16:44</var> UTC</small><br><strong>Update</strong> - Dashboards in Happy Manage may not be working</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>16:00</var> UTC</small><br><strong>Investigating</strong> - We've seen a potential disruption in the HappyCo platform. We're investigating it!</p>tag:status.happyco.com,2005:Incident/46867942020-07-23T05:13:05Z2020-07-23T05:13:05ZEmergency infrastructure upgrade<p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>05:13</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>05:12</var> UTC</small><br><strong>Update</strong> - Scheduled maintenance is still in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>05:02</var> UTC</small><br><strong>Update</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>05:01</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>05:01</var> UTC</small><br><strong>Scheduled</strong> - To resolve a performance problem causing degraded performance of the HappyCo system, we will be taking the HappyCo service offline for a short period to improve our infrastructure.</p>tag:status.happyco.com,2005:Incident/39474732020-05-03T23:45:54Z2020-05-03T23:45:54ZDelayed delivery of some email<p><small>May <var data-var='date'> 3</var>, <var data-var='time'>23:45</var> UTC</small><br><strong>Resolved</strong> - This issue is fully resolved.</p><p><small>Apr <var data-var='date'>29</var>, <var data-var='time'>00:13</var> UTC</small><br><strong>Monitoring</strong> - The fix to the root cause has been deployed, and this will be monitored over the next week to ensure that no further issues arise.</p><p><small>Apr <var data-var='date'>24</var>, <var data-var='time'>22:00</var> UTC</small><br><strong>Update</strong> - The root cause has been identified and a fix will be rolled out soon. In the meantime the backup solution is being monitored to ensure email operations contribute as normal.</p><p><small>Apr <var data-var='date'>24</var>, <var data-var='time'>01:51</var> UTC</small><br><strong>Identified</strong> - Emails are now being processed and sent out. We are investigating the root cause of issue.</p><p><small>Apr <var data-var='date'>23</var>, <var data-var='time'>20:07</var> UTC</small><br><strong>Investigating</strong> - We are investigating the issue.</p>tag:status.happyco.com,2005:Incident/23231682019-04-11T20:36:49Z2019-04-11T20:36:49ZTemporary outage<p><small>Apr <var data-var='date'>11</var>, <var data-var='time'>20:36</var> UTC</small><br><strong>Resolved</strong> - 20 minutes down - error connecting to primary database</p>tag:status.happyco.com,2005:Incident/22145312019-02-19T17:18:19Z2019-02-19T17:18:19ZTemporary Outage<p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>17:18</var> UTC</small><br><strong>Resolved</strong> - We had a temporary outage this morning due to a database issue. It has been resolved.</p>tag:status.happyco.com,2005:Incident/17654172018-06-11T18:22:48Z2018-06-11T18:22:48ZIntermittent issues with integrations<p><small>Jun <var data-var='date'>11</var>, <var data-var='time'>18:22</var> UTC</small><br><strong>Resolved</strong> - Issue has now been resolved</p><p><small>Jun <var data-var='date'>11</var>, <var data-var='time'>18:00</var> UTC</small><br><strong>Monitoring</strong> - Engineering have have applied a fix and we are now monitoring all integrations</p><p><small>Jun <var data-var='date'>11</var>, <var data-var='time'>17:30</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating reports of issues with some of our integrations. We will update as more information available.</p>tag:status.happyco.com,2005:Incident/16320542018-03-07T19:13:47Z2018-03-07T19:13:47ZGray screen appearing on login to management portal<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>19:13</var> UTC</small><br><strong>Resolved</strong> - Roughly a 5 minute outage due to an incorrect deployment</p>