tag:status.obkio.com,2005:/historyObkio Status - Incident History2024-03-29T01:22:41-04:00Obkiotag:status.obkio.com,2005:Incident/192426172023-12-06T19:37:05-05:002023-12-06T19:37:05-05:00Scheduled Database Maintenance<p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>19:37</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>18:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>09:43</var> EST</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p>tag:status.obkio.com,2005:Incident/179225122023-07-27T18:43:36-04:002023-07-27T18:43:36-04:00Scheduled reboot on Virtual Appliance and X1001 hardware agents<p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>18:43</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>18:32</var> EDT</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>18:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>21</var>, <var data-var='time'>09:43</var> EDT</small><br><strong>Scheduled</strong> - In order to keep its agents up to date, Obkio will be undergoing scheduled maintenance during this time. X1001 hardware and Virtual Appliance (VMware and Hyper-V) agents will be rebooted to apply an update. Other types of agent are not affected by this maintenance. Customers using these types of agents should expect a cut of less than 10 minutes in data collection during the maintenance.</p>tag:status.obkio.com,2005:Incident/175628622023-06-13T17:21:14-04:002023-06-13T17:21:14-04:00Obkio Service Disruptions<p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>17:21</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>17:15</var> EDT</small><br><strong>Update</strong> - The services seem to be back to normal. Backfilling data is completed and all the information is available in our web and mobile applications. We are continuing to monitor for any further issues.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>16:47</var> EDT</small><br><strong>Monitoring</strong> - We are beginning to see improvement in the service recovery. Some clients might be able to access their information and performance metrics are starting to be backfilled. More updates to come.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>16:41</var> EDT</small><br><strong>Update</strong> - We continue monitoring the ongoing AWS outage and will keep you posted here.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>15:55</var> EDT</small><br><strong>Update</strong> - The AWS incident is still ongoing, but we’re monitoring the situation. The web application might show empty pages, but don’t worry, the information will be available, once the incident is resolved. Also, your Obkio agents are still collecting network performance metrics at the moment.<br /><br />We will continue to provide timely updates through this status page as new information becomes available. Our support team remains ready to assist you and answer any questions or concerns you may have during this period.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>15:14</var> EDT</small><br><strong>Identified</strong> - We regret to inform you that our services are currently experiencing difficulties due to ongoing disruptions with Amazon Web Services (AWS). This disruption is affecting various aspects of our application. Our engineering team is collaborating with AWS to minimize the impact and restore normal operations at the earliest.<br /><br />We understand the inconvenience caused by this disruption, and we apologize for any disruption to your workflow or business operations. We will continue to provide regular updates through this status page as new information becomes available. Our support team is also on standby to address any concerns or queries you may have. Please reach out to our support channels for assistance.</p>tag:status.obkio.com,2005:Incident/173405492023-06-05T19:41:43-04:002023-06-05T19:41:43-04:00OS upgrade on hardware agents<p><small>Jun <var data-var='date'> 5</var>, <var data-var='time'>19:41</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'> 5</var>, <var data-var='time'>18:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>23</var>, <var data-var='time'>08:36</var> EDT</small><br><strong>Scheduled</strong> - In order to keep its hardware agents up to date, Obkio will be undergoing scheduled maintenance during this time. All models of hardware agent will be upgraded, except the X1001. Customers should expect a cut of 10 minutes in data collection during the maintenance.</p>tag:status.obkio.com,2005:Incident/166625862023-04-03T18:39:13-04:002023-04-03T18:39:13-04:00Scheduled Database Maintenance<p><small>Apr <var data-var='date'> 3</var>, <var data-var='time'>18:39</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Apr <var data-var='date'> 3</var>, <var data-var='time'>18:38</var> EDT</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Apr <var data-var='date'> 3</var>, <var data-var='time'>18:01</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>09:12</var> EDT</small><br><strong>Scheduled</strong> - Database will be upgraded. During the maintenance, the App will be unavailable.</p>tag:status.obkio.com,2005:Incident/160795752023-02-09T13:25:27-05:002023-02-09T13:25:27-05:00AWS Public agent EU-WEST-3 (Paris) is not available<p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>13:25</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>13:11</var> EST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>13:04</var> EST</small><br><strong>Identified</strong> - The AWS Obkio public agent EU-WEST-3 (Paris) is currently unavailable. All sessions related with this public agent are down at the moment. The issue has been identified and the team is working to bring back online this agent as soon as possible.</p>tag:status.obkio.com,2005:Incident/155792192023-01-09T20:58:34-05:002023-01-09T20:58:34-05:00Scheduled Database Maintenance<p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>20:58</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>20:46</var> EST</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>20:01</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'>19</var>, <var data-var='time'>10:20</var> EST</small><br><strong>Scheduled</strong> - Database will be upgraded. During the maintenance, services will be unavailable.</p>tag:status.obkio.com,2005:Incident/110899002022-09-09T15:22:40-04:002022-09-09T15:22:40-04:00Elevated API Errors<p><small>Sep <var data-var='date'> 9</var>, <var data-var='time'>15:22</var> EDT</small><br><strong>Resolved</strong> - The AWS issue has been fixed.</p><p><small>Sep <var data-var='date'> 9</var>, <var data-var='time'>11:37</var> EDT</small><br><strong>Identified</strong> - We're experiencing an elevated level of API errors to some AWS services in region us-east-1. This issue has been confirmed by AWS and they are working on it.</p>tag:status.obkio.com,2005:Incident/110215292022-09-07T19:24:43-04:002022-09-07T19:24:43-04:00Agent Software Maintenance<p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>19:24</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>18:01</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>19:38</var> EDT</small><br><strong>Scheduled</strong> - Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes. For hardware and virtual appliance agents, the downtime might be a few minutes longer if an OS upgrade is required.</p>tag:status.obkio.com,2005:Incident/110177892022-08-30T11:19:56-04:002022-08-30T11:19:56-04:00App Login Issues<p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>11:19</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved. Make sure to reload the Web App page if the issue is still present.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>11:03</var> EDT</small><br><strong>Update</strong> - The issue is fixed for most users. Another small fix will be deployed in 15-20 minutes.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>09:59</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>09:07</var> EDT</small><br><strong>Investigating</strong> - Some users have issues login into the App. The team is working on it.</p>tag:status.obkio.com,2005:Incident/107535932022-08-03T12:17:37-04:002022-08-03T12:17:37-04:00Issues with Public Agent Azure - US West (California)<p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>12:17</var> EDT</small><br><strong>Resolved</strong> - The agent is back online. A new VM has been provisioned and the IP address changed.</p><p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>12:16</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>12:15</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>12:03</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating issues with Public Agent Azure - US West (California).</p>tag:status.obkio.com,2005:Incident/106696452022-07-27T19:39:05-04:002022-07-27T19:39:05-04:00Agent Software Maintenance<p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>19:39</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>18:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>22</var>, <var data-var='time'>11:02</var> EDT</small><br><strong>Scheduled</strong> - Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes. For hardware and virtual appliance agents, the downtime might be a few minutes longer if an OS upgrade is required.</p>tag:status.obkio.com,2005:Incident/102825412022-06-14T11:15:22-04:002022-06-14T11:15:22-04:00App Login Issues<p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>11:15</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>11:09</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>10:41</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>09:23</var> EDT</small><br><strong>Investigating</strong> - Some users have issues login into the App. The team is working on it.</p>tag:status.obkio.com,2005:Incident/99505722022-05-11T19:26:16-04:002022-05-11T19:26:16-04:00Agent Software Maintenance<p><small>May <var data-var='date'>11</var>, <var data-var='time'>19:26</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>May <var data-var='date'>11</var>, <var data-var='time'>18:01</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'> 9</var>, <var data-var='time'>10:46</var> EDT</small><br><strong>Scheduled</strong> - Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes. For hardware and virtual appliance agents, the downtime might be a few minutes longer if an OS upgrade is required.</p>tag:status.obkio.com,2005:Incident/96667872022-04-05T19:28:16-04:002022-04-05T19:28:16-04:00Agent Software Maintenance<p><small>Apr <var data-var='date'> 5</var>, <var data-var='time'>19:28</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Apr <var data-var='date'> 5</var>, <var data-var='time'>18:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>08:48</var> EDT</small><br><strong>Scheduled</strong> - Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes.</p>tag:status.obkio.com,2005:Incident/95016152022-03-09T16:46:38-05:002022-03-09T16:46:38-05:00Alert Email Notifications Incident<p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>16:46</var> EST</small><br><strong>Resolved</strong> - The AWS outage has been resolved and email notifications should no longer be affected.</p><p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>16:03</var> EST</small><br><strong>Investigating</strong> - Alert email notifications are currently affected by an AWS outage. We are closely monitoring the situation.</p>tag:status.obkio.com,2005:Incident/94627102022-03-07T18:59:42-05:002022-03-07T18:59:42-05:00Windows Agent Software Maintenance<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>18:59</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>18:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>12:12</var> EST</small><br><strong>Scheduled</strong> - Windows Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes</p>tag:status.obkio.com,2005:Incident/93133392022-02-16T19:30:59-05:002022-02-16T19:30:59-05:00Agent Software Maintenance<p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>19:30</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>18:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>09:54</var> EST</small><br><strong>Scheduled</strong> - Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes. For hardware and virtual appliance agents, the downtime might be a few minutes longer if an OS upgrade is required.</p>tag:status.obkio.com,2005:Incident/92039202022-02-07T18:22:53-05:002022-02-07T18:22:53-05:00Agent Software Maintenance<p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>18:22</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>18:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>31</var>, <var data-var='time'>10:46</var> EST</small><br><strong>Scheduled</strong> - Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes. For hardware and virtual appliance agents, the downtime might be a few minutes longer if an OS upgrade is required.</p>tag:status.obkio.com,2005:Incident/87818292021-12-07T19:21:38-05:002021-12-07T19:21:38-05:00Elevated API Errors<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>19:21</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>18:45</var> EST</small><br><strong>Monitoring</strong> - We are seeing significant recovery of our services and we are monitoring the situation.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>15:36</var> EST</small><br><strong>Update</strong> - There is still an outage at AWS. The latest status is available on their status page: https://status.aws.amazon.com</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>11:15</var> EST</small><br><strong>Identified</strong> - Some API calls to AWS Cloud are failing which result in errors inside the App. This is related to a possible outage inside AWS Cloud region us-east-1.</p>tag:status.obkio.com,2005:Incident/85601912021-11-17T20:45:55-05:002021-11-17T20:45:55-05:00Scheduled Database Maintenance<p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>20:45</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>20:36</var> EST</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>20:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>17</var>, <var data-var='time'>11:59</var> EST</small><br><strong>Scheduled</strong> - During the maintenance, services will be unavailable.</p>tag:status.obkio.com,2005:Incident/83396052021-10-28T18:15:41-04:002021-10-28T18:15:41-04:00Public Monitoring Agent Maintenance - Azure Canada East (Quebec City)<p><small>Oct <var data-var='date'>28</var>, <var data-var='time'>18:15</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>28</var>, <var data-var='time'>18:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>28</var>, <var data-var='time'>09:03</var> EDT</small><br><strong>Scheduled</strong> - The Public Monitoring Agent "Azure Canada East (Quebec City)" will be under maintenance for hardware upgrade. No data will be collected during the maintenance. The maintenance should last only a few minutes.</p>tag:status.obkio.com,2005:Incident/82639762021-10-27T20:44:06-04:002021-10-27T20:44:06-04:00Scheduled Database Maintenance<p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>20:44</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>20:32</var> EDT</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>20:02</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>19</var>, <var data-var='time'>08:33</var> EDT</small><br><strong>Scheduled</strong> - Database will be upgraded to the latest stable release. During the maintenance, services will be unavailable.</p>tag:status.obkio.com,2005:Incident/74261422021-07-13T19:15:20-04:002021-07-13T19:15:20-04:00Agent Software Maintenance<p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>19:15</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>18:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>11:11</var> EDT</small><br><strong>Scheduled</strong> - Agents will be upgraded to the latest stable software release. During the maintenance, network measurements will be lost and users will see holes in the graphs for a few minutes. For hardware and virtual appliance agents, the downtime might be a few minutes longer if an OS upgrade is required.</p>tag:status.obkio.com,2005:Incident/74364382021-07-07T12:55:00-04:002021-07-07T12:59:19-04:00Obkio Vision Beta Update Failure<p><small>Jul <var data-var='date'> 7</var>, <var data-var='time'>12:55</var> EDT</small><br><strong>Resolved</strong> - Today (2021-07-07) between 12:49PM and 12:53PM EDT (GMT-0400), an update of Obkio Vision Beta caused issues with the agent software. Everything is back to normal now.</p>