tag:worqhat-status.statuspage.io,2005:/historyWorqHat Status - Incident History2024-03-04T00:54:01+05:30WorqHattag:worqhat-status.statuspage.io,2005:Incident/173665872023-06-01T17:25:51+05:302023-06-01T17:25:51+05:30Major Outage on Playground Access<p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>17:25</var> IST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'>27</var>, <var data-var='time'>14:21</var> IST</small><br><strong>Monitoring</strong> - A fix has been implemented and rolled out to a few users. We are monitoring this issue before rolling it out completely.</p><p><small>May <var data-var='date'>26</var>, <var data-var='time'>13:15</var> IST</small><br><strong>Identified</strong> - We have identified the cause behind the ongoing issues experienced on WorqHat Playground. The problem stems from the improper format of our API triggers, resulting in invalid responses and, in some cases, garbage outputs. Our team is actively investigating and working towards resolving this matter.</p><p><small>May <var data-var='date'>25</var>, <var data-var='time'>21:21</var> IST</small><br><strong>Investigating</strong> - All Requests on WorqHat playground is currently returning invalid responses and in most cases returning Garbage Outputs. We are trying our best to identify the reasons behind the issues. Please bear with us as we try our best to scale our Systems.</p>tag:worqhat-status.statuspage.io,2005:Incident/166873332023-03-29T20:26:14+05:302023-03-29T20:26:14+05:30AI Model is Unable to Accept Accurate Questions<p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>20:26</var> IST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>19:34</var> IST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>19:09</var> IST</small><br><strong>Identified</strong> - The Issue has been identified and we are rolling out features and corrections.</p>tag:worqhat-status.statuspage.io,2005:Incident/164451792023-03-11T23:34:51+05:302023-03-11T23:34:51+05:30Updating Application and AI Features to Add Advanced Voice Recognitions<p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>23:34</var> IST</small><br><strong>Completed</strong> - The scheduled Maintenance and Feature Updates have been completed.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>23:27</var> IST</small><br><strong>Verifying</strong> - We have deployed the Updates. We are verifying our changes to make sure everything is running properly.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>23:00</var> IST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>22:54</var> IST</small><br><strong>Scheduled</strong> - We are currently updating our application and AI features to incorporate advanced voice recognitions. This will improve the overall user experience and help us serve you better. During this maintenance period, some features of the application might not be available. We apologize for the inconvenience caused and appreciate your patience. Thank you for using our application.</p>tag:worqhat-status.statuspage.io,2005:Incident/163741962023-03-07T17:58:45+05:302023-03-07T17:58:45+05:30Unable to Create Responses<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>17:58</var> IST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>17:55</var> IST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>17:42</var> IST</small><br><strong>Investigating</strong> - Our AI Models have been replying with a Standard "Unable to Respond" due to server-side errors.</p>tag:worqhat-status.statuspage.io,2005:Incident/163565532023-03-07T01:35:49+05:302023-03-07T01:35:49+05:30Mixed up responses while answering<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>01:35</var> IST</small><br><strong>Resolved</strong> - We are pleased to inform you that all issues affecting our AI Platforms have been resolved. After extensive investigation and testing, our engineering team has successfully restored full functionality to all systems.<br /><br />We apologize for any inconvenience this may have caused and thank you for your patience as we worked to resolve these issues. As always, we remain committed to providing you with the best possible service and support.<br /><br />Please do not hesitate to contact us if you have any questions or concerns. We appreciate your business and look forward to continuing to serve you.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>01:26</var> IST</small><br><strong>Monitoring</strong> - We're happy to inform you that the issue with users getting mixed up on the server has been resolved. The problem was related to the common dataset mechanism used for user queries, which was causing conflicts and confusion among users.<br /><br />To fix this issue, we have implemented a new dataset mechanism that ensures that user queries are now properly segregated, so there will be no more conflicts or mix-ups. We understand the inconvenience caused by this outage and want to assure you that we take these issues seriously and are committed to ensuring a stable and reliable service for our users.<br /><br />Rest assured that we are monitoring this issue closely, and will provide further updates if necessary. Thank you for your understanding and patience while we worked to resolve this issue. If you continue to experience any problems or have any questions, please reach out to our support team for assistance.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>00:15</var> IST</small><br><strong>Update</strong> - We are implementing a major fix for this issue and we expect the Models to not work for a few users as we roll out the changes.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>23:39</var> IST</small><br><strong>Identified</strong> - We are happy to inform you that our team has successfully identified the issue that has been causing our AI models to provide answers on unrelated topics. We apologize for any inconvenience this may have caused and would like to take this opportunity to thank you for your patience while we worked to resolve this issue.<br /><br />Our team is now working on implementing a fix, which will ensure that our models provide accurate and relevant responses in all cases. We expect that this fix will be implemented within the next few hours and will update you as soon as we have confirmation that it has been deployed.<br /><br />Once again, we apologize for any inconvenience this may have caused and appreciate your understanding and support during this time.<br /><br />If you have any questions or concerns, please do not hesitate to reach out to our support team.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>23:06</var> IST</small><br><strong>Investigating</strong> - We regret to inform you that we have received reports of our AI models providing answers on topics that are apart from the questions asked. We apologize for any confusion, frustration or inconvenience this has caused. Our team is currently investigating the cause of this issue and working on a fix to ensure that our models provide accurate and relevant responses.<br /><br />During this period, you may experience some performance issues across our models, but rest assured that we are working hard to address this problem as soon as possible. We appreciate your patience and understanding while we work to resolve this matter.<br /><br />If you have any further concerns or questions, please do not hesitate to reach out to our support team for assistance.</p>tag:worqhat-status.statuspage.io,2005:Incident/163152332023-03-04T01:16:09+05:302023-03-04T01:16:09+05:30Major Outage on all AI Based Models<p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>01:16</var> IST</small><br><strong>Resolved</strong> - The Incident has been resolved.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>13:15</var> IST</small><br><strong>Monitoring</strong> - A fix has been implemented and is being monitored for failures closely.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>21:12</var> IST</small><br><strong>Identified</strong> - We have identified an issue with a malformed function in our AI Process Servers. We are currently investigating the issue and will keep you updated on our progress. We apologize for any inconvenience caused.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>21:04</var> IST</small><br><strong>Investigating</strong> - We are currently experiencing a major outage on all AI Models and Playground services. We are working to investigate the root cause of the issue and are taking steps to restore the services as soon as possible. We apologize for any inconvenience caused and will keep you updated on our progress.</p>tag:worqhat-status.statuspage.io,2005:Incident/162175402023-02-21T17:22:21+05:302023-02-21T17:22:21+05:30Outage on All API Models<p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>17:22</var> IST</small><br><strong>Resolved</strong> - The Incident has been resolved. All AI Models have been restored to functionality.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>16:49</var> IST</small><br><strong>Monitoring</strong> - A fix has been implemented and the services are beginning to recover. The services and their responses are being monitored.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>15:27</var> IST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue. The classification and sorting models are functional. Generational and Transformational Models are still facing issues.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>14:58</var> IST</small><br><strong>Identified</strong> - We have identified the root cause and are working to recover temporary service.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>13:41</var> IST</small><br><strong>Investigating</strong> - We're currently experiencing an elevated level of API errors across all systems of Generation, Classification and Transformation. We are currently looking into the issue.</p>tag:worqhat-status.statuspage.io,2005:Incident/159355882023-01-26T02:19:59+05:302023-01-26T02:19:59+05:30Restricted Access to Site Resources due to Scheduled Maintenance<p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>02:19</var> IST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>02:08</var> IST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>02:08</var> IST</small><br><strong>Investigating</strong> - We will be performing scheduled maintenance on WorqHat Careers Services on 26th January from 2:00 AM IST to 4:00 AM IST. During this time, users can expect a lag in response and slow and non-responsive websites.</p>