ScootKit - Notice history

Bot-Host #3 experiencing major outage

SCNX

Operational

SCNX Frontend - Operational

100% - uptime
Jul 2024 · 100.00%Aug · 100.00%Sep · 100.00%
Jul 2024
Aug 2024
Sep 2024

SCNX Backend - Operational

100% - uptime
Jul 2024 · 100.00%Aug · 100.00%Sep · 99.588%
Jul 2024
Aug 2024
Sep 2024

SCNX Bot-Manager - Operational

100% - uptime
Jul 2024 · 100.00%Aug · 100.00%Sep · 100.00%
Jul 2024
Aug 2024
Sep 2024

SCNX Image Generation API - Operational

SCNX Documentation - Operational

SCNX RSS Hub - Operational

ScootKit

Operational

ScootKit Website - Operational

100% - uptime
Jul 2024 · 100.00%Aug · 99.973%Sep · 100.00%
Jul 2024
Aug 2024
Sep 2024

ScootKit Discord Support System ("DingBot") - Operational

ScootKit Support System - Operational

ScootKit Analytics - Operational

ScootKit Mail - Operational

scootk.it URL Shortener - Operational

ScootKit Issue Reporting - Operational

ScootKit Translations - Operational

Third Parties

Operational

Discord API - Operational

Stripe API - Operational

OpenAI API - Operational

Cloudflare Pages - Operational

Cloudflare CDN - Operational

Notice history

Sep 2024

Issues with multiple servers
  • Resolved
    Resolved

    We've restored full functionality of all services.

  • Monitoring
    Monitoring

    Bot-Host #11 has been restored, and we're monitoring the situation and rolling back the emergency patch to restore full functionality.

  • Identified
    Update

    All other Bot-Hosts except Bot-Host #11 are reachable again. We're still working on this situation and are waiting for our hosting provider to address the issues affecting Bot-Host #11.

  • Identified
    Update

    Our hosting provider has restored access to "some servers", including Bot-Host #1 and some core components.

    Due to the emergency patch being applied, Early Access continues to be unavailable for now.

    Additionally, some internal services, such as our mailserver, can be reached again.

  • Identified
    Update

    Bots that aren't on any affected server can now be started again thanks to an emergency patch. Please note that Early Access features are temporarily not available due to the mentioned core component failure.

  • Identified
    Update

    We're restoring access to SCNX and have updated internal systems to ensure that the failed core component won't impact data integrity. Certain features, such as dcserver.link configurability can't be used due to the failed core component.

    Meanwhile, our hosting provider didn't share any new details regarding their "cooling issues".

  • Identified
    Update

    We've received reports that due to core infrastructure being affected on at least on of the servers, using SCNX might lead to messages being overwritten by corrupt values, leading to issues in the future. In the interest of data integrity, we've blocked SCNX access for now, while we wait for our hosting provider to resolve this issue.

    We've identified some of these components as possible single points of failure in the past and took measures to prevent such failure, but our investigation shows that one core component used to delivery experiments can cause SCNX to assume a state that is incompatible with data written by a newer state released using the experiment service.

  • Identified
    Update

    We've discovered that due to a core system being located on at least one of the affected servers, restarting your bot will lead to your bot being offline. Stopped bots can't be started and restarts will lead to temporarily making your bot offline.

    Avoid restart your bots. Bots can't be started until this incident has been resolved, spamming the restart button doesn't change this unfortunately.

  • Identified
    Identified

    Our hosting provider has confirmed that this issue is caused by an "unexpected cooling issue" and they are actively working on resolving this as soon as possible. This incident is outside of our control.

    Please note that only services marked red on status.scootkit.net are affected, other Bot-Hosts are not affected. Do not switch Bot-Hosts while this incident is ongoing to avoid corruption of your bot files.

  • Investigating
    Investigating

    Our hosting provided has issues with servers hosted in their Nürnberg location. We're working with them to resolve these issues, but this situation is outside of our control.

    This incident affects customer experiences and bots hosted on the Bot-Hosts listed below. No premium Bot-Hosts are affected.

    Due to this issue, the initial loading time of SCNX is increased by a few seconds, please be patient.

    E-Mails and online Forms sent to ScootKit might not be delivered correctly, please resend them if you are instructed to do so by your email provider.

Aug 2024

Bank transfers failing
  • Resolved
    Resolved

    Our payment provider has confirmed that this issue has been resolved and bank transfers should not fail anymore.

  • Investigating
    Update

    We're still waiting for our payment provider to resolve this issue. For now, we ask customers who have failing payments to message our billing customer support on https://scnx.app/help to receive alternative payment details until this issue has been resolved. Before contacting us, make sure your bank transfer actually fails, some customers report being able to pay via Bank Transfer without issues.

  • Investigating
    Update

    We're still in "talks" (also called spending time on hold) with our payment provider. For now, we do not accept new bank transfer payments and subscription requests. We're doing our best and considering other options for now, for affected customers, we'll be able to share a solution in the next few days. If your subscription gets canceled due to this issue, please contact us so we can extend your subscription time while we work on this issue.

  • Investigating
    Investigating

    We're received multiple reports that payments using bank transfer are being returned to the account holder due to "Incorrect banking details". We're working with our payment provider to investigate this and apologize for the issues. We'll reach out to affected customers once we've fixed this issue.

Jul 2024

Jul 2024 to Sep 2024

Next