Vitec Raisoft - Issues with customer sites in Finland – Incident details

Issues with customer sites in Finland

Resolved
Major outage
Started 11 days agoLasted about 3 hours

Affected

Finland (FIP)

Major outage from 12:52 PM to 2:00 PM, Operational from 2:00 PM to 2:22 PM, Major outage from 2:22 PM to 3:39 PM

Customer sites

Major outage from 12:52 PM to 2:00 PM, Operational from 2:00 PM to 2:22 PM, Major outage from 2:22 PM to 3:39 PM

Integrations

Major outage from 12:52 PM to 2:00 PM, Operational from 2:00 PM to 2:22 PM, Major outage from 2:22 PM to 3:39 PM

Updates
  • Postmortem
    Postmortem

    Our service provider has provided a root cause analysis of the incident.

    Two redundant network connections in separate locations failed within a short period. The first connection went down at 14:55, and before it was restored, the second connection failed at 15:41, resulting in a temporary loss of connectivity to our service.

    Connectivity was restored at 17:31 by activating an additional backup connection. The original connections were also restored later that evening, returning the environment to its normal, fully redundant state.

  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    The service provider has restored connectivity by successfully establishing a third route alongside the two previously impacted paths, adding important redundancy and improving overall network resilience.

    We will monitor the situation for a while to ensure that the connections stay up.

  • Update
    Update

    The service provider is still working on the issue and also trying to implement a workaround solution to restore connectivity.

  • Identified
    Identified

    We have identified the issue. Our upstream internet connections are down and our service provider is working on it.

  • Investigating
    Investigating
    We are currently investigating this incident.