ViiBE inaccessible

Incident Report for Viirtue

Postmortem

During a routine Kubernetes cluster upgrade activity, a critical workload dependency impacting RabbitMQ availability failed to initialize successfully. Investigation determined the issue was caused by the removal of an upstream container image from Docker Hub, preventing the cluster from pulling the required image during workload startup.

The issue was identified quickly, and service was restored by updating the workload configuration to reference an alternate trusted image source containing the same image artifact. Total impact duration was minimal, and no data loss occurred.

This incident highlighted a broader software supply chain dependency risk associated with externally hosted container images. As a result, we are reviewing additional safeguards around image provenance, availability, and internal artifact mirroring to further reduce exposure to upstream registry changes.

Posted May 16, 2026 - 12:46 EDT

Resolved

This incident has been resolved.
Posted May 16, 2026 - 12:40 EDT

Identified

The issue has been identified and a fix is being implemented.
Posted May 16, 2026 - 12:37 EDT

Investigating

We are currently investigating this issue.
Posted May 16, 2026 - 12:14 EDT
This incident affected: ViiBE.