resolvedINC-0031

Box unreachable for 3h 40m

The storage volume behind box filled up. Uploads and downloads failed with 500s; clips couldn't save new replays and the home page's box card errored.

startedAug 3, 23:12endedAug 4, 02:52duration3h 40m

Affected

boxdown

clipsdegraded

kenn.prodegraded

Cause

A parser bug in clips wrote demo files to box in a loop, filling the 200 GB volume in ~40 minutes. There was no quota alert, so the first signal was the outage itself.

Fix

Loop fixed, orphaned files purged, volume alerts at 80 / 90 / 95% added, and box now refuses writes at 97% instead of falling over.

← All incidents