Context:
https://old.reddit.com/r/sysadmin/comments/9si6r9/postmortem...
Thanks! After reading both reddit posts, I would love for someone to deep dive into how this was possible.
Previous discussion, https://news.ycombinator.com/item?id=41634119