I Made 4 LLMs Argue With Each Other to Write Better Runbooks. Here's What Happened.

I Made 4 LLMs Argue With Each Other to Write Better Runbooks. Here's What Happened.

A single LLM writing a production runbook is like asking one engineer to design, review, and approve their own code. It works. Sometimes. But the failure mode is silent: confident-sounding instructions that miss edge cases, skip the rollback step, or hallucinate a flag that doesn't exist. I spent the last few months building an alternative for RunDoc, the SaaS I run for generating runbooks and SOPs. I call it the AI Council: four LLMs generate t…