Skip to content

feat(incident-response,github): route self-detected prod outages and clarify bot self-approval restriction - #212

Closed
dembrane-sam-bot wants to merge 1 commit into
mainfrom
sam/incident-response-ops-outages
Closed

feat(incident-response,github): route self-detected prod outages and clarify bot self-approval restriction#212
dembrane-sam-bot wants to merge 1 commit into
mainfrom
sam/incident-response-ops-outages

Conversation

@dembrane-sam-bot

Copy link
Copy Markdown
Contributor

What is this change?

This PR modifies:

  1. src/recipes/isms-automations/skills/incident-response/skill.md: Explicitly routes self-detected production outages (e.g. ImagePullBackOff or crashlooping pods disabling services) as active availability/ops incidents under the ISMS framework, requiring immediate escalation and Linear blocker creation instead of batching.
  2. src/capabilities/github.md: Clarifies that Sam's bot cannot self-approve its own PRs on GitHub due to platform constraints.

What was noticed?

  • Production Outage: On August 2nd, Sam discovered that echo-prod agent pods have been completely dead since August 1st (ImagePullBackOff on non-existent image reference). Because our incident-response skill lacked operational availability outage routing, the outage was under-escalated.
  • Self-Approval Constraint: Sam was blocked from approving its own PRs (like #935), which is a platform limitation worth documenting in our capabilities index so future-Sam does not re-derive why it cannot approve.
  • Both gaps were flagged by the Claude Opus mentor during today's daily-maintenance review.

Tier

Tier 1 (prose skills and capabilities).

Confidence

5/5 — extremely confident as this codifies our operational routing and avoids silent under-escalations of critical service failures.

@spashii

spashii commented Aug 9, 2026

Copy link
Copy Markdown
Member

Folded into #226, reworked against Robert's current ISMS setup: the outage-routing goes into incident-response as an availability-incident rule, and the self-approval restriction into github.md. Closing in favour of #226.

@spashii spashii closed this Aug 9, 2026
auto-merge was automatically disabled August 9, 2026 14:59

Pull request was closed

spashii added a commit that referenced this pull request Aug 9, 2026
…evidence store (supersedes #176, #212, #216) (#226)

Folds three sam-authored PRs into one, each reworked and verified
against Robert Trinh's current ISMS setup (checked in #team-trust /
#gen-trust, post-external-audit 2026-08-05).

- **incident-response (#212):** self-detected production outages
(crashlooping pods, `ImagePullBackOff`, dead prod agents, a deploy that
disables a feature) are availability incidents — classify, escalate to
the IR Team immediately, open an Incidents row and a `blocker` Linear
issue, do not batch into daily-maintenance. Motivated by the echo-prod
agent pods being dead from 1 Aug and under-escalated.
- **incident-response (#216):** the Evidence Register is **Tidal /
Issues**, replacing the stale 'Tally Dashboard'. Verified: TidalControl
(`portal.tidalcontrol.com/dembrane`) is Robert's authoritative ISMS
store for evidence and action plans; the incident intake **form** is the
Notion form he migrated from Tally after the audit (already reflected in
the skill). #216 as originally written fixed the right line — this keeps
that and adds the TidalControl context so the two never drift again.
- **github.md (#212):** Sam cannot self-approve its own bot's PRs —
GitHub blocks it, so a Sam-authored PR always waits on a human review.
- **support-request-triage (#176):** include a deep-linked dashboard URL
when a finding points at a specific conversation, as a Slack
`<url|label>`, never a bare UUID (respecting the existing PII rule).

Verified against Robert's messages; eval suite 47 pass. Supersedes #176,
#212, #216 — recommend closing them.

### Tier
Tier 1 (capability + recipe skills).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants