Skip to content

STAC-25565 Port the beest verification trigger to GitHub Actions - #458

Open
LouisParkin wants to merge 4 commits into
stackstate-7.78.2from
STAC-25565-beest-verification
Open

STAC-25565 Port the beest verification trigger to GitHub Actions#458
LouisParkin wants to merge 4 commits into
stackstate-7.78.2from
STAC-25565-beest-verification

Conversation

@LouisParkin

@LouisParkin LouisParkin commented Aug 10, 2026

Copy link
Copy Markdown

Ports the last unported GitLab job, beest_trigger_verification. Every other GitLab job now has a GitHub equivalent.

Manual (workflow_dispatch) only, matching the GitLab job, which was when: manual. Mints a short-lived App token scoped to actions: write on beest alone, then dispatches agent-x86.yml / arm.yml.

Pins the exact agent commit. A branch builds many images with different hashes, so sending only the branch would force every run onto whichever build is newest, with no way to verify a specific commit or reproduce a failure against the image that produced it. Defaults to this run's SHA, matching the GitLab job's CI_COMMIT_SHA. If agent_branch_under_test names a different branch, our SHA does not exist there, so the pin is left unset and beest falls back rather than dispatching a hash that resolves to nothing.

An earlier revision of this PR sent the branch only and put the SHA in the run summary, claiming beest had no hash input. That was wrong — beest's own GitLab port had dropped the input while keeping all the machinery behind it. Depends on StackVista/beest#61, which restores it; until that merges the agent_hash_under_test field will be rejected by beest.

Admin ask (blocking a live run): needs BEEST_DISPATCH_APP_CLIENT_ID (var) and BEEST_DISPATCH_APP_PRIVATE_KEY (secret) on this repo, for an App with actions: write on beest. beest's own credential is repo-level there and not reachable from here.

Base branch: stackstate-7.78.2 rather than the #444 stack. It shares no files or jobs with the build lanes and is manual-only, so it cannot affect any push/PR pipeline and need not queue behind those reviews. Trivial to retarget if preferred.

Dispatch logic tested against a mock gh across the pin default, branch-override, explicit-hash, both-suites and invalid-suite paths. actionlint and zizmor clean.

LouisParkin and others added 4 commits August 10, 2026 10:03
beest_trigger_verification was the last job in the GitLab pipeline with
no GitHub Actions equivalent. Every other job is covered by the
STAC-25142 / STAC-25457 / STAC-25500 stack.

In GitLab the job sits in the postbuild stage, needs both
merge_docker_manifest jobs and is `when: manual`, passing
AGENT_BRANCH_UNDER_TEST, AGENT_HASH_UNDER_TEST and
TRIGGER_AGENT_X86_TESTS into the stackvista/integrations/beest project.

beest has since migrated to GitHub, and its agent-x86.yml and arm.yml
both expose workflow_dispatch with an agent_branch_under_test input, so
the port is a cross-repo workflow dispatch rather than a pipeline
trigger. beest resolves the agent image from the branch name, so the
commit SHA is no longer part of its input contract; it is recorded in
the run summary for traceability instead.

Keeping the workflow workflow_dispatch-only preserves the GitLab
`when: manual` semantics. These runs provision real EKS infrastructure
in the sandbox account and share a single global concurrency lock in
beest, so firing them automatically on push would queue runs behind each
other and spend hours of cluster time per merge.

The suite input defaults to x86, matching TRIGGER_AGENT_X86_TESTS: true;
arm and both are available because beest now exposes an arm workflow that
the GitLab job never reached. The scenario selector is passed through
rather than re-declared, so beest stays the single owner of the valid
scenario list.

Requires a GitHub App credential in this repo with actions:write on
StackVista/beest, provisioned via pulumi-infra:
BEEST_DISPATCH_APP_CLIENT_ID (variable) and
BEEST_DISPATCH_APP_PRIVATE_KEY (secret).

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
The first version of this workflow sent only the branch and put the SHA in
the run summary, on the reasoning that beest had no hash input. That was
the wrong conclusion: beest's own GitLab port dropped the input while
keeping the machinery, so the missing input was a regression to fix rather
than a constraint to design around. beest#61 restores it.

A branch builds many images, so branch-only means always testing whichever
build is newest -- there is no way to verify a specific commit or to
reproduce a failure against the image that produced it.

Defaults to this run's commit, matching the GitLab job's CI_COMMIT_SHA.
When agent_branch_under_test points at some other branch our SHA does not
exist there, so the pin is left unset and beest falls back instead of
dispatching a hash that resolves to nothing.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
The workflow referenced BEEST_DISPATCH_APP_CLIENT_ID/PRIVATE_KEY, which are
provisioned nowhere. The beest App already exists as BEEST_GH_APP_CLIENT_ID /
BEEST_GH_APP_PRIVATE_KEY, matching the <PURPOSE>_GH_APP_* convention every other
App credential in the estate follows.

Those variables are currently bound only to the beest repo, so pulumi-infra must
also bind them to stackstate-agent before this workflow can mint a token.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
beest replaces agent_hash_under_test with hashes_under_test in StackVista/beest#63,
so the dispatch has to send agent=<sha> through the new field. Must land together
with that PR.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@LouisParkin

Copy link
Copy Markdown
Author

Blocked on an App permission, not on review. beest-bot (client Iv23liZ0K2KfycDPvXdb, the App pulumi-infra#287 wires in here) currently holds only contents: read + metadata: readno actions permission.

This workflow calls gh workflow run against StackVista/beest, which needs actions: write on that repo, and gh run list, which needs actions: read. Both will 403 today.

Order: grant beest-bot Actions read+write (org-owner UI action, no API for it) and accept the installation update → merge pulumi-infra#287 → then a live dispatch here can actually be validated. Details on #287.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant