refactor(frontend): remove console ai features

[malinskibeniamin]

Summary

Remove Console's dedicated AI frontend surface: legacy AI Agents, Knowledge Bases, Remote MCP, Transcripts, and AIGW integrations.

• removes routes, pages, clients, state, assets, E2E coverage, and AI-only dependencies
• removes the Agentic sidebar section and related header/footer behavior
• removes public federation inputs and flags for AIGW and the Agentic Data Plane
• directs former AI URLs to a migration page linking to the corresponding Redpanda AI surface
• removes orphaned AI-derived UI primitives, hooks, assets, and query helpers
• removes the unused browser visual-test stack after its last specs and baselines disappeared
• removes stale AI-only lint, test, workflow, and Snyk configuration
• removes 56,683 lines across 333 files (net -56,276 lines)

Preserved scope

Intentionally unchanged:

• generated frontend contracts under frontend/src/protogen
• backend and shared protobuf contracts
• Redpanda Connect, including AI-capable processors, schemas, templates, branding, and service-account onboarding
• Secret Store behavior and its existing AI-related scope taxonomy
• developer AI tooling and workflows, including .mcp.json, .claude, and the Claude workflow test

Surface review

Surface	Before	After
Sidebar	Agentic section exposed AI Agents, Knowledge Bases, Remote MCP, and Transcripts	Agentic section and items removed
Former AI URLs	Dedicated Console pages	Migration page linking to Redpanda AI
Not-found actions	Click-only "Go back" text	Accessible back button plus a home fallback
Federation config	Accepted AIGW URL, ADP mode, and AI feature flags	Inputs removed
Orphaned derivatives	AI-only editors, selectors, hooks, assets, and visual-test plumbing remained	Deleted with their unused direct dependencies

The compatibility page covers /agents, /knowledgebases, /mcp-servers, /transcripts, and nested URLs. Agents and MCP links retain their Redpanda AI section; Knowledge Bases and Transcripts link to Redpanda AI home. When Console has a real cluster ID, links preserve it as adpEnvironmentId.

Local inspection covered desktop and 390 × 844 mobile layouts, semantic navigation, the migration destinations, and the unchanged standard 404 for unrelated paths.

Release coordination

• Merge cloudv2 #28294 first so the ADP UI is available independently at ai.redpanda.com.
• Cloud UI and other federation hosts must stop passing aigwUrl and isAdpEnabled before consuming the updated SetConfigArguments type. Inline typed objects otherwise get excess-property errors.
• Extra runtime properties are ignored during a staggered rollout, so an older host does not crash this Console build.
• Removed feature-flag keys should be retired in hosts alongside this change.

Testing

Node 22.22.3 unless noted:

• bun install --frozen-lockfile --ignore-scripts
• bun run lint (completed; reports the repository's existing 903 non-fixable lint findings)
• bun run type:check
• bun run build
• bun run test:unit — 51 files, 774 tests passed
• bun run test:integration — 113 files, 1,218 tests passed
• local preview dogfood — /agents and nested /mcp-servers/server-123 showed the migration UI with correct destinations; /definitely-missing retained the normal not-found UI

Automated review

• Initial Claude review findings were addressed in ce7b0b3ff.
• Claude approved the expanded cleanup before master integration. Its three merge-resolution findings (PostCSS policy, stale browser lock entries, and integrating current master) were then addressed.
• Fresh import/reference scans confirmed the removed source files and assets had no live consumers.
• Lockfiles were regenerated from current master, pruned of the obsolete browser packages, and verified with a frozen install.
• Current origin/master is merged into the branch.

Review guidance

• verify host integrations no longer pass the intentionally removed federation inputs
• verify generated contracts, Redpanda Connect, and Secret Store remain untouched functionally
• verify old and nested AI URLs show the Redpanda AI migration page
• verify unrelated missing URLs retain the standard not-found experience
• verify no downstream repository still expects the removed non-blocking frontend-visual/test-browser workflow

[github-actions]

🚨 Registry drift detected

App: frontend · Scope: diff vs origin/master · Files: 36

	Count
⚠️ Outdated registry components	0
🛠 Locally-modified components	1
❓ Unknown to registry	0
🎨 Off-token palette colours	0
🔢 Ad-hoc utility classes	1

Components needing attention

Status	Component	Uses	Detail
🛠 locally-modified	theme	1×	no tagged release matches installed bytes

🔢 Ad-hoc utility classes (arbitrary values)

These bypass the design tokens. Prefer a named scale entry or add a new token.

Class	Category	Uses	Files
fill-[#252F3E]	🎨 color	1	1

Generated by lookout audit-changes.

[malinskibeniamin]

Review fixes pushed in ce7b0b3ff.

• restored the preserved Secret Store scope taxonomy and added numeric-contract tests
• replaced the tautological nav assertion with real-router 404/no-redirect coverage
• made not-found actions keyboard-accessible with a native home-link fallback
• removed stale Biome, react-doctor, Vitest, Snyk, and JSON-schema references
• added the changelog and host/federation release-coordination notes

Validation: type-check, lint, build, 5 focused unit tests, and 10 focused integration tests pass. Final Claude Opus re-review: APPROVED (no actionable P0-P2 findings). All PR checks pass, including Enterprise CI.

[malinskibeniamin]

Removed frontend/src/removed-ai-routes.test.tsx in aa36641b3. It mutated the generated route tree and injected the not-found component, so it did not validate production routing.

[malinskibeniamin]

Added the legacy AI link migration UX in e29864b44:

• /agents and /mcp-servers (including nested URLs) link to their matching Redpanda AI sections
• /knowledgebases and /transcripts link to Redpanda AI home
• real cluster IDs are preserved as adpEnvironmentId
• unrelated missing URLs keep the standard 404

Review: inline adversarial/self-review found and fixed prototype-key route matching; no remaining P0–P2 findings. Visual inspection passed on desktop and 390 × 844 mobile. Focused tests, type-check, build, and all Console CI checks pass. Enterprise CI is still running.