Skip to content

Webhook timeout error during pod mutation #1608

Description

@iusergii

We’re experiencing intermittent issues with the Azure Workload Identity webhook in version 1.5.0. Our setup runs 4 pods of the webhook service.

This occurs during pod creation, particularly from Argo Workflows, with the following error

Internal error occurred: failed calling webhook "mutation.azure-workload-identity.io": failed to call webhook: Post "https://azure-wi-webhook-webhook-service.azure-workload-identity-system.svc:443/mutate-v1-pod?timeout=10s": context deadline exceeded

From the webhook logs, we only see occasional messages like:

{"level":"info","timestamp":"2025-05-19T08:19:49.001573Z","caller":"/usr/local/go/src/log/log.go:245$log.(*Logger).output","message":"http: TLS handshake error from 10.61.91.69:52362: EOF"}

The issue is random, not constant, but it blocks workflow execution. Any guidance on diagnosing or mitigating this would be appreciated.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions