Skip to content

[bot] Letta (agent execution SDK) not instrumented #569

Description

@braintrust-bot

Summary

Letta (formerly MemGPT) is a stateful agent execution framework with an official Python client SDK, maintained at https://github.com/letta-ai/letta with docs at https://docs.letta.com. Sending a message to a running Letta agent triggers multi-step reasoning, tool calls, and memory operations — an agent-run execution surface comparable in scope to other agent frameworks this repo already instruments (crewai, autogen, agno, strands, agentscope).

This repo does not instrument Letta anywhere: no py/src/braintrust/integrations/letta* directory, no wrapper, no nox session, no cassette, no README entry, and no mention in py/pyproject.toml's [tool.braintrust.matrix].

Braintrust docs status: not_found. https://www.braintrust.dev/docs/guides/tracing does not mention Letta or MemGPT among its supported frameworks list.

What needs to be instrumented

The primary execution entrypoint is sending a message to an agent:

  • client.agents.messages.create(agent_id, input=..., messages=[...]) — synchronous, POST /v1/agents/{agent_id}/messages
  • streaming variant (streaming=True, SSE) for token/step streaming

The response is a LettaResponse containing a messages array of typed steps (ReasoningMessage, ToolCallMessage, ToolReturnMessage, AssistantMessage, etc.), usage (LettaUsageStatistics), and stop_reason — a rich multi-step agent trace analogous to what other agent-framework integrations in this repo already capture as nested spans.

Upstream sources

Local repo files inspected

  • py/src/braintrust/integrations/ — no letta directory
  • Repo-wide grep for letta (case-insensitive) under py/src/braintrust/ — zero matches
  • README.md integrations table — no Letta/MemGPT entry
  • py/pyproject.toml [tool.braintrust.matrix] — no letta key

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions