agent-observability-crewai

Agent Observability for CrewAI

Multi-agent observability for CrewAI — track costs, tasks, and delegations across your crew.

Installation

pip install agent-observability-crewai

With CrewAI dependencies:

pip install agent-observability-crewai[crewai]

Quick Start

1. Get API Key

curl -X POST https://api-production-0c55.up.railway.app/v1/register \
  -H "Content-Type: application/json" \
  -d '{"agent_id":"my-crew"}'

2. Set Environment Variable

export AGENT_OBS_API_KEY=ao_live_your_key_here

3. Add to Your Crew

from crewai import Agent, Task, Crew
from agent_observability_crewai import AgentObservabilityTool

# Create tool for each agent
obs_tool = AgentObservabilityTool(crew_id="research-crew")

researcher = Agent(
    role="Researcher",
    goal="Find accurate information",
    tools=[obs_tool],
    verbose=True
)

writer = Agent(
    role="Writer",
    goal="Create compelling content",
    tools=[AgentObservabilityTool(crew_id="research-crew", agent_role="writer")],
    verbose=True
)

# Create and run crew
crew = Crew(
    agents=[researcher, writer],
    tasks=[...]
)

result = crew.kickoff()

Automatic Callback (Alternative)

For fully automatic logging without giving agents the tool:

from crewai import Crew
from agent_observability_crewai import ObservabilityCallback

callback = ObservabilityCallback(crew_id="my-crew")

crew = Crew(
    agents=[...],
    tasks=[...],
    callbacks=[callback]  # Logs automatically
)

What Gets Tracked

CrewAI-Specific Features

Per-Agent Cost Tracking

# Each agent logs with their role
obs = AgentObservabilityTool(
    crew_id="sales-crew",
    agent_role="lead-qualifier"
)

# Query later: "Show me costs for lead-qualifier role"

Task Delegation Logging

obs_tool.log_delegation(
    from_agent="Manager",
    to_agent="Researcher",
    task="Find competitor pricing",
    reason="Requires web search expertise"
)

Task Completion with Metrics

obs_tool.log_task_complete(
    task_description="Research competitors",
    output="Found 5 competitors...",
    cost_usd=0.15,
    duration_ms=45000
)

Pricing

Why Use This for CrewAI?

Multi-agent systems need observability more than single agents:

• Which agent costs the most? Track per-role spending
• Where are bottlenecks? See task durations per agent
• Delegation chains Audit who delegated what to whom
• Debug failures Trace errors back through agent interactions

Related Packages

• agent-observability — Core Python SDK
• agent-observability-langchain — LangChain integration
• agent-observability-autogpt — AutoGPT plugin

License

MIT License — see LICENSE for details.

Links

• API Documentation