agentgate-reliability

AgentGate

Installation

pip install agentgate-reliability

Or install from source:

git clone https://github.com/srk0704/agentgate.ai
cd agentgate.ai
poetry install

The reliability layer for AI agents taking consequential actions.

AgentGate sits between your AI agent and its tools. Every action is evaluated before execution — blocked if unsafe, escalated if risky, allowed if clean. It gets smarter from every decision your team makes.

gate = GatewayClient.from_env()
decision = await gate.evaluate(tool_call)
if decision.is_allowed:
    result = await my_tool(**args)

Works with: LangGraph · LangChain · OpenAI Agents SDK · Claude Code · any Python agent

---

Why AgentGate

88% of AI agent projects fail before production. Not because the models are bad — because production is harder than staging. Agents drift off task. They get hijacked by hidden instructions. They take irreversible actions nobody approved. They retry failing tools until something breaks.

AgentGate catches these failures before they execute.

---

What it does

Detects 47 failure modes across 9 categories — 11 actively detecting in v0.8.0:

Two detection boundaries:

• Pre-execution — scans tool call inputs before the tool runs
• Post-execution — scans tool results for hidden instructions before the agent reads them

Self-learning loop — every human approval and rejection becomes labeled training data. AgentGate automatically raises escalation thresholds, adds policy rules, and improves over time. No model retraining. Policy updates in milliseconds.

EU AI Act ready — every decision tagged with oversight_authority (auto_allowed, auto_blocked, pending_review, human_approved, human_rejected) for Article 14 compliance.

Trajectory-aware risk scoring — the risk scorer sees the last 3 session calls before deciding. A sequence of 4 consecutive expense approvals scores higher than any single approval alone.

Human-readable reason strings — every blocked or escalated action includes a plain English explanation that tells reviewers exactly what happened and what to verify before deciding.

---

Closed-Loop Intervention

AgentGate doesn't just detect failures — it tells your agent what to do about them.

Every Decision now carries an agent_guidance field — a plain English message computed fresh from session state and formatted for injection into the agent's context window.

decision = await gate.evaluate(tool_call)
if decision.is_allowed:
    result = await my_tool(**args)
elif decision.agent_guidance:
    # inject guidance back into agent context
    context.append({
        "role": "system",
        "content": decision.agent_guidance
    })
    # agent reads it, adjusts, and continues

Six failure modes covered:

Guidance is computed fresh every time from current session state — contains the actual tool name, fail count, and original task. Never stale. Never generic.

---

Quick start

pip install agentgate-reliability

import asyncio
from agentgate.client import GatewayClient
from agentgate.models import ToolCall

gate = GatewayClient.from_env()

tool_call = ToolCall(
    tool_name="process_payment",
    args={"amount": 50000, "recipient": "vendor@example.com"},
    agent_id="my-agent",
    original_task="Pay the Q1 invoice",
)

decision = await gate.evaluate(tool_call)

if decision.is_allowed:
    result = await process_payment(**tool_call.args)
else:
    print(f"Blocked: {decision.reason}")

Environment variables:

ANTHROPIC_API_KEY=sk-...
AGENTGATE_DB_PATH=./agentgate.db
AGENTGATE_POLICY_PATH=./policy.yaml
AGENTGATE_ESCALATION_TIMEOUT_SEC=300

---

Policy rules

policies:
  - name: block_large_payment
    match:
      tool: process_payment
    conditions:
      - field: args.amount
        op: gte
        value: 10000
    effect: block
    reason: Payments over $10,000 require CFO sign-off

  - name: escalate_medium_payment
    match:
      tool: process_payment
    conditions:
      - field: args.amount
        op: gte
        value: 500
    effect: escalate
    reason: Payments over $500 require manager approval

  - name: allow_read_only
    match:
      tool: get_account_balance
    effect: allow
    reason: Balance checks are read-only

---

Dashboard

Two dashboard versions — run the server and open in browser:

AGENTGATE_DB_PATH=./agentgate.db \
AGENTGATE_POLICY_PATH=./policy.yaml \
uvicorn agentgate.api.main:app --host 0.0.0.0 --port 8000

• http://localhost:8000 — v1 (dark, data-dense, engineer-facing)
• http://localhost:8000/v2 — v2 (white, narrative, executive-facing)

v2 tabs:

• Overview — plain English narrative: "Your agent caught 8 threats today"
• Failure modes — three zones: Active (with line sparklines), Monitoring, Coming soon
• Escalations — full context, actionable pre-decision checklist, approve/reject
• Audit log — card-based with expandable decision pipeline trace
• Learning loop — timeline of changes applied, patterns pending review
• Agents — command center with health rings and plain English active issues

---

Architecture

Every tool call goes through this pipeline: Agent → BlastRadiusEstimator → PolicyEngine → [parallel scoring] → Decision → AuditLog ↓ RiskScorer (LLM + trajectory context) InjectionScorer (LLM) AnomalyScorer (DB query) DriftDetector (structural + LLM) LoopDetector (DB query)

Critical blast radius never fails open — if scoring times out on a high/critical severity action, it blocks rather than allows through.

Six database tables:

---

Latency

Local LLM support — set AGENTGATE_LLM_PROVIDER=local to use Ollama. Cuts LLM latency to 150–400ms with zero data exposure.

---

Integrations

# LangGraph
from agentgate.integrations.langgraph import agentgate_node

# LangChain
from agentgate.integrations.langchain import guarded_tool

# OpenAI
from agentgate.integrations.openai import OpenAIGuard

# HTTP (any language)
POST /evaluate

---

Self-learning loop

AgentGate mines your audit log for patterns and applies fixes automatically:

All changes logged in policy_changes with before/after values. Every change is reversible.

---

Demo

Run the FinMate financial agent demo:

# Seed demo data
AGENTGATE_DB_PATH=./examples/finmate/finmate_agentgate.db \
AGENTGATE_POLICY_PATH=./examples/finmate/policy.yaml \
poetry run python examples/finmate/seed_demo_scenario.py

# Start server
AGENTGATE_DB_PATH=./examples/finmate/finmate_agentgate.db \
AGENTGATE_POLICY_PATH=./examples/finmate/policy.yaml \
uvicorn agentgate.api.main:app --host 0.0.0.0 --port 8000

Open http://localhost:8000/v2 to see the v2 dashboard with live data.

---

Tests

poetry run pytest tests/ -q

152 passed

---

Current state

---

Roadmap

Now — Get 10 design partners. Understand real production pain.

6 months — Eval dataset export. Weekly agent health reports. First paying customers.

12 months — Multi-agent fleet management. SOC2 Type 1. First enterprise contract.

24 months — Cross-customer threat intelligence. The Cloudflare model for AI agents.

---

Deploy to Railway

One-click deploy of the AgentGate API and dashboard to Railway:

Required environment variables to set in Railway dashboard:

After deploying, open: https://your-app.up.railway.app/v2

---

License

MIT

---

v0.8.0 · May 2026