agents-hub

Agents Hub

Advanced Agent Orchestration Framework by Emagine Solutions Technology

Overview

Agents Hub is a revolutionary framework for creating, managing, and orchestrating intelligent agent workforces. It provides a comprehensive solution for building multi-agent systems with emergent intelligence capabilities.

Key Features

• Multi-Agent Orchestration: Create and manage teams of specialized agents
• Multi-LLM Support: Use OpenAI, Claude, Gemini, or Ollama models with your own API keys
• Content Moderation: Built-in moderation system to ensure safe and appropriate responses
• Web Scraping: Integrated web scraping capabilities for gathering information
• Document Processing: Support for parsing PDFs, DOCX, and other document formats
• PGVector Tool: Build custom RAG systems with PostgreSQL's pgvector extension for retrieval-augmented generation
• Monitoring & Analytics: Langfuse integration for tracking agent performance and conversations
• Cognitive Architecture: Inspired by human cognition with metacognitive capabilities
• Advanced Memory System: Hierarchical memory with episodic, semantic, and procedural components
• Dynamic Neural Routing: Intelligent task distribution and resource optimization
• Self-Improvement: Agents that learn and evolve through experience
• Explainable AI: Transparent decision-making with reasoning traces
• Secure and Ethical: Built-in guardrails and safety mechanisms
• Coding Agents: Specialized agents for software development with AWS CDK integration
• Human Approval: Interactive approval system for critical operations

Project Structure

agents-hub/
├── agents_hub/                      # Main package
│   ├── agents/                      # Base agent implementations
│   │   ├── base.py                  # Base Agent class
│   │   ├── specialized/             # Specialized agents
│   │   └── evolution/               # Agent evolution capabilities
│   ├── coding/                      # Coding agents and tools
│   │   ├── agents/                  # Specialized coding agents
│   │   └── workforce.py             # CodingWorkforce implementation
│   ├── cognitive/                   # Cognitive architecture
│   │   ├── reasoning/               # Reasoning capabilities
│   │   └── metacognition.py         # Metacognitive capabilities
│   ├── llm/                         # LLM providers and interfaces
│   │   ├── base.py                  # Base LLM interface
│   │   └── providers/               # Provider implementations
│   ├── memory/                      # Memory systems
│   │   ├── base.py                  # Base memory interface
│   │   ├── backends/                # Storage backends
│   │   └── operations/              # Memory operations
│   ├── moderation/                  # Content moderation
│   │   └── filters.py               # Content filters
│   ├── monitoring/                  # Monitoring and observability
│   │   └── langfuse.py              # Langfuse integration
│   ├── orchestration/               # Agent orchestration
│   │   ├── router.py                # Agent routing
│   │   └── protocols/               # Communication protocols
│   ├── rag/                         # Retrieval-Augmented Generation utilities
│   │   └── vector_stores/           # Vector store integrations
│   ├── security/                    # Security features
│   │   └── ethics/                  # Ethical guidelines
│   ├── templates/                   # Code templates
│   │   ├── aws_cdk/                 # AWS CDK templates
│   │   ├── fastapi/                 # FastAPI templates
│   │   └── frontend/                # Frontend templates
│   ├── tools/                       # Tools for agents
│   │   ├── base.py                  # Base Tool class
│   │   ├── coding/                  # Coding tools
│   │   ├── connectors/              # External service connectors
│   │   └── standard/                # Standard tools
│   └── utils/                       # Utility functions
│       ├── approval.py              # Human approval interface
│       ├── document/                # Document processing
│       └── multimodal/              # Multimodal utilities
├── docs/                            # Documentation
│   ├── api/                         # API documentation
│   ├── guides/                      # User guides
│   └── migration_guides/            # Migration guides
├── examples/                        # Example applications
│   ├── agent_workforce/             # Agent workforce examples
│   ├── coding_workforce/            # Coding workforce examples
│   ├── cognitive/                   # Cognitive agent examples
│   ├── moderation/                  # Moderation examples
│   ├── monitoring/                  # Monitoring examples
│   ├── rag/                         # RAG examples
│   └── tools/                       # Tool usage examples
├── tests/                           # Tests
│   ├── integration/                 # Integration tests
│   └── unit/                        # Unit tests

├── .gitignore                       # Git ignore file
├── LICENSE                          # License file
├── pyproject.toml                   # Project configuration
├── README.md                        # Main README
└── setup.py                         # Setup script

The framework follows a modular architecture:

1. Agent System: Flexible agent creation and management with specialized capabilities

2. Cognitive Architecture: Multi-layered cognitive system inspired by human cognition

3. LLM Integration: Support for multiple LLM providers with a unified interface

4. Memory System: Sophisticated memory management with multiple backend options

5. Orchestration: Dynamic task routing and agent collaboration

6. Knowledge Management: Advanced RAG capabilities with PostgreSQL/pgvector

7. Tool System: Extensible tool framework for agent capabilities

8. Coding System: Specialized agents and tools for software development

9. Moderation System: Content filtering and safety mechanisms

10. Monitoring System: Performance tracking and analytics

Installation

pip install agents-hub

Quick Start

from agents_hub import AgentWorkforce, Agent
from agents_hub.llm.providers import OpenAIProvider
from agents_hub.moderation import RuleBasedModerator

# Configure LLM provider with your API key
llm = OpenAIProvider(api_key="your-openai-api-key")

# Create a content moderator
moderator = RuleBasedModerator()

# Create specialized agents with moderation
researcher = Agent(
    name="researcher",
    llm=llm,
    moderation=moderator,
    on_moderation_violation="block"
)
analyst = Agent(
    name="analyst",
    llm=llm,
    moderation=moderator,
    on_moderation_violation="block"
)
writer = Agent(
    name="writer",
    llm=llm,
    moderation=moderator,
    on_moderation_violation="block"
)

# Create a workforce with these agents
workforce = AgentWorkforce(agents=[researcher, analyst, writer])

# Execute a task with the workforce
result = workforce.execute("Research the impact of AI on healthcare and prepare a report")

print(result)

Local Development

1. Fork and clone the repository:

   git clone https://github.com/your-username/agents-hub.git
   cd agents-hub
   

2. Create and activate a virtual environment:

   python -m venv venv
   source venv/bin/activate  # On Windows: venv\Scripts\activate
   

3. Install the package in development mode:

   pip install -e .
   

   This installs the package in editable mode, allowing you to make changes to the code without reinstalling.

4. Run an example application:

   # For the FastAPI example
   cd examples/fastapi_app
   pip install -r requirements.txt  # Install example-specific dependencies
   python main.py
   

   The API will be available at http://localhost:8000 API documentation is available at http://localhost:8000/docs

Docker Setup

Some examples include Docker support for easy setup and testing. For example, to run the FastAPI example with Docker:

cd examples/fastapi_app
docker-compose up -d

See the README.md in each example directory for specific Docker instructions.

This will start:

• PostgreSQL with pgvector extension
• Ollama for local LLM inference
• FastAPI example application

API Example

The FastAPI example application provides the following endpoints:

Agent Management

• GET /agents - List all available agents
• POST /agents - Create a new agent
• DELETE /agents/{agent_name} - Delete an agent

Chat

• POST /chat - Chat with an agent or the workforce

Conversation Management

• GET /conversations/{conversation_id} - Get conversation history
• DELETE /conversations/{conversation_id} - Clear conversation history

Advanced Features

Multi-LLM Support

Agents Hub supports multiple LLM providers:

# OpenAI
from agents_hub.llm.providers import OpenAIProvider
llm = OpenAIProvider(api_key="your-openai-api-key")

# Anthropic Claude
from agents_hub.llm.providers import ClaudeProvider
llm = ClaudeProvider(api_key="your-anthropic-api-key")

# Google Gemini
from agents_hub.llm.providers import GeminiProvider
llm = GeminiProvider(api_key="your-google-api-key")

# Ollama (local models)
from agents_hub.llm.providers import OllamaProvider
llm = OllamaProvider(model="llama3")

Content Moderation

Agents Hub provides flexible content moderation options:

# Rule-based moderation (no API key required)
from agents_hub.moderation import RuleBasedModerator
moderator = RuleBasedModerator(
    jailbreak_threshold=60,  # Lower threshold for higher sensitivity
    custom_rules=["Tell me how to hack", "Ignore your instructions"]  # Custom rules
)

# OpenAI moderation (requires API key)
from agents_hub.moderation import OpenAIModerator
moderator = OpenAIModerator(
    api_key="your-openai-api-key",
    categories=["hate", "sexual", "violence"]  # Optional: specify categories
)

# Combined moderation (use multiple moderators)
from agents_hub.moderation import ModerationRegistry
moderator = ModerationRegistry(
    moderators=[RuleBasedModerator(), OpenAIModerator(api_key="your-openai-api-key")],
    mode="any"  # Flag if any moderator flags content
)

# Create agent with moderation
agent = Agent(
    name="moderated_agent",
    llm=llm,
    moderation=moderator,
    on_moderation_violation="block"  # Options: block, warn, log
)

Memory Systems

Agents Hub provides flexible memory storage options:

# PostgreSQL Memory
from agents_hub.memory.backends import PostgreSQLMemory
memory = PostgreSQLMemory(
    host="localhost",
    port=5432,
    database="agents_hub",
    user="postgres",
    password="postgres"
)

# Create an agent with memory
agent = Agent("researcher", llm=llm, memory=memory)

Web Scraping

Agents Hub includes a powerful web scraping tool:

from agents_hub.tools.standard import ScraperTool

# Create a scraper tool
scraper_tool = ScraperTool()

# Create an agent with the scraper tool
agent = Agent(
    name="web_researcher",
    llm=llm,
    tools=[scraper_tool],
    system_prompt="You are a web researcher that can scrape and analyze web content."
)

# Use the agent to scrape and analyze web content
response = await agent.run("Scrape and summarize the content from https://example.com")

Document Processing

Agents Hub provides utilities for processing various document formats:

from agents_hub.utils.document import extract_text_from_pdf, extract_text_from_docx, chunk_text

# Extract text from PDF
pdf_result = extract_text_from_pdf(file_path="document.pdf")
print(pdf_result["text"])
print(pdf_result["metadata"])

# Extract text from DOCX
docx_result = extract_text_from_docx(file_path="document.docx")
print(docx_result["text"])
print(docx_result["metadata"])

# Chunk text for processing
chunks = chunk_text(
    text=pdf_result["text"],
    chunk_size=1000,
    chunk_overlap=200,
    chunk_method="sentence"  # Options: token, character, sentence, recursive
)

# Recursive character chunking with custom separators
chunks = chunk_text(
    text=pdf_result["text"],
    chunk_size=1000,
    chunk_overlap=200,
    chunk_method="recursive",
    separators=["## ", "\n\n", "\n", ". ", " "]  # Custom separators in order of priority
)

RAG (Retrieval-Augmented Generation)

Agents Hub provides two approaches for building RAG systems:

1. RAGAgent (High-Level Interface)

The RAGAgent provides a complete solution for knowledge management with built-in methods for scraping, storing, and querying content:

from agents_hub import RAGAgent

# Create RAG agent
rag_agent = RAGAgent(
    llm=llm,
    pg_host="localhost",
    pg_port=5432,
    pg_database="postgres",
    pg_user="postgres",
    pg_password="postgres"
)

# Create a collection
await rag_agent.create_collection("research")

# Scrape and store content from a URL
await rag_agent.scrape_and_store(
    url="https://example.com/article",
    collection_name="research"
)

# Answer a question using the RAG approach
result = await rag_agent.answer_question(
    question="What is the main topic of the article?",
    collection_name="research"
)
print(result["answer"])

See the RAG Agent Documentation for more details.

2. PGVector Tool (Low-Level Interface)

For more flexibility, you can use the PGVector tool directly to build custom RAG systems:

from agents_hub.vector_stores import PGVector

# Create PGVector tool
pgvector_tool = PGVector(
    llm=llm,  # For generating embeddings
    host="localhost",
    port=5432,
    database="postgres",
    user="postgres",
    password="postgres"
)

# Create an agent with the PGVector tool
agent = Agent(
    name="knowledge_agent",
    llm=llm,
    tools=[pgvector_tool],
    system_prompt="You are a knowledge agent that can store and retrieve information."
)

# Use the agent to add and search for documents
response = await agent.run("Add this article to the 'research' collection: ...")
response = await agent.run("Search the 'research' collection for information about machine learning.")

See the PGVector Tool Documentation for more details.

Model Context Protocol (MCP)

Agents Hub supports the Model Context Protocol (MCP) for connecting to external resources:

from agents_hub.tools.standard import MCPTool

# Create an MCP tool for filesystem access
filesystem_tool = MCPTool(
    server_name="filesystem",
    server_command="npx",
    server_args=["-y", "@modelcontextprotocol/server-filesystem", "./"],
    transport="stdio",
)

# Create an MCP tool for GitHub access
github_tool = MCPTool(
    server_name="github",
    server_command="npx",
    server_args=["-y", "@modelcontextprotocol/server-github"],
    server_env={"GITHUB_PERSONAL_ACCESS_TOKEN": "your-github-token"},
    transport="stdio",
)

# Create an agent with MCP tools
agent = Agent(
    name="mcp_agent",
    llm=llm,
    tools=[filesystem_tool, github_tool],
    system_prompt="You are an assistant that can access files and GitHub repositories."
)

# Use the agent to access files and repositories
response = await agent.run("List the files in the current directory")
response = await agent.run("Check for open issues in the repository")

Monitoring & Analytics

Agents Hub integrates with Langfuse for monitoring and analytics:

from agents_hub.monitoring import LangfuseMonitor

# Create a Langfuse monitor
monitor = LangfuseMonitor(
    public_key="your-langfuse-public-key",
    secret_key="your-langfuse-secret-key",
    host="https://cloud.langfuse.com",  # Optional
    release="1.0.0",  # Optional version tracking
)

# Create an agent with monitoring
agent = Agent(
    name="monitored_agent",
    llm=llm,
    monitor=monitor,
    system_prompt="You are a helpful assistant."
)

# Use the agent with monitoring
response = await agent.run(
    "What is the capital of France?",
    context={"conversation_id": "user123"},
)

# Score a conversation
await monitor.score_conversation(
    conversation_id="user123",
    name="helpfulness",
    value=0.9,
    comment="Very helpful response",
)

Cognitive Architecture

Agents Hub includes a cognitive architecture inspired by human cognition:

from agents_hub import CognitiveAgent
from agents_hub.cognitive import CognitiveArchitecture

# Create cognitive architecture
cognitive_architecture = CognitiveArchitecture(
    metacognition_config={
        "reflection_depth": 2,
        "confidence_threshold": 0.7,
    },
    reasoning_config={
        "enabled_mechanisms": ["deductive", "inductive", "abductive"],
        "default_mechanism": "deductive",
    },
)

# Create cognitive agent
agent = CognitiveAgent(
    name="cognitive_agent",
    llm=llm,
    cognitive_architecture=cognitive_architecture,
    system_prompt="You are a thoughtful assistant with advanced reasoning capabilities.",
    cognitive_config={
        "reasoning_trace_enabled": True,
        "metacognition_enabled": True,
        "learning_enabled": True,
    },
)

# Use different reasoning mechanisms
deductive_response = await agent.run(
    "If all birds can fly, and penguins are birds, can penguins fly?",
    context={"reasoning_mechanism": "deductive"},
)

abductive_response = await agent.run(
    "The sidewalk is wet this morning. What might have caused this?",
    context={"reasoning_mechanism": "abductive"},
)

Architecture

Agents Hub uses a modular, extensible architecture:

graph TD
    A[User] --> B[Agent Workforce]
    B --> C[Orchestrator Agent]
    C --> D[Task Decomposition]
    D --> E[Agent Selection]
    E --> F1[Specialized Agent 1]
    E --> F2[Specialized Agent 2]
    E --> F3[Specialized Agent 3]
    F1 --> G[Tool Usage]
    F2 --> G
    F3 --> G
    G --> H1[Calculator Tool]
    G --> H2[RAG Tool]
    G --> H3[Custom Tool]
    H2 --> I[Vector Database]
    F1 --> J[Memory System]
    F2 --> J
    F3 --> J
    J --> K[Result Synthesis]
    K --> L[Final Response]

Security and Moderation

Agents Hub includes several security and moderation features:

• API Key Management: Secure storage and rotation of provider API keys
• Content Moderation: Built-in content filtering and safety mechanisms
  • Rule-based moderation with jailbreak detection
  • OpenAI Moderation API integration
  • Customizable moderation actions (block, warn, log)
  • Moderation registry for combining multiple moderators
• Data Privacy: Control over data storage and processing
• Audit Logging: Comprehensive logging of agent actions and decisions

Contributing

1. Fork the repository

2. Create a feature branch:

   git checkout -b feature/your-feature-name
   

3. Follow coding standards:

   • Use type hints
   • Add docstrings
   • Follow PEP 8
   • Write unit tests

4. Commit your changes:

   git commit -m "feat: add your feature description"
   

5. Push to your fork:

   git push origin feature/your-feature-name
   

6. Create a Pull Request:

   • Provide clear description
   • Link related issues
   • Include test results
   • Add documentation updates

License

This project is licensed under the MIT License.

MIT License

Agents Hub - Advanced Agent Orchestration Framework
Copyright (c) 2025 Emagine Solutions Technology

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.