AgentOps + BeeAI Framework: Complete MCP Integration
AgentOps is a MCP server that Provide observability and tracing for debugging AI agents with AgentOps API..
When integrated with BeeAI Framework, you can:
- Authorize with AgentOps API key
- Retrieve trace information by ID
- Get span information by ID
This guide provides step-by-step instructions to set up AgentOps in BeeAI Framework, including configuration, examples, and troubleshooting.
What You'll Achieve
After completing this setup:
- AgentOps will be fully integrated and operational
- You can use AgentOps tools directly in BeeAI Framework
- All AgentOps capabilities will be available for your workflows
- Access to 4 different tools
Prerequisites
Before starting, ensure you have:
- API key from AgentOps dashboard
- BeeAI Framework installed and configured
- Compatible operating system (Node.js, Cross-platform)
Installation
Step 1: Install AgentOps
Configuration
Step 2: Configure BeeAI Framework
- Open BeeAI Framework settings
- Navigate to MCP server configuration
- Add AgentOps server with appropriate settings
- Save and restart if needed
Examples
Once configured, you can use AgentOps in BeeAI Framework:
Agent Performance Debugging
undefined
Ask BeeAI Framework: "Show me traces for agent runs that failed today"
Expected Result: undefined
Cost Analysis
undefined
Ask BeeAI Framework: "Get cost breakdown for trace abc123"
Expected Result: undefined
Performance Optimization
undefined
Ask BeeAI Framework: "Show slowest spans in recent traces"
Expected Result: undefined
Testing Your Setup
- Launch BeeAI Framework
- Verify AgentOps is available in the tools list
- Test basic AgentOps functionality
Troubleshooting
Common Issues
Framework Installation Fails
Symptoms: npm install errors, Dependency conflicts
Cause: Node.js version or dependency issues
Solution:
- Verify Node.js version compatibility
- Clear npm cache and node_modules
- Use npm ci for clean installation
- Check for conflicting global packages
Configuration Not Loaded
Symptoms: Config file ignored, Default settings used
Cause: Configuration file syntax or location issues
Solution:
- Verify beeai.config.js syntax is correct
- Check configuration file location in project root
- Use absolute paths for server executables
- Validate JSON/JavaScript configuration format
Workflow Execution Fails
Symptoms: Workflow errors, MCP tools not available
Cause: MCP server connection or tool execution issues
Solution:
- Check MCP server installation and PATH
- Verify server is responding to connections
- Test server independently before framework integration
- Review workflow logs for specific error messages
AgentOps not appearing in BeeAI Framework
Symptoms: Server not listed, Tools not available
Cause: Configuration or installation issue
Solution:
- Verify configuration syntax
- Check AgentOps installation
- Restart BeeAI Framework
- Check logs for error messages
Next Steps
Now that AgentOps is integrated with BeeAI Framework:
- Explore all AgentOps capabilities through BeeAI Framework
- Check out other MCP servers that work with BeeAI Framework
- Join the MCP community for tips and support
- Consider contributing to AgentOps development
Need Help?
- Search for AgentOps documentation
- Check the BeeAI Framework MCP guide
- Join the MCP community discussions