AgentOps + AgentAI: Complete MCP Integration
AgentOps is a MCP server that Provide observability and tracing for debugging AI agents with AgentOps API..
When integrated with AgentAI, you can:
- Authorize with AgentOps API key
- Retrieve trace information by ID
- Get span information by ID
This guide provides step-by-step instructions to set up AgentOps in AgentAI, including configuration, examples, and troubleshooting.
What You'll Achieve
After completing this setup:
- AgentOps will be fully integrated and operational
- You can use AgentOps tools directly in AgentAI
- All AgentOps capabilities will be available for your workflows
- Access to 4 different tools
Prerequisites
Before starting, ensure you have:
- API key from AgentOps dashboard
- AgentAI installed and configured
- Compatible operating system (Windows, macOS, Linux)
Installation
Step 1: Install AgentOps
Configuration
Step 2: Configure AgentAI
- Open AgentAI settings
- Navigate to MCP server configuration
- Add AgentOps server with appropriate settings
- Save and restart if needed
Examples
Once configured, you can use AgentOps in AgentAI:
Agent Performance Debugging
undefined
Ask AgentAI: "Show me traces for agent runs that failed today"
Expected Result: undefined
Cost Analysis
undefined
Ask AgentAI: "Get cost breakdown for trace abc123"
Expected Result: undefined
Performance Optimization
undefined
Ask AgentAI: "Show slowest spans in recent traces"
Expected Result: undefined
Testing Your Setup
- Launch AgentAI
- Verify AgentOps is available in the tools list
- Test basic AgentOps functionality
Troubleshooting
Common Issues
Compilation Errors
Symptoms: Cargo build fails, Missing dependencies errors
Cause: Missing Rust toolchain or system dependencies
Solution:
- Ensure latest Rust toolchain is installed
- Install platform-specific build tools
- Check Cargo.toml for correct dependency versions
- Run cargo update to refresh dependencies
MCP Server Not Found
Symptoms: Runtime error finding server, Server command not found
Cause: MCP server not installed or not in PATH
Solution:
- Verify MCP server installation
- Use absolute path to server binary
- Ensure server has execute permissions
- Check environment variables are set correctly
Agent Initialization Fails
Symptoms: Agent creation errors, API key issues
Cause: Missing API keys or invalid configuration
Solution:
- Set required environment variables for AI provider
- Verify API key validity and permissions
- Check network connectivity to AI service
- Review AgentAI documentation for latest changes
AgentOps not appearing in AgentAI
Symptoms: Server not listed, Tools not available
Cause: Configuration or installation issue
Solution:
- Verify configuration syntax
- Check AgentOps installation
- Restart AgentAI
- Check logs for error messages
Next Steps
Now that AgentOps is integrated with AgentAI:
- Explore all AgentOps capabilities through AgentAI
- Check out other MCP servers that work with AgentAI
- Join the MCP community for tips and support
- Consider contributing to AgentOps development
Need Help?
- Search for AgentOps documentation
- Check the AgentAI MCP guide
- Join the MCP community discussions