AgentOps + GenAIScript: Complete MCP Integration

AgentOps is a MCP server that Provide observability and tracing for debugging AI agents with AgentOps API..

When integrated with GenAIScript, you can:

• Authorize with AgentOps API key
• Retrieve trace information by ID
• Get span information by ID

This guide provides step-by-step instructions to set up AgentOps in GenAIScript, including configuration, examples, and troubleshooting.

What You'll Achieve

After completing this setup:

• AgentOps will be fully integrated and operational
• You can use AgentOps tools directly in GenAIScript
• All AgentOps capabilities will be available for your workflows
• Access to 4 different tools

Prerequisites

Before starting, ensure you have:

• API key from AgentOps dashboard
• GenAIScript installed and configured
• Compatible operating system (Windows, macOS, Linux, VS Code)

Installation

Step 1: Install AgentOps

Configuration

Step 2: Configure GenAIScript

1. Open GenAIScript settings
2. Navigate to MCP server configuration
3. Add AgentOps server with appropriate settings
4. Save and restart if needed

Examples

Once configured, you can use AgentOps in GenAIScript:

Agent Performance Debugging

undefined

Ask GenAIScript: "Show me traces for agent runs that failed today"

Expected Result: undefined

Cost Analysis

undefined

Ask GenAIScript: "Get cost breakdown for trace abc123"

Expected Result: undefined

Performance Optimization

undefined

Ask GenAIScript: "Show slowest spans in recent traces"

Expected Result: undefined

Testing Your Setup

1. Launch GenAIScript
2. Verify AgentOps is available in the tools list
3. Test basic AgentOps functionality

Troubleshooting

Common Issues

GenAIScript Installation Failed

Symptoms: npm install errors, Command not found

Cause: Node.js version or npm configuration issues

Solution:

• Verify Node.js 18+ is installed
• Check npm global installation permissions
• Try using yarn instead of npm
• Clear npm cache and retry installation

MCP Server Not Found

Symptoms: Server not available in scripts, Connection errors

Cause: Server configuration or PATH issues

Solution:

• Verify server is properly installed
• Check genaiscript.config.ts configuration
• Use absolute path to server executable
• Test server independently first

Script Execution Fails

Symptoms: Runtime errors, Tool execution failures

Cause: Script syntax or MCP integration issues

Solution:

• Check TypeScript syntax and imports
• Verify MCP server is responding
• Use --debug flag for detailed logging
• Test with simpler script first

VS Code Extension Issues

Symptoms: Extension not working, No intellisense

Cause: Extension installation or configuration problems

Solution:

• Verify extension is properly installed
• Reload VS Code window
• Check workspace is GenAIScript project
• Update extension to latest version

AgentOps not appearing in GenAIScript

Symptoms: Server not listed, Tools not available

Cause: Configuration or installation issue

Solution:

• Verify configuration syntax
• Check AgentOps installation
• Restart GenAIScript
• Check logs for error messages

Next Steps

Now that AgentOps is integrated with GenAIScript:

• Explore all AgentOps capabilities through GenAIScript
• Check out other MCP servers that work with GenAIScript
• Join the MCP community for tips and support
• Consider contributing to AgentOps development

Need Help?

• Search for AgentOps documentation
• Check the GenAIScript MCP guide
• Join the MCP community discussions