AgentOps + JetBrains AI Assistant: Complete MCP Integration

AgentOps is a MCP server that Provide observability and tracing for debugging AI agents with AgentOps API..

When integrated with JetBrains AI Assistant, you can:

• Authorize with AgentOps API key
• Retrieve trace information by ID
• Get span information by ID

This guide provides step-by-step instructions to set up AgentOps in JetBrains AI Assistant, including configuration, examples, and troubleshooting.

What You'll Achieve

After completing this setup:

• AgentOps will be fully integrated and operational
• You can use AgentOps tools directly in JetBrains AI Assistant
• All AgentOps capabilities will be available for your workflows
• Access to 4 different tools

Prerequisites

Before starting, ensure you have:

• API key from AgentOps dashboard
• JetBrains AI Assistant installed and configured
• Compatible operating system (Windows, macOS, Linux)

Installation

Step 1: Install AgentOps

Configuration

Step 2: Configure JetBrains AI Assistant

1. Locate your configuration file:

   • Windows: Settings > Tools > AI Assistant > Model Context Protocol (MCP)
   • macOS: Preferences > Tools > AI Assistant > Model Context Protocol (MCP)
   • Linux: Settings > Tools > AI Assistant > Model Context Protocol (MCP)

2. Add server configuration:

{
  "mcpServers": {
    "agentops": {
      "command": "npx",
      "args": ["-y", "agentops"],
      "env": {
        "AGENTOPS_API_KEY": "ao_1234567890abcdef"
      }
    }
  }
}

3. Restart JetBrains AI Assistant

Completely quit and restart JetBrains AI Assistant to load the new configuration.

Examples

Once configured, you can use AgentOps in JetBrains AI Assistant:

Agent Performance Debugging

undefined

Ask JetBrains AI Assistant: "Show me traces for agent runs that failed today"

Expected Result: undefined

Cost Analysis

undefined

Ask JetBrains AI Assistant: "Get cost breakdown for trace abc123"

Expected Result: undefined

Performance Optimization

undefined

Ask JetBrains AI Assistant: "Show slowest spans in recent traces"

Expected Result: undefined

Testing Your Setup

1. Start a new conversation in JetBrains AI Assistant
2. Ask JetBrains AI Assistant to list available tools
3. Try using AgentOps functionality

Test prompts:

• "Type / and look for AgentOps tools in the command list"
• "Ask AI Assistant to use AgentOps for a specific task"
• "Check the MCP settings page for connection status indicator"

Troubleshooting

Common Issues

MCP Server Not Connecting

Symptoms: Server status shows disconnected, Tools not appearing in chat, Connection timeout

Cause: Server configuration incorrect or server not starting

Solution:

• Verify server command is correct and executable
• Check environment variables are set properly
• View MCP logs: Help > Show Log in Explorer > mcp folder
• Test server command in terminal manually

Remote Server Not Supported

Symptoms: HTTP server not connecting, SSE transport errors

Cause: AI Assistant only supports stdio transport for client connections

Solution:

• Use mcp-remote proxy for remote servers
• Configuration: npx -y mcp-remote@latest https://server-url/endpoint
• This wraps HTTP/SSE in stdio transport

Import from Claude Not Working

Symptoms: No servers imported, Configuration empty after import

Cause: Claude Desktop config file not found or in unexpected location

Solution:

• Verify Claude Desktop is installed
• Check config exists at ~/Library/Application Support/Claude/claude_desktop_config.json (macOS)
• Or %APPDATA%/Claude/claude_desktop_config.json (Windows)
• Manually copy configuration if auto-import fails

External Client Cannot Connect to IDE Server

Symptoms: Client shows MCP server unavailable, Connection refused

Cause: IDE MCP server not enabled or client not configured

Solution:

• Enable MCP Server in Settings > Tools > MCP Server
• Use Auto-Configure for supported clients
• Restart both IDE and external client
• Check firewall allows local connections

Brave Mode Commands Not Running

Symptoms: Terminal commands require confirmation, Workflow interrupted by prompts

Cause: Brave mode not enabled

Solution:

• Enable in Settings > Tools > MCP Server
• Check "Run shell commands without confirmation (brave mode)"
• Use with caution - commands run without confirmation

AgentOps not appearing in JetBrains AI Assistant

Symptoms: Server not listed, Tools not available

Cause: Configuration or installation issue

Solution:

• Verify configuration syntax
• Check AgentOps installation
• Restart JetBrains AI Assistant
• Check logs for error messages

Next Steps

Now that AgentOps is integrated with JetBrains AI Assistant:

• Explore all AgentOps capabilities through JetBrains AI Assistant
• Check out other MCP servers that work with JetBrains AI Assistant
• Join the MCP community for tips and support
• Consider contributing to AgentOps development

Need Help?

• Search for AgentOps documentation
• Check the JetBrains AI Assistant MCP guide
• Join the MCP community discussions