Helicone Integration with Hrida.ai

Helicone is an open-source LLM observability platform for developers to monitor, debug, and improve production-ready applications, including your Hrida.ai deployment.

By enabling Helicone, you can log LLM requests, evaluate and experiment with prompts, and get instant insights that helps you push changes to production with confidence.

• Real-time monitoring with consolidated view across model types: Monitor both local Ollama models and cloud APIs through a single interface
• Request visualization and replay: See exactly what prompts were sent to each model in Hrida.ai and the outputs generated by the LLMs for evaluation
• Local LLM performance tracking: Measure response times and throughput of your self-hosted models
• Usage analytics by model: Compare usage patterns between different models in your Hrida.ai setup
• User analytics to understand interaction patterns
• Debug capabilities to troubleshoot issues with model responses
• Cost tracking for your LLM usage across providers

How to integrate Helicone with Hrida.ai

Step 1: Create a Helicone account and generate your API key

Create a Helicone account and log in to generate an API key.

— Make sure to generate a write only API key. This ensures you only allow logging data to Helicone without read access to your private data.

Step 2: Create an OpenAI account and generate your API key

Create an OpenAI account and log into OpenAI's Developer Portal to generate an API key.

Step 3: Run your Hrida.ai application using Helicone's base URL

To launch your first Hrida.ai application, use the command from Hrida.ai docs and include Helicone's API BASE URL so you can query and monitor automatically.

   # Set your environment variables
   export HELICONE_API_KEY=<YOUR_API_KEY>
   export OPENAI_API_KEY=<YOUR_OPENAI_API_KEY>

   # Run Hrida.ai with Helicone integration
   docker run -d -p 3000:8080 \
     -e OPENAI_API_BASE_URL="https://oai.helicone.ai/v1/$HELICONE_API_KEY" \
     -e OPENAI_API_KEY="$OPENAI_API_KEY" \
     --name hrida-ai \
     ghcr.io/hrida-ai/hrida-ai-studio

If you already have a Hrida.ai application deployed, go to the Admin Panel > Settings > Connections and click on the + sign for "Managing OpenAI API Connections". Update the following properties:

• Your API Base URL would be https://oai.helicone.ai/v1/<YOUR_HELICONE_API_KEY>
• The API KEY would be your OpenAI API key.

Step 4: Make sure monitoring is working

To make sure your integration is working, log into Helicone's dashboard and review the "Requests" tab.

You should see the requests you have made through your Hrida.ai interface already being logged into Helicone.

Learn more

For a comprehensive guide on Helicone, you can check out Helicone's documentation.