Skip to main content

Cost Monitoring

Track AI model costs and optimize spending.

Cost Dashboard​

  1. Go to "Analytics" > "Costs"
  2. View cost breakdown

Cost Metrics​

MetricDescription
Total costAll AI costs in period
Cost per queryAverage cost per query
Input tokensTokens sent to AI
Output tokensTokens generated by AI

Cost Breakdown​

By Model​

See costs for each AI model:

ModelInput CostOutput Cost
GPT-4o$0.005/1K$0.015/1K
GPT-4 Turbo$0.01/1K$0.03/1K
Claude 3.5$0.003/1K$0.015/1K

By Chatbot​

See which chatbots cost the most:

  1. Click "By Chatbot"
  2. View per-chatbot costs
  3. Identify high-cost chatbots

By Feature​

  • RAG (retrieval)
  • MCP integrations
  • Document processing

Cost Alerts​

Set up alerts for cost thresholds:

  1. Go to "Settings" > "Notifications"
  2. Enable "Cost Alerts"
  3. Set threshold (e.g., $50)
  4. Choose notification channel

Cost Optimization​

Reduce Token Usage​

  • Use concise system prompts
  • Limit context window size
  • Reduce retrieved chunks

Choose Efficient Models​

  • Use GPT-4o for most queries
  • Reserve GPT-4/Claude Opus for complex tasks
  • Consider model routing

Optimize Retrieval​

  • Improve chunk quality
  • Use relevance thresholds
  • Cache common queries

View cost patterns:

  • Daily/weekly/monthly trends
  • Cost per query over time
  • Model usage distribution

Budget Management​

Setting Budgets​

  1. Go to "Settings" > "Billing"
  2. Click "Budget"
  3. Set monthly budget
  4. Choose action when reached:
    • Alert only
    • Reduce to cheaper models
    • Pause chatbots

Budget Tracking​

View budget vs actual:

  1. Go to "Analytics" > "Costs"
  2. See budget utilization
  3. Track remaining budget

Cost Reports​

Generate cost reports:

  1. Go to "Analytics" > "Costs"
  2. Click "Generate Report"
  3. Select date range
  4. Download PDF/CSV