Skip to main content

AI Model Settings

Fine-tune how your chatbot's AI responds to users.

Model Selection​

Choose which AI model powers your chatbot:

ModelBest For
GPT-4oGeneral purpose, fast responses
GPT-4 TurboComplex reasoning, longer context
Claude 3.5 SonnetNuanced responses, large documents
Claude 3 OpusHighest quality, complex tasks

To change the model:

  1. Go to "Settings" > "AI Settings"
  2. Select a model from the dropdown
  3. Click "Save"
note

Available models depend on your subscription plan.

Temperature​

Temperature controls response randomness:

ValueBehavior
0.0 - 0.3Deterministic, factual, consistent
0.4 - 0.6Balanced
0.7 - 1.0Creative, varied, exploratory

Recommendations:

  • Customer support: 0.2 - 0.4
  • Documentation: 0.3 - 0.5
  • Creative writing: 0.7 - 0.9

System Prompt​

The system prompt defines your chatbot's personality and behavior.

Writing Effective System Prompts​

A good system prompt includes:

  • Role - Who the chatbot is
  • Purpose - What it should help with
  • Tone - How it should communicate
  • Constraints - What it should avoid

Example System Prompt​

You are a helpful customer support assistant for Acme Corp.

Your role:
- Answer questions about our products and services
- Help troubleshoot common issues
- Guide users to relevant documentation

Tone:
- Professional but friendly
- Clear and concise
- Patient with users

Guidelines:
- Only answer questions about Acme products
- If unsure, say "I don't have that information"
- For billing issues, direct users to support@acme.com

Persona Name​

Set a custom name for your chatbot that appears in conversations:

  • Default: "AI Assistant"
  • Custom: "Sarah", "Support Bot", "Product Expert", etc.

Your chatbot can search the web for real-time information using Perplexity, supplementing its knowledge base with up-to-date results.

Web search is enabled by default for all chatbots.

  1. Open your chatbot from the Dashboard
  2. Go to the "Settings" tab
  3. Find the "Web Search" card
  4. Toggle "Enable Web Search" on or off
SettingBehavior
Enabled (default)Chatbot can fetch live web results when relevant
DisabledChatbot only uses its knowledge base
tip

Disable web search if you want the chatbot to respond strictly from your uploaded documents — for example, in compliance-sensitive environments.

Image Understanding​

Users can upload images directly in the chat and ask questions about them. The AI uses a vision model to analyze the image and answer the question in a single step.

How It Works​

  1. User attaches an image to their chat message
  2. User types a question about the image (e.g., "What does this chart show?")
  3. The AI analyzes the image and answers the question directly

Supported Scenarios​

  • Screenshots — Ask about UI elements, error messages, or data shown on screen
  • Charts and graphs — Get explanations of trends, values, or comparisons
  • Documents — Ask about content visible in photos of documents
  • Diagrams — Get explanations of architecture, workflows, or processes
tip

Image understanding works best with clear, high-resolution images. The AI will tell you if it cannot determine the answer from the image.

note

Image analysis uses a vision model (billed separately from the main chat model). The cost appears in your usage dashboard under the same request trace.

Context Window​

The context window determines how much information the AI considers:

SettingDescription
Retrieved chunksNumber of relevant document sections
Max tokensMaximum response length
History lengthHow many previous messages to include

Source Display​

Source Quality​

Control how many sources are shown alongside responses:

SettingSources Shown
NormalUp to 5
MediumUp to 7
HighUp to 10

Balanced Sources​

When your knowledge base contains multiple content types (PDFs and videos), the chatbot may favor one type over the other in displayed sources — typically PDFs, since text embeddings tend to score higher.

Balanced Sources reserves a portion of source slots for underrepresented types so users see a mix:

  • Up to 1/3 of slots are reserved for video sources (at least 1 if any exist)
  • Remaining slots go to PDF/document sources
  • Sources are re-sorted by relevance score after balancing

To enable:

  1. Go to "Settings" > "AI Settings"
  2. Toggle "Show Balanced Sources" on
  3. Click "Save"
tip

Enable this if your knowledge base includes video tutorials alongside documentation. Without it, video sources may rarely appear even when relevant.

Advanced Settings​

Retrieval Settings​

  • Similarity threshold - Minimum relevance score for retrieved content
  • Chunk size - Size of document sections
  • Overlap - How much sections overlap

Response Settings​

  • Max tokens - Maximum response length
  • Stop sequences - Text patterns that end generation

Testing Changes​

After changing AI settings:

  1. Use the "Test" feature to verify behavior
  2. Try various question types
  3. Adjust settings based on results
tip

Make small changes and test frequently to find the optimal settings.