AI Model Settings
Fine-tune how your chatbot's AI responds to users.
Model Selection
Choose which AI model powers your chatbot:
| Model | Best For |
|---|---|
| GPT-4o | General purpose, fast responses |
| GPT-4 Turbo | Complex reasoning, longer context |
| Claude 3.5 Sonnet | Nuanced responses, large documents |
| Claude 3 Opus | Highest quality, complex tasks |
To change the model:
- Go to "Settings" > "AI Settings"
- Select a model from the dropdown
- Click "Save"
note
Available models depend on your subscription plan.
Temperature
Temperature controls response randomness:
| Value | Behavior |
|---|---|
| 0.0 - 0.3 | Deterministic, factual, consistent |
| 0.4 - 0.6 | Balanced |
| 0.7 - 1.0 | Creative, varied, exploratory |
Recommendations:
- Customer support: 0.2 - 0.4
- Documentation: 0.3 - 0.5
- Creative writing: 0.7 - 0.9
System Prompt
The system prompt defines your chatbot's personality and behavior.
Writing Effective System Prompts
A good system prompt includes:
- Role - Who the chatbot is
- Purpose - What it should help with
- Tone - How it should communicate
- Constraints - What it should avoid
Example System Prompt
You are a helpful customer support assistant for Acme Corp.
Your role:
- Answer questions about our products and services
- Help troubleshoot common issues
- Guide users to relevant documentation
Tone:
- Professional but friendly
- Clear and concise
- Patient with users
Guidelines:
- Only answer questions about Acme products
- If unsure, say "I don't have that information"
- For billing issues, direct users to support@acme.com
Persona Name
Set a custom name for your chatbot that appears in conversations:
- Default: "AI Assistant"
- Custom: "Sarah", "Support Bot", "Product Expert", etc.
Context Window
The context window determines how much information the AI considers:
| Setting | Description |
|---|---|
| Retrieved chunks | Number of relevant document sections |
| Max tokens | Maximum response length |
| History length | How many previous messages to include |
Advanced Settings
Retrieval Settings
- Similarity threshold - Minimum relevance score for retrieved content
- Chunk size - Size of document sections
- Overlap - How much sections overlap
Response Settings
- Max tokens - Maximum response length
- Stop sequences - Text patterns that end generation
Testing Changes
After changing AI settings:
- Use the "Test" feature to verify behavior
- Try various question types
- Adjust settings based on results
tip
Make small changes and test frequently to find the optimal settings.