Thinh Lam
140 lines
2.8 KiB
Markdown
140 lines
2.8 KiB
Markdown
# Fix Chat Assistant 500 Error
|
|
|
|
## Issue
|
|
Getting 500 Internal Server Error when calling `/api/v1/chat` endpoint.
|
|
|
|
## Root Causes
|
|
|
|
1. **Model Name Mismatch** ✅ FIXED
|
|
- Code was using `gemma3:27b` but entrypoint pulls `gemma3:270M`
|
|
- **Fixed**: Updated code to use `gemma3:270M`
|
|
|
|
2. **Ollama Not Running**
|
|
- Ollama service might not be started in the container
|
|
- Network connectivity issues
|
|
|
|
3. **Model Not Available**
|
|
- Model might not be pulled yet
|
|
- Model name incorrect
|
|
|
|
## Solutions
|
|
|
|
### Solution 1: Restart the Container
|
|
|
|
```bash
|
|
# Stop and restart the backend container
|
|
docker-compose down
|
|
docker-compose up -d be0
|
|
|
|
# Wait for Ollama to start (check logs)
|
|
docker-compose logs -f be0
|
|
```
|
|
|
|
### Solution 2: Check Ollama Status
|
|
|
|
```bash
|
|
# Check if container is running
|
|
docker ps | grep be0
|
|
|
|
# Check Ollama inside container
|
|
docker exec be0 ollama list
|
|
|
|
# If Ollama is not running, start it
|
|
docker exec be0 ollama serve &
|
|
```
|
|
|
|
### Solution 3: Pull the Model
|
|
|
|
```bash
|
|
# Pull the required model
|
|
docker exec be0 ollama pull gemma3:270M
|
|
|
|
# Verify it's available
|
|
docker exec be0 ollama list | grep gemma3
|
|
```
|
|
|
|
### Solution 4: Test the Health Endpoint
|
|
|
|
```bash
|
|
# Check health endpoint (includes Ollama status)
|
|
curl http://localhost:4402/health
|
|
|
|
# Should show:
|
|
# {
|
|
# "status": "healthy",
|
|
# "ollama": {
|
|
# "status": "connected",
|
|
# "available_models": ["gemma3:270M", ...]
|
|
# }
|
|
# }
|
|
```
|
|
|
|
### Solution 5: Check Backend Logs
|
|
|
|
```bash
|
|
# View recent logs
|
|
docker-compose logs be0 | tail -50
|
|
|
|
# View ChatAssistant specific logs
|
|
tail -f be0/logs/ChatAssistant.log
|
|
```
|
|
|
|
## Quick Fix Commands
|
|
|
|
```bash
|
|
# 1. Restart everything
|
|
docker-compose restart be0
|
|
|
|
# 2. Check Ollama
|
|
docker exec be0 ollama list
|
|
|
|
# 3. Test health
|
|
curl http://localhost:4402/health
|
|
|
|
# 4. Test chat endpoint
|
|
curl -X POST http://localhost:4402/api/v1/chat \
|
|
-H "Content-Type: application/json" \
|
|
-d '{"message": "Hello"}'
|
|
```
|
|
|
|
## What Was Fixed
|
|
|
|
1. ✅ Model name changed from `gemma3:27b` to `gemma3:270M`
|
|
2. ✅ Added better error handling with specific error messages
|
|
3. ✅ Added Ollama connection check on initialization
|
|
4. ✅ Added health endpoint with Ollama status
|
|
5. ✅ Improved logging for debugging
|
|
|
|
## Expected Behavior After Fix
|
|
|
|
1. Container starts and Ollama service runs
|
|
2. Model `gemma3:270M` is available
|
|
3. Health endpoint shows Ollama as "connected"
|
|
4. Chat endpoint returns 200 with AI response
|
|
|
|
## If Still Not Working
|
|
|
|
1. **Check container logs:**
|
|
```bash
|
|
docker-compose logs be0
|
|
```
|
|
|
|
2. **Check if Ollama is accessible:**
|
|
```bash
|
|
docker exec be0 curl http://localhost:11434/api/tags
|
|
```
|
|
|
|
3. **Manually start Ollama:**
|
|
```bash
|
|
docker exec -d be0 ollama serve
|
|
sleep 2
|
|
docker exec be0 ollama list
|
|
```
|
|
|
|
4. **Rebuild container:**
|
|
```bash
|
|
docker-compose down
|
|
docker-compose build be0
|
|
docker-compose up be0
|
|
```
|