You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -311,13 +311,25 @@ Ensure Ollama is running with required models:
311
311
312
312
```bash
313
313
# Install Ollama models
314
-
ollama pull dolphincoder:15b
315
-
ollama pull nomic-embed-text
314
+
ollama pull qwen3:8b
315
+
ollama pull nomic-embed-text:latest
316
316
317
317
# Start Ollama (usually runs as service)
318
318
ollama serve
319
319
```
320
320
321
+
#### Useful Ollama ENV variables
322
+
323
+
```bash
324
+
OLLAMA_CONTEXT_LENGTH:8192
325
+
OLLAMA_DEBUG:INFO
326
+
OLLAMA_HOST:http://0.0.0.0:11434
327
+
OLLAMA_INTEL_GPU:false
328
+
OLLAMA_KEEP_ALIVE:3h
329
+
OLLAMA_MAX_LOADED_MODELS:1
330
+
OLLAMA_MAX_QUEUE:512
331
+
```
332
+
321
333
## API Endpoints
322
334
323
335
The embedding server provides RESTful endpoints:
@@ -361,6 +373,7 @@ The system uses a single standardized configuration:
361
373
-**tiktoken**: Token counting utilities
362
374
-**einops**: Tensor operations for advanced models
363
375
-**requests**: HTTP client for remote services
376
+
-**pypdf***: PDF parsing library
364
377
365
378
## File Structure
366
379
@@ -374,12 +387,8 @@ The system uses a single standardized configuration:
374
387
└── chroma_db/ # Default ChromaDB storage (created after indexing)
375
388
```
376
389
377
-
## License
378
-
379
-
This project is designed for local development and research use. Please ensure compliance with the terms of service for any external models or APIs used.
380
-
381
390
## Contributions
382
391
383
392
I welcome any assistance on this project, especially around trying new models for better performance and testing against ore logs than I have at my disposal!
0 commit comments