Skip to content

Add Ollama integration with local LLMs and fix conversation history#14

Merged
NeurArk merged 2 commits into
mainfrom
feature/edge-ai-fallback
May 9, 2025
Merged

Add Ollama integration with local LLMs and fix conversation history#14
NeurArk merged 2 commits into
mainfrom
feature/edge-ai-fallback

Conversation

@NeurArk
Copy link
Copy Markdown
Owner

@NeurArk NeurArk commented May 9, 2025

Summary

  • Add Ollama integration to support local language models
  • Implement session management for persistent conversations
  • Fix conversation history persistence using prev_result.to_input_list()
  • Simplify chat history management with a single source of truth
  • Add proper coroutine cleanup to avoid event loop warnings
  • Add comprehensive test coverage for session management and Ollama integration

Features

  • Support for local LLMs through Ollama integration
  • UI toggle to switch between OpenAI and local models
  • Fallback mechanisms when either service is unavailable
  • Persistent conversation history across multiple exchanges

Test Plan

  • Verify that conversation history is maintained between calls
  • Confirm Ollama integration works with local models
  • Run pytest suite to confirm all tests pass
  • Ensure PDF reports are created without unnecessary clarification requests

NeurArk added 2 commits May 9, 2025 20:18
- Fix history persistence using prev_result.to_input_list()
- Simplify chat history management with a single source of truth
- Add proper coroutine cleanup to avoid 'never awaited' warnings
- Ensure httpx clients are properly closed when using Ollama
- Add comprehensive test coverage for session management
- Move sample data to data directory
- Update tests to use new data paths
- Update CI configuration for linting
- Reorganize imports and fix unused variables
- Enhance PDF tool functionality
- Update documentation
@NeurArk NeurArk merged commit 4ea0e4d into main May 9, 2025
3 checks passed
@NeurArk NeurArk deleted the feature/edge-ai-fallback branch May 9, 2025 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant