Skip to content

RavinduBA/e19-4yp-AI-Powered-Knowledge-Management-System

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

79 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation


Leveraging AI-Powered Knowledge Management Systems to Enhance Operational Efficiency


National Research and Education Networks (NRENs) play a crucial role in supporting academic and research communities by providing advanced technological infrastructure and services. As these organizations grow in complexity, there is an increasing need for efficient knowledge management systems to support their operations. This research project aims to explore the potential of AI-powered knowledge management systems in enhancing the operational efficiency of NRENs, with a focus on managing institutional knowledge, training materials, and administrative guidelines.

This research project aims to explore the potential of AI-powered knowledge management systems in enhancing the operational efficiency of NRENs, with a focus on managing:

  • Institutional knowledge
  • Training materials
  • Administrative guidelines

Research Objectives

  • Primary Goal: Develop an AI-powered knowledge management system tailored for NREN operations
  • Focus Areas: Institutional knowledge preservation, training material organization, administrative guideline accessibility
  • Target Outcome: Enhanced operational efficiency through intelligent information retrieval and management

Technical Architecture

RAG (Retrieval-Augmented Generation) System

Our approach leverages RAG architecture to combine the benefits of large language models with domain-specific knowledge retrieval:

ARG ARCHITECTURE

Core Components

  1. Document Processing Pipeline

    • Text extraction from various formats (PDF, DOC, HTML)
    • Chunking and preprocessing
    • Vector embedding generation
  2. Vector Database

    • Semantic search capabilities
    • Efficient similarity matching
    • Scalable storage for large document collections
  3. Language Model Integration

    • Context-aware response generation
    • Query understanding and refinement
    • Multi-turn conversation support

Technology Stack

Language Models

  • Embeddings: text-embedding-3-small (cost-effective)
  • Chat: gpt-3.5-turbo (good balance of cost and performance)

Use Cases:

  • Text generation and summarization

  • Query understanding and response synthesis

  • Context-aware information retrieval

  • Vector Database: Chroma

  • Similarity Search: `Cosine similarity, semantic matching``

Development Framework

  • LangChain for LLM orchestration
  • OpenAI API for language models
  • Vector database (Chroma)
  • Flask/Python for backend services
  • NextJS for frontend interface

Setup Instructions

1. Clone this repository:

git clone https://github.com/cepdnaclk/e19-4yp-AI-Powered-Knowledge-Management-System.git

2. Navigate to the Code Folder

cd code

3. Create Python Environment and Activate It

On Windows:

python -m venv venv
venv\Scripts\activate

4. Install Required Packages

pip install -r requirements.txt

5. Create .env File with API Key

Create a .env file in the project root directory:

echo. > .env

Edit the .env file and add your OpenAI API key:

OPENAI_API_KEY=sk-your-actual-api-key-here

6. Run the Flask server

python app.py

7. Interact with the API using Postman

You can send HTTP POST requests using Postman to check system status, populate, clear, or query the database.

EX : Ask a Question❓

Endpoint:

POST http://127.0.0.1:5000/api/query

Headers:

Content-Type: application/json

Body:

{
  "query": "What is this system about?"
}

About

This project explores AI-powered systems to enhance operations, focusing on managing institutional knowledge, training, and administrative guidelines.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • TypeScript 77.8%
  • Python 20.0%
  • CSS 1.5%
  • Other 0.7%