Skip to content

Commit 40f85c3

Browse files
committed
Bug fixes
1 parent 7f150e1 commit 40f85c3

File tree

1 file changed

+5
-4
lines changed

1 file changed

+5
-4
lines changed

README.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -250,16 +250,17 @@ Here is the architecture of `Ask Question/Doubt` component:
250250

251251
```
252252

253-
- For our **Interactive Conversational AI Examiner** Component, as of now we are not doing any training as its based on
254-
recent Generative AI LLMs (Large Language models) (open access models like LLaMA, Falcon etc.). You can update the API configuration by specifying hf_model_name (LLM name available in huggingface Hub). Please checkout https://huggingface.co/models for LLMs.
253+
- For our **Interactive Conversational AI Examiner** Component, we use an Instruct-tuned or RLHF Large Language model (LLM) based on recent advancements in Generative AI. You can update the API configuration by specifying hf_model_name (LLM name available in huggingface Hub). Please checkout https://huggingface.co/models for LLMs.
255254

256255
Here is the architecture of `Interactive Conversational AI Examiner` component:
257256

258257
![](./assets/AI-Examiner.png)
259258

260-
Here for performance gain, we can use INT8 quantized model optimized using Intel® Neural Compressor (Few options are like https://huggingface.co/decapoda-research/llama-7b-hf-int8 etc.)
259+
We can use several open access models from hugging face Hub like MPT-7B-instruct (https://huggingface.co/mosaicml/mpt-7b-instruct), Falcon-7B-instruct (https://huggingface.co/TheBloke/falcon-7b-instruct-GPTQ), etc. (follow https://huggingface.co/models for more options.)
261260

262-
Please Note that for fun 😄, we also provide usage of Azure OpenAI Cognitive Service to use models like GPT3 paid subscription API. You just need to provide `azure_deployment_name`, set `llm_name` as `azure_gpt3` in the below configuration and then add `<your_key>`
261+
Here for performance gain, we can use INT8 quantized model optimized using Intel® Neural Compressor (like https://huggingface.co/decapoda-research/llama-7b-hf-int8 etc.)
262+
263+
Please Note that for fun 😄, we also provide usage of Azure OpenAI Service to use models like GPT3 with paid subscription API. You just need to provide `azure_deployment_name`, set `llm_name` as `azure_gpt3` in the below configuration and then add `<your_key>`
263264

264265
```python
265266

0 commit comments

Comments
 (0)