You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -251,7 +251,11 @@ Here is the detailed architecture of `Ask Question/Doubt` component:
251
251
```
252
252
253
253
- For our **Interactive Conversational AI Examiner** Component, as of now we are not doing any training as its based on
254
-
recent Generative AI LLMs (Large Language models) (open access models like LLaMA, Falcon etc.). You can update the API configuration by specifying hf_model_name (LLM name available in huggingface Hub). Please checkout https://huggingface.co/models for LLMs
254
+
recent Generative AI LLMs (Large Language models) (open access models like LLaMA, Falcon etc.). You can update the API configuration by specifying hf_model_name (LLM name available in huggingface Hub). Please checkout https://huggingface.co/models for LLMs.
255
+
256
+
Here is the architecture of `Interactive Conversational AI Examiner` component:
257
+
258
+

255
259
256
260
Here for performance gain, we can use INT8 quantized model optimized using Intel® Neural Compressor (Few options are like https://huggingface.co/decapoda-research/llama-7b-hf-int8 etc.)
257
261
@@ -306,6 +310,10 @@ Please Note that for fun 😄, we also provide usage of Azure OpenAI Cognitive S
306
310
307
311
# Benchmark Results with Intel® oneAPI AI Analytics Toolkit
308
312
313
+
- We follow the below process flow to optimize our models from both the components
314
+
315
+

316
+
309
317
- We have already added several benchmark results to compare how beneficial Intel® oneAPI AI Analytics Toolkit is compared to baseline. Please go to `benchmark` folder to view the results. Please Note that the shared results are based
310
318
on provided Intel® Dev Cloud machine *[Intel Xeon Processor (Skylake, IBRS) -10v CPUs 16GBRAM]*
311
319
@@ -315,7 +323,7 @@ on provided Intel® Dev Cloud machine *[Intel Xeon Processor (Skylake, IBRS) - 1
315
323
316
324
# What we learned 
317
325
318
-

326
+

319
327
320
328
✅ **Utilizing the Intel® AI Analytics Toolkit**: By utilizing the Intel® AI Analytics Toolkit, developers can leverage familiar Python* tools and frameworks to accelerate the entire data science and analytics process on Intel® architecture. This toolkit incorporates oneAPI libraries for optimized low-level computations, ensuring maximum performance from data preprocessing to deep learning and machine learning tasks. Additionally, it facilitates efficient model development through interoperability.
0 commit comments