Skip to content

Commit 5b2d069

Browse files
authored
Merge pull request #3316 from odidev/llmaindex
Build RAG applications with LlamaIndex on Google Cloud C4A Axion VM
2 parents 09debb2 + c37d116 commit 5b2d069

17 files changed

Lines changed: 838 additions & 0 deletions
Lines changed: 68 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,68 @@
1+
---
2+
title: Build RAG applications with LlamaIndex on Google Cloud C4A Axion VM
3+
4+
draft: true
5+
cascade:
6+
draft: true
7+
8+
description: Set up LlamaIndex on Google Cloud C4A Axion Arm VMs running SUSE Linux to build browser-based Retrieval-Augmented Generation (RAG) applications using local LLMs, vector databases, and FastAPI.
9+
10+
minutes_to_complete: 30
11+
12+
who_is_this_for: This is an introductory topic for DevOps engineers, AI engineers, ML engineers, and software developers who want to build Retrieval-Augmented Generation (RAG) applications using LlamaIndex on SUSE Linux Enterprise Server (SLES) Arm64, integrate vector databases, and query custom documents using local LLMs.
13+
14+
learning_objectives:
15+
- Install and configure LlamaIndex on Google Cloud C4A Axion processors for Arm64
16+
- Build indexing and retrieval pipelines using LlamaIndex
17+
- Integrate ChromaDB vector databases with local LLMs using Ollama
18+
- Build and test a browser-based RAG application using FastAPI
19+
20+
prerequisites:
21+
- A [Google Cloud Platform (GCP)](https://cloud.google.com/free) account with billing enabled
22+
- Basic familiarity with Python and AI/LLM concepts
23+
24+
author: Pareena Verma
25+
26+
##### Tags
27+
skilllevels: Introductory
28+
subjects: ML
29+
cloud_service_providers:
30+
- Google Cloud
31+
32+
armips:
33+
- Neoverse
34+
35+
tools_software_languages:
36+
- LlamaIndex
37+
- Python
38+
- ChromaDB
39+
- Ollama
40+
- FastAPI
41+
42+
operatingsystems:
43+
- Linux
44+
45+
# ================================================================================
46+
# FIXED, DO NOT MODIFY
47+
# ================================================================================
48+
49+
further_reading:
50+
- resource:
51+
title: LlamaIndex official documentation
52+
link: https://docs.llamaindex.ai/en/stable/
53+
type: documentation
54+
55+
- resource:
56+
title: LlamaIndex GitHub repository
57+
link: https://github.com/run-llama/llama_index
58+
type: documentation
59+
60+
- resource:
61+
title: Ollama documentation
62+
link: https://ollama.com/library
63+
type: documentation
64+
65+
weight: 1
66+
layout: "learningpathall"
67+
learning_path_main_page: yes
68+
---
Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
---
2+
# ================================================================================
3+
# FIXED, DO NOT MODIFY THIS FILE
4+
# ================================================================================
5+
weight: 21 # Set to always be larger than the content in this path to be at the end of the navigation.
6+
title: "Next Steps" # Always the same, html page title.
7+
layout: "learningpathall" # All files under learning paths have this same wrapper for Hugo processing.
8+
---
Lines changed: 38 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,38 @@
1+
---
2+
title: Learn about LlamaIndex and Google Axion C4A for RAG applications
3+
weight: 2
4+
5+
layout: "learningpathall"
6+
---
7+
8+
## Google Axion C4A Arm instances for AI and RAG workloads
9+
10+
Google Axion C4A is a family of Arm-based virtual machines built on Google’s custom Axion CPU, which is based on Arm Neoverse V2 cores. Designed for high-performance and energy-efficient computing, these virtual machines offer strong performance for modern cloud workloads such as AI applications, vector databases, Retrieval-Augmented Generation (RAG) pipelines, and scalable inference services.
11+
12+
The C4A series provides a cost-effective alternative to x86 virtual machines while using the scalability and performance benefits of the Arm architecture in Google Cloud.
13+
14+
To learn more, see the Google blog [Introducing Google Axion Processors, our new Arm-based CPUs](https://cloud.google.com/blog/products/compute/introducing-googles-new-arm-based-cpu).
15+
16+
## LlamaIndex for RAG and context-aware AI applications on Arm
17+
18+
LlamaIndex is an open-source framework designed to build context-aware AI applications using Large Language Models (LLMs). It's widely used for Retrieval-Augmented Generation (RAG), document indexing, vector search, semantic retrieval, and integrating custom data sources with LLMs.
19+
20+
LlamaIndex provides a unified framework with components such as:
21+
22+
* Document loaders for ingesting custom data
23+
* Indexing pipelines for structured retrieval workflows
24+
* Query engines for context-aware question answering
25+
* Vector store integrations for scalable embedding search
26+
* LLM integrations for generating grounded responses
27+
28+
Running LlamaIndex on Google Axion C4A Arm-based infrastructure enables efficient execution of AI and RAG workloads by using multi-core Arm CPUs and optimized memory performance. This results in improved performance per watt, reduced infrastructure costs, and better scalability for browser-based AI applications and local inference pipelines.
29+
30+
Common use cases include browser-based AI assistants, document search applications, semantic retrieval systems, vector database integrations, enterprise knowledge bases, and context-aware chatbot applications.
31+
32+
To learn more, see the [LlamaIndex documentation](https://docs.llamaindex.ai/en/stable/) and the [LlamaIndex GitHub repository](https://github.com/run-llama/llama_index).
33+
34+
## What you've learned and what's next
35+
36+
You've now learned about Google Axion C4A Arm-based virtual machines and their performance advantages for AI and RAG workloads. You were also introduced to core LlamaIndex components including document ingestion, indexing pipelines, query engines, vector stores, and LLM integrations.
37+
38+
Next, you'll create a firewall rule in Google Cloud Console to enable remote access to the browser-based LlamaIndex RAG application used in this Learning Path.

0 commit comments

Comments
 (0)