AWS S3 to EFS Data Migration using AWS DataSync

📖 Project Overview

This project demonstrates a complete data migration workflow from Amazon S3 to Amazon Elastic File System (EFS) using AWS DataSync.
The migration is verified using an EC2 instance, created and managed through AWS CloudShell, and accessed via MobaXterm for remote operations.

---

Architecture Overview

AWS Services Used

• Amazon S3 – Source data storage bucket.
• Amazon EFS – Target file system to store migrated data.
• AWS DataSync – Automates and accelerates data transfer between S3 and EFS.
• Amazon EC2 – Used to verify the transferred data by mounting EFS.
• AWS CloudShell – For creating and managing AWS resources via CLI.
• MobaXterm – Used to SSH into EC2 instances and run commands.

---

Data Flow

1. Upload source data to Amazon S3.
2. Create a DataSync task to transfer data from S3 → EFS.
3. Launch an EC2 instance in the same VPC as EFS using CloudShell.
4. Connect to EC2 using MobaXterm via the public IP.
5. Install NFS utilities on EC2 to mount the EFS file system.
6. Verify the transferred data inside the mounted directory.

---

Prerequisites

Before you begin, ensure you have:

• An AWS account with proper IAM permissions for S3, EFS, EC2, and DataSync.
• AWS CLI configured in CloudShell.
• A key pair (.pem) file for EC2 SSH access.
• MobaXterm installed for connecting to EC2.

---

How It Works

1. Data is stored in an S3 bucket.
2. AWS DataSync copies the data to EFS automatically.
3. EC2 instance mounts the EFS volume using NFS protocol.
4. The transferred files from S3 are visible inside EC2’s mounted directory.

---

Commands Overview

Install NFS Utils on EC2:

sudo -s
sudo yum install -y nfs-utils
mkdir test
mount -t nfs4 efsdnsname:/ test/


## Learning Outcomes

- Understanding of DataSync automation for cloud data migration.
- Familiarity with AWS storage services (S3, EFS).
- Hands-on experience using CloudShell, EC2, and MobaXterm for verification.
- Ability to manage and monitor data transfers across AWS services.

## 👩‍💻 Author
**Keerthi B**
📧 Email: bkeerthi1528@gmail.com
🔗 LinkedIn: [www.linkedin.com/in/siva-sai-keerthi-bondalapati-b89779248](#)