Skip to content

readme.md

Latest commit

 

History

History
72 lines (50 loc) · 1.73 KB

readme.md

File metadata and controls

72 lines (50 loc) · 1.73 KB

Awesome ScrapeGraphAI Use Cases

This repository contains practical use cases and examples for the ScrapeGraphAI API, demonstrating how to scrape data from various websites.

📋 Prerequisites

Before running any use case, make sure you have:

  1. Dependencies installed from the requirements.txt file:

    pip install -r requirements.txt

  2. API Key configured in your .env file:

    SGAI_API_KEY=your_api_key_here

    Get your API key from dashboard.scrapegraphai.com

📁 Structure

Each use case is organized in a separate folder with its own implementation:

  • eBay/ - eBay product scraping
  • YouTube/ - YouTube search results scraping
  • Linkedin Profiles/ - LinkedIn profile scraping

Each use case folder contains:

  • A Python scraper script (*-scraper.py)
  • A README.md file with detailed usage instructions

🚀 Quick Start

To run any use case, navigate to the specific folder and execute:

python <use-case-name>-scraper.py

📝 Examples

eBay Product Scraper

cd use-cases/eBay
python ebay-scraper.py

YouTube Search Results Scraper

cd use-cases/YouTube
python youtube-scraper.py

LinkedIn Profile Scraper

cd use-cases/Linkedin Profiles
python linkedin-scraper.py

📚 Documentation

For detailed information about each use case, including customization options and advanced features, check the README.md file in each use case folder.

🔑 Getting Your API Key

  1. Visit dashboard.scrapegraphai.com
  2. Sign up or log in to your account
  3. Navigate to the API keys section
  4. Copy your API key
  5. Add it to your .env file as SGAI_API_KEY