Skip to content

Latest commit

 

History

History
20 lines (13 loc) · 1005 Bytes

File metadata and controls

20 lines (13 loc) · 1005 Bytes

🐦 Graph Rag Based Brand Intelligence System

Asynchronous Twitter Scraper

This project is an asynchronous Twitter scraper that fetches tweets based on a specified brand or keyword.

The scraper utilizes Twikit to interact with Twitter's search feature and supports pagination using cursors to fetch large amounts of data efficiently.

Try it on Twikit

🚀 Key Features

  • 🔍 Fetches real-time tweets mentioning specific brands (e.g., Nike, Adidas, Under Armour)
  • 🕒 Supports asynchronous execution for non-blocking API requests
  • 📦 Stores tweets in CSV format for easy data analysis
  • 🔄 Handles rate limits gracefully using Twikit's API headers
  • Uses cursor-based pagination for continuous tweet extraction
  • 🛠️ Well-structured modular codebase for easy customization
  • Skips duplicate tweets to avoid redundant data