Skip to content

Commit a8f0907

Browse files
authored
Merge pull request #25 from Zubdata/development
Merge Development Branch into Main
2 parents 1e20ac0 + d7cec30 commit a8f0907

20 files changed

Lines changed: 711 additions & 563 deletions

CHANGELOG.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,11 @@
22

33
All notable changes to this project will be documented in this file.
44

5+
6+
## [Unreleased]
7+
### Added
8+
- Added functionality to extract email addresses from location websites
9+
510
## [3.1.0] - 2024-04-26
611
### Added
712
- Added additional data fields

Google map scraper/scraper/parser.py

Lines changed: 0 additions & 151 deletions
This file was deleted.

Google map scraper/starter.py

Lines changed: 0 additions & 21 deletions
This file was deleted.

README.md

Lines changed: 47 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -2,23 +2,18 @@
22

33
## Version: 3.1.0
44

5-
## Note:
6-
**Our all scrapers are working, if you find any issue or bug please open an issue with the detail of issue. We will try to resolve it quickly for you.**
75

8-
<img src="Readme assets/zubdata google maps scraper.jpg" alt="Zubdata open sourced google maps scraper">
9-
10-
Welcome to the Zubdata GitHub Google Maps Scraper repository, an open-source GUI tool built in Python. This tool allows you to extract data from Google Maps using a user-friendly interface.
11-
Documentation can be found at this [link](https://zubdata.com/docs/google-maps-scraper/getting-started/installation/) 🔗
126

137
## Features
14-
8+
- Designed to be highly user-friendly for **beginners**.
159
- User-friendly graphical interface for easy navigation and interaction. 😊
1610
- Scrapes various data from Google Maps, such as:
1711
- **Category**
1812
- **Name**
1913
- **Phone Number**
2014
- **Google Maps URL**
2115
- **Website**
16+
- **Email**
2217
- **Address**
2318
- **Total Reviews**
2419
- **Rating**
@@ -27,38 +22,65 @@ Documentation can be found at this [link](https://zubdata.com/docs/google-maps-s
2722
- **Hours**
2823
- Fast and efficient 🚀
2924

25+
26+
27+
28+
## Note:
29+
**Our all scrapers are working, if you find any issue or bug please open an issue with the detail of issue. We will try to resolve it quickly for you.**
30+
31+
<img src="Readme assets/zubdata google maps scraper.jpg" alt="Zubdata open sourced google maps scraper">
32+
33+
Welcome to the Zubdata GitHub Google Maps Scraper repository, an open-source GUI tool built in Python. This tool allows you to extract data from Google Maps using a user-friendly interface.
34+
Documentation can be found at this [link](https://zubdata.com/docs/google-maps-scraper/getting-started/installation/) 🔗
35+
3036
## Sample Data
3137
{
32-
"Category":"Restaurant",
33-
"Name":"Veh\u0101ri Village",
34-
"Phone":"0300 0020103",
35-
"Google Maps URL":"https:\/\/www.google.com\/maps\/place\/Veh%C4%81ri+Village\/data=!4m7!3m6!1s0x393cc006c30226c7:0xb71394954cfc0b22!8m2!3d30.0558272!4d72.3348188!16s%2Fg%2F11cmp6z14g!19sChIJxyYCwwbAPDkRIgv8TJWUE7c?authuser=0&hl=en&rclk=1",
36-
"Website":"https:\/\/www.facebook.com\/VehariVillage\/",
37-
"Business Status":"Open\u22c5 Closes 1\u202fam",
38-
"Address":"The Royal Gardens Society, Khanewal Vehari Rd, Vehari, Punjab",
39-
"Total Reviews":"(347)",
38+
"Category":"Shopping mall",
39+
"Name":"Packages Mall",
40+
"Phone":"(042) 111 696 255",
41+
"Google Maps URL":"https:\/\/www.google.com\/maps\/place\/Packages+Mall\/data=!4m7!3m6!1s0x39190680e8f2d445:0x32ba63a1571efb2a!8m2!3d31.4715199!4d74.3555422!16s%2Fg%2F11gmxj94jy!19sChIJRdTy6IAGGTkRKvseV6FjujI?authuser=0&hl=en&rclk=1",
42+
"Website":"http:\/\/www.packagesmall.com\/",
43+
"email":"careers@packagesmall.com, info@packagesmall.com",
44+
"Business Status":"Open\u22c5 Closes 10\u202fpm",
45+
"Address":"Main Walton Rd, Shahrah-E-Roomi Nishtar Town, Lahore, Punjab 54750",
46+
"Total Reviews":"(67,295)",
4047
"Booking Links":null,
41-
"Rating":"4.2 stars ",
42-
"Hours":"Friday9\u202fam\u20131\u202famSaturday9\u202fam\u20131\u202famSunday9\u202fam\u201312\u202famMonday9\u202fam\u20131\u202famTuesday9\u202fam\u20131\u202famWednesday9\u202fam\u20131\u202famThursday9\u202fam\u20131\u202famSuggest new hours"
48+
"Rating":"4.6",
49+
"Hours":"Sunday11\u202fam\u201310\u202fpm\ue14dMonday11\u202fam\u201310\u202fpm\ue14dTuesday11\u202fam\u201310\u202fpm\ue14dWednesday11\u202fam\u201310\u202fpm\ue14dThursday11\u202fam\u201310\u202fpm\ue14dFriday11\u202fam\u201310\u202fpm\ue14dSaturday11\u202fam\u201310\u202fpm\ue14dSuggest new hours"
4350
}
4451

4552
## Getting Started
4653

4754
To get started with the Google Maps Scraper, follow these steps:
4855

49-
1. Clone the repository to your local machine:
56+
### 1. Clone the repository to your local machine:
5057

5158
```shell
5259
git clone https://github.com/Zubdata/Google-Maps-Scraper.git
5360
```
5461

55-
2. Install the required dependencies by running the following command:
56-
```shell
57-
pip install -r requirements.txt
62+
### 2. Setup the Environment for Scraper
63+
64+
- For Windows, run:
65+
```bash
66+
./setup_win.cmd
5867
```
59-
3. Run the command in root directory:
68+
- For Linux, run:
69+
```
70+
./setup_linux.sh
71+
```
72+
73+
It will auto install the dependencies
74+
75+
## 3. Install the Driver
76+
77+
- If you already have a driver compatible with your Chrome browser, specify the driver path in `app/settings.py`.
78+
- If you don't have a driver, the scraper will automatically install it.
79+
- If the automatic installation fails, download the driver from the [Chrome Official Page](https://googlechromelabs.github.io/chrome-for-testing/#stable) and specify the driver path in `app/settings.py`. And then re-run the scraper.
80+
81+
### 3. Run the scraper:
6082
```shell
61-
python "Google map scraper\starter.py" start
83+
python app/run.py
6284
```
6385

6486
`For further helping docs please visit our` [documentation](https://zubdata.com/docs/google-maps-scraper) `page`
@@ -75,7 +97,7 @@ We welcome contributions from the open-source community to enhance the Google Ma
7597

7698
4. Push your changes to your forked repository.
7799

78-
5. Create a pull request to the `main` branch of the repository.
100+
5. Create a pull request to the `development` branch of the repository.
79101

80102
6. Wait for the code review and address any feedback received.
81103

@@ -89,7 +111,7 @@ The Google Maps Scraper tool is open-source software licensed under the [GNU GEN
89111

90112
If you encounter any issues or have any questions or suggestions, please feel free to open an issue. We appreciate your feedback and are here to assist you.
91113

92-
Happy scraping with Zubdata's Google Maps Scraper! ✨
114+
`Developed with Love for you ✨`
93115

94116
## Buy me a coffee☕
95117

app/run.py

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
from scraper.frontend import Frontend
2+
3+
4+
def main():
5+
6+
app = Frontend()
7+
app.root.protocol("WM_DELETE_WINDOW", app.closingbrowser)
8+
app.root.mainloop()
9+
10+
11+
if __name__ == "__main__":
12+
main()
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88

99

1010
class Base:
11-
timeout = 60
11+
timeout = 120
1212

1313
def openingurl(self, url: str):
1414
"""

0 commit comments

Comments
 (0)