Skip to content

Commit fad13e7

Browse files
danpoletaevTC-MO
andauthored
fix: fetch Google SERP multiple pages (#2244)
This PR updated our documentation to include information about how to fetch multiple pages from Google in 1 request <!-- CURSOR_SUMMARY --> --- > [!NOTE] > **Low Risk** > Documentation-only change with no runtime or behavioral impact to the proxy/service. > > **Overview** > Updates `google_serp_proxy.md` to clarify pagination behavior for Google SERP requests. > > Documents that Google’s `num` query parameter is deprecated/ignored, and introduces a supported `numPages` parameter (1–10) that fetches multiple result pages in one request, including pricing implications and an alternative using Google’s `start` parameter. > > <sup>Written by [Cursor Bugbot](https://cursor.com/dashboard?tab=bugbot) for commit 41ac9ee. Configure [here](https://cursor.com/dashboard?tab=bugbot).</sup> <!-- /CURSOR_SUMMARY --> --------- Co-authored-by: Michał Olender <92638966+TC-MO@users.noreply.github.com>
1 parent ab7ed2e commit fad13e7

1 file changed

Lines changed: 32 additions & 0 deletions

File tree

sources/platform/proxy/google_serp_proxy.md

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,38 @@ For example:
5959

6060
See a [full list](https://ipfs.io/ipfs/QmXoypizjW3WknFiJnKLwHCnL72vedxjQkDDP1mXWo6uco/wiki/List_of_Google_domains.html) of available domain names for specific countries. When using them, remember to prepend the domain name with the `www.` prefix.
6161

62+
## Fetch more than one page of results
63+
64+
By default, Google returns up to _10 search results per page_. To retrieve additional results beyond the first page, use the `numPages` query parameter.
65+
66+
When you specify `numPages`, the proxy makes multiple requests in the background and merges them into a single HTML response.
67+
68+
### `numPages` parameter
69+
70+
Add the `numPages` parameter to your search URL with a value between 1 and 10:
71+
72+
```text
73+
http://www.google.com/search?q=wikipedia&numPages=3
74+
```
75+
76+
This example fetches and combines the first 3 pages of results (up to 30 results total) into one HTML response.
77+
78+
:::caution Pricing for multi-page requests
79+
Each page counts as a separate request. A request with `numPages=10` is priced as 10 requests.
80+
:::
81+
82+
Use Google's `start` parameter to handle pagination manually. The `start` parameter specifies the index of the first result (e.g., `start=10` for page 2, `start=20` for page 3).
83+
84+
### Deprecated `num` parameter
85+
86+
Google has deprecated the `num` query parameter, which previously controlled the number of results displayed per page.
87+
88+
:::caution Ignored parameter
89+
If you include the `num` parameter in your requests, it will be ignored. Google no longer supports this parameter, and Google SERP proxy does not process it.
90+
:::
91+
92+
To retrieve more than 10 results, use the `numPages` parameter described before instead.
93+
6294
## Examples
6395

6496
### Using the Apify SDK

0 commit comments

Comments
 (0)