Make
HTTP module
Section titled “HTTP module”- Add the HTTP → Make a request module to your scenario.
- Set the URL to the endpoint, e.g.
https://api.scrapier.io/api/v2/google-maps/, and methodGET. Keep the trailing slash. - Add a header: name
X-API-Key, value your API key from app.scrapier.io/dashboard/api-keys. - Add the endpoint’s parameters as query string items, e.g.
queries=coffee shops. - Turn on Parse response, then run the module once.
Make parses the JSON, so data (the page, including its result array and next_cursor) can be mapped into later modules.
More pages
Section titled “More pages”To fetch the next page, call the same URL again with a cursor query item set to the previous response’s data.next_cursor. Required inputs are ignored when a cursor is sent. Stop when next_cursor is empty (null). Each page is one billed call. See Pagination.
Errors
Section titled “Errors”A failed call returns a non-2xx status and isn’t billed. The message is in error (or detail for key problems). See Errors for what each status means and which ones are worth retrying.