n8n
There are two ways to use Scrapier in n8n: the Scrapier community node (easiest), or n8n’s built-in HTTP Request node, which can call any endpoint.
Scrapier community node
Section titled “Scrapier community node”The package is n8n-nodes-scrapier. Version 1.1.0 uses API v2: every scrape is synchronous, and one call returns one page of results.
- In self-hosted n8n, open Settings → Community Nodes → Install.
- Enter
n8n-nodes-scrapierand install it. - Add a Scrapier node to a workflow and create a Scrapier credential with your API key from app.scrapier.io/dashboard/api-keys. n8n checks the key against
GET /api/v2/meand shows your account email on the credential.
What’s in the node
Section titled “What’s in the node”- Curated operations for the most-used scrapers, plus Custom Scrape, which calls any endpoint in the catalog by slug with a JSON parameter object.
- One item per page: each call outputs the page object (the results under an endpoint-specific key such as
results,productsorposts, plusnext_cursor) as a single n8n item. - Cursor pagination: most operations have an optional Cursor field. Set it to the previous page’s
next_cursor, e.g.{{ $json.next_cursor }}in a loop. Required inputs are ignored when a cursor is set, andnext_cursorisnullon the last page. See Pagination. - Errors: a failed call fails the node with the API’s error message, or outputs
{ "error": "..." }when Continue On Fail is on. - Pricing: each successful call costs the endpoint’s
cost_credit(most endpoints cost 1 credit; see Credits & pricing), however many results the page holds. Failed calls are free.
Upgrading from 1.0.x
Section titled “Upgrading from 1.0.x”1.1.0 moved from API v1 to v2 and is a breaking change for some workflows:
- Google Map Reviews was removed (not available in v2).
- Youtube Search was replaced by Youtube Search Full.
- The Webhook URL option was removed, because v2 returns results directly.
- The Split Rows Into Items option was removed; output is one item per page.
HTTP Request node
Section titled “HTTP Request node”No install needed, and it can call every endpoint.
- Add an HTTP Request node.
- Create a credential of type Header Auth with name
X-API-Keyand your key as the value. Keeping the key in a credential keeps it out of the workflow JSON. - Set the method and URL for the endpoint, e.g.
GET https://api.scrapier.io/api/v2/google-maps/with the query parameterqueries=coffee shops. Keep the trailing slash. - Run it. The result is in the node’s output under
data.
For more pages, loop while data.next_cursor is set and send it as the cursor query parameter. You can also paste a cURL command from any endpoint page into n8n’s Import cURL:
curl -G "https://api.scrapier.io/api/v2/google-maps/" \ -H "X-API-Key: YOUR_API_KEY" \ --data-urlencode "queries=coffee shops"Read each endpoint’s parameters on its page, or from GET https://api.scrapier.io/api/v2/endpoints.