Yahoo Search
Structured Yahoo data: send queries. Cursor-paginated, 1 credit per successful call.
Overview
Section titled “Overview”Call GET /api/v2/yahoo-search/ with queries. The results are in data.results; send data.next_cursor back as cursor to get the next page. 5 optional parameters refine the call (see Parameters).
Request
Section titled “Request”curl -G "https://api.scrapier.io/api/v2/yahoo-search/" \ -H "X-API-Key: YOUR_API_KEY" \ --data-urlencode "queries=java developer" \ --max-time 210const params = new URLSearchParams({ queries: "java developer" });
const res = await fetch(`https://api.scrapier.io/api/v2/yahoo-search/?${params}`, { headers: { "X-API-Key": "YOUR_API_KEY" }, signal: AbortSignal.timeout(210_000),});const body = await res.json();if (!res.ok) throw new Error(body.error ?? body.detail ?? `HTTP ${res.status}`);
console.log(body.data.results);import requests
resp = requests.get( "https://api.scrapier.io/api/v2/yahoo-search/", headers={"X-API-Key": "YOUR_API_KEY"}, params={"queries": "java developer"}, timeout=210,)body = resp.json()if not resp.ok: raise RuntimeError(body.get("error") or body.get("detail"))
print(body["data"]["results"])curl -X POST "https://api.scrapier.io/api/v2/yahoo-search/" \ -H "X-API-Key: YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{"queries":"java developer"}' \ --max-time 210Parameters
Section titled “Parameters”| Name | Type | Required | Default | Description |
|---|---|---|---|---|
X-API-Key header | string | yes | — | Your API key from the dashboard. |
queries | string | yes | e.g. java developer | Search term. Required on first call; ignored when cursor is supplied. |
cursor | string | no | — | Pagination cursor returned in the previous response's next_cursor. Pass it back unchanged to fetch the next page. When next_cursor is null, you have reached the last page. |
time_period | string | no | Anytime | Filter by recency. AnytimePast dayPast weekPast month locked in cursor |
backfill_empty_results | boolean | no | true | Fetch each result's own page to fill in text/links when Yahoo's SERP snippet is empty.locked in cursor |
backfill_concurrency | integer | no | 8 | Concurrent backfill page fetches per page. locked in cursor |
backfill_max_links | integer | no | 10 | Max sub-links to extract per backfilled result page. locked in cursor |
Advanced
| Name | Type | Default | Description |
|---|---|---|---|
use_proxy | boolean | true | Route the request through Scrapier's residential proxy pool. Default: true. Leave as is unless support tells you otherwise. |
raw_data | boolean | false | When true, the response carries the full raw upstream payload(s) the scraper received (GraphQL / JSON API bodies, HTML, embedded JSON-LD -- exactly as the platform returned them) under raw_responses, in place of the formatted items. When false (default) you get the formatted output. Pagination (cursor / next_cursor) works the same in both modes. |
Response
Section titled “Response”{ "success": true, "data": { "query": "java developer", "page": 1, "page_size": 7, "results": [ { "url": "https://www.geeksforgeeks.org/gfg-academy/how-to-become-a-java-developer/", "title": "How to become a Java Developer? - GeeksforGeeks", "description": "What is a Java Developer? A Java Developer is a software engineer who builds, maintains, and improves applications using Java.", "text": " * Careers & Jobs in Java\n\nCareers in Java are in high demand...\n", "logo_url": "https://s.yimg.com/pv/static/search_favicon/images/32x32_7eae5aac8b7f7402.png", "links": [ "https://www.geeksforgeeks.org/java/careers-jobs-in-java/" ], "domain": "www.geeksforgeeks.org" } ], "next_cursor": "eyJxIjoiamF2YSBkZXZlbG9wZXIiLCJiIjo4LCJ0cCI6IkFueXRpbWUiLCJiZiI6dHJ1ZSwiYmMiOjgsImJsIjoxMCwiaCI6ImFiYzEyM2RlZiJ9" }}Bad input. The exact message varies by endpoint.
{ "success": false, "error": "…"}Balance below the endpoint’s price.
{ "error": "Insufficient credits. Buy more to scrape more.", "balance": 1, "required": 2}Invalid or unknown API key.
{ "detail": "Authentication service unavailable or invalid API key."}Throttled — wait for Retry-After.
{ "detail": "Request was throttled. Expected available in N seconds."}Sample from the live catalog; arrays trimmed to 3 items. Results are in data.results.
Response fields
Section titled “Response fields”| Field | Type | Example | Description |
|---|---|---|---|
query | string | java developer | — |
page | integer | 1 | — |
page_size | integer | 7 | — |
results | array | [1 item] | The results. |
next_cursor | string | eyJxIjoiamF2YSBkZXZlbG9wZXIiLCJiIjo4LCJ0cCI6I… | Pass back as cursor for the next page. null on the last page. |
results[].url | string | https://www.geeksforgeeks.org/gfg-academy/how… | — |
results[].title | string | How to become a Java Developer? - GeeksforGeeks | — |
results[].description | string | What is a Java Developer? A Java Developer is… | — |
results[].text | string | * Careers & Jobs in Java Careers in Java a… | — |
results[].logo_url | string | https://s.yimg.com/pv/static/search_favicon/i… | — |
results[].links | array | [1 item] | — |
results[].domain | string | www.geeksforgeeks.org | — |
Pagination
Section titled “Pagination”Pass data.next_cursor back as cursor until it is null. Required inputs are ignored once a cursor is sent. Each page is one billed call. More in Pagination.
const url = "https://api.scrapier.io/api/v2/yahoo-search/";let params = { queries: "java developer" };const items = [];
for (let page = 0; page < 10; page++) { // each page is one billed call const res = await fetch(`${url}?${new URLSearchParams(params)}`, { headers: { "X-API-Key": "YOUR_API_KEY" }, signal: AbortSignal.timeout(210_000), }); const body = await res.json(); if (!res.ok) throw new Error(body.error ?? body.detail ?? `HTTP ${res.status}`); const data = body.data; items.push(...(data.results ?? [])); if (!data.next_cursor) break; // null = last page params = { cursor: data.next_cursor };}import requests
URL = "https://api.scrapier.io/api/v2/yahoo-search/"HEADERS = {"X-API-Key": "YOUR_API_KEY"}params = {"queries": "java developer"}items = []
for _ in range(10): # each page is one billed call resp = requests.get(URL, headers=HEADERS, params=params, timeout=210) resp.raise_for_status() data = resp.json()["data"] items.extend(data.get("results") or []) if not data.get("next_cursor"): # None = last page break params = {"cursor": data["next_cursor"]}Errors
Section titled “Errors”Failed calls are free. Branch on the HTTP status and read the message from error (or detail). Full details in Errors.
| Status | Meaning | Retry? | Charged? |
|---|---|---|---|
400 | Bad or missing input. | No — fix the params | No |
401 / 403 | Missing, invalid or revoked API key. | No — fix the key | No |
402 | Out of credits (body has balance). | No — top up | No |
404 | Unknown endpoint slug. | No — check the slug | No |
429 / 503 | Busy or throttled. | Yes — after Retry-After | No |
5xx | Target site or upstream failure, or timeout. | Yes — with backoff | No |
- Locked into the cursor:
time_period,backfill_empty_results,backfill_concurrency,backfill_max_links. Set them on the first call; later pages reuse them.