Ecommerce Product Page Scraper

Extract structured product snapshots from public ecommerce product page URLs. Paste product links and get normalized rows with title, price, availability, identifiers, images, ratings, breadcrumbs, metadata provenance, and per-URL errors when a page is blocked or missing.

Use this Actor for price monitoring, competitor analysis, product catalog enrichment, SEO audits, marketplace research, and automated checks where you already have product URLs.

Who is this for?

• Ecommerce analysts comparing public prices and stock status across stores.
• Price-monitoring operators who already maintain lists of product URLs.
• SEO and content teams auditing product metadata, descriptions, images, and breadcrumbs.
• Data teams enriching internal catalogs with public product page snapshots.
• Dropshipping and marketplace researchers checking visible identifiers, availability, and price text.

Use cases

• Monitor public prices and availability for a known set of competitor products.
• Enrich a product database with titles, descriptions, images, and identifiers.
• Audit product pages for missing structured metadata or empty descriptions.
• Check stale product links and capture 404/error rows without failing the whole run.
• Feed normalized product data into spreadsheets, dashboards, alerts, or agents.

Example input

{
  "urls": [
    "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html",
    "https://books.toscrape.com/catalogue/tipping-the-velvet_999/index.html"
  ],
  "maxItems": 2,
  "includeRawMetadata": false
}

Example output

{
  "url": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html",
  "finalUrl": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html",
  "statusCode": 200,
  "title": "A Light in the Attic",
  "price": "£51.77",
  "currency": null,
  "availability": "In stock (22 available)",
  "sku": null,
  "upc": "a897fe39b1053632",
  "brand": null,
  "description": "It's hard to imagine a world without A Light in the Attic...",
  "ratingValue": null,
  "reviewCount": null,
  "images": [],
  "breadcrumbs": ["Home", "Books", "Poetry", "A Light in the Attic"],
  "structuredDataTypes": [],
  "sourceMethod": "dom",
  "renderModeUsed": "http",
  "attemptedRenderModes": ["http"],
  "warnings": [],
  "error": null,
  "fetchedAt": "2026-07-12T15:44:45.332Z"
}

What data can you extract?

Verified public example tasks

These Apify Store tasks use small, QA-verified inputs and can be opened or cloned directly:

• Compare Two Ecommerce Product Pages — verified run IJSfh1c4gKOy5hi3g produced 2 dataset items.
• Inspect Raw Ecommerce Product Metadata — verified run lmnNYqpXdMQo2xf4O produced 1 dataset item.
• Scrape Public Ecommerce Product Page — verified run m91hC4XTogFMV4fPN produced 1 dataset item.

Input recipes

• Smoke test: Run the default Books to Scrape URL with maxItems: 1.
• Price monitoring sample: Paste 10-50 direct product URLs from public store pages and schedule the Actor daily or weekly.
• Catalog enrichment: Export product URLs from your catalog, run the Actor, then join results by url or finalUrl.
• Error audit: Include known old URLs and check statusCode plus error for missing or redirected product pages.

Tips for best results

• Use direct public HTTP(S) product-detail URLs, not category, search, cart, or checkout URLs. Private-network addresses, credentials, and non-standard ports are rejected before the run starts.
• Product fields vary by store. Empty fields mean the page did not expose that data clearly.
• For blocked stores, try Apify Proxy settings and keep batches small while testing.
• Keep automatic browser fallback enabled for mixed-store lists. Enable renderJavascript when every URL in a run is known to need client-side rendering.
• Use sourceMethod to understand whether data came from structured metadata, meta tags, or page content.
• Keep includeRawMetadata disabled unless you need debugging details; it can make rows larger.

Limits and caveats

• This Actor extracts public page data only. It does not log in, solve CAPTCHAs, add items to cart, or access account-specific prices.
• The Actor tries fast HTTP first, a same-origin Shopify product-data route when applicable, and bounded browser rendering for classified blocked or incomplete responses. A site can still deny every supported route; those pages remain uncharged diagnostics.
• Automatic browser fallback does not silently enable Residential proxy traffic. Proxy use remains explicit through proxyConfiguration.
• Redirect destinations are validated again. The Actor keeps a bounded pending-work checkpoint and RUN_SUMMARY record when the shared run deadline is near.
• Universal product extraction is best-effort. Store-specific scrapers may be better for high-volume extraction from a single marketplace.

API usage

Node.js:

import { ApifyClient } from "apify-client";

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor("fetch_cat/ecommerce-product-page-scraper").call({
  urls: ["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"],
  maxItems: 1
});
console.log(run.defaultDatasetId);

Python:

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("fetch_cat/ecommerce-product-page-scraper").call(run_input={
    "urls": ["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"],
    "maxItems": 1,
})
print(run["defaultDatasetId"])

cURL:

curl -X POST "https://api.apify.com/v2/acts/fetch_cat~ecommerce-product-page-scraper/runs?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"],"maxItems":1}'

MCP and AI agents

Use this Actor from MCP-compatible tools through the official Apify MCP Server.

claude mcp add --transport http apify "https://mcp.apify.com?tools=fetch_cat/ecommerce-product-page-scraper"

{
  "mcpServers": {
    "apify": {
      "url": "https://mcp.apify.com?tools=fetch_cat/ecommerce-product-page-scraper"
    }
  }
}

Example prompt: "Run Ecommerce Product Page Scraper for these three product URLs and summarize price, stock status, and missing fields."

Support

Open an issue from the Actor page if a run fails or output looks wrong. Include the run ID or run URL, input JSON, expected output, actual output, and one reproducible public URL.