Skip to content

Add implementation of Shopify scraper.#156

Open
AbdElRhmanArafa wants to merge 1 commit into
mainfrom
add-Shopify-scraper
Open

Add implementation of Shopify scraper.#156
AbdElRhmanArafa wants to merge 1 commit into
mainfrom
add-Shopify-scraper

Conversation

@AbdElRhmanArafa

Copy link
Copy Markdown
Contributor
  1. scrape_products: fall back to parsing the HTML if the JSON data is not available, since not all websites expose product JSON (it can be enabled or disabled by the website owner).

There are two test cases:

  • allbirds.com: JSON is available, so no fallback is used.
  • gymshark.com: No JSON is available, so it falls back to HTML parsing.
  1. scrape_catalog: I couldn't find a fallback url that works consistently across all store domains, so I didn't implement one.

@AbdElRhmanArafa
AbdElRhmanArafa requested a review from mazen-r July 23, 2026 20:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant