Structured Bulk Data Extract with Bright Data Web Scraper
Configured with Aggregate, Function, HTTP Request, Read Write File, and additional nodes. Review the connections and setup before adapting this template.
Node categories in this workflow
- Trigger
- Routing
- Transform
- Web / API
- Wait
- Code
- Files / media
Icons describe general node roles, inferred from node types. Inspect the parameters for the configured action.
Drag to pan; use + and − to zoom. Reconstructed from the exported node positions; nothing runs here. Dashed lines represent non-main connections. Full node names and notes appear below.
How it works
The exported workflow contains the following configured nodes. Their connections are shown above; inspect the JSON for the complete logic, expressions, and external actions.
| Node | Category | Type | Operation |
|---|---|---|---|
| When clicking ‘Test workflow’ | Trigger | Manual Trigger | See node parameters |
| If | Routing | If | See node parameters |
| Set Snapshot Id | Transform | Edit Fields | See node parameters |
| Download Snapshot | Web / API | HTTP Request | See node parameters |
| Wait | Wait | Wait | See node parameters |
| Check on the errors | Routing | If | See node parameters |
| Check Snapshot Status | Web / API | HTTP Request | See node parameters |
| Initiate a Webhook Notification | Web / API | HTTP Request | See node parameters |
| Aggregate JSON Response | Transform | Aggregate | See node parameters |
| Set Dataset Id, Request URL | Transform | Edit Fields | See node parameters |
| Create a binary data | Code | Function | See node parameters |
| Write the file to disk | Files / media | Read Write File | write |
| HTTP Request to the specified URL | Web / API | HTTP Request | POST |
Setup
- Download the JSON and import it into an isolated n8n instance. Leave the workflow inactive.
- Connect your own credentials through n8n’s credential store. Replace
REPLACE_WITH_*values with your resource identifiers. - Inspect API destinations, Code nodes, database queries, file paths, and outbound actions.
- Run with synthetic data and harmless destinations. Enable triggers only after checking the actual outputs.
Requirements
An n8n instance with the listed node types and compatible versions. Service-connected workflows may require accounts, credentials, or paid APIs.
Credential types declared in the source
httpHeaderAuth
Workflow notes
Note
Note
Deals with the Amazon web scraping by utilizing Bright Data Web Scraper Product.
Please make sure to set the Bright Data -> Dataset Id, Request URL and update the Webhook Notification URL
Refer
- https://brightdata.com/products/web-scraper/ai
- https://brightdata.com/products/web-scraper
Who can benefit?
Who can benefit?
Data analysts, scientists, engineers, and developers seeking efficient methods to collect and analyze web data for AI, ML, big data applications, and more will find Scraper APIs particularly beneficial.
Structured Bulk Data Extract with Bright Data Web Scraper
Structured Bulk Data Extract with Bright Data Web Scraper
Purpose and structure
This folder contains the Structured Bulk Data Extract with Bright Data Web Scraper workflow. Its executable nodes use aggregate, function, httpRequest, if, manualTrigger, readWriteFile, set, wait. The table and connection map below are derived from the JSON, not an inferred guarantee of behavior.
Setup
Import inactive. Configure your own credentials and replace REPLACE_WITH_* values. Review external destinations and Code nodes before running.
Entry points
When clicking ‘Test workflow’
Verification
Sanitized source candidate; not runtime-tested. This overview is generated from node metadata. Read the folder README for the connection map, credential types, and license.
Attribution
https://github.com/Zie619/n8n-workflows/blob/94007c1445d9258a7da116646b79473e7c7c3282/workflows/Wait/1579_Wait_Manual_Automation_Webhook.json MIT; preserve source notices.
Canvas section labels
These name areas of the original canvas; they do not include explanatory instructions.
- Wait until the Snapshot is ready