Bear Brown
← All N8N workflows
AI & researchAgentFunctionHTTP RequestLM Chat Google GeminiManual Trigger

Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent

Configured with Agent, Function, HTTP Request, LM Chat Google Gemini, and additional nodes. Review the connections and setup before adapting this template.

Download workflow JSONView files on GitHub ↗15 nodes · MIT
Workflow preview
AI & modelsAI AgentAgentTriggerWhen clicking ‘Testworkflow’Manual TriggerIntegrationMCP Client list alltools for Bright DataMcp ClientIntegrationMCP Client List alltoolsMcp Client ToolIntegrationMCP Client Bright DataWeb ScraperMcp ClientWeb / APIWebhook for web scraperHTTP RequestTransformSet the URLsEdit FieldsIntegrationMCP Client to Scrape asMarkdownMcp Client ToolIntegrationMCP Client to Scrape asHTMLMcp Client ToolAI & modelsGoogle Gemini ChatModel for AI AgentLM Chat Google GeminiData storeSimple MemoryMemory Buffer WindowWeb / APIWebhook for Web ScraperAI AgentHTTP RequestTransformSet the URL with theWebhook URL and data…Edit FieldsCodeCreate a binary dataFunctionFiles / mediaWrite the scrapedcontent to diskRead Write File

Node categories in this workflow

  • AI & models
  • Trigger
  • Integration
  • Web / API
  • Transform
  • Data store
  • Code
  • Files / media

Icons describe general node roles, inferred from node types. Inspect the parameters for the configured action.

Drag to pan; use + and − to zoom. Reconstructed from the exported node positions; nothing runs here. Dashed lines represent non-main connections. Full node names and notes appear below.

How it works

The exported workflow contains the following configured nodes. Their connections are shown above; inspect the JSON for the complete logic, expressions, and external actions.

Workflow node names, types, and operations
NodeCategoryTypeOperation
AI AgentAI & modelsAgentSee node parameters
When clicking ‘Test workflow’TriggerManual TriggerSee node parameters
MCP Client list all tools for Bright DataIntegrationMcp ClientSee node parameters
MCP Client List all toolsIntegrationMcp Client ToolSee node parameters
MCP Client Bright Data Web ScraperIntegrationMcp ClientexecuteTool
Webhook for web scraperWeb / APIHTTP RequestSee node parameters
Set the URLsTransformEdit FieldsSee node parameters
MCP Client to Scrape as MarkdownIntegrationMcp Client ToolexecuteTool
MCP Client to Scrape as HTMLIntegrationMcp Client ToolexecuteTool
Google Gemini Chat Model for AI AgentAI & modelsLM Chat Google GeminiSee node parameters
Simple MemoryData storeMemory Buffer WindowSee node parameters
Webhook for Web Scraper AI AgentWeb / APIHTTP RequestSee node parameters
Set the URL with the Webhook URL and data formatTransformEdit FieldsSee node parameters
Create a binary dataCodeFunctionSee node parameters
Write the scraped content to diskFiles / mediaRead Write Filewrite

Setup

  1. Download the JSON and import it into an isolated n8n instance. Leave the workflow inactive.
  2. Connect your own credentials through n8n’s credential store. Replace REPLACE_WITH_* values with your resource identifiers.
  3. Inspect API destinations, Code nodes, database queries, file paths, and outbound actions.
  4. Run with synthetic data and harmless destinations. Enable triggers only after checking the actual outputs.

Requirements

An n8n instance with the listed node types and compatible versions. Service-connected workflows may require accounts, credentials, or paid APIs.

Credential types declared in the source

  • googlePalmApi
  • mcpClientApi

Workflow notes

AI Agent

Bright Data Web Scraping Agent

MCP Client Bright Data Web Scraper

Scrape a single webpage URL with advanced options for content extraction and get back the results in MarkDown language.

MCP Client to Scrape as HTML

Scrape a single webpage URL with advanced options for content extraction and get back the results in HTML.

Disclaimer

Disclaimer

This template is only available on n8n self-hosted as it's making use of the community node for MCP Client.

Note

Note

The AI agent utilizes Bright Data's MCP tools to perform web scraping based on user requests. It intelligently selects the most suitable web scraping tool to fulfill the user's query.

Once the web scraping is complete, the AI agent's response is:

  1. Used to trigger a webhook call.

  2. Persisted to disk for future reference.

Google Gemini is employed by the AI agent to understand and interpret user queries. Based on this interpretation, the agent initiates a call to the appropriate MCP client to perform the required web scraping task.

Source - https://github.com/luminati-io/brightdata-mcp

Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent

Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent

Purpose and structure

This folder contains the Scrape Web Data with Bright Data, Google Gemini and MCP Automated AI Agent workflow. Its executable nodes use agent, function, httpRequest, lmChatGoogleGemini, manualTrigger, mcpClient, mcpClientTool, memoryBufferWindow, readWriteFile, set. The table and connection map below are derived from the JSON, not an inferred guarantee of behavior.

Setup

Import inactive. Configure your own credentials and replace REPLACE_WITH_* values. Review external destinations and Code nodes before running.

Entry points

When clicking ‘Test workflow’

Verification

Sanitized source candidate; not runtime-tested. This overview is generated from node metadata. Read the folder README for the connection map, credential types, and license.

Attribution

https://github.com/Zie619/n8n-workflows/blob/94007c1445d9258a7da116646b79473e7c7c3282/workflows/Manual/1707_Manual_Stickynote_Automate_Webhook.json MIT; preserve source notices.

Canvas section labels

These name areas of the original canvas; they do not include explanatory instructions.

  • Bright Data Web Scraper
  • Bright Data Web Scraper Tools

More in AI & research

"Hey Siri, Ask Agent" workflow#️⃣Nostr #damus AI Powered Reporting + Gmail + Telegram(G) - Email Classification