Skip to main content

Web Scrape Tool

Scrapes content from a single web page using Firecrawl, good to use after web-search-tool to get the full content of a page

Quick Start

import { WebScrapeTool } from '@bubblelab/bubble-core';
import { CredentialType } from '@bubblelab/shared-schemas';
const result = await new WebScrapeTool({

url: 'example', // The URL to scrape content from
credentials: {
[CredentialType.FIRECRAWL_API_KEY]: process.env.FIRECRAWL_API_KEY as string,
},
}).action();

Operation Details

execute

url string required
The URL to scrape content from
format 'markdown'
Content format to extract (default: markdown)
onlyMainContent boolean
Extract only main content, filtering out navigation/footers
credentials Record<CredentialType,string>
Required credentials including FIRECRAWL_API_KEY