Web Scrape Tool
Scrapes content from a single web page using Firecrawl, good to use after web-search-tool to get the full content of a page
Quick Start
import { WebScrapeTool } from '@bubblelab/bubble-core';
import { CredentialType } from '@bubblelab/shared-schemas';
const result = await new WebScrapeTool({
url: 'example', // The URL to scrape content from
credentials: {
[CredentialType.FIRECRAWL_API_KEY]: process.env.FIRECRAWL_API_KEY as string,
},
}).action();
Operation Details
execute
- Input Schema
- Output Schema
urlstring required- The URL to scrape content from
format'markdown'- Content format to extract (default: markdown)
onlyMainContentboolean- Extract only main content, filtering out navigation/footers
credentialsRecord<CredentialType,string>- Required credentials including FIRECRAWL_API_KEY
contentstring required- Scraped content in requested format
titlestring required- Page title if available
urlstring required- The original URL that was scraped
formatstring required- Format of the returned content
successboolean required- Whether the scraping was successful
errorstring required- Error message if scraping failed
creditsUsednumber required- Number of credits used
metadataobject- Additional metadata about the scrape