Web Scraping with BrowseFleet

The Problem

Modern websites use JavaScript rendering, anti-bot detection, and CAPTCHAs to prevent scraping. Running headless browsers locally does not scale. Each instance consumes 200-500MB of RAM, crashes under load, and gets blocked by fingerprint detection. Managing proxies, retries, and browser lifecycle adds weeks of engineering work.

The Solution

BrowseFleet handles the hard parts of scraping. Launch cloud browser sessions with stealth mode enabled by default, connect your existing Puppeteer or Playwright code with a one-line change, and let BrowseFleet manage browser lifecycle, proxy rotation, and CAPTCHA solving. For simple pages, use the quick-action scrape endpoint that returns cleaned HTML, Markdown, and readability-optimized text in a single API call.

import { BrowseFleet } from 'browsefleet';

const bf = new BrowseFleet({ apiKey: 'bf_...' });

// Quick scrape - one call, no session needed
const { markdown, html, text } = await bf.scrape(
  'https://example.com/products',
  { stealth: 'full' }
);

// Or use a full session for multi-page scraping
const session = await bf.sessions.create({
  stealth: 'full',
  proxy: 'socks5://user:pass@proxy:1080',
});

const browser = await puppeteer.connect({
  browserWSEndpoint: session.websocketUrl,
});

const page = await browser.newPage();
for (const url of productUrls) {
  await page.goto(url);
  const data = await page.evaluate(() => ({
    title: document.querySelector('h1')?.textContent,
    price: document.querySelector('.price')?.textContent,
  }));
  results.push(data);
}

await session.close();

Features Used

Benefits

• Scrape JavaScript-heavy sites without managing browsers
• Built-in stealth bypasses most anti-bot detection
• Per-session proxies prevent IP blocking
• CAPTCHA solving handles reCAPTCHA, hCaptcha, and Turnstile
• Quick actions return clean Markdown for simple pages
• Scale to 100 concurrent browsers without infrastructure work

Learn More