How to Run Website Capture Software on Your Own Servers
Deploy website capture software on infrastructure you control, from ArchiveBox on one Docker host to Browsertrix on Kubernetes, with storage and security guidance.
Blog
Guides for capturing the web
How to take clean screenshots, turn HTML into images and PDFs, run headless browsers, and give AI agents eyes. Written by the team that builds ScreenshotNeo.
Raw Proxies vs. Web Scraping APIs: When to Use Each
Compare raw proxies and scraping APIs by control, JavaScript support, reliability, cost, and maintenance, then choose the right architecture.
Building Durable Browser Workflows with Temporal
Build crash-resistant Playwright automation with Temporal Workflows, Activities, retries, versioning, and practical recovery patterns.
How to Use a Go SDK for Web Scraping APIs
Install a provider’s Go SDK, authenticate safely, make a context-aware scrape request, and handle API and network errors in production.
How to Scrape Walmart Prices and Track Product Changes Over Time
Use Walmart’s authorized APIs to identify products, collect prices, store dated observations, and detect changes without losing history.
How to Run Parallel Lighthouse Tests in Your CI Pipeline
Run Lighthouse audits across CI workers without confusing job parallelism with repeated measurements. Configure LHCI, shard URLs, handle reports, and reduce noisy results.
How to Print JavaScript-Rendered Pages and Charts to PDF
Learn browser printing, print CSS, Chart.js resizing, and Puppeteer automation for reliable PDFs from JavaScript-rendered pages.
Web Crawlers: How They Work and Where They Break
Learn how crawlers discover, fetch, render and index pages, why crawling fails, and how to diagnose robots.txt, JavaScript and server issues.
How to Send Custom HTTP Headers with PHP cURL for Screenshot or PDF APIs
Learn to send authentication, Accept, Content-Type, cookies and custom headers with PHP cURL when calling screenshot or PDF APIs.
How to Screenshot a Web Page in a Browser Window
Capture the browser window, the visible page, or a full scrolling webpage on Windows, Mac, or Firefox—and learn where the image goes.
How to Inspect Elements in Chrome, Safari, Firefox, and More
Learn how to inspect any webpage element, read its DOM and CSS, debug layouts, and make temporary changes in Chrome, Safari, Firefox, Edge, and other browsers.
How to Run Custom Functions in a Headless Browser
Run JavaScript inside a headless browser with Playwright or Puppeteer. Learn how to pass data, handle async results, run code before page scripts, and call back to Node.js.
How to Design Clear Validation Errors for Screenshot APIs
Design screenshot API errors that identify invalid inputs, explain how to fix them, and give clients a stable format they can handle.
Google Chat Open Graph Image Generator
Generate and serve page-specific Open Graph images for Google Chat. Learn the metadata workflow, build it yourself, and troubleshoot stale or missing previews.
Native PDF Styling in Chrome
Use @media print, @page, and Chrome 131 margin boxes to control PDF layout, page numbers, headers, footers, and troubleshooting.
Challenges of Scraping Google Search Results and How to Overcome Them
Learn why Google blocks automated search scraping, the compliant API path, quota planning, reliability patterns, and safer alternatives.
Redirect IP Requests to Domain URLs: Test and Fix IP Canonical Issues
Redirect IP and alternate host requests to one canonical HTTPS domain. Configure the redirect, preserve paths and queries, and verify the result.
Is Guzzle a Built-In PHP Library?
Guzzle is not built into PHP. Learn how Composer installs it, how native streams differ, and how to fix common setup errors.