Competitive Intelligence Sources: How to Find Useful Competitor Data

Useful competitor data comes from matching sources to a specific decision, then checking important findings against independent evidence. Start with public records and competitor materials, add customer-facing evidence from sales and support, and use paid research when its coverage or time savings justify the cost. Record where each observation came from and when you collected it; a folder of links without analysis is not competitive intelligence.

Competitive intelligence is systematic gathering, analysis, and communication about competitors and the external environment to support decisions. The goal is not to collect everything. It is to answer a defined business question with evidence whose limits are understood. IEEE’s overview of competitive intelligence describes this decision-support role.

1. Start with a decision and answerable questions

Before searching, state the decision the research should inform. Examples include how to respond to a sales objection, whether a product capability is table stakes, how a competitor packages a service, or whether a market entry deserves further study. Broad prompts such as “find out everything about Competitor A” produce disconnected facts and wasted effort.

Name the decision. Write one sentence describing what the team may do differently based on the research.
List the intelligence questions. Turn the decision into questions that evidence can answer. For a pricing review, ask what is publicly listed, when the page changed, which customer segments or terms are described, and whether customers mention price in deal notes.
Set boundaries. Define the competitors, geography, timeframe, budget, deadline, and acceptable collection methods.
Choose sources for each question. A filing is suited to reported company information; a product page establishes what the company currently says it offers; win/loss interviews can illuminate why a buyer chose an alternative.
Log observations and implications separately. “The company advertised five data-science roles this month” is an observation. “It is launching a new AI product” is an inference that needs more evidence.
Corroborate material signals. Look for a second source before presenting a consequential change as strategic intent.
Share a decision and refresh date. State what the evidence supports, what remains uncertain, and when to revisit it.

2. Where to find competitor data

Competitor websites and announcements

Product pages, pricing pages, documentation, press releases, company blogs, and annual reports show what a company publicly claims about its products, positioning, packaging, customers, launches, partnerships, strategy, and risks. These are primary sources for the company’s statements, but they are selective and promotional. Attribute claims to the company and seek customer or independent evidence before treating them as verified outcomes.

For pages likely to change, retain the URL, access date, and a dated capture or change log. A screenshot can document what was visible at a particular time, but it does not prove why a change happened or whether a stated capability works as described. Website captures can be made manually or through a screenshot API such as ScreenshotNeo.

Public-company filings

For a U.S. company that files with the SEC, EDGAR provides free access to filings, company searches, full-text search, APIs, and feeds. Periodic reports and registration statements can help establish reported financial and risk information. EDGAR covers SEC filers, not every private company, and filing scope and timing follow disclosure rules. Start at the SEC EDGAR search page.

Patents, trademarks, and hiring signals

Patent and trademark records can reveal filings and intellectual-property claims. They do not prove a product will ship or succeed. Job posts can suggest a possible hiring priority or capability-building effort, but listings may be stale, duplicated, speculative, or cancelled. Treat each as an indirect signal and seek corroboration.

Reviews and public discussions can reveal individual experiences, recurring complaints, perceived strengths, and the language customers use. They are self-selected and may not represent the wider market. Quote or summarize them as individual reports; do not convert them into market-wide prevalence claims without a defensible sampling method.

Trade publications, associations, events, and conferences

These sources can surface launches, partnerships, expert discussion, and product observations. For conversations and interviews, record the speaker’s role and context and represent what they said honestly. Do not imply that an informal conversation is an official company position.

Search, advertising, and traffic indicators

Keyword, advertising, and traffic tools can suggest acquisition priorities or positioning. Their outputs may be modeled estimates rather than audited company results. If you use a number, identify the provider, date, geography, and methodology when available. Avoid presenting an estimate with the certainty of a company-reported figure.

Commercial reports, databases, and monitoring tools

Analyst reports and market databases may add category context, forecasts, benchmarks, or broader coverage. Monitoring software can reduce the effort of watching public pages and feeds. Use these services when their coverage, scale, or time savings answer a defined need and fit the budget. A subscription does not make an estimate authoritative: verify consequential findings against primary material where practical.

Internal customer-facing evidence

Sales notes, win/loss interviews, churn conversations, support feedback, CRM records, and partner-facing teams can explain why buyers choose a competitor—context external sources often cannot supply. Preserve the deal or customer context, date, exact wording where appropriate, and whether the account is firsthand or secondhand. Internal reports can carry bias, so treat them as evidence about specific encounters rather than proof of broad market behavior.

3. Match the source to the claim

Source	Can help establish	Key limitation
Company website or press release	What the company publicly says it offers or intends	Promotional and selective; not independent confirmation
SEC filing	Filed disclosures and reported information for an SEC filer	Does not cover every private company; scope and timing follow filing rules
Patent or trademark record	A filing or registered intellectual-property claim	Does not establish launch, execution, or commercial success
Job posting	A role the employer advertises and a possible hiring priority	May be stale, speculative, duplicated, or cancelled
Review or social post	An individual’s expressed experience and customer vocabulary	Selection and representativeness limits
Analyst report or database	The provider’s estimates, benchmarks, and synthesized context	Provider framing and methodology may need scrutiny
Sales or win/loss note	What a buyer or field team reported in a specific deal	May be secondhand or biased; preserve context

When comparing sources, assess authority, recency, coverage, specificity to your question, independence, method transparency, and cost or effort. The best source is the one that can establish the particular claim—not necessarily the most elaborate database. For example, a company’s own pricing page is direct evidence of its published price at the time captured; it does not establish what every customer pays after discounts.

4. Keep a source log that another person can audit

A lightweight spreadsheet is enough for a small project. Include these fields:

Research question and decision it supports
Source name and source type
URL or document reference
Publisher and publication date, if available
Access date and relevant geography
Exact observation or a concise summary
What the source can establish—and what it cannot
Confidence, corroborating sources, and unresolved questions
Analyst, next action, and refresh date

Keep source material and your interpretation distinct. Save page captures or relevant excerpts when permitted and useful, with dates. If the page later changes, the log should make clear what was observed then rather than silently replacing an old claim with a new one.

5. Use screenshots to document public web pages

When the question concerns a competitor’s public website, a dated screenshot gives reviewers a visual record of the page state you observed. It is useful for comparing published pricing, product positioning, and page changes over time. It does not establish the company’s intent, unpublished terms, or what a particular customer was offered.

Do it yourself with a browser

Playwright can open a public page and save a full-page screenshot. The example below uses Node.js. It captures the page as rendered at run time; select the target URL and viewport to fit your research question.

npm init -y
npm install playwright
npx playwright install chromium

// capture.mjs
import { chromium } from 'playwright';

const targetUrl = process.argv[2] ?? 'https://example.com';
const browser = await chromium.launch({ headless: true });
const page = await browser.newPage({ viewport: { width: 1440, height: 1000 } });

try {
  const response = await page.goto(targetUrl, {
    waitUntil: 'domcontentloaded',
    timeout: 30000,
  });
  if (!response || !response.ok()) {
    throw new Error(`Navigation failed: ${response?.status() ?? 'no response'}`);
  }
  await page.screenshot({ path: 'competitor-page.png', fullPage: true });
  console.log(`Saved competitor-page.png (${response.status()})`);
} finally {
  await browser.close();
}

node capture.mjs https://example.com/pricing

Use a permitted, public page and a reasonable capture cadence. Some sites restrict automated access or use bot checks. Do not bypass access controls, authenticate as someone else, or represent yourself deceptively. Respect the site’s terms and applicable law.

cURL request to ScreenshotNeo

For an API-based capture, send a GET request with your API key and target URL. See the ScreenshotNeo API documentation for request options.

curl -G "https://api.screenshotneo.com/v1/shot" \
  -d access_key=YOUR_API_KEY \
  --data-urlencode url=https://example.com/pricing \
  -o competitor-page.webp

Python request

import requests

response = requests.get(
    "https://api.screenshotneo.com/v1/shot",
    params={"access_key": "YOUR_API_KEY", "url": "https://example.com/pricing"},
    timeout=90,
)
response.raise_for_status()
with open("competitor-page.webp", "wb") as image_file:
    image_file.write(response.content)

Node.js request

const q = new URLSearchParams({
  access_key: process.env.SCREENSHOTNEO_API_KEY,
  url: 'https://example.com/pricing',
});
const res = await fetch(`https://api.screenshotneo.com/v1/shot?${q}`);
if (!res.ok) throw new Error(`Screenshot request failed: ${res.status}`);
await Bun.write('competitor-page.webp', res);

Set SCREENSHOTNEO_API_KEY in the environment before running the Node example. Keep API keys out of source control and logs. ScreenshotNeo also supports PNG, JPEG, PDF, full-page and element captures, viewport and device settings, custom CSS and JavaScript, wait conditions, headers and cookies, caching, async jobs, bulk capture, and other options documented in its API reference. Use only the options relevant to the evidence you need.

6. Or skip the browser setup

ScreenshotNeo takes a screenshot with one API call. Cookie banners are accepted and removed before the capture, along with known consent banners, newsletter popups, and chat widgets; each cleanup step can be turned off. Bot checks, blank pages, and failed loads are never billed, and the response identifies the page verdict and billing status. Its MCP server lets AI agents take screenshots. The free plan includes 1,000 screenshots a month with no card; paid plans start at $5 for 3,000.

curl -G "https://api.screenshotneo.com/v1/shot" \
  -d access_key=YOUR_API_KEY \
  --data-urlencode url=https://example.com/pricing \
  -o competitor-page.webp

See the ScreenshotNeo API docs, then sign up free for 1,000 screenshots a month with no card.

7. Ethics and legal boundaries

Keep research honest and based on publicly available or otherwise lawfully obtained information. Do not use deception, theft, bribery, hacking, or breach of confidentiality to obtain nonpublic competitor material. Be transparent in inquiries, respect confidentiality obligations, and do not try to evade access controls. Legal requirements vary by jurisdiction and collection method; these general principles are not a complete account of privacy, surveillance, database-access, employment, or competition law. Seek jurisdiction-specific guidance when the method or stakes require it.

8. Performance, reliability, and cost

Keep the scope small. Research the questions tied to a decision. A smaller set of well-matched sources is easier to verify and maintain.
Automate repeated public-page checks selectively. Monitoring can save time when pages change often, but captures still need review and interpretation. Use a cadence matched to the pace of the market.
Expect imperfect evidence. Pages change, estimates vary, job listings disappear, and accounts can be secondhand. Preserve timestamps and corroborate signals that may change a decision.
Budget for the whole workflow. Include analyst time, commercial subscriptions, and the effort to validate findings. Buy reports or tools only when their added coverage or time savings justify their cost.
Minimize capture friction. Browser setup requires maintaining a browser runtime and handling page loading. An API can simplify recurring captures, but it cannot turn a screenshot into proof of claims beyond what the page visibly showed.
Retain provenance. A fast capture without its URL and date can be difficult to interpret later. Keep the source log with the artifact.

9. Common mistakes and fixes

Problem	Why it happens	Fix
A pile of links with no conclusion	Collection began before defining a decision or questions	Write the decision, map each source to a question, and summarize implications and unknowns.
A press release is treated as verified performance	The company’s statement is mistaken for independent evidence	Attribute the claim and seek filings, customer evidence, or independent corroboration appropriate to the claim.
A job post is presented as a confirmed product launch	An indirect hiring signal is interpreted as fact	Label it as an inference, check other signals, and preserve the post date.
Reviews are reported as representative of all customers	Public reviewers are self-selected	Describe them as individual reports unless the sampling method supports a broader conclusion.
Pricing appears inconsistent across sources	Pages may be dated, regional, customized, or subject to discounts	Record date, geography, terms, and source; distinguish listed pricing from negotiated pricing.
A browser capture is blank or incomplete	The page may need more time, depend on scripts, lazy loading, or block automation	Check the URL and response, wait for a specific page element, and use a permitted capture method. Do not bypass access controls.
A screenshot differs between runs	Dynamic content, personalization, viewport, time, or location can change rendering	Record capture conditions and compare like-for-like viewports and dates; treat variation as part of the evidence.
A capture is mistaken for a complete audit trail	An image alone lacks source and collection context	Store the source URL, capture date, relevant conditions, and interpretation alongside it.

10. Short FAQ

What are the different sources of competitive intelligence?

They include public company material, filings, intellectual-property records, hiring signals, reviews and forums, trade coverage, commercial research, and internal customer-facing evidence. Choose based on the claim and decision at hand.

How do I research a private competitor?

Use its public pages, announcements, job posts, customer discussion, event activity, and evidence from your own customer interactions. SEC filings are not available for every private business, so avoid implying that a lack of filings means a lack of activity.

How often should competitor research be refreshed?

Refresh it according to how quickly the relevant market or decision changes. Preserve the date of each observation so readers can tell current evidence from older findings.

Can a screenshot prove a competitor’s strategy?

No. It documents visible page content at a point in time. Strategy is an interpretation that needs context and corroborating evidence.