Competitive Intelligence Sources: Where to Find Data on Your Competitors
Learn where to find competitor data, how to judge its reliability, and how to turn public, paid, and internal sources into evidence for decisions.
Competitive intelligence comes from three complementary source groups: public information, commercial research and company-data services, and evidence your own organization already holds. Start with a decision or question, choose sources that can answer it, and corroborate important signals. A competitor’s claim, a job listing, a review, or a database entry is evidence to assess—not automatically a verified conclusion.
For example, to understand a competitor’s pricing in a target region, compare its dated pricing and product pages with customer conversations and independent coverage. To understand why qualified buyers choose another supplier, combine win-loss interviews and CRM notes with review themes. The right source depends on the question.
1. The three families of competitive intelligence sources
Public sources
Public sources include company websites, product and pricing pages, press releases, annual reports, regulatory filings, job postings, patents, customer reviews, forums, social media, trade publications, associations, and industry events. They are often inexpensive to access and useful for what an organization publicly discloses or visibly does. They take time to monitor and interpret, and the material may reflect the publisher’s interests or a self-selected sample.
Commercial sources
Commercial sources include analyst reports, market databases, company-reference data, paid news services, and monitoring platforms. They can provide structured coverage, historical context, or benchmarks. Evaluate the provider’s scope, definitions, update timing, methods, and costs; a paid dataset is still evidence with provenance and limitations.
For instance, Moody’s describes company-reference data covering private and public company financials, corporate structures and ownership links, patents and intellectual property, M&A data, news, and alerts. That makes it an example of the category, not a universal recommendation. Check whether its coverage suits your companies, geographies, and question. Moody’s company reference data.
Internal sources
Internal sources include CRM records, deal notes, sales calls, win-loss interviews, customer-success and support conversations, and input from frontline teams. They can explain buyer alternatives, decision criteria, objections, and reasons for wins or losses—context that external monitoring may not provide. They can also be incomplete, unrepresentative, or shaped by how staff record conversations. Compare across segments, outcomes, and teams.
Use all three families where practical. Public claims can be checked against customer experience; an analyst’s framing can be compared with original disclosures; internal assumptions can be tested against external evidence.
2. Where to look and what each source can tell you
| Source | Useful for | Interpret with care |
|---|---|---|
| Competitor product, pricing, and help pages | Visible positioning, offers, feature descriptions, packaging, and changes. | Pages show what the company says. Record the date and region; verify availability and context. |
| Press releases and company news | Announced launches, partnerships, funding, and leadership changes. | An announcement may describe an initiative already underway. Combine it with dated earlier signals. |
| Annual reports, filings, investor materials, and earnings discussions | For public companies: financial disclosures, segments, stated risks, and management’s account. | Availability varies by company and jurisdiction. Attribute forecasts and company statements; verify entity and period. |
| Job postings and hiring patterns | Possible investment in functions, technologies, customer segments, or regions. | A vacancy is an indirect signal, not proof of a launch or strategy. Patterns over time are more informative than one listing. |
| Patent databases | Disclosed inventions and areas of technical activity. | A filing does not prove commercial intent, readiness, or launch timing. Relevance varies by sector. |
| Customer reviews, forums, and social media | Customer language, recurring complaints, perceived strengths, and public discussion. | Posts are self-selected and may not represent the customer base. Look for repeated themes and corroboration. |
| Trade publications, associations, and events | Sector developments, specialist reporting, commentary, demonstrations, and industry concerns. | Separate reported facts from commentary. Check whether independent sources repeat a claim. |
| Government statistics and regulatory portals | Market context, category demand, labor or economic signals, and formal disclosures. | Match geography, definitions, reporting period, and industry classification to the question. |
| Analyst reports and market studies | Market sizing, forecasts, industry benchmarks, and competitor comparisons. | Check definition, scope, date, and research method before comparing figures from different publishers. |
| CRM, deal notes, calls, and win-loss interviews | Buyer alternatives, objections, decision criteria, and reasons for wins and losses. | Internal samples can be incomplete or affected by recording practices. Compare segments and outcomes. |
| Commercial company-reference data | Structured company profiles, financials, ownership links, patents, transactions, and news. | Check coverage, geography, provenance, update timing, and provider definitions. |
3. Match the source plan to the decision
- Write the question as a decision. Examples: “How has this competitor changed pricing in our target region?” or “Why are qualified buyers choosing another supplier?” Specify the company set, geography, and time period.
- Identify the evidence that could answer it. Pricing pages can show published offers; customer interviews can clarify perceived value; filings may inform financial questions. Avoid collecting mentions with no connection to the decision.
- Choose sources with complementary viewpoints. Pair a competitor’s own page with customer conversations or independent coverage. Pair review themes with internal support or sales records.
- Capture observations with dates and provenance. Keep the exact source URL or record identifier, access date, geography, relevant period, and a short note separating what you observed from what you infer.
- Corroborate consequential claims. Seek independent evidence, ideally from a different source family. If evidence conflicts, preserve the disagreement and investigate the definitions, timing, or sample.
- Update the conclusion when evidence changes. A current page can establish a visible current offer; it cannot alone establish when the offer began or how customers respond.
For offer or positioning changes, save dated versions of competitor product, pricing, and announcement pages, then compare with customer conversations and reviews. For financial strength or public commitments, use relevant filings and investor disclosures and verify identity and reporting period. For possible expansion or capability signals, monitor hiring, patents, regulatory records, and industry coverage, but label them as inferences until confirmed. For customer preference and churn, combine reviews with CRM, support, sales, and win-loss evidence. For market size, consult analyst research and official statistics, checking that definitions and periods match.
4. How to compare source options
| Criterion | Questions to ask |
|---|---|
| Question fit | Can this source answer the decision question, or does it only provide background? |
| Directness | Is this a company disclosure, customer account, third-party estimate, or your own interpretation? |
| Coverage | Does it include the relevant private and public companies, geography, industry, and competitor set? |
| Recency and history | How often is it updated? Can you see dated changes over time? |
| Auditability | Can a colleague trace the claim to a source and reproduce the observation? |
| Cost and effort | Will public research answer the question, or is structured paid coverage worth its time and subscription cost? |
There is no source that is best for every question. Public material is useful for disclosures and visible activity; internal evidence can reveal buyer reasoning; commercial products may organize broad or structured data. Select based on fit and document limitations.
5. Capture competitor website evidence reproducibly
Product and pricing pages are useful public sources, but a page changes over time and may render differently by viewport, region, or browser behavior. Record the URL and capture date alongside your notes. The following small Python example saves a screenshot of a public page using Playwright. It is a capture aid, not a substitute for checking terms, consent requirements, or whether the rendered page is representative.
from pathlib import Path
from datetime import datetime, timezone
from playwright.sync_api import sync_playwright
url = "https://example.com/pricing" # Replace with a public page you may access
with sync_playwright() as p:
browser = p.chromium.launch(headless=True)
page = browser.new_page(viewport={"width": 1440, "height": 1000})
response = page.goto(url, wait_until="domcontentloaded", timeout=60000)
page.wait_for_timeout(1500) # Allow a short time for client-side rendering
stamp = datetime.now(timezone.utc).strftime("%Y%m%dT%H%M%SZ")
Path("captures").mkdir(exist_ok=True)
page.screenshot(path=f"captures/pricing-{stamp}.png", full_page=True)
print({"url": url, "status": response.status if response else None,
"captured_at_utc": stamp})
browser.close()Install and run it with:
python -m pip install playwright
python -m playwright install chromium
python capture.pyReplace the example URL with a page you are authorized to access. For repeatable comparisons, keep viewport, region, browser settings, and wait strategy consistent; retain the capture timestamp and URL. A screenshot records appearance, not the underlying truth of a claim, and it may omit content that loads later or only after interaction.
6. Or skip the browser setup
For a dated competitor-page capture, ScreenshotNeo provides a website screenshot API and MCP server. One GET request returns an image or PDF. See the ScreenshotNeo API documentation.
cURL
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webpPython
import requests
r = requests.get("https://api.screenshotneo.com/v1/shot", params={"access_key": "YOUR_API_KEY", "url": "https://stripe.com"}, timeout=90)
open("shot.webp", "wb").write(r.content)Node.js
const q = new URLSearchParams({ access_key: 'YOUR_API_KEY', url: 'https://stripe.com' });
const res = await fetch(`https://api.screenshotneo.com/v1/shot?${q}`);Replace the target URL with the public page you need to capture and keep the capture date in your research record. ScreenshotNeo removes cookie banners, newsletter popups, and chat widgets before the shot; bot checks, blank pages, and failed loads are never billed. Its MCP server lets AI agents take screenshots. The free plan includes 1,000 screenshots a month with no card; paid plans start at $5 for 3,000. Learn about ScreenshotNeo or sign up for 1,000 free screenshots a month, with no card.
7. Troubleshooting common evidence problems
| Problem | Likely cause | What to do |
|---|---|---|
| A pricing page conflicts with what a customer says they paid | Regional, account-specific, negotiated, or time-specific differences. | Record region and date; ask which plan, contract period, and customer segment the evidence describes. |
| A job listing appears to signal a new product | A role is only an indirect clue and may support existing work. | Label it as a hypothesis; look for repeated hiring signals and independent confirmation. |
| A patent appears to describe a competitor feature | A filing describes disclosed technical subject matter, not a shipping commitment. | Do not state that a feature will launch without further evidence; track subsequent product disclosures. |
| Reviews strongly disagree | Different customer segments, review incentives, timing, or self-selection. | Compare repeated themes across platforms and check against interviews, support, or sales evidence. |
| Two market reports give different market sizes | Different category definitions, geographies, periods, or methods. | Compare definitions and methodology before comparing numbers; attribute estimates to their publishers. |
| A public-company filing cannot be found | The competitor may be private or report under another entity or jurisdiction. | Confirm the legal entity and jurisdiction. Do not infer financial figures from missing disclosures. |
| A screenshot is blank or incomplete | The page may depend on client-side rendering, delayed resources, or interaction. | Wait for an appropriate page condition, inspect the page directly, and record capture settings. Treat missing content as a capture limitation. |
| Internal notes do not explain a loss | Notes may be sparse or capture a convenient explanation rather than the buyer’s actual reason. | Use win-loss interviews where appropriate and compare multiple deal outcomes and segments. |
8. Performance, reliability, and cost
Start with a small source set tied to a decision, then expand only when gaps remain. A broad feed can create review work without improving an answer. Use dated snapshots for pages where changes matter, and keep a source log so findings can be revisited. For recurring research, make capture conditions consistent and account for pages that load content after the initial response.
Public information may have low access cost but high researcher time cost. Commercial databases and reports trade subscription cost for structured coverage or analysis; assess that value against the question and verify provider scope and update practices. Internal evidence uses existing records but still takes time to collect and may require interviews. No family removes the need to inspect provenance or bias.
For website captures using ScreenshotNeo, the supplied product facts state that only clean shots are billed; bot checks, blank pages, timeouts, failed loads, and cache hits cost nothing, and responses identify the page verdict and billed status in headers. Caching can reduce repeat work. The free allowance is 1,000 shots monthly with no card; paid options are Starter $5 for 3,000, Growth $15 for 15,000, Pro $39 for 60,000, Scale $99 for 250,000, and Business $249 for 1,000,000. Yearly billing gives two months free, and every feature is on every plan. Confirm current plan details in the product documentation before making purchasing decisions.
9. Legal and ethical collection
Prefer public disclosures, properly licensed research, and information your organization may appropriately use. Respect access restrictions and applicable privacy, confidentiality, contract, and platform rules. This source guide does not settle jurisdiction-specific questions about scraping or personal data. When in doubt, use authorized sources and seek appropriate legal guidance for the specific collection method.
10. Frequently asked questions
What is the best source of competitive intelligence?
The best source depends on the question. Use direct disclosures for what a company has publicly stated, customer-facing internal records for buyer reasoning, and commercial sources when structured coverage fits the need. Corroborate important conclusions.
Can a job posting prove a competitor is entering a market?
No. It can be a useful signal, but it does not prove a launch or strategic commitment. Track patterns and seek independent confirmation.
How should I cite a competitor finding in an internal report?
Give the source link or record identifier, access date, geography and time period, and distinguish the observed evidence from your interpretation.
Do I need paid intelligence databases?
Not for every question. First determine whether public sources and your own customer evidence are sufficient. Consider paid coverage when its structure, breadth, or historical context addresses a real gap.
How often should competitor sources be reviewed?
Set a cadence that matches the decision and how quickly relevant evidence changes. Preserve dated observations so a later review can distinguish a new event from an old signal.
Sources and further reading
- Contify: Competitive intelligence discusses using intelligence to answer strategic questions.
- Moody’s company reference data describes an example of commercial company-data coverage.
- ScreenshotNeo documentation covers API usage.
