What should investors and consultants check when choosing an eCommerce pricing and assortment data provider?
Judge an eCommerce data provider on what happens after collection, not on how many websites it scrapes. The questions that decide whether the data is usable are: are brands resolved to their owners, public and private; are listed owners mapped to tickers point-in-time; is every retailer's range placed in one category tree; does history run continuously through retailer site changes; can prices be compared on a matched-product or per-unit basis; and is collection documented well enough for your compliance team.
Last reviewed
The checklist
- Brand to owner. Are brands resolved to the company that owns them, including private companies, with sub-brands and licensed lines handled? Without this you cannot see a company's full footprint.
- Point-in-time tickers. For listed owners, is the brand-to-ticker mapping dated, so acquisitions and disposals do not leak future information into a backtest?
- One category tree. Is every product placed in the same category structure at every retailer, or are you left with each retailer's own menus?
- Continuous history. How far back does the data go, and does it survive retailer website redesigns without breaks?
- Comparable prices. Can you measure price change on the same products over time (matched basis) and compare pack sizes per unit, so product mix does not distort the answer?
- Coverage that fits the question. Which retailers, markets and categories are covered, and from when? Ask for coverage for your own names, not a total count.
- Documented collection. Is collection limited to public information, with no personal data, and will the provider answer your due diligence questionnaire?
- Delivery. Can you take the data the way your team works: a data share, files, a portal or partner platforms?
Questions to ask in a trial
- 1Pick three brands you know well, including one private company, and check the provider finds every retailer that stocks them.
- 2Take one listed company that made an acquisition and check the acquired brand maps to it only from the deal date.
- 3Compare a category across two retailers and check the products line up in the same categories.
- 4Ask for a price series on a matched basis and check it against a known price rise or tariff.
How Data Purl answers the checklist
Data Purl resolves every brand to its owner, public or private, maps listed owners to tickers point-in-time, places every product in one tree of about 4,000 categories and keeps continuous history back to 2013 across 400+ retailers. Collection is limited to public product information. The methodology page documents each step.
Metrics used
- Brand-to-ticker mapping: Linking each consumer brand to the company that owns it and to that company's listed security, with ownership changes dated.
- Matched-SKU inflation: The price change of identical products observed in both periods, which isolates true price moves from changes in product mix.
- Markdown breadth: The share of in-stock SKUs (each size or variant) selling below full price.
- Alternative data (shelf-side): Non-traditional data used in investment research; shelf-side data measures what is listed, at what price and availability, rather than what was bought.
How each measure is built: methodology.
See the data for your coverage
Start free in the analytics portal, or talk to the founders about the full dataset delivered to Snowflake or S3.