Year
Client
Industry
In collaboration with
Services provided
WHAT
Since 2018, Decodo (formerly Smartproxy) has provided proxy and web scraping solutions to businesses and independent users worldwide. As the company evolved from a proxy provider into a broader web data collection platform serving 85,000+ users, it needed a large-scale, real-world project to demonstrate the practical value and scalability of its scraping infrastructure.
Decodo approached us with a clear objective: create a data-driven study that would showcase how automated web data collection can be transformed into structured market intelligence. The project needed to meet two goals simultaneously. First, it had to highlight the reliability and scale of Decodo’s Web Scraping API in a demanding, multi-country environment. Second, it had to produce meaningful insights that businesses could actually use.
Visit website
Visit website
METHODOLOGY
We built a continuous pricing pipeline to capture, normalize, and compare retail price movements at scale. The system monitored 120+ eCommerce sites across 40 countries, tracking 12 products per site—balanced across higher‑ and lower‑priced items. Prices were collected every four hours from January through December 2025, producing more than 1.5 million observations.
Each capture included the current price, original price when available, discount flags, currency, and timestamp. All data flowed into a standardized database schema that preserved country, retailer, product, and time dimensions, making results consistent and comparable across markets and categories. To keep comparisons fair across regions, prices were converted to USD using daily exchange rates.
With this foundation, we compared pricing behavior across retailers, mapped common pricing patterns, and surfaced differences by country, category, and brand strategy. The database was connected via MCP to a continuous analysis layer, enabling ongoing aggregation, trend detection, and segment‑level monitoring as new pricing events arrived.
RESULT
The Dynamic Pricing Index ‘25 provides a structured benchmark for understanding how pricing competition unfolds across global eCommerce. It reveals where prices change most frequently, which industries show the highest volatility, and how retailer strategies differ—from frequent small adjustments to occasional but deep discounting.
Because the study runs throughout the year, it also highlights seasonal patterns, sales-event effects, and shifts in competitive pressure over time. For businesses, the index supports competitor benchmarking and pricing strategy evaluation. For analysts and researchers, it offers a consistent cross-country dataset that makes global pricing behavior comparable.
At the same time, the project demonstrates how automated web data collection can move beyond raw extraction and become a scalable, insight-driven analytical product—aligning directly with Decodo’s mission to enable efficient, high-quality access to public web data.
.png)
TESTIMONIAL
