Technical and Methodological Challenges of Collecting Price Data from Online Retailers

Alexey S. Evseev – Researcher of the Russian Presidential Academy of National Economy and Public Administration (Moscow, Russia). E-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.

Rodion R. Latypov – Head of Macroeconomic Research, Economist of the JSC Arowana Capital (Moscow, Russia). E-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.

Egor A. Postolit – Analyst of the JSC Arowana Capital (Moscow, Russia). E-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.

Elena S. Sinelnikova-Muryleva – Senior Researcher of the Russian Presidential Academy of National Economy and Public Administration, Candidate of Economic Sciences (Moscow, Russia). E-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.

Price data from online retailers is a valuable source for economics. The use of these data makes it possible to refine inflation forecasts and anticipate future trends in the moment, refine estimates of price rigidity and the conclusions of theoretical pricing models, and test the law of one price. However, there are major difficulties in the data collection process that are not obvious and can threaten both the quality of the data collected and the sustainability of the collection process over time.

The article, for the first time in the literature, discusses in detail the technical and methodological problems that impede the continuous collection of data on the network and presents our experience in solving these problems. The pros and cons of solutions to emerging problems are discussed.

The article was written on the basis of the RANEPA state assignment research programme for 2022.

Key words: prices of online retailers, web-scrapping, inflation, alternative data, big data.

JEL-codes: C81, C82, E31, C55.