Retail Data Collection and Weekly Reporting in Tableau

Our client, an eCommerce company with millions of monthly sales on Amazon, began to expand into retail and took steps to increase sales through retail channels.

Previously, specialists from our client's company manually imported data from Walmart, Michaels, and Joann on a weekly basis, processed it, and unified it into a single format to create a weekly report. This resulted in a significant workload for the employee and diverted attention from more important tasks. Additionally, the weekly reports were only created in Excel, were not maintained in a consistent format, making it extremely difficult to analyze and plan sales efficiency over long periods.

After reviewing the problem, we proposed the development of an automated solution to save reports in their original format from Walmart, Michaels, and Joann systems, followed by automated processing and unification into a single format. We were also tasked with creating a weekly report in Tableau.

1. We implemented a Solution based on Selenium, which emulates user actions in the browser and downloads the required reports weekly for Walmart, Michaels, and Joann with the necessary settings to a storage (Data Lake).
2. Our processing scripts individually processed the original reports for Walmart, Michaels, and Joann, unified all data into a single format, and saved the result to a database (Data Warehouse).
3. The BI connector prepares data from the Data Warehouse for reporting in Tableau.
4. We created a convenient report in Tableau for data visualization. In this report, our clients can analyze weekly sales as well as by SKU, Marketplace, and Average Item Price.