Why this project?
As a technical expert, I am thrilled about this project and the opportunity to create an end-to-end data ETL (Extract, Transform, Load) platform on Amazon Web Services (S3, Glue, & Athena). This platform aggregated an impressive amount of data for car dealerships – over 30 million records and 300 gigabytes of market, research, government, and public data.

Our goal was to extract and provide insights for car dealerships on days on market for listings, market valuations, sale numbers, and average days on market. We also aimed to identify which sales channels bring in the most sales and to enable dealerships to source inventory from the public. By providing dealerships with this data, we aimed to help them stand out against their competitors and run their operations more efficiently.

We knew that data is essential for exploration, but despite technological advancements over the years, difficulties in sourcing and managing data still pose significant challenges for organisations looking to be fully data-driven. That’s why we set out to create a pervasive data culture within the business, making data-driven decision making the standard operating procedure across the entire workforce.

In summary, we delivered a solution that drove an increase in market share for car dealerships. This solution covered a range of technologies, from big data to machine learning to the Internet of Things. It has been customer tested with leading car dealerships and proven to be a valuable tool for their operations.