Retail Orders Analysis and Data Pipeline with SQL Integration
This project involves analyzing retail orders data sourced from Kaggle. The data was downloaded as a ZIP file through the Kaggle API, extracted using code in Jupyter Notebook, then cleaned, transformed, and loaded into Microsoft SQL Server. The goal of this project is to demonstrate data wrangling, transformation, and visualization skills while maintaining a robust data pipeline workflow.
- The dataset was imported from Kaggle using the Kaggle API.
- The dataset was downloaded as a ZIP file, extracted using Python code in Jupyter Notebook.
- The data was loaded directly into Jupyter Notebook for further processing.
- The data was examined for missing values, duplicates, and incorrect data types.
- Unnecessary columns were removed, and the data was formatted for improved readability.
- The cleaned and transformed data was exported to Microsoft SQL Server.
- SQL Server was connected via Jupyter Notebook to facilitate seamless data migration.
🔸 Top 10 revenue-generating categories and subcategories 🔸 Top 5 highest-selling products in each region 🔸 Month-over-month growth comparison for 2022 and 2023 sales 🔸 Identifying the month with the highest sales for each category 🔸 Category with the highest growth percentage in profit in 2023 compared to 2022 🔸 Subcategory with the highest growth percentage in profit in 2023 compared to 2022 🔸 Top 5 states with the highest sales
- The project includes:
- 📒 Jupyter Notebook containing code for data cleaning, transformation, and SQL integration.
- 📁 The original dataset for reference.
- 📝 A detailed README file (this document).
- Python Libraries:
pandaspyodbc(for SQL Server connection)- Microsoft SQL Server (with database setup for data storage)
- Jupyter Notebook
✅ Identified peak sales periods and trends.
✅ Recognized top-selling products and customer segments.
✅ Provided actionable insights for improving business decisions.
- ⚙️ Automate the data pipeline for real-time updates.
- 📊 Develop dashboards for improved visualization.
- 🧠 Expand analysis to predict sales trends using machine learning.
Contributions are welcome! Feel free to submit issues or pull requests to enhance this project.
For questions or collaboration, reach out via rakeshmeka.work@gmail.com.