Skip to content

Latest commit

ย 

History

12 Commits

Folders and files

NameName
Last commit message
Last commit date
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿ›’ Amazon Recommendation System: Applied AI Project

Python 3.10+ Pandas Scikit-Surprise MIT Program


๐Ÿ“‹ Project Overview

This project was developed as part of the MIT Professional Education โ€“ Applied AI & Data Science Program, specifically within the Elective Project: Recommendation Systems.

The objective is to design, implement, and evaluate multiple recommendation system approaches using an Amazon product ratings dataset.


๐ŸŽฏ Objective

To build a recommendation system capable of suggesting relevant products while addressing:

  • Data sparsity
  • Popularity bias
  • Cold-start problem

๐Ÿ“Š Dataset

Feature Description
user_id Unique user identifier
prod_id Unique product identifier
rating Rating (1โ€“5)
timestamp Not used

๐Ÿ”— Dataset:
๐Ÿ‘‰ https://drive.google.com/file/d/1XahZcR287ke7j48I7-oj0KzmmwSSvA3Y/view


๐Ÿงน Data Preprocessing

  • Users โ‰ฅ 50 ratings
  • Products โ‰ฅ 5 ratings

โžก๏ธ Reduced sparsity and improved reliability


๐Ÿ” Exploratory Data Analysis

โญ Rating Distribution

Rating Distribution

๐Ÿ‘ค User Activity

User Activity

๐Ÿ“ฆ Item Popularity

Item Popularity

๐Ÿ“‰ Long Tail Distribution

Long Tail

๐Ÿ” Top Users

Top Users


๐Ÿค– Models Implemented

๐Ÿ“Œ Rank-Based Model

  • Non-personalized baseline

๐Ÿ‘ฅ User-User Collaborative Filtering

  • Cosine similarity
  • Personalized

๐Ÿ“ฆ Item-Item Collaborative Filtering

  • More stable than user-user

๐Ÿงฎ Matrix Factorization (SVD)

  • Handles sparsity effectively
  • Best performance

๐Ÿ“ˆ Model Comparison

Model RMSE Precision Recall F1
UU Baseline 1.001 0.855 0.867 0.861
UU Optimized 0.953 0.847 0.894 0.870
II Baseline 0.995 0.851 0.870 0.860
II Optimized 0.958 0.839 0.880 0.859
SVD Baseline 0.888 0.853 0.880 0.866
SVD Optimized 0.882 0.860 0.900 0.879

๐Ÿ“Š Model Performance Visualization

๐Ÿ”ฅ Heatmap

Heatmap

๐Ÿ“Š Precision & Recall

Precision Recall

๐Ÿ“‰ RMSE Comparison

RMSE


๐Ÿ“Š Prediction Analysis

๐Ÿ“‰ Error Distribution (All Models)

Errors

๐Ÿ“ SVD Predictions

SVD

๐Ÿ“ User-User Predictions

UU

๐Ÿ“Š Error (User-User)

UU Error


๐Ÿ“ Recommendation Behavior

Scatter


โš ๏ธ Key Challenges

  • High sparsity (~99%)
  • Popularity bias
  • Cold-start problem

๐Ÿ† Key Results

  • Rank-based model provides a strong baseline
  • KNN improves personalization but struggles with sparsity
  • Item-item is more stable
  • SVD achieves the best overall performance

๐Ÿ“Œ Conclusion

Matrix factorization (SVD) provides the best balance between:

  • Accuracy
  • Robustness
  • Scalability

๐Ÿ› ๏ธ Technologies

  • Python
  • Pandas / NumPy
  • Matplotlib / Seaborn
  • Scikit-surprise

๐ŸŒŸ Highlights

  • End-to-end recommendation system pipeline
  • Advanced EDA
  • Model comparison
  • Hyperparameter tuning
  • Visual evaluation

๐Ÿ‘จโ€๐Ÿ’ป Author

Developed as part of the
MIT Professional Education โ€“ Applied AI & Data Science Program


๐Ÿ“„ License

Educational use only

About

MIT Applied AI & Data Science Program Elective Project. End-to-end recommendation system project using Amazon product ratings data, implementing rank-based, collaborative filtering (User-User, Item-Item), and SVD models, with evaluation and visual analysis.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages