This repository contains my submission for the Data Science Intern assignment at Honeybee Digital.
The project focuses on web scraping, API-based data collection, data cleaning, and logical data mapping.
- Scraped gym listings in Ahmedabad from MagicPin
- Cleaned and structured data with fields:
- Gym Name, Address, Area, City, State
- Phone Number, Timings (if available)
- Reference URL
- Saved final dataset as CSV (80–100+ entries)
- Scraped selected categories and subcategories from Amazon
- Extracted:
- Category, Subcategory
- Product Title, Price, Rating
- Product URL
- Implemented basic anti-blocking practices (user-agent rotation, delays)
- Used Overpass API to retrieve tourist attractions
- Extracted:
- Name, Type, Latitude, Longitude
- Converted API response into a clean CSV dataset
- Mapped keywords and URLs to:
- Category
- Sub-Category
- Followed structured mapping guidelines based on keyword intent and URL context
- Provided explanation of mapping logic
- Python
- Pandas, NumPy
- BeautifulSoup
- Selenium
- Requests
- OpenStreetMap Overpass API
- Jupyter Notebook
- All datasets contain at least 80–100 entries, as required.
- Data has been cleaned and structured for clarity and consistency.
- Ethical scraping practices were followed.
- Referenced are mentioned, if used.
Jahnavi Agrawal
B.Sc. Computer Science & Mathematics