Autonomous LinkedIn Lead Scraper Chrome Extension (MV3) + MongoDB Atlas Bridge

System Overview

This project consists of two core components:

1. Manifest V3 Chrome Extension: Autonomous, human-emulated LinkedIn lead scraper with daily quotas, anti-ban protection, and an interactive popup dashboard.
2. Express REST API Backend Bridge (backend/server.js): Runs locally on http://localhost:5000 to connect the Chrome Extension to MongoDB Atlas (email-sender database, linkedin_leads collection).

---

Technical Stack & Configuration

MongoDB Atlas Connection

• Database: email-sender
• Collection: linkedin_leads
• Port: 5000

---

Quick Start Guide

1. Start Express Backend Bridge Server

Navigate to the backend folder, install Node modules, and start the server:

cd backend
npm install
npm run dev

You should see the following logs in your console:

====================================================
LinkedIn Scraper Express Bridge running on port 5000
====================================================
[MongoDB] Connected successfully to MongoDB Atlas
[MongoDB] Unique index on profileUrl verified

---

2. Install Chrome Extension (Load Unpacked)

1. Open Chrome and navigate to chrome://extensions/.
2. Enable Developer mode (toggle in the top-right corner).
3. Click Load unpacked.
4. Select the root folder of this repository: c:\Users\Smart Technologies\OneDrive - Hikmah Tech LLC\Desktop\Projects\Scrap-Extension
5. Pin the LinkedIn Lead Scraper Bridge extension icon to your browser toolbar.

---

Features & Account Safety Protocols

1. Human-Emulated Anti-Ban Protection

• Daily Quotas: Strict limit of 40–50 full extractions per 24 hours.
• Randomized Delays:
  • Page Navigation: 12 to 25 seconds (Gaussian distribution).
  • DOM Click Delay: 2.5 to 5 seconds before opening/closing modal.
• Smooth Scrolling: Simulates mouse wheel scrolling to lazy load dynamic elements before extraction.
• Safety Pause: Automatic detection of CAPTCHAs, security checkpoints, or HTTP 429 throttling banners.

2. Filtering & Schema Rules

• Role Keywords: Matches CEO, Founder, Owner, Director, Managing Director, Investor, Partner, President, VP, CFO, CTO, CMO.
• Allowed Locations: Pakistan, United States, USA, Turkey, Canada, Australia, Germany, France, Spain, Italy, United Kingdom, UAE, Dubai.
• Blocked Locations: Israel, India.
• Email Enforcement: Only saves profiles that contain an accessible email address. Profiles without an email address are skipped immediately.

3. One-Click Excel (.xlsx) Export

Click Export Leads to Excel (.xlsx) in the popup dashboard to download all saved leads from MongoDB Atlas directly to an Excel file.