Dollar General data, powered by Bright Data.
This repository provides two approaches to accessing Dollar General data at scale:
- Method 1: Bright Data Dollar General Scraper API (Recommended) - A fully managed, enterprise-grade scraping API that handles proxies, CAPTCHAs, and scaling automatically.
- Method 2: Bright Data Dollar General Datasets - Ready-to-download, pre-collected Dollar General datasets, no scraping required.
- Why Use Bright Data for Dollar General Scraping?
- Method 1: Bright Data Dollar General Scraper API
- Method 2: Bright Data Dollar General Datasets
- Data Collection Approaches
Dollar General scraping comes with several challenges:
- Rate Limiting: Dollar General monitors request frequency and may block IPs that exceed limits.
- CAPTCHA Detection: Automated access may trigger CAPTCHA challenges.
- Authentication Barriers: Some data requires login and the platform detects automated attempts.
- Dynamic Content Loading: JavaScript-rendered content is difficult to scrape with simple HTTP requests.
- IP Blocking: Repeated requests from the same IP may result in blocks.
Bright Data's Dollar General Scraper API solves these problems with:
- ✅ Built-in rotating proxies: Bypass IP-based rate limits automatically
- ✅ CAPTCHA solving: Handles bot detection without any extra setup
- ✅ Structured data output: Receive clean JSON ready for analysis
- ✅ No infrastructure needed: Cloud-managed scraping at any scale
- ✅ 99.9% uptime SLA: Reliable data collection for business-critical workflows
The Bright Data Dollar General Scraper API is a fully managed solution requiring zero infrastructure setup.
- Sign up for a free Bright Data account
- Navigate to the Dollar General Scraper API
- Get your API token from the dashboard
- Install the
requestslibrary:pip install requests - Run any of the scripts in
dollar-general_scraper_api_codes/
Collect data from Dollar General Products.
| Field | Type | Required | Description |
|---|---|---|---|
url |
string | Yes | The URL of the Dollar General item to scrape |
limit |
integer | No | Maximum number of results to return |
include_errors |
boolean | No | Include error details in the response |
notify |
url | No | Webhook URL to notify when collection is complete |
format |
enum | No | Output format: JSON, NDJSON, JSON Lines, CSV |
{
"additional_image_urls": [
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-2",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-3",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-4",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-5",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-6",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-7",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-8",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-9",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-10",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-11",
"https://s7d1.scene7.com/is/image/dolgen/dg-01908801-1",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/d2297bd5-3115-5403-b260-9e1e2c65ad5f",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/1b202a3f-2157-5702-8d09-090f90b78e9c",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/46b28d8c-ff9d-50d3-bf6b-20b6ae36ae2b",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/3b21fc1b-4ad2-54d5-a37f-53b6302498cf",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/75ecdadc-717e-5932-85a7-7e16689898dc",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/127cd769-19e5-5e8d-b820-3627c84b7913",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/d2297bd5-3115-5403-b260-9e1e2c65ad5f",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/1b202a3f-2157-5702-8d09-090f90b78e9c",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/46b28d8c-ff9d-50d3-bf6b-20b6ae36ae2b",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/e84490bf-71a1-54a2-9efa-f414197de049",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/3b21fc1b-4ad2-54d5-a37f-53b6302498cf",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/75ecdadc-717e-5932-85a7-7e16689898dc",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/127cd769-19e5-5e8d-b820-3627c84b7913",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/7fa13acf-3f43-5ac2-98f2-dc0c434fecf2",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/55964cd6-9103-52eb-b9d0-1f724e942975",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/81653f0c-5e39-5a43-9d34-8568ca0f6c47",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/fda3554d-bb22-5caf-a01f-cdf8e107bf9a",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/c229a1f3-6193-5c19-86cd-192ba7c4b846",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/8e1fa7b4-52d3-5ff0-ac31-dde0254fef58",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/06d64dee-9138-57ac-9894-c54f4e5d853f",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/c1116bd4-ed3c-50fb-98a8-b78e5b2133b0",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/df5e138d-7262-5034-9f57-78f1f3e532c0",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/3d5896d8-f190-5b08-a6a7-86d27a5fb525",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/4b6ccb75-1623-5887-b06d-540bd765e59e",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/d50e94df-007f-5a33-886a-9ab3f4e2e7a2",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/e3ef8676-a59a-5a6e-876e-ba0f9f5b1adf",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/1130ae91-d9a8-54bb-9c78-3ae0bb5954f3",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/c864a693-5f3a-55ae-b631-617a13fbda99",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/1703deae-9e41-594b-a8c8-959ea5bedeb2",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/7c434da5-d929-53fa-a7d5-891ae84caa81",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/2073ea8c-ca16-5e74-b802-de4e6f5221dc",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/6ca84a49-fa1d-52aa-98df-bc5a5204a477",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/e6334765-8f8f-5f04-973b-693f3b8df774",
"https://photos-us.bazaarvoice.com/photo/2/cGhvdG86ZHJwZXBwZXI/3bf42ef6-c0d5-523a-841d-bdd6055152de"
],
"availability": "in_stock",
"brand": "Dr Pepper",
"category_tree": [
{
"name": "Food \u0026 Beverage",
"url": "https://www.dollargeneral.com/c/food-beverage"
},
{
"name": "Beverages",
"url": "https://www.dollargeneral.com/c/food-beverage/beverages"
}
],
"category_urls": [
"https://www.dollargeneral.com/c/food-beverage",
"https://www.dollargeneral.com/c/food-beverage/beverages"
],
"description": "Satisfy your craving for flavor with the unique taste of Dr Pepper! It\u2019s not your ordinary soda, and it\u2019s definitely not a cola. It\u2019s the sweet treat that can\u2019t be beat. So, whether you enjoy the original or any of the varieties like Dr Pepper Cherry and our latest innovation, Dr Pepper \u0026 Cream Soda, you\u2019ll get the satisfying flavor that only Dr Pepper can deliver straight to your taste buds. Established in 1885 in Waco, TX, Dr Pepper is the oldest major soft drink in the United States. It\u2019s a refreshing favorite that\u2019s always smooth and delicious at dinner, lunch, or breakfast (we won\u2019t judge you!). Although you can enjoy the unique flavor all on its own, you can also pair it with food. Dr Pepper is the perfect companion for everything from a full meal like pizza, burgers, or rotisserie chicken to a quick snack like pastries, chocolates, or your favorite candy. You can\u2019t go wrong with a Dr Pepper when you want to satisfy your sweet cravings. Give your tastebuds something to cheer for with the smooth, satisfying flavor of an ice-cold Dr Pepper, Dr Pepper Cherry, or Dr Pepper \u0026 Cream Soda, and they\u2019ll thank you for it every time!",
"group_id": "78000082166",
"image_url": "https://s7d1.scene7.com/is/image/dolgen/dg-01908801-1",
"item_id": "78000082166",
"listing_has_variations": false,
"price": "$9.00",
"product_category": "Food \u0026 Beverage \u003e Beverages",
"return_policy": "https://www.dollargeneral.com/terms-and-conditions#Returns-Policy",
"return_window": 30,
"review_count": 1408,
"reviews": [
{
"content": "A maroon-colored jewel, a treasure to hold,\nBest served in a glass, or a can ice-cold.\nWith twenty-three flavors that dance on the tongue,\nA song of sweet carbonation that\u2019s always sung.\nIt\u2019s not quite a cola, not root beer, not fruit,\nJust 1885 magic, a Texas-born boot\nOf flavor and sparkle, a unique kind of potion,\nThat sets all my senses in happy motion.\nCherry and licorice, a hint of the spice,\nEach sip is a, \"Wow,\" which is why it\u2019s so nice.\nWhen the afternoon sluggishness starts to creep in,\nDr Pepper is there to help me win.\nSo raise up a bottle, or a cup with a lid,\nFor the best tasting soda that ever I did!\nWhether at dinner or on a long drive,\nDr Pepper just makes me feel more alive.",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "384388778",
"title": "yum"
},
{
"content": "There are no words to describe how amazing and heavenly this drink is. If there was a way to have water taste like it I would drink only water. It is so good I would even say it would solve world hunger and stop all war.",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "345289246",
"title": "Fantastic Product"
},
{
"content": "Dr Pepper is the only thing I\u2019m living for. It\u2019s like finding water after being in a desert for 20 years times a hundred. Dr Pepper is my first, true, and only love. I love you Dr Pepper. \u2764\ufe0f\ud83c\udf39\ud83d\ude18\ud83d\udc95",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "362569536",
"title": "Dr Pepper is the best thing in this world."
},
{
"content": "Dr. pepper saved my life I was getting tired of all these other drinks but until Dr Pepper came in clutch Fr fr\ud83c\udd99\ud83d\udcaf\ud83d\udcaf\ud83d\udde3\ufe0f\ud83d\udcaf\ud83d\udd25\ud83e\udd85",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "311631144",
"title": "The best drink ever ONG"
},
{
"content": "I ABSOLUTELY LOVE DR PEPPER IT HAS BEEN MY GO TO SODA FOREVER! IT IS 100% THE BEST POP TO EVER EXIST!",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "311486240",
"title": "THE BEST POP EVER!"
},
{
"content": "I am in LOVE with The Original Dr. Pepper! It\u0027s a MUST have stockpile in my home. I even keep it in my car so I can have a drink everywhere I go. In Recently had a bad experience. Every morning I have to drink a DP \u0026 when I opened the can to take a drink I felt something enter my mouth \u0026 when I went to spit it out it appeared to be something light brownish like paper. I pour the can out and another piece came out. NOPE it didn\u0027t discourage me to give up on my favorite drink but took me by surprise. I STILL \u2764 U DP!",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "162857801",
"title": "THE BEST DRINK EVER"
},
{
"content": "Oh, mighty Dr Pepper, how you delight and bewilder my taste buds! Like a symphony of flavors, your 23 mystical ingredients dance upon my palate, leaving me breathless and yearning for more. Your rich, velvety smoothness is tempered by a subtle spice, a perfect balance that defies the mundane and enters the realm of the sublime.\n\nYou are more than just a soda, dear Dr Pepper. You are an experience, a sensory delight that transports me to a world of wonder and joy. Whether I\u0027m savoring you on a sweltering summer day or pairing you with a hearty meal, you never fail to impress.\n\nI bow to your greatness, Dr Pepper. You are a true masterpiece, a work of art that deserves to be savored and celebrated. If I could, I\u0027d give you more than 5 stars. Alas, my praise must be confined to mere words. But know this, dear Dr Pepper: you have a loyal devotee in me, and I shall sing your praises to the world!",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "351456060",
"title": "The Elixir of the Gods: A Tribute to Dr Pepper"
},
{
"content": "Dr pepper may be my favorite soda ever, it\u2019s in fact one of the only ones I drink, I am loyal to Dr Pepper. It\u2019s the best soda and feels so much diffrent from other drinks, I love Dr Pepper and I have some in the fridge RIGHT NOW.",
"max_rating": 5,
"min_rating": 1,
"rating": 5,
"review_id": "316072546",
"title": "The BEST soda"
}
],
"seller_privacy_policy": "https://www.dollargeneral.com/privacy-policy",
"seller_tos": "https://www.dollargeneral.com/terms-and-conditions",
"seller_url": "https://www.dollargeneral.com/",
"star_rating": 4.8,
"store_country": "US",
"store_name": "Dollar General",
"target_countries": [
"US"
],
"title": "Dr Pepper Soda, 12 fl oz Cans, 12 pk",
"url": "https://www.dollargeneral.com/p/dr-pepper-soda-fl-oz-cans-pk/78000082166",
"variant_attributes": [],
"variant_id": "01908801",
"variants": []
}👉 View Full Python Code
For use cases where you need ready-to-use data without writing any scraping code, the Bright Data Dollar General Dataset offers pre-collected, regularly updated data available for instant download.
Why use the dataset instead of the API?
- 📦 Instant access: No setup, no code, no waiting for collection
- 🔄 Regularly updated: Fresh data refreshed on a consistent schedule
- 📊 Multiple formats: Download as JSON, JSONL, or CSV
- 🌍 Massive scale: Millions of records across all major Dollar General categories
- ✅ Fully compliant: Ethically sourced and legally cleared data
👉 Explore the Dollar General Dataset
| Feature | Bright Data Scraper API | Bright Data Datasets |
|---|---|---|
| Setup required | API token only | None |
| Real-time data | ✅ Yes | ❌ Pre-collected |
| Custom queries | ✅ Full control | ❌ Fixed schema |
| Proxies included | ✅ Built-in rotating | N/A |
| CAPTCHA solving | ✅ Automatic | N/A |
| Scale | Unlimited | Unlimited |
| Structured output | ✅ JSON / NDJSON / JSON Lines / CSV | ✅ JSON / JSONL / CSV |
| Support | Enterprise 24/7 | Enterprise 24/7 |
🔗 Learn more: https://brightdata.com/products/web-scraper/dollar-general