Skip to content

joffemd/googleScraper

 
 

Repository files navigation

Scraping Google Starter Script

Simple script to scrape Google using requests and bs4.

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Prerequisites

Python3+

https://www.python.org/downloads/

Installing

# clone repo
git clone https://github.com/getlinksc/scrape_google.git
# install requirements after changing directory to scrape_google
pip install -r requirements.txt
# modify query in search.py and run script
python writeToExcel.py
  • Python3 - Python is a programming language that lets you work quickly and integrate systems more effectively.
  • Pip - The Python Package Installer
  • Requests - HTTP for Humans
  • Beautiful Soup - a Python library for pulling data out of HTML and XML files
  • Google Search API - an API for scraping Google search results

Contributing

Versioning

Authors

License

Acknowledgments

About

Scrapes google search results to find government website

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages