This Scrapy script will generate USA city, state, state short name, latitude and longitude list from wikipedia. Wikipedia Page Link: https://en.wikipedia.org/wiki/List_of_United_States_cities_by_population
- git clone https://github.com/salayhin/scrapy_wikipedia_usa_cities.git
- cd scrapy_wikipedia_usa_cities
- Command for generating json file: scrapy crawl wikipedia -o wikipedia_cities.json
- Command for generating csv file: scrapy crawl wikipedia -o wikipedia_cities.csv -t csv