This repository was archived by the owner on Mar 16, 2023. It is now read-only.

20 lines (16 loc) · 338 Bytes

WuxiaCrawler

A Scrapy crawler developed to scrape contents from wuxiaworld.com

To install required libraries

pip install -r requirements.txt

To run the spider

first you need to go to the spider directory

cd wuxia
scrapy crawl Spider

To run a sheel

scrapy shell 'www.example.com'