This is client-server-based console app “web_scraper”.
- server-side: The server must be started and wait the request from the client. Server must produce the web scraping of the webpage to get two parameters: the number of pictures and the number of the leaf paragraphs. The leaf paragraphs in HTML document represents only the last paragraphs in the nested paragraphstructures
- client-side: The client must send the request to the server to get the proper answer. The client has options page (-p) to get the statistical data.
To download console app, you need to type following command:
Then install requirements to have all packets needed for this project:
- pip install requirements.txt
For server and client, open 2 terminal tabs and run the following commands:
-
Server Terminal:
python3 web_scraper.py server -
Client Terminal:
python3 web_scraper.py client -p [URL]