29 lines
518 B
Markdown
29 lines
518 B
Markdown
# Web Scraper
|
|
|
|
## Installation
|
|
|
|
Either download a copy of the script, or use to git clone to grab a copy
|
|
|
|
```sh
|
|
git clone https://git.cusack.cloud/acid/web-scraper.git
|
|
```
|
|
|
|
Create a virtual environment and then activate it
|
|
|
|
```sh
|
|
cd web-scraper
|
|
python3 -m venv .
|
|
source bin/activate
|
|
```
|
|
|
|
Install requirements
|
|
|
|
```sh
|
|
pip install -r requirements.txt
|
|
```
|
|
|
|
## Usage
|
|
|
|
Copy the .env_sample to .env and fill in your twilio details to send SMS messages
|
|
|
|
Edit the config object in scrape.py to point to the URL to be monitored. |