acid/web-scraper

Go to file

AcidUK 55a88510be Added SMS_TO environmental variable to testing environment

2021-03-08 08:57:22 +00:00

Added tests

2021-03-07 14:58:01 +00:00

.env_sample

Moved telephone number to env file

2021-03-08 08:48:05 +00:00

.gitignore

Refactored to functional style to increase reusability

2021-03-06 15:37:16 +00:00

.gitlab-ci.yml

Update .gitlab-ci.yml file

2021-03-08 08:56:45 +00:00

LICENSE

Update LICENSE

2021-03-07 15:23:24 +00:00

README.md

added readme

2021-03-06 16:33:15 +00:00

requirements.txt

updated requirements

2021-03-07 15:19:02 +00:00

scrape.py

Moved telephone number to env file

2021-03-08 08:48:05 +00:00

test_scrape.py

Added tests

2021-03-07 14:58:01 +00:00

README.md

Web Scraper

Installation

Either download a copy of the script, or use to git clone to grab a copy

git clone https://git.cusack.cloud/acid/web-scraper.git

Create a virtual environment and then activate it

cd web-scraper
python3 -m venv .
source bin/activate

Install requirements

pip install -r requirements.txt

Usage

Copy the .env_sample to .env and fill in your twilio details to send SMS messages

Edit the config object in scrape.py to point to the URL to be monitored.