- Driver functions are in scraper.py, bios.txt and bio_urls.txt are the output information
- Modify scraper.py to fit specific tasks
- Dependencies:
from bs4 import BeautifulSoup
from selenium import webdriver
from selenium.webdriver.chrome.options import
Structure
├── README.md
├── bio_urls.txt
├── bios.txt
├── livedatalab_config.json
├── sample
│ ├── bio_urls.txt
│ ├── bios.txt
│ └── scraper.ipynb
└── scraper_code
└── scraper.py