Scraping website by python, bs4 and selenium

To scrap website data with python, usually we just bs4 but if some web pages generate content by javascript then selenium will be one of handful tool we need to make the job done.

The simple and easy way to install selenium on your pc is using command pip install selenium, however sometime after install the different version between your chrome and chromedriver may cause error:

SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 81

To resolve this issue, first you need to check your chrome browser version, the go to chromedriver website which is here, and download version match with your chrome browser. Extract and copy overwrite to the old one. That is it, now you good to run your program.