I have a python script that scraps data off from a website on an hourly basis. It is stored on the server at the moment and is working well as I am using task scheduler to schedule it to execute the script on an hourly basis.
I am using this code
driver.quit()
to quit the browser window
My problem to this that whenever I am not logging in to the server, it will start stacking up the webdriver window as somehow the driver.quit() function does not work when I am logging into the server. every morning when I came to work, I have tons of window to close from the server.
I tried to quit, close, dispose, but it doesn't help. What else I can try?
In python using chromedriver, I quit Chrome processes with:
driver.close()
For Python and chromedriver I've found these two methods useful (mind the difference):
driver.close() - closes the browser active window.
driver.quit() - closes all browser windows and ends driver's session/process.
Could'nt you scrape in headless mode? (example for chrome)
chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument('--headless')
chrome_options.headless = True
...
driver = webdriver.Chrome(chrome_options=chrome_options)
driver.create_options()