I'm trying to crawl a job search website. For the past 2 weeks I have been testing my crawl on the website smoothly. But today the website SSL Certificate expired and I can't crawl the website.
Is there a way to crawl the website?
Like making a script that lets the crawler to go pass the security check.