I'm occasionally getting a ERR_TIMED_OUT when scraping a site and want to know how I can catch the error so I can start the loop processing it again?
This is the function I'm using the get the response:
const responsePending = page.waitForResponse((response) => {
return response.url().includes('cloudfront.net');
});
console.log('Wait for response...');
var response = await responsePending;
// when there's an error it doesn't print the next line
console.log('Response received: '+response.status());
And this is the error I'm sometimes getting:
This site can’t be XXXXX took too long to respond.
Try:
Checking the connection
Checking the proxy and the firewall
ERR_TIMED_OUT
Puppeteer also records this error in the logs:
crbug/1173575, non-JS module files deprecated.
Set the timeout option to 0
const responsePending = page.waitForResponse((response) => {
return response.url().includes('cloudfront.net');
},{timeout:0});