How to handle HTTP error 408 in scraping agent?

The HTTP  408 status code means that the request was timed-out while making a connection to the server. So, the default scraping agent configuration is set to wait for 60 seconds and skip the slow page if takes longer then that. The default behavior can be changed by following the steps below or for slow websites.

The 408 Request Timeout error displays as :

http-error.

We can change the web scraping agent default connection timeout by following these steps : 

  1. Edit the agent
  2. Go to Connections section
  3. Increase the timeout(seconds) to 60 or 120

http-error2