General Tips

Request Timeout

Slower connections may get a timeout from the super-proxy server (in the header) or from the target website (in the https). To avoid timeouts, set a longer timeout period (in the request). When you do that, you may want to increase...

General Tips to Avoid Blocking

IPs The main things to consider for IPs are: Geolocation: it's generally best to match the peer country to the country of the target.Using more specific targeting can also help:City is more specific than State, and State more spec...

Add headers and cookies to your http/https requests

Sometimes target sites can detect users as a bot or a crawler. In this case include headers and cookies in your http/https requests in order to mimic human behavior.

Mimic a human user

Including all headers and cookie behavior. See bash example, using Bright Data Proxy Manager: curl --proxy http://127.0.0.1:PORT_NUM "http://lumtest.com/myip.json" -H 'pragma: no-cache' -H 'accept-encoding: gzip, deflate, br' -H 'a...

Rotate between as many unblocked IPs as possible

Switch an IP when it gets an error, and use it again only after it cools down several hours. For optimal results use Bright Data Dedicated residential IPs. To do this you have 2 options: Use our API to control the IP rotation: Ch...