General Tips
-
Request Timeout
Slower connections may get a timeout from the super-proxy server (in the header) or from the target website (in the https). To avoid timeouts, set a longer timeout period (in the request). When you do that, you may want to increase...
-
General Tips to Avoid Blocking
IPs The main things to consider for IPs are: Geolocation: it's generally best to match the peer country to the country of the target.Using more specific targeting can also help:City is more specific than State, and State more spec...
-
Add headers and cookies to your http/https requests
Sometimes target sites can detect users as a bot or a crawler. In this case include headers and cookies in your http/https requests in order to mimic human behavior.
-
Mimic a human user
Including all headers and cookie behavior. See bash example, using Bright Data Proxy Manager: curl --proxy http://127.0.0.1:PORT_NUM "http://lumtest.com/myip.json" -H 'pragma: no-cache' -H 'accept-encoding: gzip, deflate, br' -H 'a...
-
Rotate between as many unblocked IPs as possible
Switch an IP when it gets an error, and use it again only after it cools down several hours. For optimal results use Bright Data Dedicated residential IPs. To do this you have 2 options: Use our API to control the IP rotation: Ch...
-
Remote DNS
Using Remote DNS gives you a DNS resolve server similar to that of the Proxy peer (the origin of the Proxy's IP). This makes your request look more credible as the resolve server is usually located geographically close to the IP, w...