Tools & Integrations

Integration

See all 9 articles

General Tips

  • Request Timeout

    Slower connections may get a timeout from the super-proxy server (in the header) or from the target website (in the https). To avoid timeouts, set a longer timeout period (in the request). When you do that, you may want to increase the amount of IPs tha...

  • Avoid getting blocked or spoofed

    IP Country: Set the country of your IP (in the Zone) to the same country as the destination site. It makes your request look more like that of a human user, which in some cases prevents getting blocked or mislead. IP City: Setting the city targeting of...

  • Add headers and cookies to your http/https requests

    Sometimes target sites can detect users as a bot or a crawler. In this case include headers and cookies in your http/https requests in order to mimic human behavior.

  • Mimic a human user

    Including all headers and cookie behavior. See bash example, using Bright Data Proxy Manager: curl --proxy http://127.0.0.1:PORT_NUM "http://lumtest.com/myip.json" -H 'pragma: no-cache' -H 'accept-encoding: gzip, deflate, br' -H 'accept-language: en-US,...

  • Rotate between as many unblocked IPs as possible

    Switch an IP when it gets an error, and use it again only after it cools down several hours. For optimal results use Bright Data Dedicated residential IPs. To do this you have 2 options: Use our API to control the IP rotation: Check the IP by session ...

  • Remote DNS

    Using Remote DNS gives you a DNS resolve server similar to that of the Proxy peer (the origin of the Proxy's IP). This makes your request look more credible as the resolve server is usually located geographically close to the IP, whereas without using R...

Performance

See all 7 articles

Browser Extension

  • What is Bright Data Proxy Browser Extension?

    It's a browser extension that allows you to use Bright Data from your browser with minimum setup.Watch video:

  • How can I start using it?

    Once you have an active account on Bright Data, install the extension here, set up your zone and start browsing from anywhere in the world.

  • Why login message keeps appearing

    Bright Data uses cookies to remember your login credentials in order to keep your user experience at its best. If you are using third-party extensions that regularly removes cookies from your device then you'll see the login message quite often.How can ...

  • Does the extension work in incognito mode?

    Yes. Bright Data extension works on both regular and incognito mode. To enable incognito support on Chrome, do the following: Type chrome://extensions in the chrome address bar Make sure Allow in incognito is checked

  • When should I use custom headers?

    Custom headers are mainly meant to make the request more specific. You should use it in cases when you need to pass custom parameters with your requests to the target site. Every header should contain Name & Value and you can add as many headers as you ...

  • Why am I getting an 'error' message when I setup the extension?

    There are few possible reasons for proxy error when setting up the extension: A zone was not selected. Make sure that the form is filled correctly. Your account is 'disabled'. You can easily check this on your Dashboard. You have a negative balance. Ch...

See all 11 articles

Proxy Manager

See all 58 articles

3rd Party Integrations

  • Proxifier Integration Guide

    Learn how to set up your Proxifier proxy settings and integrate them with Bright Data's Proxy IPs Proxifier is an advanced proxy client that allows network applications that do not support working through proxy servers to operate through SOCKS or ...

  • Selenium Proxy Integration with Bright Data

    Note: When using the Selenium Integration with the Bright DataSuper Proxy - you will have to handle the authentication by yourself.In order to avoid it - you can use the proxy manager tool. Learn how to set up your Selenium proxy settings and integrat...

  • VMLogin Proxy Integration with Bright Data

    VMLogin Proxy Integration with Bright Data Register and manage multiple online accounts using physical devices with VMLogin's virtual browsing profiles which helps enable anti-association capabilities as well as fingerprint protection Manage mul...

  • PhantomBuster Proxy Integration with Bright Data

    PhantomBuster Proxy Integration with Bright Data Learn how to setup your PhantomBuster proxy settings and integrate with Bright Data's Proxy IPs PhantomBuster is a code-free automations and data extraction software that lets you automate actions...

Become a Bright Data professional

  • How to crawl a website without getting blocked or misled (cloaked)?

    Why should I care?When a target website detects crawlers from a proxy (datacenter) IP, it typically Blocks the IP, or Presents the IP with purposely misleading information, or Throttle down the response rate How does the target website identify my cra...

  • How to get an IP in a specific city

    Why should I care?Example: If you are responsible for testing Yelp's city level service - you need to check the site from 10,000 different cities around the world.How to get an IP in a specific city?If you only use a traditional data center proxy soluti...

  • How to accelerate your web scraping

    Why should I care?If the number of requests you rotate through a single IP are higher than what target websites allow, the website you target will identify your IP and block or mislead you with false information. It means that your information collectin...

  • How to rotate your IP address

    Why should I care?When many requests are sent to a website from the same IP, the website can tag the IP used as a crawler and send misleading information or block you. Periodically changing, or rotating, your IP address helps prevent a target site from ...

  • How do I avoid subnet block range?

    What is a subnet block range?Smaller sections of a network are called subnets, which are useful for grouping hosts together and managing them all at once. Subnets are based on IP address, making it easy for websites or malicious users to target or block...

  • How to switch from API to Proxy Manager

    Why should I care?Using the Proxy Manager offers advanced features that are not readily available in the API. Instead of having to manually code mechanisms for tasks like keeping an IP as long as possible or rotating your IP after each request, you can ...

See all 8 articles

Troubleshooting

  • How to resolve "Auth Failed (code: ip_forbidden)"

    The Auth failed (also appears as 407 status code) within the "ip_forbidden" text message can happen when your proxy zone is configured with Whitelist IPs permission, and the machine IP (crawler) is not part of that list.In order to resolve this matter, ...

  • Why Am I getting '400 Proxy Error: ip_requested_not_allocated_by_customer' ?

    When Using the Data center/ISP or Gips products, the error code 400 can appear in case the IPs under your zone has been refreshed, removed, or simply changed due to system updatesWhenever this error appear, you should go to your Bright Data Zones page ,...

  • What is "x-luminati-ip: superproxy bypass"

    Whenever targeting a domain that is not allowed or not in use with the right product, the Bright data "Network policy" monitoring system will either block the request or route it from the super proxy server. When routing from the super proxy server, tra...

  • I need help with solving a technical issue

    In case you have an issue that you attempted and failed to resolve, and it has been made clear by a Bright Data representative that the problem does not originate in Bright Data, you may ask your account manager for a Developer Review.A Developer Review...

  • Getting blocked and not sure why?

    In order to understand if the block is generated by the target website or by your code, you should run the following command in the terminal/CMD/git bash etc. curl --proxy zproxy.lum-superproxy.io:22225 --proxy-user USERNAME:PASSWORD -k "TARGET WEBSITE"...

  • How do I handle a 407 error message (Proxy authentication required)?

    Encountering a 407 error message means that the client must first authenticate itself with the proxy. Resolving this issue requires adding the requested IPs, which are now refused connection, to the whitelist. For details, see Configure Whitelist IPs. I...

See all 12 articles