Tools & Integrations

• How can I use Proxy credentials type: http://host:port || IP:PORT ?

  In case you are using software that can accept only IP:PORT and not accept IP:PORT USERNAME:PASSWORD - you will need to use an additional tool.In order to remove the user name password section from the request, please use the Brigh...

• Edge Browser Integration with Bright Data

  Click the Edge menu on the browser toolbar Select "Settings" Select “System and performance” at the left menu In the "System" section, click "Open your computer's proxy settings" Turn on the "Use a proxy server" box under "Manual ...

• How do I integrate Bright Data as my proxy network?

  The recommended way to integrate Bright Data is through the open source Proxy Manager. Alternatively, you can find the Bright Data API here.For Firefox, chrome, or any other browser, use the Browsers API integration tool

• How do I integrate Bright Data into a web browser automation tool?

  Integrating Bright Data into a web browser automation tool such as Selenium or Puppeteer can be done by route to Bright Data super proxy port which isbrd.superproxy.io:22225 and authenticate with your Bright Data Zone credentials.T...

• Which ports and protocols are supported by Bright Data?

  Ports 80 and 443 are available by default, supporting HTTP and HTTPS protocols.The below table shows supported protocols by port: Port Protocol 80 HTTP and HTTP CONNECT 443 HTTPS   Bright Data can support additional ports...

• Can I use Bright Data on more than one device?

  Yes. You are not limited by the number of devices, IPs, sessions, concurrent connections, or Geo-Locations. We charge based only on the traffic going through our network. See the basic package for more information.

See all 11 articles

• Request Timeout

  Slower connections may get a timeout from the super-proxy server (in the header) or from the target website (in the https). To avoid timeouts, set a longer timeout period (in the request). When you do that, you may want to increase...

• General Tips to Avoid Blocking

  IPs The main things to consider for IPs are: Geolocation: it's generally best to match the peer country to the country of the target.Using more specific targeting can also help:City is more specific than State, and State more spec...

• Add headers and cookies to your http/https requests

  Sometimes target sites can detect users as a bot or a crawler. In this case include headers and cookies in your http/https requests in order to mimic human behavior.

• Mimic a human user

  Including all headers and cookie behavior. See bash example, using Bright Data Proxy Manager: curl --proxy http://127.0.0.1:PORT_NUM "http://lumtest.com/myip.json" -H 'pragma: no-cache' -H 'accept-encoding: gzip, deflate, br' -H 'a...

• Rotate between as many unblocked IPs as possible

  Switch an IP when it gets an error, and use it again only after it cools down several hours. For optimal results use Bright Data Dedicated residential IPs. To do this you have 2 options: Use our API to control the IP rotation: Ch...

• Remote DNS

  Using Remote DNS gives you a DNS resolve server similar to that of the Proxy peer (the origin of the Proxy's IP). This makes your request look more credible as the resolve server is usually located geographically close to the IP, w...

• How can I see my current bandwidth usage with your API?

  You can see your current bandwidth usage with the following curl request: curl -H "X-Lum-Auth: brd-customer-YOUR_CUSTOMER_ID-zone-YOUR_ZONE-key-PASSWORD" "https://api.brightdata.com/bw" Full request example: curl -H "X-Lum-Auth: br...

• My code/software/Proxy Manager bandwidth calculation is not similar to the numbers on my control panel dashboard, How can I debug it?

  Your Brighdata Control panel Dashboard is the number we count into your monthly invoice as it calculates the rquests end BW, while LPM provides an assumption for requests BW. to see how we calculate BW, Click hereTo repreduce the e...

• Can you recommend ways for us to speed up proxies and drop slow ones?

  In the 200 Response there is a field called "x-luminati-timeline".The time in the field is the latency between the last IP and the site. You can use that to measure up to evaluate IPs. Some fields and their meanings: z20822-init:1...

• How do I exclude a specific IP?

  You cannot remove specific IPs because the super proxy allocates them randomly. However, you can make a simple query to get the specific IP you want to exclude. Go to http://lumtest.com/myip and disconnect (change session).

• Why did I get the same IP after changing the session ID?

  Sometimes an HTTP client caches the proxy username/password and as a result you may get the same IP even after changing a session. Ensure that your code accurately follows Bright Data's 'high performance' sample according to the la...

• Event log

  For a quick overview of your usage, go to the event sign in your Zones page: The event log will show you one line of data for the first request made with each unique IP in the past hour. The presented data is: Date: Time and date...

• Proxifier Integration Guide

  Learn how to set up your Proxifier proxy settings and integrate them with Bright Data's Proxy IPs Proxifier is an advanced proxy client that allows network applications that do not support working through proxy servers to ope...

• Selenium Proxy Integration with Bright Data

  Note: When using the Selenium Integration with the Bright DataSuper Proxy - you will have to handle the authentication by yourself.In order to avoid it - you can use the proxy manager tool. Learn how to set up your Selenium proxy...

• VMLogin Proxy Integration with Bright Data

  VMLogin Proxy Integration with Bright Data Register and manage multiple online accounts using physical devices with VMLogin's virtual browsing profiles which helps enable anti-association capabilities as well as fingerprint pr...

• PhantomBuster Proxy Integration with Bright Data

  PhantomBuster Proxy Integration with Bright Data Learn how to setup your PhantomBuster proxy settings and integrate with Bright Data's Proxy IPs PhantomBuster is a code-free automations and data extraction software that let...

• How to crawl a website without getting blocked or misled (cloaked)?

  Why should I care?When a target website detects crawlers from a proxy (datacenter) IP, it typically Blocks the IP, or Presents the IP with purposely misleading information, or Throttle down the response rate How does the target w...

• How to get an IP in a specific city

  Why should I care?Example: If you are responsible for testing Yelp's city level service - you need to check the site from 10,000 different cities around the world.How to get an IP in a specific city?If you only use a traditional da...

• How to accelerate your web scraping

  Why should I care?If the number of requests you rotate through a single IP are higher than what target websites allow, the website you target will identify your IP and block or mislead you with false information. It means that your...

• How to rotate your IP address

  Why should I care?When many requests are sent to a website from the same IP, the website can tag the IP used as a crawler and send misleading information or block you. Periodically changing, or rotating, your IP address helps preve...

• How do I avoid subnet block range?

  What is a subnet block range?Smaller sections of a network are called subnets, which are useful for grouping hosts together and managing them all at once. Subnets are based on IP address, making it easy for websites or malicious us...

• How to switch from API to Proxy Manager

  Why should I care?Using the Proxy Manager offers advanced features that are not readily available in the API. Instead of having to manually code mechanisms for tasks like keeping an IP as long as possible or rotating your IP after ...

See all 8 articles

• How to resolve "Auth Failed (code: ip_forbidden)"

  The Auth failed (also appears as 407 status code) within the "ip_forbidden" text message can happen when your proxy zone is configured with Whitelist IPs permission, and the machine IP (crawler) is not part of that list.In order to...

• Why Am I getting '400 Proxy Error: ip_requested_not_allocated_by_customer' ?

  When Using the Data center/ISP or Gips products, the error code 400 can appear in case the IPs under your zone has been refreshed, removed, or simply changed due to system updatesWhenever this error appear, you should go to your Br...

• What is "x-luminati-ip: superproxy bypass"

  Whenever targeting a domain that is not allowed or not in use with the right product, the Bright data "Network policy" monitoring system will either block the request or route it from the super proxy server. When routing from the s...

• I need help with solving a technical issue

  In case you have an issue that you attempted and failed to resolve, and it has been made clear by a Bright Data representative that the problem does not originate in Bright Data, you may ask your account manager for a Developer Rev...

• Getting blocked and not sure why?

  In order to understand if the block is generated by the target website or by your code, you should run the following command in the terminal/CMD/git bash etc. curl --proxy brd.superproxy.io:22225 --proxy-user USERNAME:PASSWORD -k "...

• How do I handle a 407 error message (Proxy authentication required)?

  Encountering a 407 error message means that the client must first authenticate itself with the proxy. Resolving this issue requires adding the requested IPs, which are now refused connection, to the whitelist. For details, see Conf...

See all 12 articles