Tools & Integrations
Integration
-
How can I use Proxy credentials type: http://host:port || IP:PORT ?
In case you are using software that can accept only IP:PORT and not accept IP:PORT USERNAME:PASSWORD - you will need to use an additional tool.In order to remove the user name password section from the request, please use the Bright DataProxy Manager to...
-
How do I integrate Bright Data as my proxy network?
The recommended way to integrate Bright Data is through the open source Proxy Manager. Alternatively, you can find the Bright Data API here.For Firefox, chrome, or any other browser, use the Browsers API integration tool
-
How do I integrate Bright Data into a web browser automation tool?
Integrating Bright Data into a web browser automation tool such as Selenium or Puppeteer can be done by route to Bright Data super proxy port which iszproxy.lum-superproxy.io:22225 and authenticate with your Bright Data Zone credentials.The username and...
-
Which ports and protocols are supported by Bright Data?
Ports 80 and 443 are available by default, supporting HTTP and HTTPS protocols.The below table shows supported protocols by port: Port Protocol 80 HTTP 443 HTTPS Bright Data is able to support additional ports by request. Every request to su...
-
Can I use Bright Data on more than one device?
Yes. You are not limited by the number of devices, IPs, sessions, concurrent connections, or Geo-Locations. We charge based only on the traffic going through our network. See the basic package for more information.
-
How many concurrent sessions can I use?
We do not place a limit on the number of concurrent sessions used.
General Tips
-
Request Timeout
Slower connections may get a timeout from the super-proxy server (in the header) or from the target website (in the https). To avoid timeouts, set a longer timeout period (in the request). When you do that, you may want to increase the amount of IPs tha...
-
Avoid getting blocked or spoofed
IP Country: Set the country of your IP (in the Zone) to the same country as the destination site. It makes your request look more like that of a human user, which in some cases prevents getting blocked or mislead. IP City: Setting the city targeting of...
-
Add headers and cookies to your http/https requests
Sometimes target sites can detect users as a bot or a crawler. In this case include headers and cookies in your http/https requests in order to mimic human behavior.
-
Mimic a human user
Including all headers and cookie behavior. See bash example, using Bright Data Proxy Manager: curl --proxy http://127.0.0.1:PORT_NUM "http://lumtest.com/myip.json" -H 'pragma: no-cache' -H 'accept-encoding: gzip, deflate, br' -H 'accept-language: en-US,...
-
Rotate between as many unblocked IPs as possible
Switch an IP when it gets an error, and use it again only after it cools down several hours. For optimal results use Bright Data Dedicated residential IPs. To do this you have 2 options: Use our API to control the IP rotation: Check the IP by session ...
-
Remote DNS
Using Remote DNS gives you a DNS resolve server similar to that of the Proxy peer (the origin of the Proxy's IP). This makes your request look more credible as the resolve server is usually located geographically close to the IP, whereas without using R...
Performance
-
Can I request an IP change every 15 seconds?
Yes. Our code snippet defines an IP change by number of requests (the default is 40), but can be modified by you so that your code would change every number of seconds as well.
-
How can I see my current bandwidth usage with your API?
You can see your current bandwidth usage with the following curl request: curl -H "X-Lum-Auth: lum-customer-YOUR_CUSTOMER_ID-zone-YOUR_ZONE-key-PASSWORD" "https://brightdata.com/api/bw" Full request example: curl -H "X-Lum-Auth: lum-customer-CXXXXX-zone...
-
My code/software/LPM bandwidth calculation is not similar to the numbers on my control panel dashboard, How can I debug it?
Your Brighdata Control panel Dashboard is the number we count into your monthly invoice as it calculates the rquests end BW, while LPM provides an assumption for requests BW. to see how we calculate BW, Click hereTo repreduce the error and to make sure ...
-
Can you recommend ways for us to speed up proxies and drop slow ones?
In the 200 Response there is a field called "x-luminati-timeline".The time in the field is the latency between the last IP and the site. You can use that to measure up to evaluate IPs. Some fields and their meanings: z20822-init:1 - time to initialize ...
-
How do I exclude a specific IP?
You cannot remove specific IPs because the super proxy allocates them randomly. However, you can make a simple query to get the specific IP you want to exclude. Go to http://lumtest.com/myip and disconnect (change session).
-
Why did I get the same IP after changing the session ID?
Sometimes an HTTP client caches the proxy username/password and as a result you may get the same IP even after changing a session. Ensure that your code accurately follows Bright Data's 'high performance' sample according to the language you use. This s...
Browser Extension
-
What is Bright Data Proxy Browser Extension?
It's a browser extension that allows you to use Bright Data from your browser with minimum setup.Watch video:
-
How can I start using it?
Once you have an active account on Bright Data, install the extension here, set up your zone and start browsing from anywhere in the world.
-
Why login message keeps appearing
Bright Data uses cookies to remember your login credentials in order to keep your user experience at its best. If you are using third-party extensions that regularly removes cookies from your device then you'll see the login message quite often.How can ...
-
Does the extension work in incognito mode?
Yes. Bright Data extension works on both regular and incognito mode. To enable incognito support on Chrome, do the following: Type chrome://extensions in the chrome address bar Make sure Allow in incognito is checked
-
When should I use custom headers?
Custom headers are mainly meant to make the request more specific. You should use it in cases when you need to pass custom parameters with your requests to the target site. Every header should contain Name & Value and you can add as many headers as you ...
-
Why am I getting an 'error' message when I setup the extension?
There are few possible reasons for proxy error when setting up the extension: A zone was not selected. Make sure that the form is filled correctly. Your account is 'disabled'. You can easily check this on your Dashboard. You have a negative balance. Ch...
Proxy Manager
-
What does MaxListenersExceededWarning: Possible EventEmitter error means - should I be concern?
MaxListenersExceededWarning is intended to assist the developer by warning themwhen they have code that may be causing a memory leak.If PM works fine then you may not be concerned about this warning.
-
Difference in calculation of traffic in Proxy Manager panel and Control Panel
Proxy Manager is a middleman between the request initiator and our Super Proxy servers. Proxy Manager statistics can be seen here, and Super Proxy statistics can be seen here. So each request that you send to Proxy Manager eventually reaches Super Proxy...
-
How to define a proxy IP country when using SOCKS5 protocol with Proxy Manager?
SOCKS5 protocol uses an encrypted base64 string for authentication. Therefore, when using SOCKS5, if you need to define a proxy IP country (-country-<COUNTRY_CODE>), you will have to convert your basic authentication information into base64 token: Brow...
-
What to do if I cannot log in when opening Proxy Manager?
If you fail to log in to your Proxy Manager (PM), please do the following: Make sure that the computer that runs PM is not using a VPN.Mind that using a VPN while running PM might cause login problems, and also slow down the connection to the proxies ...
-
How to install Proxy Manager on Linux / MacOS
If you plan to install Proxy Manager on a Linux or a MacOS computer or server, please: Confirm the recommended hardware requirements: 4GB RAM 2 CPUs 3GB SSD Confirm the recommended software requirements: Important: Linux CentOS 8.x is not supporte...
-
Proxy manager connection error (port status is not "ok")
If you cannot log in to Proxy Manager, or If Proxy Manager cannot connect to Super Proxy (i.e. port status is not OK), check the following: Make sure that VPN is not turned on Make sure that there is no anti-virus or any other security software (such a...
3rd Party Integrations
-
Proxifier Integration Guide
Learn how to set up your Proxifier proxy settings and integrate them with Bright Data's Proxy IPs Proxifier is an advanced proxy client that allows network applications that do not support working through proxy servers to operate through SOCKS or ...
-
Selenium Proxy Integration with Bright Data
Note: When using the Selenium Integration with the Bright DataSuper Proxy - you will have to handle the authentication by yourself.In order to avoid it - you can use the proxy manager tool. Learn how to set up your Selenium proxy settings and integrat...
-
VMLogin Proxy Integration with Bright Data
VMLogin Proxy Integration with Bright Data Register and manage multiple online accounts using physical devices with VMLogin's virtual browsing profiles which helps enable anti-association capabilities as well as fingerprint protection Manage mul...
-
PhantomBuster Proxy Integration with Bright Data
PhantomBuster Proxy Integration with Bright Data Learn how to setup your PhantomBuster proxy settings and integrate with Bright Data's Proxy IPs PhantomBuster is a code-free automations and data extraction software that lets you automate actions...
Become a Bright Data professional
-
How to crawl a website without getting blocked or misled (cloaked)?
Why should I care?When a target website detects crawlers from a proxy (datacenter) IP, it typically Blocks the IP, or Presents the IP with purposely misleading information, or Throttle down the response rate How does the target website identify my cra...
-
How to get an IP in a specific city
Why should I care?Example: If you are responsible for testing Yelp's city level service - you need to check the site from 10,000 different cities around the world.How to get an IP in a specific city?If you only use a traditional data center proxy soluti...
-
How to accelerate your web scraping
Why should I care?If the number of requests you rotate through a single IP are higher than what target websites allow, the website you target will identify your IP and block or mislead you with false information. It means that your information collectin...
-
How to rotate your IP address
Why should I care?When many requests are sent to a website from the same IP, the website can tag the IP used as a crawler and send misleading information or block you. Periodically changing, or rotating, your IP address helps prevent a target site from ...
-
How do I avoid subnet block range?
What is a subnet block range?Smaller sections of a network are called subnets, which are useful for grouping hosts together and managing them all at once. Subnets are based on IP address, making it easy for websites or malicious users to target or block...
-
How to switch from API to Proxy Manager
Why should I care?Using the Proxy Manager offers advanced features that are not readily available in the API. Instead of having to manually code mechanisms for tasks like keeping an IP as long as possible or rotating your IP after each request, you can ...
Troubleshooting
-
How to resolve "Auth Failed (code: ip_forbidden)"
The Auth failed (also appears as 407 status code) within the "ip_forbidden" text message can happen when your proxy zone is configured with Whitelist IPs permission, and the machine IP (crawler) is not part of that list.In order to resolve this matter, ...
-
Why Am I getting '400 Proxy Error: ip_requested_not_allocated_by_customer' ?
When Using the Data center/ISP or Gips products, the error code 400 can appear in case the IPs under your zone has been refreshed, removed, or simply changed due to system updatesWhenever this error appear, you should go to your Bright Data Zones page ,...
-
What is "x-luminati-ip: superproxy bypass"
Whenever targeting a domain that is not allowed or not in use with the right product, the Bright data "Network policy" monitoring system will either block the request or route it from the super proxy server. When routing from the super proxy server, tra...
-
I need help with solving a technical issue
In case you have an issue that you attempted and failed to resolve, and it has been made clear by a Bright Data representative that the problem does not originate in Bright Data, you may ask your account manager for a Developer Review.A Developer Review...
-
Getting blocked and not sure why?
In order to understand if the block is generated by the target website or by your code, you should run the following command in the terminal/CMD/git bash etc. curl --proxy zproxy.lum-superproxy.io:22225 --proxy-user USERNAME:PASSWORD -k "TARGET WEBSITE"...
-
How do I handle a 407 error message (Proxy authentication required)?
Encountering a 407 error message means that the client must first authenticate itself with the proxy. Resolving this issue requires adding the requested IPs, which are now refused connection, to the whitelist. For details, see Configure Whitelist IPs. I...