Learn about Bright Data's Proxy Manager application tool. What it is, how to get started, and how it can be utilized to manage our various proxy products.
Bright Data's Proxy Manager
Bright Data Proxy Manager is an application where you can control, manage, and monitor all of your proxies either from our app interface or via API.
It is an advanced open-source application tool (GitHub) built by developers, for developers and allows unique proxy customization, rules implementation, and integration of external proxies.
Best For:
- Automating waterfalls between different proxy products and IPs
- Reducing Bandwith with rules that block certain types of data
- Monitoring HAR logs with live preview of the whole traffic
- User access management by whitelisting or generating tokens
- Teams that are looking to customize and manage their proxy flows and infrastructure
Quick Start
- Proxy Manager can be run either on-premise or through the Bright Data Cloud
On-Premise: You take care of the installation, management, and monitoring
Cloud Server (Recommended): Get full access to all that Proxy Manager has to offer
- No installation or server setup necessary - Log-in straight to our web app from anywhere
- Managed end-to-end solution
- Live server status monitoring by Bright Data's 24/7 team
- Once Proxy Manager is installed, you can log-in and start managing your proxies by setting up ports configured with your zone settings.
- Now you can implement rules and headers to customize your proxies to your needs. This will ensure a more cost-optimized usage of bandwidth and more accurate results.
Additional info and resources
Port targeting configuration
Bright Data proxy manager enables targeting the Proxy using IP:PORT format. For example, targeting a port indexed as 24000 when the proxy manager is installed locally:
curl --proxy 127.0.0.1:24000 "<TARGET SITE>"
(If installed remotely simply switch 127.0.0.1 with the remote server IP address)
Instead of the IP:PORT USERNAME:PASSWORD
curl --proxy brd.superproxy.io:22225 --proxy-user brd-customer-<USERNAME>-zone-<ZONE>:<PASSWORD> "<TARGET SITE>"
This allows:
- Removing the username:password section from the request.
- Integration with 3rd party softwares that accept only IP:Port format
- Clean code. Ports can be configured with all necessary headers and rules in advance no need to adjust the command/request itself. More information is available here
Presets configuration
Long single session (IP)
Use this preset if you need full page loads. Connect from the browser manually (for example Chrome/Firefox) or programatically (for example Puppeteer/Selenium). All requests share the same IP. You can control when you refresh the IP from the UI or API.
Rotating
Use this preset if you want to get a fresh new IP on each single request. This preset also rotates the User-Agent header automatically. It's the best for scraping API when you don't load the full pages.
Custom
Build your own preset fit your needs
Note that using a custom preset requires testing in the internal environment before going to production to verify the process is working as expected
Rules and Headers configuration
Navigate to Rules and start building your own rules based on triggers such as:
- URL suffixes
- Status codes
- String values found in the Response body
- Requests latency
You can choose an action to be taken to each trigger respectively.
For example, an implementation of a rule to save bandwidth by nullifying media URLs' outputs.
In addition, you can implement the desired headers in advance under the Rules section.
For example, adding the user-agent header of a Linux desktop on i686 CPU (More about user-agents can be found here)
Add other proxy providers to Proxy Manager
Bright Data Proxy Manager supports external proxies from other vendors. Connecting external proxies will allow you to optimize and manage all of your proxies in one place.
- Login to your Proxy Manager
- Set a new Port.
- Select 'External'
- Add your proxies in the next format
['<proxy_peer_IP>', '<username>:<password>@<proxyprovider_server>:<port>']
- Click 'Save' and you will have the external proxies available as one of the Proxy Manager's port
Difference in the calculation of traffic in Proxy Manager panel and Control Panel
Proxy Manager is a middleman between the request initiator and our Super Proxy servers. Proxy Manager statistics can be seen here, and Super Proxy statistics can be seen here. So each request that you send to Proxy Manager eventually reaches Super Proxy. But there could be a difference in traffic calculations, here's why:
- Proxy Manager calculates incoming requests as they are being sent, but after they reach the Proxy Manager, it attaches additional headers, so that request's response will have more information about the request's flow (timeline, proxy IP, etc)
- Requests that reach the Super Proxy server from Proxy Manager are incoming with those additional parameters; that's why Super Proxy calculates slightly bigger requests than it initially was when reached Proxy Manager
- Proxy Manager sometimes adds headers to present a better view of logs, but this data is not being calculated in the billing
In conclusion, the main source of traffic statistics should be Zones' page since it represents statistics formulated by Super Proxy.
As a rule - Bright Data uses the Zones' page for calculation and one source of truth
Invoices and billing events will be triggered based on the zones calculations