Configure your Proxy

It is technically possible to overload a website by consuming its resources and causing performance issues in the data collection field. Bright Data, on top of putting systems in place to avoid target site overloading, is also offering the cache proxy feature to avoid making redundant requests to target sites in cases where we have an up-to-date cache record from an identical request made by another customer.

Responses received from our cache are roughly 20 times faster! This means that as our cache usage grows, performance will keep increasing.

To promote our goal of maintaining a healthy ecosystem, we are providing a usage discount for any usage going through a proxy zone that is opted in to cache proxy.

While the cache records we will serve may be a small percentage of the overall proxy zone usage, the discount will be applied for the full use of the proxy zone.

Requests sent from machines lacking our certificate or not utilizing the “without-certificate” method (which ignores SSL errors) will result in failure. Please ensure your system complies with these requirements for successful caching.

Our Mobile peers’ pool consists of real users around the world who opt-in to use our product. As part of the opt-in, we utilize the IPs of these real users during their “down” periods as part of our ethical peer-to-peer network. By enabling Long-Session Peers, you ensure that you will be routed through peers who are known to stay active for extended periods of time, and can maintain a single IP address for a much longer period of time in comparison to regular Mobile peers.

Consistent scraping operations: This stability minimizes disruptions caused by IP changes and maximizes the efficiency of your scraping tasks. You can rely on a consistent IP address for an extended period, allowing for long-duration scraping operations. This feature is particularly useful for projects that require continuous data extraction or monitoring.