Redundant Cross-Border Proxy Pools That Rotate When Throttled

Step by step

1. 1

   Build one pool per country

   Keep at least two providers or subnets per country so a single provider outage does not empty the pool.

2. 2

   Score endpoints continuously

   Track success rate and median latency over a sliding window. Prefer endpoints with high success and low latency, not just the next one in a list.

3. 3

   Detect throttling explicitly

   Count 429 and 503 responses, connection resets and responses far slower than the pool median as throttle events.

4. 4

   Cool down, then fail over

   Remove a throttled node for a period that grows with repeated failures, and retry the request on the next best endpoint in the same country.

Example

import time

class ProxyPool:
    def __init__(self, endpoints: list[str]):
        self.score = {e: 1.0 for e in endpoints}
        self.cooldown_until = {e: 0.0 for e in endpoints}

    def pick(self) -> str:
        now = time.time()
        ready = [e for e in self.score if self.cooldown_until[e] <= now]
        return max(ready, key=self.score.get)

    def report(self, endpoint: str, status: int) -> None:
        if status in (429, 503):
            self.score[endpoint] *= 0.5
            self.cooldown_until[endpoint] = time.time() + 60
        else:
            self.score[endpoint] = min(1.0, self.score[endpoint] + 0.05)

Frequently Asked Questions