← All articles

Proxies · 8 min read · 7/28/2026

Proxy Latency Benchmark: How to Test Speed Accurately

Learn how to benchmark proxy latency, identify bottlenecks, compare networks fairly, and choose endpoints for your workload.

Proxy Latency Benchmark: How to Test Speed Accurately

A proxy can have a large IP pool and broad location coverage yet still perform poorly when every request takes too long. A proxy latency benchmark measures how quickly a proxy establishes connections and returns data under controlled conditions. Done correctly, it separates provider performance from delays caused by your device, target website, network, or test design.

This guide explains which metrics matter, how to build a repeatable test, and how to interpret results without relying on a single misleading speed score.

What a proxy latency benchmark measures

Latency is the time required for data to travel through the proxy path and produce a response. It is commonly reported in milliseconds, but there is no single universal latency metric.

A useful benchmark measures several stages:

  • Proxy connection time: Time needed to establish a TCP connection with the proxy gateway.
  • TLS handshake time: Time required to negotiate HTTPS encryption. This matters because most real browsing and automation traffic uses HTTPS.
  • Time to first byte (TTFB): Time from sending the request until the first response byte arrives.
  • Total response time: Time needed to receive the complete response.
  • Throughput: Data transferred per second during a larger download or upload.
  • Success rate: Percentage of requests completed without proxy, timeout, DNS, TLS, or target errors.
  • Latency percentiles: Median, p90, and p95 results show typical performance and slower outliers.

Ping alone is insufficient. Many proxy gateways block ICMP ping, while HTTP traffic involves extra DNS, TCP, TLS, authentication, proxy routing, and target-server processing.

Why proxy type changes latency

Different proxy products route traffic differently, so they should not be placed in one undifferentiated table.

Datacenter proxies

[Datacenter proxies](/blog/datacenter-proxies) usually provide the shortest and most consistent routes because their servers run in data centers with high-capacity connections. They are often suitable for workloads where speed and stable sessions matter more than residential network identity.

Residential proxies

Residential requests may pass through an additional provider gateway and an end-user device or ISP connection. Peer availability, last-mile quality, rotation rules, and geographic filtering can increase variance. A fast median result can therefore coexist with a much slower p95.

ISP proxies

ISP proxies use addresses registered to consumer-facing networks while being hosted on server infrastructure. Their latency profile may be closer to datacenter proxies than peer-to-peer residential networks, although routing and provider architecture still matter.

Mobile proxies

Mobile proxies can introduce carrier routing, network address translation, radio-network congestion, and shared gateway overhead. Performance may vary by carrier, region, and time of day.

Compare like with like: the same proxy type, target country, session mode, protocol, and test destination.

Build a controlled benchmark environment

Start with a clean baseline. Run the same requests without a proxy to estimate the contribution of your local connection and the target server.

Control these variables:

  • Use the same test machine, operating system, and client.
  • Prefer a wired or stable connection over variable public Wi-Fi.
  • Record the test runner's physical region and cloud provider, if applicable.
  • Select equivalent proxy locations rather than relying on automatic routing.
  • Use identical authentication and session settings.
  • Set the same timeout, retry, DNS, and redirect behavior.
  • Test providers during the same time window when possible.
  • Disable unrelated downloads, VPN tunnels, and background traffic.
  • Confirm whether DNS resolution occurs locally or through the proxy.

The destination also affects results. Test against an endpoint you control or a neutral service that permits automated requests. Public websites may rate-limit tests, change content dynamically, or route providers to different edge servers.

For geographically targeted proxies, use at least two destinations: a small controlled endpoint for latency and a larger static file for throughput. Do not use large downloads on metered residential or mobile plans unless the terms and test budget allow it.

How to run a repeatable proxy latency test

A practical procedure looks like this:

  • Measure the direct connection. Send 20 to 50 requests without a proxy and save connection time, TTFB, total time, status code, and response size.
  • Warm up each gateway. Make a few excluded requests so DNS caches and connection pools do not unfairly affect the first recorded result.
  • Run sequential requests. Sequential tests reveal normal per-request latency without concurrency pressure.
  • Run controlled concurrency. Repeat at realistic levels such as 5, 10, or 20 simultaneous requests rather than immediately stressing the network.
  • Repeat across locations. Test each required proxy country from the same runner and destination setup.
  • Repeat over time. Morning, evening, and weekend samples can expose congestion that a one-minute test misses.
  • Record failures separately. Do not remove timeouts or retry them silently. They are part of the user experience.
  • Summarize distributions. Report median, p90, p95, success rate, and sample count rather than only the arithmetic mean.

One hundred or more recorded requests per configuration is a reasonable starting point for comparison, but it is not a universal statistical threshold. Higher-variance networks and business-critical workloads need longer tests.

A simple HTTPS test with curl can capture useful timings:

```bash

curl --proxy http://USER:PASS@HOST:PORT \

--connect-timeout 10 --max-time 30 \

-o /dev/null -sS \

-w 'connect=%{time_connect} tls=%{time_appconnect} ttfb=%{time_starttransfer} total=%{time_total} code=%{http_code}\n' \

https://your-permitted-test-endpoint.example/payload

`

Run it in a script that timestamps each result and writes to CSV or JSON. Protect proxy credentials, and avoid placing passwords in shared shell history or public logs.

Comparison framework for proxy benchmarks

Use a scorecard that preserves context instead of reducing performance to one number.

| Measure | What it reveals | Preferred interpretation |

|---|---|---|

| Median TTFB | Typical request responsiveness | Lower is better |

| p95 TTFB | Slow-tail behavior | Lower and close to median is better |

| Success rate | Operational reliability | Higher is better |

| Timeout rate | Severe stalls | Lower is better |

| Throughput | Large-transfer performance | Higher is better |

| Response-size match | Test validity | Should be consistent |

| IP or session stability | Rotation behavior | Must match the workload |

Before declaring a winner, complete this checklist:

  • [ ] Same proxy category and advertised location
  • [ ] Same test runner and destination
  • [ ] Same protocol, timeout, and retry policy
  • [ ] Same payload and response validation
  • [ ] Both sequential and concurrent samples
  • [ ] At least median and p95 reported
  • [ ] Errors included in the results
  • [ ] Multiple test periods represented
  • [ ] Costs normalized by traffic, request, or successful result

A provider with the lowest median is not necessarily best. For transaction monitoring or checkout automation, a slightly slower service with fewer timeouts may finish more jobs. For downloads, throughput may matter more than TTFB. For scraping, target-specific success and block rates can outweigh raw latency.

Common benchmarking mistakes

Several errors can make results look precise while measuring the wrong thing:

  • Testing only one IP: This measures an endpoint, not the wider pool.
  • Using only averages: A few severe delays can be hidden or overemphasized; include percentiles.
  • Ignoring retries: Automatic retries inflate total job time and can conceal first-attempt failures.
  • Mixing rotating and sticky sessions: Rotation may add routing overhead and change the IP on each request.
  • Using unequal locations: A nearby proxy will usually beat a distant one because physical distance matters.
  • Downloading different content: Compression, caching, redirects, and page size can distort comparisons.
  • Overloading the target: Target throttling may be mistaken for proxy congestion.
  • Assuming advertised locations are exact: Validate exit IP geolocation with more than one database when location is critical.
  • Publishing isolated figures: Latency varies by route, time, target, protocol, and network conditions, so figures should be presented as test-specific ranges rather than universal facts.

How to interpret typical results

There is no globally valid threshold for a fast proxy. A nearby datacenter endpoint accessing a nearby server may respond within tens to a few hundred milliseconds. Cross-continent, residential, or mobile routes may take several hundred milliseconds or longer, particularly at the slow tail. These are broad patterns, not provider guarantees.

Focus on the gap between direct and proxied results. If direct TTFB is already high, changing proxies may not solve the problem. If proxied p95 grows sharply under moderate concurrency, the gateway, available peers, connection limits, or routing policy may be the bottleneck.

Also segment results by country, gateway, target domain, protocol, and time period. A single global median can hide excellent performance in one region and poor performance in another.

FAQ

What is a good proxy latency?

A good result is one that meets your workload's response-time and reliability requirements. Nearby datacenter routes often have lower latency than residential or mobile routes, but target location and internet routing can reverse that pattern. Establish a direct baseline and evaluate median, p95, and success rate together.

Should I use ping to benchmark a proxy?

No, not by itself. Ping measures ICMP round-trip time and may be blocked. It does not capture proxy authentication, TCP connection setup, TLS negotiation, HTTP processing, rotation, or target response time. Use real HTTP or SOCKS requests that resemble production traffic.

How many requests should a proxy benchmark include?

Start with at least 100 recorded requests per configuration and repeat the test at different times. That may be enough for an initial comparison, but high-variance residential or mobile networks require larger and longer samples. Always disclose sample count, concurrency, time window, and failure handling.

Bottom line

A trustworthy proxy latency benchmark is repeatable, workload-specific, and transparent about its conditions. Measure connection time, TTFB, percentiles, throughput, and failures against controlled destinations; compare equivalent proxy types and locations; and repeat tests over time. The best choice is not simply the endpoint with the smallest headline number, but the network that delivers acceptable latency and reliable completion under your actual traffic pattern.

Benchmark data

Figures below come from our own provider tests — the same dataset behind our provider reviews.

Request success rate

Successful responses across 12 target sites (higher is better).

Bright Data99.2%
Oxylabs98.7%
Decodo98.1%
SOAX97.3%
Webshare96.4%
Rayobyte95.8%
Average response time

Median time to first byte in seconds (lower is better).

Rayobyte0.5s
Webshare0.6s
Bright Data0.7s
Oxylabs0.8s
Decodo0.9s
SOAX1.1s
Proxy type coverage

Share of tested providers offering each network type.

  • Residential29%
  • ISP29%
  • Datacenter24%
  • Mobile19%