Wednesday, November 29, 2023 • Welcome to the 💯 Nonsense-Free Zone!
🛍️ Check out Today’s 🔥Amazon logoDeals! 🛒

It’s a Solid! How Networking Speed Testing is Done for Dong Knows Tech’s Reviews

Share what you're reading!

If you ever wonder how I test networking devices, including Wi-Fi broadcasters (routers and access points) and switches, for reviews on this website, you're reading the right post.

I'll reveal here my testing methods and the equipment I used. If you pay close attention, you might be able to build similar testing "labs" yourself. But it would be best if you took my word for it.

I don't suggest you create your testing system, but if you do, keep in mind that you'll always get (slightly) different results, even if you use the same equipment and data sets. That's because, among other things, Wi-Fi behaves differently from one location to another. That's just the nature of this popular wireless technology.

This post is mainly for your information in case you want to know how I come up with the performance numbers and the rating for each review. Spoiler: It's easier, though more time-consuming than you think.

Dong's note: The content of this post was originally part of the post on Wi-Fi and Internet speed testing and was moved out as a separate post on November 9, 2022, to clarify the subject and make it easier for future updates.

TP Link 10Gbps Network Adapter
Networking speed testing: A super-fast network card is a must.

Wi-Fi Speed tests in Dong Knows Tech’s reviews

It usually takes me a week to finish evaluating a Wi-Fi device and about three days for a network switch -- I only review Multi-Gig switches.

During this time, I generally use the hardware as my personal device for an extended amount of time.

The testing mentioned here is mostly about throughput speeds, which are only part of what I do during a review.

In any case, I put all reviewed hardware through the same process. And I use the same testing method mentioned in the speed testing post.

Specifically:

  • I use a "server" unit, a Windows 10 computer, that connects to the test hardware via a wired connection, which is always Gigabit or faster (Multi-Gig) when applicable.
  • For the sustained throughput rates, I perform the test using Windows' File Explorer (Windows Explorer) from the server to a connected client. It's a simple drag and drops copy test via the standard Server Message Block (SMB, a.k.a. Samba) protocol and time the process to figure out the speed in megabits per second (Mbps.)

Below is the general specs of my equipment, which I upgrade pretty frequently -- I will update this post when the changes are significant enough.

Server specs for networking speed tests

My server is a custom-built computer with the following specs:

This server hosts specific test files, which I copy to clients via the test device (router, switch, or access point) using Wi-Fi and/or wired connections to determine the speeds.

Again, the server always connects to the test hardware via a wired connection, which varies from Gigabit to 10Gbps, depending on the device. I don't test any device that has sub-Gigabit ports.

Quick note

A router with a Multi-Gig LAN port benefits greatly, regarding sustained Wi-Fi speeds, from this wired-to-wireless testing method than one of the same Wi-Fi specs without. The Gigabit port limits the wireless performance of the latter.

Clients’ specs for networking speed tests

The test client is a computer that connects to the test hardware -- a Wi-Fi router, an access point, or a switch -- using the fastest connection method possible, wireless or wired.

Generally, I use three clients for official throughput testing. They all use a relatively high-end Intel CPU, 16GB or more RAM, and a top-tier NVMe SSD as the primary storage.

  • Client #1 (for wired and Wi-Fi speed tests): This is a desktop computer, sharing the same specs as the server above, plus an Asus PCE-AC88 4x4 Wi-Fi 5 adapter -- the fastest Wi-Fi 5 client on the market. I use this mainly for a close-range (10 feet or shorter) throughput test of a router's Wi-Fi 5 band. This client also has a 10GbE BASE-T card and a built-in Gigabit port that I use for testing wired connection speeds.
  • Client #2 (Wi-Fi only): A Dell XPS 15-inch laptop. This machine has top-of-the-line specs, built-in Wi-Fi 6E, and a Netgear A700 3x3 Wi-Fi 5 USB adapter.
  • Client #3 (Wi-Fi only): An Intel-based Apple MacBook Pro 16 with a built-in Wi-Fi 5 adapter. This laptop runs both macOS and Windows (via Bootcamp) and works for compatibility tests.

For additional Wi-Fi tests, I also use over half a dozen other laptops, tablets, USB Wi-Fi adapters, and phones of different Wi-Fi standards, including some extra Wi-Fi 6 and Wi-Fi 6E devices.

Networking speed test (Wi-Fi broadcaster and switches): Data and configurations

The following are the data and how I conduct tests on standalone networking devices, including Wi-Fi broadcasters (routers, access points, extenders) and switches.

Depending on a particular device, there might be more testing. For example, a Wi-Fi 6E router will also be tested as though it were a Wi-Fi 6 or Wi-Fi 5 router. But all of them have to go through these:

  • I upgraded the hardware to the latest firmware available. When applicable, the last mobile app or desktop software is used.
  • I use single large files for test data, which generally take less time to copy than multiple small files. Depending on the tests and how fast a router is, I use a 2GB, 6GB, 10GB, 20GB, or 60GB test file. Generally, I use the smaller test file when a bigger one would make the test take too long.
  • Wi-Fi broadcasters are first tested with settings that favor speed (and not compatibility, which is generally the default) using each available Wi-Fi channel separately. After that, I also try them using the default (Auto) settings.
  • All switches are tested in unmanaged mode (applicable only to managed switches.)
  • For official performance scores, I test the hardware with just one connection at a time.
    • For Wi-Fi broadcasters: I place this client at two specific locations that are (a) less than 10 feet (3 m) and (b) 40 feet (12.2 m) away from the router -- within the line of sight (*). I do multiple tests at different times during the day and on different days of the week and use the highest consistent numbers as the final scores.
    • For switches: The client is connected to the switch via a 7-foot CAT6a or CAT5e cable. Also, the best throughput rates are recorded. I might also do additional tests using Gigabit client or CAT5e cables might.
    • If a router has two or more Multi-Gig LAN ports, these ports are also tested, like the case of a Multi-Gig switch.

(*) This distance is used for consistency, and it's also where most broadcasters show their best performance over range yet with noticeable degradation.

Besides the performance, I use the hardware for an extended period in real-world anecdotal testing, from a few days to even a few weeks.

During this time, Wi-Fi broadcasters are used with clients of different standards and tiers, placed at various locations and distances, at times behind one or more walls. While this experience is nuanced and can't be put in numbers, it helps determine a broadcaster's real-world performance.

Netgear RAXE300 Internet Speed Test
An example of the Internet speed anecdotal tests. This one was part of the Netgear RAXE300 review.

On top of the local data transfer test, I also test the speed via my 10Gbps Fiber-optic Internet connection and report it when applicable.

This test is mostly to confirm the router's WAN port can deliver the expected speed to the rest of the local network. I don't use the Internet to test Wi-Fi (or local network speed) and vice versa -- it's never accurate that way.

I report network performance in megabits per second (Mbps).

Wi-Fi mesh speed test: Hardware placement

Generally, I test the multi-unit Wi-Fi system in the wireless setup. That's because, in the wired backhaul configuration, the extender unit (satellite) performs similarly to the router unit -- you can use the router's throughput numbers as that of the satellite.

For standard testing, I place the satellite 40 feet away from the router unit. After that, the test client is set at 10 feet and 40 feet away from the satellite. All are within lines of sight with no objects or walls in between them.

Also, I use the star topology for the testing, meaning the satellite units (if more than one) are placed around the router unit. In other words, a 2-pack mesh will generally deliver the same test results as a 3-pack one.

When the mesh hardware is Tri-band -- where it has an additional 5GHz band -- I will test it so that one of the 5GHz bands works as the backhaul and the other works as the front haul. The idea is to get the best possible performance.

In exceptional cases, I also do additional testing on the hardware via wired backhauling.

Backhaul vs fronthaul

When you use multiple Wi-Fi broadcasters -- in a mesh network or a combo of a router and an extender -- there are two types of connections: fronthaul and backhaul.

Fronthaul is the Wi-Fi signals broadcast outward for clients or the network ports for wired devices. It's what we generally expect from a Wi-Fi broadcaster.

Backhaul (a.k.a backbone,) on the other hand, is the link between one satellite Wi-Fi broadcaster and another, which can be the network's primary router, a switch, or another satellite unit.

This link works behind the scenes to keep the hardware units together as a system. It also determines the ceiling bandwidth (and speed) of all devices connected to the particular broadcaster.

The connection type, a Wi-Fi band or a network port, used for the backhaul is often called the uplink. A Wi-Fi broadcaster might use one of its bands (2.4GHz, 5GHz, or 6GHz) or a network port for the uplink.

Dual-WAN: Where the distinction between bandwidth vs speed is clear

When a Wi-Fi band handles backhaul and fronthaul simultaneously, only half its bandwidth is available to either end. From the perspective of a connected client, that phenomenon is called signal loss.

A Wi-Fi connection between two direct parties occurs in a single band, using one fixed channel, at any given time. This principle applies to all existing Wi-Fi standards, up to Wi-Fi 6E.

When a Wi-Fi band functions solely for backhauling, it's called the dedicated backhaul. Often that means no other band will do this job, though that depends on the hardware.

In a mesh system, only traditional Tri-band hardware -- those with an additional 5GHz band -- can have a dedicated backhaul band without ostracizing clients of the same band.

Generally, it's best to use network cables for backhauling -- wired backhauling. And that's an advantage of mesh hardware with network ports. In this case, a satellite broadcaster can use its entire Wi-Fi bandwidth for front-hauling.

In networking, network cables are always much better than wireless in speed and reliability.

Similar to the case of standalone broadcasters, I use the mesh in different real-world scenarios, with anecdotal tests, to understand how it works and use that experience for the review.

Important note on Wi-Fi speed testing

Again, I measure the official test score using a single high-speed Wi-Fi client using a single band at a time. This client pulls data from the test server connected to the router (or access point) via a network cable.

Two things to note:

  1. Using a single client is the only way to consistently figure out all broadcasters' speeds. If I use multiple clients, due to different speed tiers, standards, and the fact Wi-Fi bandwidth is shared, there'd be too many variables, making it impossible to come up with relevant throughput numbers to say if this router is faster than the other, etc.
  2. A router (or AP) with a Multi-Gig LAN port has a significant advantage in test scores over those with only Gigabit ports. That's because, without this super-fast port, the hardware's performance is limited at Gigabit.

In any case, the scores reported in my reviews are likely those of the best-case scenario. They show the router's Wi-Fi band's total real-world bandwidth.

Netgear RAX120 Hosting an External Storage Device for a Mini NAS Setup
You can turn most Wi-Fi routers with a USB port into a mini NAS server.

Router network-attached storage (NAS) speed test

If a router has a USB or eSATA port that can host a storage device, I test the performance of its NAS feature, too.

In this case, for consistency's sake, the following is the standard way I go about it:

  • I use at least two random portable SSDs, out of this list, for the test and pick the one with higher consistent scores as the official numbers. So far, any portable SSD has proved to have way higher speeds than the router's USB port. In other words, regardless of the drive I used, all routers' NAS performances remained the same.
  • The drive is formatted in NTFS. If the router doesn't support this file system, I'll use the applicable one and note that in the review. So far, all routers I've reviewed support NTFS.
  • I perform the test using Windows' File Explorer (Windows Explorer). It's a simple drag and drops copy test via the standard Server Message Block (SMB, a.k.a. Samba) protocol with a 20GB single file as the data.
  • The test computer has the old and insecure SMBv1 disabled by default, meaning the router must support SMBv2 for the test to work. (If SMBv1 must be enabled, I'll note that in the review.)
  • I do the test using a wired Gigabit connection. If the router has a Multi-Gig port, I'll use that port, too.
  • I perform each test (write and read) at least three times and pick the highest consistent numbers (within 5 percent) as the router's scores.
  • I report NAS performance in megabytes per second (MB/s). (You can find the scores of all routers I've tested in this post of the best routers with NAS feature.)

Note: The test for the router's NAS feature is just for reference in terms of raw speeds. I use real NAS servers (and I'd always recommend that you do, too.) That said, I generally only use the router's USB port for a short time and do not try all available applications or functions, nor do I check for conflicts or issues.

Power consumption measurement

Since mid-2021, I've started adding real-world power consumption on reviewed hardware that uses a power adapter, which doesn't apply to no PoE or USB bus-powered devices.

I measure this by connecting the hardware via a simple power meter and reporting the result after 24 hours.

It's worth noting that the measurement is intended to give a rounded ballpark number of how much energy the device uses in watt-hour (Wh). It's not intended to be scientifically accurate.

A device consumes more or less energy depending on its loads. In my case, the reviewed hardware is generally being used more intensively than average during the testing phases.

Asus ZenWiFi Pro XT12 5
An Asus ZenWiFi Pro XT12 router is being tested.
There are a lot of things going on behind that fancy lighting.

Networking speed test: You can’t put your finger on it.

After years of working with hundreds of networking devices, I have to admit that the process can get repetitive and tedious. It's also not 100% accurate. Also, no one can try every scenario, considering a router can have many features and settings.

It's impossible to say how fast a router's Wi-Fi is because so many factors and elements can affect a test's outcome. That's not to mention the fact a router can change dramatically via firmware updates.

For this reason, I try to keep my testing as consistent as possible. Ultimately, I aim to show how a particular device does against others.

In other words, my testing doesn't mean to represent your experience of a device, such as a Wi-Fi router, in terms of throughputs. Instead, it describes how better, or worse, a choice it is, among others, at the time of the review.

Again, speed testing is just one of many things I do to evaluate networking devices. I always take the time to have real-life experiences with them before publishing my reviews. You can count on that.

Share what you just read!

Comments are subject to approval, redaction, or removal.

It's generally faster to get answers via site/page search. Your question/comment is one of many Dong Knows Tech receives daily.  

  1. Strictly no bigotry, profanity, trolling, violence, or spamming, including unsolicited bashing/praising/plugging a product, a brand, a piece of content, a webpage, or a person (•).
  2. You're presumed and expected to have read this page in its entirety, including related posts and links in previous comments -- questions already addressed will likely be ignored.
  3. Be reasonable, attentive, and respectful! (No typo-laden, broken-thought, or cryptic comments, please!)

Thank you!

(•) If you represent a company/product mentioned here, please use the contact page or a PR channel.

4 thoughts on “It’s a Solid! How Networking Speed Testing is Done for Dong Knows Tech’s Reviews”

Hate scrolling? Consider subscribing!
      • iperf is use quite a bit. Its consistent for comparison between test runs and is a running constant which is good for moving wifi client around and can see variations in speed as you move. Lugging a 2gig file around means you need to be static and need to do the math at the end of the completed transfer.

        Also there is less potential interference in the software stack with iperf – file handling can sometimes get impacted by anti malware + anti virus and also need to keep an eye on storage contention – OK slim chance of that with your Evos and repeated tests but its a remote possibility. As you say though the real world SMB testing is a great indicator, iperf gives some great “theoretical” results

        Reply

Leave a Comment

📌