Today we’re revisiting storage performance with an emphasis on gaming. Since we tested the first batch of PCIe 4.0 SSDs about a year ago, we’ve been wanting to run more tests. Up until now, most games have been built with hard drives in mind, but as we move into a new generation of game consoles featuring super fast PCIe SSDs, the storage requirements for gaming may change in the coming years. We’ll be able to look back on this tests to see how things have changed.
Some of the questions we plan to answer today include: what sort of storage device do you need to play today’s games? Specifically, what sort of drive provides the best loading times, so you’re not sitting around and waiting ages to get into gaming. Part of this answer is obvious, SSDs are faster than hard drives, so we want to dial down a bit and see what sort of SSD is required. Do you need a PCIe drive? Do you need something with a DRAM cache? Are certain memory technologies worse than others?
The test setup is simple. We’ll be loading up a variety of games, and timing how long it takes to get into a playable level from the main screen. Loading screens are the primary thing impacted by storage performance in games, everyone wants to get in and play games immediately, so we’ll be testing that across a selection of different titles.
We have included PCIe 4.0 drives in today’s storage suite, so our testbed consists of a Ryzen 9 3900XT running on top of MSI’s X570 Tomahawk, 16GB of DDR4-3200 memory and a GeForce RTX 2080 Ti (because Steve is hoarding all the RTX 30 GPUs) built inside a Corsair case. The storage setup sees the system running off an M.2 drive in the second slot, with our games for testing running on a separate drive in the primary M.2 slot, which has direct lanes to the CPU.
Let’s work our way through the drives we’ll be testing because we have 14 different options on hand. Representing Team Hard Drive in today’s battle is the Western Digital WD120EMAZ 12TB. This is a standard OEM drive used for archival storage, with a 5400 RPM speed, 256MB cache and SATA 6 Gbps interface. We’re fully expecting this guy to be slow.
Team SATA SSD has three contenders. Our entry-level model is the Team Group GX1 500GB, which uses SanDisk TLC NAND, a Phison S11 controller and does not feature a DRAM cache. One step up is the Crucial MX500 2TB which packs Micron TLC NAND, an SMI SM2258 controller and a DRAM cache. Then for the big data hoarders we have the Samsung 870 QVO, with Samsung’s QLC memory and controller, along with an 8GB DRAM cache.
We have lots of PCIe 3.0 x4 SSDs for today’s testing as well.
From Western Digital we have both the WD Black SN750 and WD Blue SN550 in 1TB capacities. Both use SanDisk TLC, but the SN750 has a DRAM cache where the SN550 does not. You’ll also spot this pre-installed heatsink on the SN750.
Adata has provided their SX8200 Pro 1TB, which has an SMI controller and TLC NAND from Micron, with a DRAM cache. So this is an alternative to the SN750 with different components. We also have the Sabrent Rocket 2TB, a popular option that uses the Phison E12 controller and Toshiba TLC NAND with a DRAM cache.
Then rounding out our PCIe 3.0 offerings are two QLC drives. The first is the Intel SSD 665p in a 1TB capacity, which uses an SMI SM2263 controller alongside Intel’s own QLC memory. Then as an alternative solution, we also have the Sabrent Rocket Q 2TB, which features a Phison E12S controller and Micron QLC NAND. Both drives also feature DRAM caches.
Then we have three PCIe 4.0 drives, all of which use essentially the same design. The Seagate Firecuda 520 1TB and Corsair Force MP600 1TB both have TLC NAND from Toshiba and Physon E16 controllers. The Sabrent Rocket 4.0 2TB is similar, but with a larger capacity.
And last but not least, we have an SSD with a USB interface, the Samsung T5. This drive features USB 3.2 Gen 2×1 and TLC memory from Samsung along with, as you might have guessed, a Samsung controller. There’s also a DRAM cache here, as is the case for the PCIe 4.0 drives.
Before getting into the game data, let’s run a single synthetic workload, CrystalDiskMark, to see what the numbers say. This is a typical workload you might fire up on your new SSD after you get it so see those super high numbers so, how do these drives stack up?
For sequential reads, it’s a pretty simple story. At the top with 5 GB/s transfer speeds, are the PCIe 4.0 drives. All of the PCIe 4.0 drives are in the range of 30 to 40 percent faster than the next group of higher end PCIe 3.0 drives for performance.
One step down from that are the more entry-level PCIe 3.0 offerings, such as the SSD 665p and SN550. Then we see the SATA drives, capped to around 550 MB/s sequential reads, and the hard drive comes in last. Generally the difference between a PCIe 3.0 drive and a SATA drive is that the PCIe 3.0 model has up to 7x faster sequential reads.
For sequential writes, the story doesn’t change much either, although this is peak performance from writing into those DRAM caches.
Things get more interesting when it comes to random performance, although at high queue depths there is still an advantage going PCIe 4.0 over 3.0. The QLC-based PCIe 3.0 SSDs deliver the least impressive performance here, less than half that of the better TLC models. SATA SSDs also suffer, offering just a quarter of PCIe 3.0 performance in the best cases.
Of course, for single queue depth random reads, there isn’t much separating a lot of these drives, except for the hard drive which is very slow in comparison to even the slowest SSD.
Here’s the random write performance as well, while writing random data isn’t as strenuous as reading it for some of these drives, SATA models do suffer again with just 1/5th the performance on offer.
So that’s a quick look at the synthetic numbers. Based on this, it looks like PCIe 4.0 drives are clearly the fastest in this test, followed as expected by the higher-end, then more entry-level PCIe 3.0 drives. These NVMe options are then much faster than SATA drives, often 4x faster or more, with the slow mechanical hard drive rounding out the group with particularly bad random performance.
But does this matter for game loading? Let’s find out.
We want to start with Horizon Zero Dawn, one of the most resource-intensive games you can play on PC today. However, for load times, it’s not hugely dependent on storage performance, at least when you get into the SSDs.
The slowest SATA drive, the Samsung 870 QVO, offered a 73% speedup to load times versus the hard drive, so it’s clear that having an SSD is important. But beyond that, there’s just a 36% improvement moving from the slowest to fastest SSD tested.
For loading Horizon Zero Dawn, there is no clear advantage to having a PCIe 4.0 drive over PCIe 3.0. Despite the 4.0 drives putting up 30% better read performance in CrystalDiskMark, when loading this game in the best case, the 4.0 drive was 2 seconds faster than the slowest 3.0 drive. At a 15% speedup, that’s on the minor end of the scale and that’s comparing entry-level PCIe 3.0 in a drive like the SN550, to the top-end FireCuda 520.
There is a small gap between the SATA/USB and PCIe 3.0 drives. On average the non-PCIe SSDs loaded in 21 seconds, compared to 17 seconds for the PCIe equipped models. That’s a respectable 24% improvement, but it’s not nearly in line with the huge differences in synthetic workloads. We’re talking drives that can pull 2GB/s reads easily, versus a cap of just 500 MB/s for the SATA models. That doesn’t materialize when loading games.
The difference is even less pronounced in Death Stranding. There was a mere 2 second difference in load times between the fastest and slowest SSD models.
Yes, there is a tendency for the SATA drives to be slightly slower, but this is a marginal difference. Even the hard drive does reasonably well in this game, loading in 22 seconds.
In Shadow of the Tomb Raider we see another 2-second difference between the fastest and slowest SSDs, so in this case up to a 15% gain going from an entry-level SATA drive to a blazing fast PCIe 4.0 option. It’s also clear from the testing so far that having a DRAM cache, as expected, plays little to no role in game loading: the DRAM-less SN550 is one of the faster models for loading this game.
However, it’s clearly better to have at least some form for SSD for loading Tomb Raider. Loading from a hard drive was more than twice as slow, and while overall load times aren’t terrible on a hard drive, a simple speedup from an SSD is worthwhile.
Red Dead Redemption 2 is one of the slower loading games in our test suite, which is why we chose to use it. However, these slow loading times do not appear to be as a result of storage bottlenecks, at least with an SSD. Most drives loaded this game in around 40 seconds, with a negligible difference between loading from a SATA or PCIe drive. However, it is worth having an SSD, as you’ll shave 23 seconds off the load time versus a hard drive.
Borderlands 3 is an interesting case as we were looking at the loading time for both loading into the level, and waiting for the assets and textures to load in. When loading this game, often you’ll have to wait a few seconds for everything to be fully rendered. Despite this, the game doesn’t appear to be storage limited during this process, as all SSDs took between 17 and 19 seconds to load the game and its assets fully.
In fact, nearly all of these drives loaded into the level within about 11 seconds, and then there were some small differences in texture loading time. In any case, with some of the entry-level SATA drives performing well, and say the Sabrent Rocket 4.0 being not quite as quick, it appears the engine is more to blame for loading than the storage you’re loading from.
This is another game where we didn’t see a big speedup coming from a hard drive to SSD. Yes, SSDs were noticeably faster, but not to the extent of a game like Horizon Zero Dawn or Shadow of the Tomb Raider.
The Outer Worlds was a game we chose to test because it has a lot of loading screens. Luckily, if you’re playing from an SSD, loading shouldn’t be that painful as it was one of the quickest games to load that we tested. However, it only appears to require an SSD to be fast, not any specific sort of SSD. Once you have solid state storage at hand, there was only a 1 second difference between the fastest and slowest models. And there was no preference for PCIe over SATA, it was a bit of everything.
One thing is clear though: get an SSD for playing Outer Worlds, as they are more than twice as fast for game loading versus a hard drive. Playing this game off a hard drive would get pretty frustrating, constantly having to put up with 25 second load times when you could be loading in at 11 seconds.
Assassin’s Creed Odyssey, loading into the heart of Athens, is another title where your choice of SSD doesn’t matter. PCIe drives were, on average, just 7% faster than non-PCIe drives for loading into the game, which is a negligible difference. There was no clear advantage to PCIe 4.0 drives at all, with the additional speed of those models providing no benefit.
Next we have loading into The Division 2. In this game we’re looking at loading with all textures rendered, with the time taken from after the game connects to the live service, to the final textures being loaded. This title behaves more like Horizon Zero Dawn in that there is a small but more noticeable advantage to some SSDs over others, and having faster storage can speed up your entry into the game world.
The differences aren’t huge though. An entry-level PCIe 3.0 SSD like the SN550 is less than 10% faster than a value champion like the Crucial MX500. And some of the faster PCIe drives load the game fully around 20% quicker than the more entry-level models. There is a 6 second difference between the best and worst SSDs, but we’re still well off some of the results we saw in our synthetic workload from earlier.
Still, there is a moderate improvement moving from a hard drive, so we suspect most gamers will want to play this game on an SSD, like all the others we’ve been looking at.
The final game we wanted to check out is Planet Coaster. The reason is that loading into simulation games with large worlds is known to be particularly slow across pretty much all of these sorts of games. So whether you’re loading a big theme park, or a big city in a world building game, you can expect load times that take multiple minutes.
However what’s really important to realize is these load times are not due to slow storage speeds. When loading a huge Planet Coaster park, generally the game took at least 6 minutes to load on my 3900XT system, with a 26 second difference between the fastest and slowest drives.
There’s not much of a difference between a hard drive and SSD for loading this game, and a barely noticeable tendency for faster PCIe drives to get an edge over SATA models. With a 7% difference splitting the fastest and slowest drives — when you’re having to wait over 6 minutes even with a super fast PCIe 4.0 SSD — isn’t really worth talking about.
The simple fact is that in these sorts of games, there is far more processing work that goes on when loading a level, than there is copying from storage into system or GPU memory.
After working through all of this data, we don’t think there are too many surprises in here for PC gamers. Everyone should know at this point that if you want to improve game loading times, upgrading from a hard drive to an SSD is a no brainer. In all instances, the mechanical disk was the slowest storage device for loading, and in many cases upgrading to even the slowest SSD led to games loading in half the time. Hard drives are fine for archival storage of games, but moving the game you’re currently playing to faster storage makes a lot of sense.
What has become blatantly clear from this test is that it doesn’t matter what sort of SSD you have for gaming, so long as it’s an SSD of some sort.
In six of the nine games we tested, there was only a 2 second difference in load times between an entry-level SATA SSD and the absolute fastest PCIe 4.0 drive. In percentages, this was usually below a 15% performance uplift moving from the fastest to slowest drive, which is hardly worth talking about.
In the best cases, like Horizon Zero Dawn and The Division 2, we saw up to a 35% speedup for load times moving from entry-level SATA to super fast PCIe 4.0, but what we’re talking about in absolute numbers is the difference between waiting 21 seconds or 16 seconds.
There’s also little difference between different SSD specifications. PCIe 4.0 vs 3.0 provides essentially no benefit in most cases, especially compared to a top-end PCIe 3.0 drive. QLC memory is not slower than TLC for reading game files. Having a DRAM cache is also not important for game loading. The only specification that has some influence is whether the SSD is SATA or PCIe, with SATA being slightly slower, but beyond that, other specs are rather meaningless for gaming.
Why don’t games benefit all that much from faster SSDs? Well, it seems clear that raw storage performance is not the main bottleneck for loading today’s games. Pretty much all games released up to this point are designed to be run off hard drives, which are very slow; after all, the previous generation of consoles with the PS4 and Xbox One both used slow mechanical drives to store games.
Today’s game engines simply aren’t built to make full use of fast storage, and so far there’s been little incentive to optimize for PCIe SSDs. Instead, the main limitation seems to be things like how quickly the CPU can decompress assets, and how quickly it can process a level before it’s ready for action, rather than how fast it can read data off storage.
While choosing an SSD for gaming is easy based on this data, there are some extra elements to consider…
If you are planning to play games off a secondary SSD in your system, so separate from your boot drive, buying an SSD for this task is straightforward. You’re better off buying an affordable SSD drive with a high capacity. It’s preferable to have more storage space for games than it is to get a slight performance uplift from PCIe.
However, in today’s market there often isn’t a huge price difference between a cheap SATA drive and a cheap M.2 PCIe SSD. An entry-level drive like the SATA model from TeamGroup in a 1TB capacity is often only $20-30 cheaper than say, a WD Blue SN550. That makes the SATA model better value for gamers, but not by much. Where that gap widens is in the high capacity range: 4TB SATA drives such as the Samsung 870 QVO are much cheaper than 4TB PCIe models like the Sabrent Rocket Q. At 4TB, the Samsung model goes for around $500 while the Sabrent Rocket Q is closer to $750. At this capacity, it may make more sense to stick with SATA.
The one caveat we’d make to this recommendation is that some drives are much slower to copy data to than others. QLC-based drives, like the Samsung 870 QVO or Intel SSD 665p, can be slow to write to once you get beyond their DRAM or SLC caches, and you’re writing directly to the QLC memory. If you’re going to copying files or games in and out of storage a lot, from another fast source, you may want to avoid a QLC drive and stick with a TLC option. This will be more expensive though, and QLC is still a great choice for an archival-type SSD that you play games off.
If you’re going to have just one drive in your system that doubles as both a boot drive and a gaming drive, we’d make a somewhat different set of recommendations. Because in this situation, it’s not just game loading that you’re worrying about, but general system tasks as well like other app loading. While we purposely didn’t cover anything other than gaming in this article, we’ve covered general storage performance tests before and we still think it’s important to talk about it briefly here.
As a boot drive, it is worth paying a premium for PCIe 3.0 storage, especially given current pricing for 1-2TB drives where PCIe doesn’t cost that much more. We’d be after something with a DRAM cache, so you get that nice peak write performance, and preferably TLC memory to avoid some of the performance shortfalls of QLC.
For a gaming-focused build, we wouldn’t go out of the way to get anything higher end and certainly wouldn’t pay attention to any of the professional-focused drives with high-end controllers, like say the Samsung Pro line.
Pricing will vary depending on the retailer you’re looking at, but something like the SX8200 Pro or WD SN750 might be right around the mark of good value here, with either drive available around $130 for 1TB. The Sabrent Rocket is a popular choice as well. These drives are around $25 more at 1TB than their DRAM-less or QLC based entry-level competitors. As a boot drive, it’s well worth spending that extra cash.
We should note, when we tested Sabrent’s Rocket and Corsair’s MP600 PCIe 4.0 drives at launch last year, the first thing that we loved about them is that pricing was at par or below what used to be until then top-of-the-line NVMe PCIe 3.0 drives.
But – you might be shouting or typing angrily into the comments – what about this next-generation of gaming? Don’t the PS5 and Xbox Series X pack powerful SSDs which will make SSD performance key for gaming? That’s definitely a possibility, but we’re likely talking about years down the track. API’s like Microsoft DirectStorage, which is designed to mimic the storage capabilities of these new consoles, has only just been released for developers. Like with all technology transitions we’ve seen, one prior example being DirectX 12, it’ll be several years before we start to see these things harnessed in cross-platform titles on PC.
Source link : https://www.techspot.com/review/2116-storage-speed-game-loading/