Associate
- Joined
- 17 Dec 2015
- Posts
- 294
TLDR; not all fast SSD drives are equal.
An issue I’ve had on various PCs and laptops (all windows based) for several years has been when copying large amounts of data from camera memory cards (mostly raw files) is that the copy speed initially starts high, but then after a minute or two it slows down and at times almost stops or pauses, before speeding up briefly then slowing down and eventually settling down to a copy speed much slower than the memory card/USB interface is capable of.
The problem became more pronounced when using faster memory cards such as CFast and CFExpress. I thought it was perhaps thermal throttling of the memory cards as the Cfast ones get quite toasty and tried various things like updating USB drivers, disabling windows indexing on the target drive, switching off the virus checker during copying etc. Though these all helped in a small way by increasing the maximum transfer rate, the copy speed would still drop after a couple of minutes.
Thinking about the issue last week after a nightmare trying to transfer photos and videos between BTCC races, it occurred to me that I never had the issue when using slower CF cards, as the write speed to disk was higher than the read speed from the cards. But surely the write speeds of NVME SSDs are much higher? Running tests on them confirmed that the internal SSD drive on my laptop had write speeds of over 3000 Mb/s, and when copying from a Cfast card the peak copy speed was about 1/10th of this. So where was the issue?
Something I wasn’t aware of is that SSDs have a finite amount of cache on board, sometimes this is DDR4 and sometimes slower memory. When writing large amounts of data (60Gb or more) over a period of minutes, this cache eventually fills up. At this point the on board controller either stops accepting new data (for up to 30-60 seconds), or slows down dramatically, matching the actual write speed to the drive storage. Many reviews of SSDs don’t detail the amount of cache on board, or what happens when this fills up during sustained writes as they are more focussed on the headline read/write speeds. I did find one site which routinely performs these tests, and the difference between drives with similar maximum read/write speeds under sustained writes can be staggering. Some drop to a fraction of their maximum speeds, whilst others have a much higher sustained write speed. The intel 670p SSD that my laptop came with falls into the former category. It’s very quick when handling smaller reads/writes, but when writing 200Gb of data to the drive, it slows to a crawl after a minute of so.
Even though my laptop uses the older pcie3 interface, I thought that some of the better pcie4 drives might offer better sustained write speeds even running at half speed, and after reading some reviews I found a few drives which promised much better sustained write performance. I opted for a 1TB Seagate Firecuda 530 drive which had encouraging reviews. I’m aware you can get similar capacity NVME drives for £20-£30 less, and even lesser known 2TB drives for the same money. However, they didn’t have the sustained write speed I was looking for.
I cloned my existing drive and installed it in my laptop a short while ago. I still had the files on the CFExpress card from last weekend, and repeated the same copy. Wow, what a difference! What took a frustrating 20+ minutes or so last weekend completed in less than 90 seconds, maintaining a steady 745Mb/s all the way through. This is likely the real world limit of the USB port or memory card. Needless to say I’m over the moon, and I’m now thinking about swapping out the SSD in my desktop PC as well, which is also an older pcie3 interface.
I know my use case is very niche and unlikely to impact most PC users, but for any content creators who routinely transfer large data sets, it’s certainly one aspect of SSD performance worth considering.
An issue I’ve had on various PCs and laptops (all windows based) for several years has been when copying large amounts of data from camera memory cards (mostly raw files) is that the copy speed initially starts high, but then after a minute or two it slows down and at times almost stops or pauses, before speeding up briefly then slowing down and eventually settling down to a copy speed much slower than the memory card/USB interface is capable of.
The problem became more pronounced when using faster memory cards such as CFast and CFExpress. I thought it was perhaps thermal throttling of the memory cards as the Cfast ones get quite toasty and tried various things like updating USB drivers, disabling windows indexing on the target drive, switching off the virus checker during copying etc. Though these all helped in a small way by increasing the maximum transfer rate, the copy speed would still drop after a couple of minutes.
Thinking about the issue last week after a nightmare trying to transfer photos and videos between BTCC races, it occurred to me that I never had the issue when using slower CF cards, as the write speed to disk was higher than the read speed from the cards. But surely the write speeds of NVME SSDs are much higher? Running tests on them confirmed that the internal SSD drive on my laptop had write speeds of over 3000 Mb/s, and when copying from a Cfast card the peak copy speed was about 1/10th of this. So where was the issue?
Something I wasn’t aware of is that SSDs have a finite amount of cache on board, sometimes this is DDR4 and sometimes slower memory. When writing large amounts of data (60Gb or more) over a period of minutes, this cache eventually fills up. At this point the on board controller either stops accepting new data (for up to 30-60 seconds), or slows down dramatically, matching the actual write speed to the drive storage. Many reviews of SSDs don’t detail the amount of cache on board, or what happens when this fills up during sustained writes as they are more focussed on the headline read/write speeds. I did find one site which routinely performs these tests, and the difference between drives with similar maximum read/write speeds under sustained writes can be staggering. Some drop to a fraction of their maximum speeds, whilst others have a much higher sustained write speed. The intel 670p SSD that my laptop came with falls into the former category. It’s very quick when handling smaller reads/writes, but when writing 200Gb of data to the drive, it slows to a crawl after a minute of so.
Even though my laptop uses the older pcie3 interface, I thought that some of the better pcie4 drives might offer better sustained write speeds even running at half speed, and after reading some reviews I found a few drives which promised much better sustained write performance. I opted for a 1TB Seagate Firecuda 530 drive which had encouraging reviews. I’m aware you can get similar capacity NVME drives for £20-£30 less, and even lesser known 2TB drives for the same money. However, they didn’t have the sustained write speed I was looking for.
I cloned my existing drive and installed it in my laptop a short while ago. I still had the files on the CFExpress card from last weekend, and repeated the same copy. Wow, what a difference! What took a frustrating 20+ minutes or so last weekend completed in less than 90 seconds, maintaining a steady 745Mb/s all the way through. This is likely the real world limit of the USB port or memory card. Needless to say I’m over the moon, and I’m now thinking about swapping out the SSD in my desktop PC as well, which is also an older pcie3 interface.
I know my use case is very niche and unlikely to impact most PC users, but for any content creators who routinely transfer large data sets, it’s certainly one aspect of SSD performance worth considering.