Quickest way of archiving a folder?

Russinating · 2 May 2024 at 14:32

Looking for the fastest, no-compression way of archiving a folder. Using 7-zip with "0 - Store" compression (ie none) still takes about 50 minutes for a 350GB folder (159 files).

Are there any other alternatives that are faster?

Sinbad2000 · 2 May 2024 at 14:42

Russinating said:
Looking for the fastest, no-compression way of archiving a folder. Using 7-zip with "0 - Store" compression (ie none) still takes about 50 minutes for a 350GB folder (159 files).

Are there any other alternatives that are faster?

What's the storage media / bandwidth involved here?

Russinating · 2 May 2024 at 14:44

Sinbad2000 said:
What's the storage media / bandwidth involved here?

Video projects, so the bulk of that is MP4/MXF etc. Bandwidth?

Sinbad2000 · 2 May 2024 at 14:46

Russinating said:
Video projects, so the bulk of that is MP4/MXF etc. Bandwidth?

I meant - SSD, NVME, SATA disk etc... How much IO bandwidth do you have?

For example, at 100MB/sec writes, 350GB will take about an hour to write.

Russinating · 2 May 2024 at 14:49

Sinbad2000 said:
I meant - SSD, NVME, SATA disk etc... How much IO bandwidth do you have?

For example, at 100MB/sec writes, 350GB will take about an hour to write.

Gotcha, yeah, it skipped me by but that'll be bottle neck. It'll be being read from and to the same SATA. The machines we use have NVME and SSD scratch disks but not large enough for some of the volumes (some projects are north of 1TB etc).

Mujja · 5 May 2024 at 17:42

Copying and writing to the same storage device will always be slow. Have you tested with a SSD in an external enclosure? You'll need fast USB ports to support.