Speed of Restore for Very Small Files
Are there any suggestions for speeding up restore of very small files? One of the applications we backup has tens of thousands of small files, many between 150 and 700 bytes. Restore of these files is extremely slow, running at something like 24kbps. We've seen the same speed whether we are using B2, S3 or Wasabi storage.
I would recommend you try increasing the number of threads used (Options - Advanced - Thread Count). I know the dialog says it's for backup, but my understanding is it applies to File Restores as well. There is a lot of file IO latency when running APIs over the internet to grab each object in cloud storage and start the restore - as opposed to local disk access or even local network access where latency is low. Increasing the thread count will allow the backup process to run many object restores in parallel and reduce the latency impact.
Later this year, we will be introducing a new feature that will eliminate the IO latency issue for customers. For now, though, the best option is an increase in Threads.
Let us know how it works out.
Sign in or register to add a comment.
Add a Comment
Welcome to MSP360 Forum!
MSP360 Managed Products
Managed Backup - General
Managed Backup Windows
Managed Backup Mac
Managed Backup Linux
Managed Backup SQL Server
Managed Backup Exchange
Managed Backup Microsoft 365
Managed Backup G Workspace
Backup for Linux
Backup SQL Server
Connect Free/Pro (Remote Desktop)
Calculating optimum Thread Count and Chunk Size for lots of small files
Files not backing up - small test job
restore files from image back-up ntfs permissions
Storing files using CloudberryDrive results in 0-byte files
Terms of Service
Useful Hints and Tips
Created with PlushForums
© 2023 MSP360 Forum