Slow restore from S3 Glacier Deep Archive
I am currently evaluating CloudBerry Backup combined with AWS S3 Glacier Deep Archive. So far I liked what I see, except for that I'm worried about slow restores.
It's not the wait time that concerns me. When I recently ran a test restoring 9 files I had to wait quite a few hours before the files started appearing on my local disk. Since I used GDA, that's to be expected.
What concerned me was rather that it took 8 minutes to retrieve these 9 tiny files (less than 4 MB in total) from the moment they started actually downloading. Below is a a somewhat garbled log. Note the times to the right and especially the time difference between the first and the last files:
Type File Size Result Finish Time
Restore C:\Users\...\Hjul_S.jpg 363666 Success 2019-09-12 19:27
Restore C:\Users\...\eka_S.jpg 714278 Success 2019-09-12 19:27
Restore C:\Users\...\solen_S.jpg 418767 Success 2019-09-12 19:28
Restore C:\Users\...\solen2_S.jpg 271845 Success 2019-09-12 19:28
Restore C:\Users\...\sol3_S.jpg 232198 Success 2019-09-12 19:29
Restore C:\Users\...\knut_S.jpg 521645 Success 2019-09-12 19:30
Restore C:\Users\...\vass_S.jpg 165628 Success 2019-09-12 19:30
Restore C:\Users\...\kraftverk_S.jpg 354988 Success 2019-09-12 19:31
Restore C:\Users\...\dorr_S.jpg 548806 Success 2019-09-12 19:35
Is this normal? What does it mean if one day I will have to restore tens of thousands of files or even more?
Has anyone restored vast amounts of data from GDA using CloudBerry Backup? If so, what was your experience?
Everything you described in your post is quite expected, since we're talking about GDA. The sole purpose of this storage class is to archive data and then store it for a long time.
Just to warn you if you plan on restoring large volumes of data from GDA: it is likely to cost you a lot, so check their documentation first.
Thanks Matt. I'm fine with slow restores but not one minute per file. That would equal more than 40 days for my quite moderate archive of 60.000 files.
Luckily, things seems to speed up for larger restores. I tried another restore of around 800 files and while that took 40 minutes all in all, somewhere around 95% of the files were restored within a 10 minute windows.
So I guess GDA scales quite nicely.
Sign in or register to add a comment.
Add a Comment
Welcome to MSP360 Forum!
MSP360 Managed Products
Managed Backup - General
Managed Backup Windows
Managed Backup Mac
Managed Backup Linux
Managed Backup SQL Server
Managed Backup Exchange
Managed Backup Microsoft 365
Managed Backup G Workspace
Backup for Linux
Backup SQL Server
Connect Free/Pro (Remote Desktop)
Deleting files automatically with S3 Glacier Deep Archive
Detailed report unreadable with S3 Glacier Deep Archive
Image Based Back to S3 Glacier, file level restore, how does it work?
question about aws s3 restore from glacier
Terms of Service
Useful Hints and Tips
Created with PlushForums
© 2023 MSP360 Forum