Slow restore from S3 Glacier Deep Archive
  • Marcus O
    0
    Hi,

    I am currently evaluating CloudBerry Backup combined with AWS S3 Glacier Deep Archive. So far I liked what I see, except for that I'm worried about slow restores.

    It's not the wait time that concerns me. When I recently ran a test restoring 9 files I had to wait quite a few hours before the files started appearing on my local disk. Since I used GDA, that's to be expected.

    What concerned me was rather that it took 8 minutes to retrieve these 9 tiny files (less than 4 MB in total) from the moment they started actually downloading. Below is a a somewhat garbled log. Note the times to the right and especially the time difference between the first and the last files:

    Type File Size Result Finish Time

    Restore C:\Users\...\Hjul_S.jpg 363666 Success 2019-09-12 19:27
    Restore C:\Users\...\eka_S.jpg 714278 Success 2019-09-12 19:27
    Restore C:\Users\...\solen_S.jpg 418767 Success 2019-09-12 19:28
    Restore C:\Users\...\solen2_S.jpg 271845 Success 2019-09-12 19:28
    Restore C:\Users\...\sol3_S.jpg 232198 Success 2019-09-12 19:29
    Restore C:\Users\...\knut_S.jpg 521645 Success 2019-09-12 19:30
    Restore C:\Users\...\vass_S.jpg 165628 Success 2019-09-12 19:30
    Restore C:\Users\...\kraftverk_S.jpg 354988 Success 2019-09-12 19:31
    Restore C:\Users\...\dorr_S.jpg 548806 Success 2019-09-12 19:35

    Is this normal? What does it mean if one day I will have to restore tens of thousands of files or even more?

    Has anyone restored vast amounts of data from GDA using CloudBerry Backup? If so, what was your experience?

    Best,
    Marcus
    Marcus O Options
  • Matt
    91
    ↪Marcus O
    Everything you described in your post is quite expected, since we're talking about GDA. The sole purpose of this storage class is to archive data and then store it for a long time.
    Just to warn you if you plan on restoring large volumes of data from GDA: it is likely to cost you a lot, so check their documentation first.
    Matt Options
  • Marcus O
    0
    Thanks Matt. I'm fine with slow restores but not one minute per file. That would equal more than 40 days for my quite moderate archive of 60.000 files.

    Luckily, things seems to speed up for larger restores. I tried another restore of around 800 files and while that took 40 minutes all in all, somewhere around 95% of the files were restored within a 10 minute windows.

    So I guess GDA scales quite nicely.

    Problem solved.
    Marcus O Options
bold
italic
underline
strike
code
quote
ulist
image
url
mention
reveal
youtube
tweet
Add a Comment