Trying to understand the interface and how to perform full file and incremental file backups

[reply=“Stratos Misinezis;5031”] Amount of change is not a consideration for incremental. If a file changes in any way, the file is backed up again the next backup schedule. If you are working with large files that tend to change very little day-to-day, then you can also enable block-level backups and in that case the files will be backed up either with block-level (if they qualify) or in full (if they don’t). The customer data is safe no matter what options you select or how you have your retention settings set. We will never, for example, remove a block-level backup that is needed to restore a version of a file that is kept because of retention settings.

What you should be aware of when using block-level backups is that there is a chain of backups of changes for some files and this can affect how many file versions need to be kept based on retention settings. As an example, let’s say you are backing up a single large file and perform daily block-level backups and monthly incremental backups. You want to keep all file versions for 14-days. In this case because you are only running new incrementals monthly, you would end up with about 45 days of backups before the older files can be removed (the initial file backup plus 30 block-level backups, followed by a new file backup and 13 block-level backups). In order to keep 14 days, we can’t delete any backups until that 13th block-level is complete on the new backup set. In this case you might decide to run your incremental backups every 14 days instead (or more frequently) to reduce storage.

Clearly they don’t know what they want to do with this product and quite frankly, I wish I could get my money back at this point and go with a product that is more clear.

[reply=“Michael Pietrzak;5033”] I strongly disagree with you. There is not a one restore that I have done in past 3 year’s and encounter a problem. However there are up’s and down’s and this one I believe is one of the down’s on msp360. Something inside me tell me that needs a change?

[reply=“David Gugick;5030”] [quote=“David Gugick;5030”]All files are backed up with incrementals[/quote]

Then it’s a full!! An incremental, as defined by the industry, is everything that has changed since the last Full backup.Fuck it. I give up. Can you please refund my credit card purchase for this?

[quote=“Stratos Misinezis;5034”]Michael Pietrzak
I strongly disagree with you. There is not a one restore that I have done in past 3 year’s and encounter a problem. However there are up’s and down’s and this one I believe is one of the down’s on msp360. Something inside me tell me that needs a change?[/quote]

If I quit my job tomorrow and some poor bastard had to come in and make heads or tails of what this product does, he would be lost and immediately say…lets move to something else.

If the (Amount of change is not a consideration for incremental) why there is an option to run incremental instead of block level in between block-level backups?

If all options in advanced recurring are enabled what factors would determine if block level or incremental would run?

For all this algorithm you are describing please bear in mind that we doing backup in thousands of folders let’s say with a mixture of very small big and very big files. Your answer makes me consider to change the customers folders and files to large files folders and small files folder in order to do a proper backup?

[reply=“Stratos Misinezis;5037”] It appears I cannot sufficiently convey the meaning of the options on this thread. If you’d like to take this offline, let me know. As I’ve stated, the options, regardless of what you select, in no way put your customer backups at risk. They are safe regardless. I think you should start a new thread or contact Support for help. If you start a new thread, please post your retention and scheduling options (as well as the schedules) selected, and we can review.

[reply=“David Gugick;5038”]

Can I have a refund on my five licenses (four server and one ultimate)? I would like to move onto another product.

[reply=“David Gugick;5038”] I would do. Thanks David. I am sure we would find out what is the best solution to secure our customer’s files. Sorry to keep you in flame.

As a new user I have to agree that the wording ‘Incremental backup’ is a bit confusing.
‘Incremental file-version backup’ would make more sence in this context.

[reply=“David Gugick;5026”]
You said that “…file backups are incremental forever…”

https://www.cloudberrylab.com/resources/blog/incremental-backup-guide/
This documentation says. “Forever incremental backup decreases recovery reliability” and
“periodical full backups are highly recommended”

So, backups are incremental forever (reducing reliability) and need a periodic full backup. I can find no option to run a periodic full backup as recommended.

This thread suggests that full and incremental are the same thing. (The word full was just replaced by the word incremental but they always meant the same thing.) How does this explain the Cloudberry documentation that says incremental forever is not reliable and requires periodic full backups?

[reply=“Tumble;5058”] Again, this is a terminology and definition problem. The backup sets (all files being backed up in the set) are incremental forever. In other words, you back up all files in full only the first time, and after that, you back up only those files that are new or changed. Those subsequent backups can be a backup of the entire file or just the parts of the file that changed. The type depend on whether you are scheduling block-level backups. If you are, then some of the files may be subsequently backed up block-level with just the file changes backed up. Or, if the file is small, we may just back up the entire file again. If you are not using block-level backups, then we back up the changed file in full each time.

When you’re talking about individual files, then yes, you need to run a periodic backup of the entire file (now called Incremental in the current release). I know the terminology is confusing, but don’t get hung up on the terms. Just know that you should schedule block-level backups if you are backing up large files and want to take advantage of the ability to only back up changes within those files. Schedule the incremental backup less frequently.

If you do not need block-level, leave that setting off. From a scheduling perspective, if you’re using block-level, you might schedule them once a day and then schedule the incremental backup every 14 or 30 days. You can adjust as needed.

I understand what you are saying. “Full” during the very first backup means an exact copy of all folders/files in the entire backup set. “Full” during subsequent (incremental) backups means an exact copy of only new or changed files. (ignoring block-level for simplicity)

This all seems reasonable and I would not be worried or confused except that when I read the documentation for incremental at:
https://www.cloudberrylab.com/resources/blog/incremental-backup-guide/
Which states:
“Forever incremental backup decreases recovery reliability”
“It also becomes harder and takes longer to recover the whole dataset”
“periodical full backups are highly recommended to start the new sequence of incremental backups”
“An incremental backup approach has several drawbacks…Less data consistency and reliability”
“backup software analyzes the whole incremental backup chain. If one element in that chain is corrupt, your data is non-recoverable”
“The flaws of this backup type such as slower restore and dependence on the increments integrity may be addressed by performing the full backup periodically”

This documentation seems to say that incremental is NOT RELIABLE unless a “Full” backup (meaning a new exact copy of ALL folders/files in the entire backup set) is performed occasionally.

[reply=“Tumble;5082”] That’s just a general blog post and not one related to the product specifically. It does not apply to what we’re discussing.