Comments

  • Why is consistency check removing all entries from the cbbackup database?
    Hi Alexander. I appreciate the response but I don't think you understand my issue. Did you read through the details? I am using legacy backup jobs.

    I've been using Cloudberry Backup since 2017 and have had no issues with consistency checks that I'm aware of. Beginning recently, consistency check will delete all entries in the cbbackup database and data stored in the S3 repository is unaffected. The next time a backup runs, duplicate files are uloaded to the S3 repository, I assume because Cloudberry Backup has no knowledge of files being stored in the S3 repository since there is no data in the cbbackup database for the destination.

    I'm able to reproduce this issue on demand:
    - Navigate to Backup Storage for the repository. Browse and restore various files to the local file system, confirm the restored files files are valid.
    - Run a Consistency Check for the repository. Wait for the Consistency Check to complete
    - Navigate to Backup Storage for the repository. The repository shows as empty. No files or folders are displayed for browsing.
    - S3 storage is unaffected.

    The consistency check is doing more than simply comparing the local repository toe S3 storage and reporting differences:

    Log files show these entries as part of the Consistency Check. All entries are deleted for the destination. 1001 is the destination id for the S3 repository affected.

    ArchiveLiteSyncHelper.ExecuteCompleteConsistencyCheck: Start executing total consistency check...
    2024-05-21 09:57:30,026 [PL] [5] NOTICE - ArchiveLiteSyncHelper.CommitSync: Committing sync changes complete...
    2024-05-21 09:59:13,694 [PL] [13] NOTICE - SQL query 'DELETE FROM cloud_file_versions WHERE file_id IN (SELECT id FROM cloud_files WHERE destination_id = ?)'. Parameters: '[param_1]='1001'' takes in total: 00:01:03
    2024-05-21 10:01:07,123 [PL] [13] NOTICE - SQL query 'DELETE FROM cloud_files WHERE destination_id = ?'. Parameters: '[param_1]='1001'' takes in total: 00:01:53

    2024-05-21 10:01:12,681 [PL] [13] NOTICE - Sync for 'AmazonS3-Dell5810-Standard-IA-US-East-Ohio' is completed. Files: 492046, size: 1.66 TB, duration: 01:22:11

    I've searched through forums and the knowledge base and am unable to find details of these warnings to know what this actually means. Can you help me understand the detail of these errors and what this means with regard to local files and files in the S3 destination, and what actions I may need to take on my part?

    2024-05-21 09:57:28,211 [PL] [5] WARN - all: Cannot convert string 'CBB_Archive\dell5810-standard-ia\ECBB_DELL5810\zzzz27ppn4tencbgnnk5jr4jvejxibleqo4ohwvspinneuuwvyaml6jops5hxkuq73sfxzhj65ipyuf2xna4zf64c66qmatma7fz74z4ghzclacv5ixvzgrwe3pnkbazob52v4g5vfar36pe23fszf46ojamif7y3xwbrznoni2mbpotywha====' to storage path

    2024-05-21 10:51:09,632 [PL] [1] WARN - File ECBB_DELL5810/xsmrclcce6st5pj2lhc6t74nyt2skrhpipqhoqnx533ijgvurus3t2xzbvkfcfjdx32eehzrz54pf24em4cp3wc2haxzodhz44oint5zmqkhxlejb2ht7lxk2zhhkhgmw3aj2sk63swnei3p5kxxi64cctgo5oxp3ebhszo7rkssvosjqz7dky7xmunldti4st5wnkblxkrjy=== will be ignored. History path: