For the past two months, we have been experiencing issues uploading our backups to Amazon Glacier using Cloudberry. The files are failing, and multiple retries are needed to successfully complete the copy.
System.Net.WebException
Error on the remote server: (400) Bad Request
en System.Net.HttpWebRequest.GetResponse()
en aQU.a(aQP )
2024-02-07 10:01:54,239 [Base] [9] WARN - Rate exceeded
CloudBerryLab.Base.Exceptions.RequestRateLimitException
Rate exceeded
en aQU.b(aQP )
en aQU.C(aQP )
en aQU.c(aQP )
en aQV.py(aQP )
en aQV.A(aQP )
CloudBerryLab.S3Client.Glacier.Exceptions.GlacierWebException
Rate exceeded
System.Net.WebException
Error on the remote server: (400) Bad Request
en System.Net.HttpWebRequest.GetResponse()
en aQU.a(aQP )
2024-02-07 10:01:58,206 [Base] [9] WARN - Rate exceeded
CloudBerryLab.Base.Exceptions.RequestRateLimitException
Rate exceeded
en aQU.b(aQP )
en aQU.C(aQP )
en aQU.c(aQP )
en aQV.py(aQP )
en aQV.A(aQP )
CloudBerryLab.S3Client.Glacier.Exceptions.GlacierWebException
Rate exceeded
System.Net.WebException
Error on the remote server: (400) Bad Request
en System.Net.HttpWebRequest.GetResponse()
en aQU.a(aQP )
2024-02-07 10:02:02,179 [Base] [9] WARN - Rate exceeded
CloudBerryLab.Base.Exceptions.RequestRateLimitException
Rate exceeded
en aQU.b(aQP )
en aQU.C(aQP )
en aQU.c(aQP )
en aQV.py(aQP )
en aQV.A(aQP )
CloudBerryLab.S3Client.Glacier.Exceptions.GlacierWebException
Rate exceeded
System.Net.WebException
Error on the remote server: (400) Bad Request
en System.Net.HttpWebRequest.GetResponse()
en aQU.a(aQP )
In the copying process, we observe that Cloudberry interacts with 3 AWS IP addresses, two of which seem to be working normally, but from one of them, we do not receive any kind of return traffic on the firewall logs.