cbbWorker process and thread count
  • Ron
    0
    Hi all

    I am trying to perform a backup to Backblaze and came across something that has me stumped.

    I am only getting 1Mb/sec upload although when running speed tests against backblaze the speed shows 8Mb/s which is my upload speed cap.

    I've also noticed that there is only 1 cbbWorker process and I had thought there was 1 / thread.

    I have the following settings

    Threads: 5
    Chunk Size 150M
    Max Memory: 10GB

    Running:

    Ubuntu 18.04.2 LTS
    Cloudberry 3.0


    When running the process is only using about 25% CPU and 300M of memory

    Anything else I should be looking at?
    Ron Options
  • David Gugick
    118
    ↪Ron
    may not be the issue but that's a very large chunk size. Any reason you set it so large?
    David Gugick Options
  • Ron
    0
    ↪David Gugick
    I have some very large files.
    I'll lower it and retry
    Ron Options
  • David Gugick
    118
    ↪Ron
    The idea behind that setting is not to maximize it based on your file sizes. we use multi-part uploads, so we can effectively upload multiple chunks for many files in parallel and the cloud provider automatically reassembles the chunks when complete. For you particular speed you might try the 10MB chunk size. May not help your issue so let me know and I'll loop in support of needed to assist.
    David Gugick Options
bold
italic
underline
strike
code
quote
ulist
image
url
mention
reveal
youtube
tweet
Add a Comment