v11: NBD multi-threading for VMware backup


Userlevel 7
Badge +12
  • On the path to Greatness
  • 1273 comments

Reading through the What’s new document, I discovered an new feature/option which hasn’t been mentioned here before: “NBD multi-threading”

As the performance of NBD (network) in VMware backups is often not as good as virtual appliance or direct storage access storage mode, it sounded quite interesting to try. Perhaps this way we can get over some limitations of NBD mode and better utilize the network capacity of our proxies.

NBD multi-threading — The backup engine is now capable of establishing multiple NBD connections per VMDK for better performance of network transport mode. At the same time, due to the low limit of max NBD connections per ESXi host, there are reliability concerns associated with increasing the number of such connections. While our resource scheduler tracks NBD tasks per host to ensure they remain within the limit, we decided that a marginal performance benefit is not worth the risk of enabling this new behavior for our entire customer base right away, as there might be external NBD connections too. However, you can use the fully supported VMwareNBDConnectionsPerDisk (DWORD) registry value on the backup server to give this functionality a try. Our internal testing showed that the best performance is achieved with two NBD connections per disk. Please share your results in the Veeam R&D Forums to help us decide whether to enable this functionality by default in future updates!

https://www.veeam.com/veeam_backup_11_0_whats_new_wn.pdf

Unfortunately I couldn’t produce any significant numbers in my lab and don’t currently have any other V11 environment where I could compare the results of using multiple NBD threads per Disk. But I still wanted to share this option here in the community. Perhaps you’ll be able to test it in your environment and achieve a slightly better network based backup performance.

As it’s a new option and disabled by default, be carefully when using it and give a feedback on your results to Veeam R&D. The only forum post I could find is this one, so I would suggest to collect all feedback there: https://forums.veeam.com/vmware-vsphere-f24/new-nbd-multithreading-feature-v11-t72689.html


6 comments

Userlevel 7
Badge +13

Yes, I found it very interesting too, as I read it in the what’s new!

Unfortunately I have some problems testing this in my demo/test environment too. But I will post numbers, when I did some testing and comparison. Looking forward to see what comes out!

Userlevel 7
Badge +17

Interesting feature :grin:

I have just tried a restore with this registry key set to 1 and one with it set to 2.
The speed difference was 1 MB/sec…

Ok, this test environment is old and not performant. I will have to try it on a newer environment in the next days and perhaps with a bigger VM….

I think a really fantastic feature would be to be able to have several sessions with hotadd mode. Big virtual disks with several TB size take a lot of time to restore with only one session :sunglasses: But I don’t know if this is possible...

Userlevel 7
Badge +8

@regnor  400 mb/s to 600mb/s with this option enable, thank you very much !

Userlevel 7
Badge +12

@regnor  400 mb/s to 600mb/s with this option enable, thank you very much !


That’s huge! Thanks for testing and sharing your results. How many connections did you configure?

Userlevel 7
Badge +13

@regnor  400 mb/s to 600mb/s with this option enable, thank you very much !

@BertrandFR Thanks for testing!

What did you test here? A single VMDK, or a VM with multiple VMDKs, Or multiple VMs? 

Userlevel 7
Badge +8

@regnor  400 mb/s to 600mb/s with this option enable, thank you very much !

@BertrandFR Thanks for testing!

What did you test here? A single VMDK, or a VM with multiple VMDKs, Or multiple VMs? 


Multiples VMs , Multiples VMDKS (some are huge like 1 -2 TBs), primary storage simplivity. On this kind of HCI nbd is recommanded rather than hotadd). 2thread like in the r&d forum we plan to try with 3 thead.

Comment