We are using Network and Virtual Appliance Mode.
All of our VMWare Clusters are using vSAN, so the Direct Storage Access Mode is no optionā¦.
We are using Network and Virtual Appliance Mode.
Do you use Linux based proxies for virtual appliance mode, @JMeixner?
I only use Direct Storage Access with physical servers and Iām interested why people would be using it with virtual machines? Iām not disputing itās possible, just why anyone would want to use it?
It feels like a rabbit hole of inefficiency to head down.
Ā
Best practice is to dedicate the NICs of your ESXi for iSCSI, so weād either end up using general VM traffic NICs for iSCSI which could easily saturate the bandwidth or greatly contribute to bandwidth saturation of the production VM network or weād need to dedicate NICs to virtual iSCSI direct access.
Assuming we decided on dedicated NICs then to ensure that our cluster was capable of still performing vMotions for example on our proxies to ensure we have dedicated NICs on all hosts.
Once thatās out the way we then need to think about our repository, are we going to share our iSCSI NICs to interact with a physical iSCSI storage for the repository? We wouldnāt want the files within a VMDK after all and unless we can use a share capable of supporting block cloning that would rule out space efficiency as a candidate. (Assuming we dual homed the proxy and repository roles on this VM)
Finally weāve got to think about the amount of concurrent tasks available and the vCPU and RAM demands of the proxies, unless we deployed the physical NICs to all hostsĀ weāre impacting the clusterās ability to load balance anyway and would have to pin VMs to hosts, this could impact backup and recoverability during maintenance windows. So we could have unbalanced hosts. If we did deploy multiple VMs with physical NIC access weād still need rules to ensure the VMs arenāt co-existing on the same hosts otherwise theyād impede each others access to the iSCSI NICs by sharing them.
Ā
Thatās my thought process on it so Iād be curious to hear of anyone using it and what their thoughts are on the above. Iād rather just use VA Mode or a physical host or dare I say it, networking mode (for simplicity).
I only use Direct Storage Access with physical servers and Iām interested why people would be using it with virtual machines? Iām not disputing itās possible, just why anyone would want to use it?
I know quite a few customers using either NFS or iSCSI who do not want physical backup proxies, but they do want to leverage backup from storage snapshots.
I only use Direct Storage Access with physical servers and Iām interested why people would be using it with virtual machines? Iām not disputing itās possible, just why anyone would want to use it?
I know quite a few customers using either NFS or iSCSI who do not want physical backup proxies, but they do want to leverage backup from storage snapshots.
Itās an interesting point, regarding the other bits I mentioned such as dedicated NICs etc, how do they overcome those challenges?
Do you use Linux based proxies for virtual appliance mode,Ā @JMeixner?
Up to now we have Windows based Proxies only.
A Linux based Proxy is the next thing I want to try. If this works well, it will be a lot cheaper and smaller than the Windows VMs.
Do you use Linux based proxies for virtual appliance mode,Ā @JMeixner?
A Linux based Proxy is the next thing I want to try. If this works well, it will be a lot cheaper and smaller than the Windows VMs.
@JMeixner, cheaper because you do not use data center licensing and pay Microsoft per server? or are you thinking of a service provider environment? I see some experiences shared by @HannesKĀ on the R&D forums on which Linux distro to use:Ā https://forums.veeam.com/post360698.html#p360698
I only use Direct Storage Access with physical servers and Iām interested why people would be using it with virtual machines? Iām not disputing itās possible, just why anyone would want to use it?
I know quite a few customers using either NFS or iSCSI who do not want physical backup proxies, but they do want to leverage backup from storage snapshots.
Itās an interesting point, regarding the other bits I mentioned such as dedicated NICs etc, how do they overcome those challenges?
@MicoolPaul, re-reading your previous post it sounds like you are assuming physical proxy will also be a repository and if we use a virtual proxy it would also be a virtual repository? You could of course use virtual backup proxies and then target physical backup repositories.
Depending on your environment size, a simple VM to host rule could suffice (as this does not require vSphere DRS) but the more fancy way of course would be an anti-affinity DRS rule to just avoid the virtual proxies to be co-located on the same host(s).
iSCSI/NFS traffic from the virtual backup proxy, this definitely needs some consideration. Ideally, you would have a dedicated NIC for the virtual backup proxy to use, but if you have a lot of hosts this might not be feasible - instead, I often see Network IO Control (NIOC) used with share values.
@haslundĀ I did make considerations that it either could be dual roled or not with regards to proxy & repository roles as that would compound the issue further. HoweverĀ the main concerns were around NIC provisioning and then by extension the CPU impact on the hosts as weāve both alluded to by pinning VMs to hosts and unbalancing clusters.
A fairly safe assumption to make here is that customers utilising Storage Snapshots have made a fairly significant investment in both storage and Veeam licensing so itās interesting to here of the āall virtualā approach, definitely not a use-case Iād have considered before.
Anyone else have any further use-case examples to contribute?
Do you use Linux based proxies for virtual appliance mode,Ā @JMeixner?
Up to now we have Windows based Proxies only.
A Linux based Proxy is the next thing I want to try. If this works well, it will be a lot cheaper and smaller than the Windows VMs.
In my opinion, the best benefitĀ is that Linux Proxy don't useĀ on VMware VDDK,Ā Veeam written codeā¦Ā
@JMeixner, cheaper because you do not use data center licensing and pay Microsoft per server? or are you thinking of a service provider environment? I see some experiences shared byĀ @HannesKĀ on the R&D forums on which Linux distro to use:Ā https://forums.veeam.com/post360698.html#p360698
Yes, I want to try an Ubuntu. So no Windows license costs.
I use each of the transport modes. Depending on the environment, each of them could be faster - in terms of backup-duration - than the others.
Sometime I wish, transport mode is a setting on job layer, not on proxy layer. This would be very helpful to take the āfastestā mode for your workload.
Do you use Linux based proxies for virtual appliance mode,Ā @JMeixner?
Up to now we have Windows based Proxies only.
A Linux based Proxy is the next thing I want to try. If this works well, it will be a lot cheaper and smaller than the Windows VMs.
More and more linux proxies will come with v11. I am quite sure we will push them for hardware proxies as well. Just because of XFS with immutability. Just linux tape proxies are left to come.