A Deeper Look at the Smart-Entity
In my Veeam Amazing Object Storage Tips & Techniques Part 4 I provided a high level introduction of the Smart-Entity feature of the Smart Object Storage API (SOSAPI). In this article, I will explain how our Technical Alliance Partner (TAP) Object First has implemented the Smart-Entity as part of their object storage solution.
Let’s start off with a reminder of how the Smart-Entity feature works:
- Veeam Backup & Replication will tell the object storage platform how much data VBR is about to send it as well as for what object (virtual machines, cloud vms, NAS file share, and Physical machines).
- The object storage platform can then use this information to determine what node/endpoint will receive the backup data
- The object storage platform then provides VBR the node name/endpoint address to send the data to
Before I dive into the details of how Smart-Entity works, let me define what an entity is. Veeam Backup & Replication uses backup jobs to protect the object(s) mentioned above within your environment. An entity is an individual object that is being backed up. If you had a backup job that was protecting 100 virtual machine objects, you would have 100 entities being protected.
For the rest of this article, I will be referring to this diagram to demonstrate how Object First uses the Smart-Entity:
When you create the object storage repository using the repository wizard, you need to specify the S3 endpoint/service point that Veeam Backup & Recovery (VBR) will use to access the object storage bucket:
Once the object storage repository is created, you will see the S3 endpoint within the path for the repository:
Since Object First is using the SOSAPI, you will see the blue bucket icon next to the repository’s name. The repository “Type” is “S3-integrated” which is another indicator that the SOSAPI is used by Object First. Both of those indicators are used to highlight the deeper level of integration Object First and other partners using the SOSAPI have versus traditional S3 compatible solutions.
Object First also implemented the SOSAPI’s Capacity feature which allows VBR to report the repository’s capacity and free space. Neither of those values are available for object storage repositories that don’t use the SOSAPI.
Because Object First also implemented the SOSAPI Smart-Entity feature, lets see the benefits of it. The first benefit is the Smart-Entity allows Object First to load balance the backup date being sent to their storage by VBR. This is done by VBR telling Object First the name of the entity from which the backup data is coming, as well as the size of the backup data. Based on this information, Object First will determine which node within the cluster to send the backup data.
In the example below VBR is going to backup the virtual machines (VM-1, VM-2, and VM-3). The process using Smart-Entity is as follows:
- All three backup jobs are sent to the S3 Endpoint (192.168.1.100) by VBR along with the Smart-Entity information mentioned earlier (VM name and size of backup job)
- Object First decides based on the Smart-Entity information which node to send the VM backup data
- Object First will use Smart-Entity to note the node where the backup data was stored
The last step where Object First notes which node the VM backup data was stored is used during subsequent backups and restores. This is a very important feature of the Smart-Entity. VBR prefers to store the backup chains for the entity being protected on the same node. This “intelligent data placement” improves both backup and restore performance.
In the example above, whenever VM-3 is backed up Object First will store the backup on the 192.168.1.101 node. VM-2 will be stored on the 192.168.1.103 node and VM-1 will be stored on node 192.168.1.102.
The same Smart-Entity information and logic is used whenever an entity needs to be restored by VBR. VBR will make the restore request to the S3 Endpoint address of 192.168.1.100, but Object First will use the Smart-Entity information it has stored for the endpoint to know which node to get the backup data and return it to VBR so that the restoration can occur more efficiently which results in faster restores.
Object First utilizes the Smart-Entity feature to help facilitate a customer’s lifecycle management of the Object First cluster. When a customer adds storage and/or nodes to an Object First cluster., the Smart-Entity is utilized to balance capacity, IO performance, and network performance automatically.
Hopefully you now have a better understanding of what the Smart-Entity feature of the SOSAPI is and the value it can provide to an object storage partner who implements it. By implementing and taking advantage of the Smart Object Storage API’s Smart-Entity feature, Object First has created a deeply integrated solution with Veeam Backup & Replication. The combination of Object First and SOSAPI can help customers with both their backup and restore operations as well as their Object First storage lifecycle management.
