Skip to main content
  • EN

Team

Need your advice and support on below topic

We are using AWS S3 for cloud backups, with the on-premises performance tier, the cloud capacity tier set to S3 Standard class, and the archive tier set to Glacier.

The data transfer from on-premises to the cloud uses Direct Connect and the S3 private endpoint, which works perfectly fine.

The issue is when data moves from the capacity tier to the archive tier. This process is handled by a helper appliance, which uses the S3 private endpoint for transferring data from capacity to archive tiers and for deleting data from the archive tier. These activities generate significant data transfer costs.

If the helper appliance uses the S3 gateway endpoint instead, it would be free as per AWS. We need your assistance how to instruct the helper appliance to use the S3 gateway endpoint instead of the S3 private endpoint.

 

See if this post from the community helps with the setup for the helper appliance - https://community.veeam.com/blogs-and-podcasts-57/object-storage-backup-directly-to-aws-s3-step-by-step-recipe-4168

 

​@dlinfrastructureteam I read the post indicated by Chris, it’s very useful. I think it will solve the issue your are facing.

Thank you ​@Chris.Childerhose  for sharing document.

Our cloud backup has been working fine since June, so there are no configuration or routing issues in AWS.

The issue is how to reduce data transfer costs when moving data from the capacity tier to the archive tier within the cloud.

Currently, the helper appliance uses the S3 private endpoint to move and delete data in the archive tier, which increases transfer costs.

If the helper appliance switches to using the S3 gateway endpoint, it would be free according to AWS and no data transfer cost incur.

Thank you ​@Chris.Childerhose  for sharing document.

Our cloud backup has been working fine since June, so there are no configuration or routing issues in AWS.

The issue is how to reduce data transfer costs when moving data from the capacity tier to the archive tier within the cloud.

Currently, the helper appliance uses the S3 private endpoint to move and delete data in the archive tier, which increases transfer costs.

If the helper appliance switches to using the S3 gateway endpoint, it would be free according to AWS and no data transfer cost incur.

Did you look at the networking piece?  Not sure if both the S3 private endpoint and S3 gateway endpoint use the same network or not but that is what I wondered about.  If they do then we need others that use AWS more to chime in as I don’t use it myself.

 

Hi ​@Chris.Childerhose . thank you once again for your support.

We have a similar setup. however, as shown in the diagram below, the helper appliance is supposed to use the S3 Gateway Endpoint for moving data from S3 to S3 Glacier. In my case, the helper appliance is using the S3 Interface Endpoint for this purpose. please review and advice.

I have verified , in AWS routing we have added s3 GW endpoint

 

 

 

Hi ​@Chris.Childerhose . thank you once again for your support.

We have a similar setup. however, as shown in the diagram below, the helper appliance is supposed to use the S3 Gateway Endpoint for moving data from S3 to S3 Glacier. In my case, the helper appliance is using the S3 Interface Endpoint for this purpose. please review and advice.

 

 

Ok if it is not using the right network or path then at this point I would suggest a Support ticket.  I would not be able to suggest or help but support will as they can check logs and configurations, etc.  For expediency this is the best route to take.

The other option is searching the forums for answers possibly of similar cases - https://forums.veeam.com

 

Thank you ​@Chris.Childerhose 

I have created support ticket with Veeam

thank you

Thank you ​@Chris.Childerhose 

I have created support ticket with Veeam

thank you

Not a problem.  Let us know the outcome and answer.

 
 
 

Comment


Terms & Conditions