Skip to main content

One of the biggest mysteries of Veeam’s list of features in my opinion is the Backup Copy Job. On the surface, they’re easy to understand – you create a Copy Job, use some supported backup source, and copy this source VM data to a designated target to implement part of the 3-2-1(-1-0) Rule – have multiple copies of your data and/or at least 1 offsite copy of your data. Easy, right? Well, when you look under the hood of the technology behind the retention, scheduling, interval, etc. things start to get murky pretty quick, at least for me. The most difficult to understand about Copy Jobs in my opinion is how the retention algorithm works when using the GFS (grandfather-father-son) archive option. And with the changes brought to Copy Jobs with the release of Veeam v11, I believe things got worse instead of better. As such, I thought it would be beneficial to the Veeam Community for me to go through the Backup Copy process from a deep-dive perspective, and see if I can make a bit more clearer sense, for myself and the Community, of how Backup Copy Jobs retention works. I will tackle this topic in a “3-part” series of posts – Part I Intro, Part II Short-Term Retention, and Part III Long-Term (GFS) Retention.

 

In this Part I post, I thought it would be best to share explicitly what Veeam states Copy Jobs are, then move on to their requirements, as well as some considerations and limitations. This will give us a foundation from which to begin our retention discussion in subsequent posts.

 

WHAT ARE COPY JOBS?

From the Veeam User Guide, a Backup Copy Job allows you the ability to create several instances of your backup data in different locations, whether onsite or offsite, for long-term storage, to help you meet the 3-2-1 Rule

 

REQUIREMENTS / LIMITATIONS

Sources:

– Instead of listing all the sources you can create a Backup Copy job from (see full list here), I will list jobs for which a Backup Copy job cannot be created:

  • Immediate Copy Mode – you cannot create a Copy Job from any Veeam Agent for Windows, Linux, or MAC sources in Standalone Mode when using Immediate Copy Mode. The Agent Jobs have to be in Managed Mode (managed by the VBR Server). Other Veeam Agents – Nutanix AHV, Oracle Solaris, AWS, & Azure – are not suppported in Immedicate Copy Mode
  • Periodic Copy Mode – does not support sources which use Enterprise Plug-Ins such as: Oracle RMAN, SAP HANA, and SAP on Oracle
  • Other Backup Copy Jobs – I know I said I would share what isn’t supported, but this option can be a bit confusing, so I will discuss it here. The short answer is YES, using other Backup Copy Jobs is supported, but there is no explicit option to select them when adding your source objects. To use other Copy Jobs as a source for a new Copy Job, you have to do so indirectly by adding the source Copy Job Repository. Click the Add button > Repository option when using Immediate Mode; or in Periodic Mode, click the Source button. Then choose the Repo the source Copy Job you want to use resides on

 

Task Behavior:

  • If the Backup Copy job is utilizing the source Backup job chain for a Copy task, and the source Backup job starts a task, the Copy job task will be put on hold until the source Backup job releases from its chain
  • Copy job Interval setting is only allowed when using Periodic Copy Mode
  • Active Fulls vs Synthetic Fulls – Synthetic is the default and Active is only available for Periodic Mode & recommended when using dedup appliances for Copy job target Repos

 

Limitations:

  • Because of logic differences between the two, you cannot change between Immediate and Periodic Copy Modes
  • Immediate Copy Mode only allows copying Transaction Logs; Periodic Copy Mode is not supported (see below):
     
     
  • Veeam does not copy incomplete source restore points
  • Veeam does not copy source restore points if the data block size differs from the block size of the data already copied. To be able to do so, you would need to create an Active Full, then perform the copy
  • If you’re using a target Repo for the Copy Job which uses rotated drives, you’re not able to use GFS retention
  • GFS Fulls cannot be merged or deleted by Short-Term Retention; Short-Term (Regular; ‘R’) Fulls can be
  • When using Periodic Copy Mode, if the configured interval for the Copy Job isn’t long enough to create an Active Full, the interval will be prolonged until it’s completed
  • When using Deleted Items Retention, this feature only applies to Short-Term Retention, not GFS Retention. Also, when data is deleted, space is not freed up in the Repo; instead, it is marked as available to be used for overwriting of subsequent Copy Job runs. If using Per-VM, the space is not marked as available but instead just deletes the single VM data
  • Periodic Copy Mode Interval behavior – if the interval is not configured long enough – e.g. is configured for only 1 day – and the full source Backup chain needed to retrieve for the Copy Job is for longer than the configured interval (e.g. 1 week’s worth), Veeam will not be able to Copy those restore points because they fall out of the interval’s search scope

 

Whew! That sure is a lot of “gotchas” to know about with regards to setting up and configuring your Copy Jobs, isn’t it? See what I mean by ‘Copy Jobs being murkey’? And, I didn’t even cover all of the requirements/limitations. But I did share most of them and the above are the most important for our purpose of moving on to Part II and Part III.

 

If you have any questions about any of the above, don’t hesitate to comment below.

 

Cheers!

Thank you, very helpful. 

I ran into some of these gochas when getting started with Backup Copy Jobs


You bet @dips ..thank you. Stay tuned as I hope to clear up some misconceptions about restore point behavior in subsequent posts.

Cheers!


You bet @dips ..thank you. Stay tuned as I hope to clear up some misconceptions about restore point behavior is subsequent posts.

Cheers!

Ah brilliant. The one that always gets me is Instant Recovery and how it runs. 


@coolsport00 : Thanks for the share !


Great idea to cover this off @coolsport00. I absolutely agree that there are many things in Veeam that are simple solutions to execute but with a lot of complexity under the hood, case in point Copy Job Periods, especially in the older Periodic Copy mode. Look forward to the next instalment :smiley:  


Thank you @AndyPilk ...totally agree! 


Very nice writeup Shane.


Thanks Chris!


Hi @coolsport00 , great deep dive regarding copy jobs! It was a nice recap 😉. The way it’s working is not that obvious as it seems to be. When I explain it to my colleagues, mostly I’m having a lot surprised looks 🙂.

 

Nice is the following you mentioned : 

  • Active Fulls vs Synthetic Fulls – Synthetic is the default and Active is only available for Periodic Mode & recommended when using dedup appliances for Copy job target Repos

I hadn’t noticed yet that using the immediate copy mode was only available with synthetic full. Why? I rarely used the active full using a copy backup job 😉.

 

Personally I would prefer that Veeam used the same naming conventioning (active full instead of : read the entire restore point from source backup instead...)

Nice tip to remind when I will study for the VMCE 2021 exam ;-)


Appreciate the kind words @Nico Losschaert . Agree on the wording. I’ll mark that down and maybe make mention of that in the Forums, along with a question or 2 I still need answered before I finish my Part III post :) 

Cheers!


Great topic @coolsport00 ! It is a good idea to talk about the limitations, so it is easier to see what is not going to work.

I have gotten into the habit to name the backup-copy-job a backup-backup-job. I think this explains the job better.

 

 


Because you talk about other backup-copy job as source for a backup-copy job: once I wrote a post about how to copy a copy job

 

 

 

 


Good one Shane, this perspective is very valuable.


Appreciate it Rick! 


Thanks for creating this series @coolsport00. Understanding the backup copy jobs sometimes isn’t so easy, so your explainations are very useful.


Sure thing... & thanks for the kind words @regnor 


@coolsport00 : Awesome job !


Thank you @Inder !


Great write up coolsport00. One thing that I have noticed with immediate mode is that if you don’t have the bandwidth necessary for the loads that you are trying to copy then all sorts of problems can spring up including even corrupted backup chains. I of course can’t claim with 100 percent certainty that the the corruption was not just a coincidence but nevertheless I have seen this a few times. The dilemma in my view is that periodic mode is much harder to explain to customers but allows more flexibility, immediate mode is closer to “legacy” thinking (this I realize is subjective assessment on my part) therefore need little explanation but comes with restrictions.  


Hi @Geoff Burke ...thanks for the kind words. Yes, if you don’t have a couple WAN Accelerators in your setup if there’s low-bandwidth, it could indeed cause issues. Not heard of leading to corrupt files before, but I guess it’s possible. :)


Thank you, very helpful. 


Hope it helps you @miriam1989 


 

Want to copy all restore points to a backup-hardened repository, but only one restore point is being copied. the primary backup has 10 restore points but the hardened backup copy repo only has one. We choose "All" when running the Sync option.Running in immediate mode.

My setting for the source job is not using use-per machine but the target repo is using per-machine 

Any thoughts?


 

Want to copy all restore points to a backup-hardened repository, but only one restore point is being copied. the primary backup has 10 restore points but the hardened backup copy repo only has one. We choose "All" when running the Sync option.Running in immediate mode.

My setting for the source job is not using use-per machine but the target repo is using per-machine 

Any thoughts?

Check this link for an explanation as to why only one file is there as the copy job is creating it during the process - https://helpcenter.veeam.com/docs/backup/vsphere/backup_copying_process.html?ver=120

 


Thanks Chris. 


Comment