Skip to main content

Consolidation / retention on local servers AND on remote offsite servers

Thread needs solution

Hi,

we are a company using Acronis Backup Advanced on our local servers. Our current setup is creating a full backup and then creating incremental backups with a chain up to 50 backups. After 50 backups, we run a consolidation job on weekends. So basically, we store between 50 and 57 backups on site before the consolidation job shrinks the entire chain to 50 elements. We do not use acronis vault and only use plain archive files on windows shares.

We currently setup a server on a remote location running nothing but Windows Server 2016. Via file share and a sync tool we copy all new incremental backups to this offsite remote backup storage server. A VPN connection allows us to transfer the files.

The entire archive chain is roughly 2 TB of data. (1 full backup and 49 incremental backups) If we run a consolidation / retention job on the local storage system we run into the problem that we have to transfer all files (2 TB) to the remote site, because all files have been changed by the consolidation job.

Would it be possible to run a consolidation job both on the local and on the remote server? In theory, new incremental files created on the local server should be compatible with the chain on the remove server. However, up to now I was unable to setup only a consolidation job on the remote server. It does not seem to be possible to activate this in the acronis management server.

I found this forum entry of people discussing this problem in 2010: https://forum.acronis.com/forum/11117

Best regards

Mathias

0 Users found this helpful
frestogaslorastaswastavewroviwroclolacorashibushurutraciwrubrishabenichikucrijorejenufrilomuwrigaslowrikejawrachosleratiswurelaseriprouobrunoviswosuthitribrepakotritopislivadrauibretisetewrapenuwrapi
Posts: 22
Comments: 3800

Hi Mathias,

First of all note that after consolidation in 1st location, the newly added incremental backups cannot be simply copied to the 2nd location, since they won't append to existing not-consolidated archive chain - so your original plan is unlikely to work. To cover the scenario I'd suggested the following approach instead:

1) Install Acronis Backup Command Line utility on both source backup server (1st location) and onto the remote Windows Server 2016 host (2nd location: where the backups are stored locally after transferring them over VPN)

2) Instead of file sync tools - use Acronis Backup CLI 'replicate backup' function in the 1st primary location (replicate backups from 1st to 2nd location). It supports incremetal backups appending (it won't transfer whole 2TB archive) and also takes into consideration the consolidation activity, e.g. handles situations where backups in 1st location were consolidated.

2) Perform backups consolidation via the CLI installed in remote site (2nd location) whenever necessary. The list of existing backups (to make a decision on which backups to keep) can be checked via 'list backups' command.

Hope this helps.

Thank you.

Hi Vasily,

thank you for your response.

> “First of all note that after consolidation in 1st location, the newly added incremental backups cannot be simply copied to the 2nd location”
I understand that and it appears that we both have the same idea. My statement “Would it be possible to run a consolidation job both on the local and on the remote server?” is apparently what you are proposing with the CLI.

I checked your suggestion with the CLI and currently I’m a bit confused. According to the manual page the command “consolidate backup” needs the arg --backup. “Modifies an archive so that only the backups specified in the --backup parameter are kept. All other backups of the archive are deleted.” The backup arg needs the corresponding ids of the backups, that I want to remain.
So let’s say I have 57 archive files (backup.TIB, backup2.TIB, … backup57.TIB). The result should be to consolidate to 50 archives and deleting the oldest backups in the process. This means I need to add the ids of backup57 up to backup7 right? So backup.tib up to backup6.tib would disappear from the chain correct?

How exactly do I get the ids of the other backups? I tried these commands with following output:

> acrocmd.exe list backups --loc="z:\Backups" --arc=Backup --output=raw
E0304C21-AEED-45D0-AC4C-6C69C0D95351    full    false   03.12.2016 00:00:27
The operation completed successfully.
> acrocmd.exe list backups --loc="z:\Backups" --arc=Backup1 --output=raw
An error occurred while executing the command.
    Error: 0x1510008
    $module = "acrocmd_vs_50058"
    Tag: 0x7A8E520180FDC065
TOL: Failed to execute the command. The 'Reindexing archive' command rebuilds the metadata of the specified archive.
    Error: 0x1350016
    TraceLevel = 1 (0x1),
    $module = "dms_reindex_archive_command_addon_vs_50058"
    Tag: 0x8D165E86FB819666
Failed to find archive 'Backup1'.
    Error: 0xA100D4
    IsReturnCode = 1 (0x1),
    $module = "disk_bundle_vs_50058"
    Tag: 0xB320396ADFE3DA3
Cannot find archive 'Backup1'.
    Error: 0xA10007
    $module = "disk_bundle_vs_50058"
    Tag: 0xA110F03A4AA48DBD

How do I get the ids of other then the base archive?

Thank you in advance.
Mathias

frestogaslorastaswastavewroviwroclolacorashibushurutraciwrubrishabenichikucrijorejenufrilomuwrigaslowrikejawrachosleratiswurelaseriprouobrunoviswosuthitribrepakotritopislivadrauibretisetewrapenuwrapi
Posts: 22
Comments: 3800

Hi Matthias,

-------

> acrocmd.exe list backups --loc="z:\Backups" --arc=Backup --output=raw
E0304C21-AEED-45D0-AC4C-6C69C0D95351    full    false   03.12.2016 00:00:27

-------

The bolded GUID is the actual ID of the backup in the archive with name "Backup". Note that archive may contain several backups, so "--arc" parameter defines the _archive_ name rather than backup name => this means that specifying "--arc=Backup1" is not a valid command since it does not address the archive.

In case of multiple backups saved in 1 archive you will see the list of multiple backup IDs and from there you'll need to select the ones to be preserved and provide these IDs in the acrocmd command parameters (so it has to be scripted, e.g. first parse the output of the backups list and then script it into new acrocmd command).

One more alternative which I can suggest is to use the GUI function of backups replication - it's also taking care of the consolidation and backups retention rules in both primary and secondary location. Probably this would be an easier solution rather than playing with the CLI.

Thank you.

Hi Vasily,

I’m sorry, I still don’t get it. This is my directory:
Directory of Z:\VBackups
27.01.2017  13:04    <DIR>          .
27.01.2017  13:04    <DIR>          ..
01.01.2017  00:17    <DIR>          Catalog
27.01.2017  04:58            56.095 Backup.xml
27.01.2017  04:01     9.266.673.664 Backup_2016_10_27_00_00_19_193D.TIB
27.01.2017  13:04             6.950 Backup_2016_10_27_00_00_19_193D.xml
27.01.2017  04:02       195.917.824 Backup_2016_10_27_00_00_19_193D2.TIB
27.01.2017  04:03       122.767.360 Backup_2016_10_27_00_00_19_193D3.TIB
27.01.2017  04:04       109.668.352 Backup_2016_10_27_00_00_19_193D4.TIB
27.01.2017  04:05       101.271.552 Backup_2016_10_27_00_00_19_193D5.TIB
27.01.2017  04:05       106.473.472 Backup_2016_10_27_00_00_19_193D6.TIB
27.01.2017  04:06       128.194.560 Backup_2016_10_27_00_00_19_193D7.TIB
27.01.2017  04:07       102.332.416 Backup_2016_10_27_00_00_19_193D8.TIB
27.01.2017  04:08       112.703.488 Backup_2016_10_27_00_00_19_193D9.TIB
... and so on

So the command “acrocmd.exe list backups --loc="z:\Backups" --arc= Backup_2016_10_27_00_00_19_193D --output=raw” showed me only this “E0304C21-AEED-45D0-AC4C-6C69C0D95351    full    false   03.12.2016 00:00:27” and nothing else. So how do I get the ids of the other files? Shouldn’t the command have showed me the IDs of the other files as well?

>It's also taking care of the consolidation and backups retention rules in both primary and secondary location
Yes, but from which location will it do that? Will it consolidate on my first site and then transfer all the files (every single bit, not the changed bits) to the secondary location or will it do the consolidation on the second location as well? I currently have no agent installed on the secondary site.

Please bear in mind that transferring all consolidated files from the first to the second location is exactly what I am tring to prevent. We are talking about a 100 Mbit connection via WAN / VPN which is not practable with archives of a total of 2 TB.

Thank you in advance.
Mathias

frestogaslorastaswastavewroviwroclolacorashibushurutraciwrubrishabenichikucrijorejenufrilomuwrigaslowrikejawrachosleratiswurelaseriprouobrunoviswosuthitribrepakotritopislivadrauibretisetewrapenuwrapi
Posts: 22
Comments: 3800

Mathias,

The archive name in your case is simply "Backup" - no date timestamps or other service info is required. So the command should be:

acrocmd.exe list backups --loc="z:\Backups" --arc=Backup --output=raw

P.S. Still I would recommended to try using the native GUI option before trying the CLI (as mentioned in my previous comments) - it's very likely that this approach would work better for you.

Thank you.