IBM Storage Defender

IBM Storage Defender

Early threat detection and secure data recovery

 View Only
Expand all | Collapse all

Restore vs Archive

Prem Singh

Prem SinghWed January 25, 2017 04:48 AM

  • 1.  Restore vs Archive

    Posted Tue January 24, 2017 02:38 AM

    Hi Experts,

    I am looking for your view on restore vs Archive option under BA Client GUI snap-in. I am taking continuous backup of vm's lets assume If i am taking backup today then it's reflecting under restore and next day it is moving into Archive. I am not able to understand how to restore backup which is reflecting under archive. If anyone can tell me how to sustain this under restore only if applicable attaching the snapshot for better understanding. If i follow snapshot 2 how i can restore the backup which is reflecting under Archive option.

    Node details-

    Node Name                 Platform Policy Domain  Days Since Days Since Locked?
                                       Name           Last Acce-   Password
                                                              ss        Set
    ------------------------- -------- -------------- ---------- ---------- -------
    ADC                       WinNT    VM_DOM                 <1        125   No

    DC                        WinNT    VM_DOM                 <1        174   No

    Schedule detail of DC-

    tsm: ITSM01>q sched vm_dom dc_bkp f=d

                Policy Domain Name: VM_DOM
                     Schedule Name: DC_BKP
                       Description: Daily Image Level backup for DC
                            Action: Command
                           Options:
                           Objects: e:\vcb\scripts\dc.cmd
                          Priority: 5
                   Start Date/Time: 08/02/2016 18:00:00
                          Duration: 10 Minute(s)
                    Schedule Style: Classic
                            Period: 1 Day(s)
                       Day of Week: Any
                             Month:
                      Day of Month:
                     Week of Month:
                        Expiration:
    Last Update by (administrator): PREM
             Last Update Date/Time: 08/02/2016 22:18:07
                  Managing profile:

    Copygroup details-

    tsm: ITSM01>q copy vm_dom f=d

                     Policy Domain Name: VM_DOM
                        Policy Set Name: ACTIVE
                        Mgmt Class Name: STANDARD
                        Copy Group Name: STANDARD
                        Copy Group Type: Backup
                   Versions Data Exists: 3
                  Versions Data Deleted: 3
                  Retain Extra Versions: 75
                    Retain Only Version: 75
                              Copy Mode: Modified
                     Copy Serialization: Shared Static
                         Copy Frequency: 0
                       Copy Destination: VMPOOL
    Table of Contents (TOC) Destination:
         Last Update by (administrator): ADMIN
                  Last Update Date/Time: 04/11/2016 16:34:11
                       Managing profile:
                        Changes Pending: No

                     Policy Domain Name: VM_DOM
                        Policy Set Name: STANDARD
                        Mgmt Class Name: STANDARD
    more...   (<ENTER> to continue, 'C' to cancel)

                        Copy Group Name: STANDARD
                        Copy Group Type: Backup
                   Versions Data Exists: 3
                  Versions Data Deleted: 3
                  Retain Extra Versions: 75
                    Retain Only Version: 75
                              Copy Mode: Modified
                     Copy Serialization: Shared Static
                         Copy Frequency: 0
                       Copy Destination: VMPOOL
    Table of Contents (TOC) Destination:
         Last Update by (administrator): ADMIN
                  Last Update Date/Time: 04/11/2016 16:34:11
                       Managing profile:
                        Changes Pending: No

    in copygroup I didn't find any settings for archive how it works not able to understand.

     

    Prem



  • 2.  RE: Restore vs Archive

    Posted Wed January 25, 2017 04:48 AM

    any suggestion pls.

     

    Prem



  • 3.  RE: Restore vs Archive

    Posted Wed January 25, 2017 06:34 AM

    Archive can only be used in the Backup-Archive Client for files. Not for VMs or in other TDP Products.

    https://adsm.org/forum/index.php?threads/archive-options-tsm.31266/

     

    Rgd.
    Espen



  • 4.  RE: Restore vs Archive

    Posted Wed January 25, 2017 06:53 AM

    Espen,

    I understand the point but the problem is what I indicated on copy group my ret version  is 3 and days are 75 not able to understand why it's moving into Archive automatically.

     

    Prem



  • 5.  RE: Restore vs Archive

    Posted Thu January 26, 2017 10:56 PM

    Espen,

    I am attaching the snapshot for your reference which i was indicating earlier, yesterday backup created on local disk then moved to tape now reflecting under archive option. This is vm backup only.

     

    Prem



  • 6.  RE: Restore vs Archive

    Posted Mon January 30, 2017 10:55 AM

    Prem,

     

    To see the ARCHIVE retention, you need to use "type=archive" on the q copygroup setting, such as:

     

       QUERY COPYGROUP   VM_DOM   TYPE=ARCHIVE  FORMAT=DETAIL

     

    Of course, if you see any Pending Updates, you would need to ACTIVATE POLICYSET to ensure the ACTIVE copygroup gets the latest values from the STANDARD.

     

    I think it would be very helpful for TSM and VMware in general, to use consistent terminology; for example:

       - TSM Client Backup, with COPYGROUP TYPE=BACKUP for retention, has a Restore.

       - VMware backups (not sure what their retention terminology involves).

       - TSM Client Archive uses Retrieve (not Restore). 

    And it appears you perform a VMware backups to local disk, then TSM Client Archive, then delete the VMDK from vSphere, and then you want to Retrieve an Archived VMDK using the TSM Client to the vSphere server.

    Phrased this way, it is easier for us to understand and assist you.  Hope this helps! 

     

      Best Regards,

         Robert



  • 7.  RE: Restore vs Archive

    Posted Mon January 30, 2017 11:38 AM

    Hi Robert,

    Thank you for the detail summary it really help me let me share the output first.

    tsm: ITSM01>q copy vm_dom type=archive f=d

                Policy Domain Name: VM_DOM
                   Policy Set Name: ACTIVE
                   Mgmt Class Name: STANDARD
                   Copy Group Name: STANDARD
                   Copy Group Type: Archive
                    Retain Version: 365
              Retention Initiation: Creation
               Retain Minimum Days:
                Copy Serialization: Shared Static
                    Copy Frequency: CMD
                         Copy Mode: Absolute
                  Copy Destination: VMPOOL
    Last Update by (administrator): ADMIN
             Last Update Date/Time: 12/20/2010 21:50:03
                  Managing profile:
                   Changes Pending: No

                Policy Domain Name: VM_DOM
                   Policy Set Name: STANDARD
                   Mgmt Class Name: STANDARD
                   Copy Group Name: STANDARD
                   Copy Group Type: Archive
    more...   (<ENTER> to continue, 'C' to cancel)

                    Retain Version: 365
              Retention Initiation: Creation
               Retain Minimum Days:
                Copy Serialization: Shared Static
                    Copy Frequency: CMD
                         Copy Mode: Absolute
                  Copy Destination: VMPOOL
    Last Update by (administrator): ADMIN
             Last Update Date/Time: 12/20/2010 21:50:03
                  Managing profile:
                   Changes Pending: No

    No changed pending as of now.

    output of retention:-

    tsm: ITSM01>q copy vm_dom type=backup f=d

                     Policy Domain Name: VM_DOM
                        Policy Set Name: ACTIVE
                        Mgmt Class Name: STANDARD
                        Copy Group Name: STANDARD
                        Copy Group Type: Backup
                   Versions Data Exists: 3
                  Versions Data Deleted: 3
                  Retain Extra Versions: 75
                    Retain Only Version: 75
                              Copy Mode: Modified
                     Copy Serialization: Shared Static
                         Copy Frequency: 0
                       Copy Destination: VMPOOL
    Table of Contents (TOC) Destination:
         Last Update by (administrator): ADMIN
                  Last Update Date/Time: 04/11/2016 16:34:11
                       Managing profile:
                        Changes Pending: No

                     Policy Domain Name: VM_DOM
                        Policy Set Name: STANDARD
                        Mgmt Class Name: STANDARD
    more...   (<ENTER> to continue, 'C' to cancel)

                        Copy Group Name: STANDARD
                        Copy Group Type: Backup
                   Versions Data Exists: 3
                  Versions Data Deleted: 3
                  Retain Extra Versions: 75
                    Retain Only Version: 75
                              Copy Mode: Modified
                     Copy Serialization: Shared Static
                         Copy Frequency: 0
                       Copy Destination: VMPOOL
    Table of Contents (TOC) Destination:
         Last Update by (administrator): ADMIN
                  Last Update Date/Time: 04/11/2016 16:34:11
                       Managing profile:
                        Changes Pending: No

    here also no change pending.

    your below statement is almost correct.

    And it appears you perform a VMware backups to local disk, then TSM Client Archive, then delete the VMDK from vSphere, and then you want to Retrieve an Archived VMDK using the TSM Client to the vSphere server.

    although same setting is configured for all other copygroup but only this copygroup data is moving into archive.

    I am attaching the snapshot for other copygroup also fort better clarification.

    tsm: ITSM01>q copy vmmonth type=archive f=d
    ANR2034E QUERY COPYGROUP: No match found using this criteria.
    ANS8001I Return code 11.

    tsm: ITSM01>q copy vmweek type=archive f=d
    ANR2034E QUERY COPYGROUP: No match found using this criteria.
    ANS8001I Return code 11.

     

    Regards

    Prem



  • 8.  RE: Restore vs Archive

    Posted Wed February 01, 2017 05:32 AM

    Hi Robert,

    Any other suggestions i have shared all the requested details with you.

     

    Prem

     

    Prem



  • 9.  RE: Restore vs Archive

    Posted Wed February 01, 2017 09:18 AM

    VMs are backed up, not archived.  You may have been doing archives, but they are not archives of VM.

    If you want your backups to be kept for 75 days (have 75 restore points), you need to update the BACKUP copygroup with:
    retver=0  (unlimited)
    retextra=75   (days)

    source:  https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Tivoli%20Storage%20Manager/page/DP%20for%20VMWare%20FAQ%20for%20Tivoli%20Storage%20Manager%20for%20Virtual%20Environments?section=Q11a%20retention

     

    With the current retver=3, you only have the last 3 versions, so with daily backups, you can only go back 3 days.  retver and retextra work together, the first one that is exceeded makes the oldest backup expire.  So you can't have more than 3 versions and no more than 75 days.  If you did backups every 25 days, your oldest version could be 75 days because you would not exceed 3 versions.



  • 10.  RE: Restore vs Archive

    Posted Wed February 01, 2017 09:34 AM

    I see you may have been using the BA client to archive VMDK files, but not performed a backup VM.  So if you are doing backups or archives of VMDK files, we are just talking file backup then, not VMs as far as TSM is concerned.

    Like other have said:
    If you archive data, you use retrieve and affected by archive copygroup
    If you backup data, you use restore and affected by backup copygroup
    If you backup vm,  you use restomre vm

    Also, you try to do an archive, and there is no archive copy group in the management class you are using, the archive will fail.  Not sure which management class you are using, but the output you pasted showed that some did not have an archive copygroup.

    So I think we need to circle back to the beginning and we need to know exactly how you are doing:
    1 - archive of vmdk files?
    2 - backup of vmdk files?
    3 - backup of VM using TSM for VE?

    If you are doing 1 or 2 (or both), what are the commands you are using?  Or if using a schedule, what does the schedule do: q sched {domain} {schedule} f=d

    If 3, go to my earlier post about retention.



  • 11.  RE: Restore vs Archive

    Posted Thu February 02, 2017 12:30 AM

    Hi Marc,

    I have no words to describe how helpful you are, thank you for the response. I am doing backup of vmdk files. first it come into my local disk then move into tape from another schedule. let me paste here both the details.

    Schedule details-

    tsm: ITSM01>q sched vm_dom dc_bkp f=d
    Session established with server ITSM01: Windows
      Server Version 5, Release 5, Level 6.100
      Server date/time: 02/02/2017 10:44:50  Last access: 02/02/2017 09:47:02


                Policy Domain Name: VM_DOM
                     Schedule Name: DC_BKP
                       Description: Daily Image Level backup for DC
                            Action: Command
                           Options:
                           Objects: e:\vcb\scripts\dc.cmd
                          Priority: 5
                   Start Date/Time: 08/02/2016 18:00:00
                          Duration: 10 Minute(s)
                    Schedule Style: Classic
                            Period: 1 Day(s)
                       Day of Week: Any
                             Month:
                      Day of Month:
                     Week of Month:
                        Expiration:
    Last Update by (administrator): PREM
             Last Update Date/Time: 08/02/2016 22:18:07
                  Managing profile:

    Batch file content -

    c:
    cd \
    cd Program Files (x86)
    cd VMware
    cd VMware Consolidated Backup Framework

    vcbMounter.exe -h 10.50.59.73 -u test -p abcd1234 -a ipaddr:10.50.58.51 -t fullvm -r g:\VCB\dc -m san

     

    But alt east 3 version should display under restore point. which i understand.

    Prem



  • 12.  RE: Restore vs Archive

    Posted Thu February 02, 2017 12:46 AM

    Hi Marc,

    additionally let me share the schedule details how it's moving vmdk file into tape.

    schedule details-

    tsm: ITSM01>q sched vm_dom tsm_vcb_g_drive f=d

                Policy Domain Name: VM_DOM
                     Schedule Name: TSM_VCB_G_DRIVE
                       Description:
                            Action: Selective
                           Options:
                           Objects: g:\vcb\*.*
                          Priority: 5
                   Start Date/Time: 09/23/2014 13:00:00
                          Duration: 1 Hour(s)
                    Schedule Style: Classic
                            Period: 1 Day(s)
                       Day of Week: Any
                             Month:
                      Day of Month:
                     Week of Month:
                        Expiration:
    Last Update by (administrator): ADMIN
             Last Update Date/Time: 09/23/2014 12:46:23
                  Managing profile:

     

    Prem



  • 13.  RE: Restore vs Archive

    Posted Thu February 02, 2017 07:11 AM

    Ok, so a straight file backup (meaning it's using the backup copygroup settings).  So no archives involved.

    So, when you go in the baclient GUI and click on Restore, do you click on View -> Display Active/Inactive Files?

    Active being the most current backup
    Inactive being previous ones.



  • 14.  RE: Restore vs Archive

    Posted Thu February 02, 2017 09:41 AM

    Hi Marc,

    When i go into BA client and check on active/inactive files I could not see any active backup for DC although one adc backup is showing but that is also very old it is showing the backup date of 2016. But at the same time other backup which is schedule for monthly and weekly it is showing inactive which is fare enough but when i see on archive option the latest backup of DC as well ADC which is part of vm_dom domain policy reflecting.

    I am attaching the snapshot for reference.when you go into snapshot 3 you will find sqldbbackup is also reflecting under Archive option that is part of different domain policy and devclass .

     

    Prem 



  • 15.  RE: Restore vs Archive

    Posted Thu February 02, 2017 09:59 AM

    Hi Prem,

     

    Ok, looks like you are doing Archives too.  The schedules you shared did not show that, but that's fine.  I can't explain why you are not seeing what you are expecting to see.  The only thing I can say is check the dsmsched.log to see if your backups and archives were successful.

    The other thing, is backups are totally independent of archives. Two different things for different purposes.  Backups, once taken remain backups until they expire and archives once taken remain archives until they expire.  They have no interaction with one another.  A backup cannot become and archive or vice-versa.



  • 16.  RE: Restore vs Archive

    Posted Thu February 02, 2017 11:21 AM

    Hi Marc, 

    I am just expecting the backup should show under restore and I am not doing any manual archive and i have shared the configuration also it also doesn't show any archive settings, i have checked the logs also but nothing indicates over there also.my only worry is how i will restore the backup from archive if required.

     

    Prem



  • 17.  RE: Restore vs Archive

    Posted Thu February 02, 2017 11:26 AM

    You can't restore an archive,  you can only retrieve an archive.

    So if you don't see your backups in the restore window, either the backups failed or expired.  It's also possible that the script that prepares your data failed and the directory was empty, that's why TSM backed up nothing.

    In Reply to Prem Singh:

    Hi Marc, 

    I am just expecting the backup should show under restore and I am not doing any manual archive and i have shared the configuration also it also doesn't show any archive settings, i have checked the logs also but nothing indicates over there also.my only worry is how i will restore the backup from archive if required.

     

    Prem



  • 18.  RE: Restore vs Archive

    Posted Mon February 06, 2017 12:31 AM

    Hi Marc,

    Good day ! I am happy to convey that my purpose got resolved after making below change on schedule configuration now my backup is reflecting under restore a big thank you to all of you for your precious advice and support. I have highlighted on red what i change.


               Policy Domain Name: VM_DOM
                    Schedule Name: TSM_VCB_G_DRIVE
                      Description: Move VMDK file G drive TO LTO
                           Action: Incremental
                          Options: -subdir=yes
                          Objects: g:\vcb\*.*
                         Priority: 5
                  Start Date/Time: 09/23/2014 13:00:00
                         Duration: 1 Hour(s)
                   Schedule Style: Classic
                           Period: 1 Day(s)
                      Day of Week: Any
                            Month:
                     Day of Month:
                    Week of Month:
                       Expiration:
    ast Update by (administrator): PREM
            Last Update Date/Time: 02/04/2017 12:42:06
                 Managing profile:

     

    Prem



  • 19.  RE: Restore vs Archive

    Posted Fri February 10, 2017 10:28 PM

    Hi Marc/Everyone,

    Everyone need your help something went wrong and it is very serious now recently I have assign a LUN to tsm server and created one drive called O for some other task I put the lotus server backup on that drive and now what i can see i was closing monitoring my tsm and found that O drive backup is moved automatically on TSM O drive backup also started reflecting on TSM . When i launch ba client under Archive option whole 700 gb backup was reflecting now i have no clue without taking backup manually or any other way how the local system data moved into tsm. I do not want any backup should archive. because I have no such requirement. let me attach the snapshot for your reference. My tapes are filling very fast could not able to understand where is the issue why every thing is archiving. Pls help me out.

    Copygroup -

    tsm: ITSM01>q copy vm_dom f=d

                     Policy Domain Name: VM_DOM
                        Policy Set Name: ACTIVE
                        Mgmt Class Name: STANDARD
                        Copy Group Name: STANDARD
                        Copy Group Type: Backup
                   Versions Data Exists: 1
                  Versions Data Deleted: 1
                  Retain Extra Versions: 7
                    Retain Only Version: 7
                              Copy Mode: Modified
                     Copy Serialization: Shared Static
                         Copy Frequency: 0
                       Copy Destination: VMPOOL
    Table of Contents (TOC) Destination:
         Last Update by (administrator): PREM
                  Last Update Date/Time: 02/10/2017 12:38:10
                       Managing profile:
                        Changes Pending: No

                     Policy Domain Name: VM_DOM
                        Policy Set Name: STANDARD
                        Mgmt Class Name: STANDARD
    more...   (<ENTER> to continue, 'C' to cancel)

                        Copy Group Name: STANDARD
                        Copy Group Type: Backup
                   Versions Data Exists: 1
                  Versions Data Deleted: 1
                  Retain Extra Versions: 7
                    Retain Only Version: 7
                              Copy Mode: Modified
                     Copy Serialization: Shared Static
                         Copy Frequency: 0
                       Copy Destination: VMPOOL
    Table of Contents (TOC) Destination:
         Last Update by (administrator): PREM
                  Last Update Date/Time: 02/10/2017 12:38:10
                       Managing profile:
                        Changes Pending: No

    Prem



  • 20.  RE: Restore vs Archive

    Posted Fri February 10, 2017 10:35 PM

    additionally this is the domain policy which is helping to move the data into tape here i can see archive option.

    tsm: ITSM01>QUERY COPYGROUP   VM_DOM   TYPE=ARCHIVE  FORMAT=DETAIL

                Policy Domain Name: VM_DOM
                   Policy Set Name: ACTIVE
                   Mgmt Class Name: STANDARD
                   Copy Group Name: STANDARD
                   Copy Group Type: Archive
                    Retain Version: 365
              Retention Initiation: Creation
               Retain Minimum Days:
                Copy Serialization: Shared Static
                    Copy Frequency: CMD
                         Copy Mode: Absolute
                  Copy Destination: VMPOOL
    Last Update by (administrator): ADMIN
             Last Update Date/Time: 12/20/2010 21:50:03
                  Managing profile:
                   Changes Pending: No

                Policy Domain Name: VM_DOM
                   Policy Set Name: STANDARD
                   Mgmt Class Name: STANDARD
                   Copy Group Name: STANDARD
                   Copy Group Type: Archive
    more...   (<ENTER> to continue, 'C' to cancel)

                    Retain Version: 365
              Retention Initiation: Creation
               Retain Minimum Days:
                Copy Serialization: Shared Static
                    Copy Frequency: CMD
                         Copy Mode: Absolute
                  Copy Destination: VMPOOL
    Last Update by (administrator): ADMIN
             Last Update Date/Time: 12/20/2010 21:50:03
                  Managing profile:
                   Changes Pending: No


    tsm: ITSM01>

    Prem