Hey Experts,

I am really in a big trouble my backup is not functioning at all. Automated backup as well as I tried manually also nothing is working. it shows server out of data storage space although statement is not true. I am attaching the log for better reference.

 

Regards

Prem

 

Hi,

Surprisngly on a different class tape is mounting, now i am confused totally from where to start searching the issue.

tsm: ITSM01>q mo
ANR8330I LTO volume KG1650L4 is mounted R/W in drive DRIVE1 (mt0.0.0.6),
status: IN USE.
ANR8334I         1 matches found.

 

Regards

Prem

Prem,

Look at your stgpool setting, it is controlled by how many scratch tapes you allow and how many are used. I am guessing if you will see that the number you set for maxscratch is the same as ‘Number of scratch volumes used’.

Command: Update stgp xxxxx maxscratch=###

tsm: MSPRBK102>q stgp case_ltp f=d

Storage Pool Name: CASE_LTP
Storage Pool Type: Primary
Device Class Name: LTOB
Estimated Capacity: 2,225,303 G
Space Trigger Util:
Pct Util: 9.5
Pct Migr: 23.0
Pct Logical: 100.0
High Mig Pct: 90
Low Mig Pct: 70
Migration Delay: 0
Migration Continue: Yes
Migration Processes: 1
Reclamation Processes: 1
Next Storage Pool:
Reclaim Storage Pool:
Maximum Size Threshold: No Limit
Access: Read/Write
Description:
Overflow Location:
Cache Migrated Files?:
Collocate?: No
Reclamation Threshold: 100
Offsite Reclamation Limit:
Maximum Scratch Volumes Allowed: 1,000
Number of Scratch Volumes Used: 230
Delay Period for Volume Reuse: 0 Day(s)
Migration in Progress?: No
Amount Migrated (MB): 0.00
Elapsed Migration Time (seconds): 0
Reclamation in Progress?: No
Last Update by (administrator): SYSTEM
Last Update Date/Time: 11/02/2016 04:00:19
Storage Pool Data Format: Native
Copy Storage Pool(s):
Active Data Pool(s):
Continue Copy on Error?: Yes
CRC Data: No
Reclamation Type: Threshold
Overwrite Data when Deleted:
Deduplicate Data?: No
Processes For Identifying Duplicates:
Duplicate Data Not Stored:
Auto-copy Mode: Client
Contains Data Deduplicated by Client?: No
Deduplicate Requires Backup?:

From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 02, 2016 5:43 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space


Hi,

Surprisngly on a different class tape is mounting, now i am confused totally from where to start searching the issue.

tsm: ITSM01>q mo
ANR8330I LTO volume KG1650L4 is mounted R/W in drive DRIVE1 (mt0.0.0.6),
status: IN USE.
ANR8334I 1 matches found.



Regards

Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Brenda,

No, I have checked and verified that's not same. you can see below one empty tape is already assigned to that pool. moreover you can see on the 3rd snapshot you will find many volume is showing filling, usually it shows when data is moving/copying into those volumes these tapes i assigned recently to the same pool but after sometimes it automatically change the volume status to unavailable. I am attching the log file also, looking forward for your input on this. when you will see the log after 4 PM today you will find i have assigned those tapes to that stgpool but it went unavailable automatically.

tsm: ITSM01>q stg vmpool f=d

               Storage Pool Name: VMPOOL
               Storage Pool Type: Primary
               Device Class Name: LTO_CLASS_1
              Estimated Capacity: 43,797 G
              Space Trigger Util:
                        Pct Util: 12.4
                        Pct Migr: 50.0
                     Pct Logical: 99.8
                    High Mig Pct: 90
                     Low Mig Pct: 70
                 Migration Delay: 0
              Migration Continue: Yes
             Migration Processes: 1
           Reclamation Processes: 1
               Next Storage Pool:
            Reclaim Storage Pool:
          Maximum Size Threshold: No Limit
                          Access: Read/Write
                     Description: Vmware Image Level backup
               Overflow Location:
           Cache Migrated Files?:
                      Collocate?: Group
           Reclamation Threshold: 60
       Offsite Reclamation Limit:
 Maximum Scratch Volumes Allowed: 9
  Number of Scratch Volumes Used: 2
   Delay Period for Volume Reuse: 0 Day(s)
          Migration in Progress?: No
            Amount Migrated (MB): 0.00
Elapsed Migration Time (seconds): 0
        Reclamation in Progress?: No
  Last Update by (administrator): ADMIN
           Last Update Date/Time: 08/03/2016 15:22:10
        Storage Pool Data Format: Native
            Copy Storage Pool(s):
             Active Data Pool(s):
         Continue Copy on Error?: Yes
                        CRC Data: No
                Reclamation Type: Threshold
     Overwrite Data when Deleted:

tsm: ITSM01>q v stg=vmpool access=readw

Volume Name               Storage      Device      Estimated    Pct   Volume
                          Pool Name    Class Name   Capacity   Util   Status
------------------------  -----------  ----------  ---------  -----  --------
KG3856L4                  VMPOOL       LTO_CLASS-      1.1 T    0.0    Full
                                        _1
KG3857L4                  VMPOOL       LTO_CLASS-      1.2 T    0.2    Full
                                        _1
KG3858L4                  VMPOOL       LTO_CLASS-      1.1 T    0.0    Full
                                        _1
KG5045L4                  VMPOOL       LTO_CLASS-      0.0 M    0.0   Empty
                                        _1
KG5069L4                  VMPOOL       LTO_CLASS-      1.1 T   64.9    Full
                                        _1

tsm: ITSM01>q libvol

Library Name Volume Name Status           Owner      Last Use  Home    Device
                                                               Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
3573LIB      CI2980L4    Private          ITSM01               4,103
3573LIB      JK9749L4    Private          ITSM01               4,109
3573LIB      JK9779L4    Private          ITSM01               4,110
3573LIB      KG1650L4    Private          ITSM01     Data      4,102
3573LIB      KG1656L4    Private          ITSM01               4,113
3573LIB      KG1657L4    Private          ITSM01               4,100
3573LIB      KG1658L4    Private          ITSM01               4,099
3573LIB      KG1660L4    Private          ITSM01               4,098
3573LIB      KG5041L4    Private          ITSM01     Data      4,116
3573LIB      KG5042L4    Private          ITSM01               4,106
3573LIB      KG5044L4    Private          ITSM01     Data      4,105
3573LIB      KG5045L4    Private          ITSM01     Data      4,108
3573LIB      KG5046L4    Private          ITSM01     Data      4,096
3573LIB      KG5047L4    Private          ITSM01     Data      4,104
3573LIB      KG5048L4    Private          ITSM01               4,112
3573LIB      NJ3085L4    Private          ITSM01               4,117
3573LIB      NJ9302L4    Private          ITSM01               4,101

 

Regards

Prem

Brenda,

I have updated maxscratch=100 now .

 

Prem

Hi Prem,

I highlighted some different issues in your log that you sent. See attached.

1. No drive available to label a volume & check it in.

2. I/O error reading labels due to tape unavailable.

3. I/O error reading label on scratch tape. It is now changed to private and telling you there are no scratch tapes available. (Not sure which pool it is trying to get the tape from.)

4. Tape trying to mount could not be mounted due to not being available.


I know you are checking tapes out but I do not know at what point. Here is the problem that I think you are running into.

tsm: ITSM01>q stg vmpool f=d

Storage Pool Name: VMPOOL
Storage Pool Type: Primary
Device Class Name: LTO_CLASS_1
Estimated Capacity: 43,797 G
Space Trigger Util:
Pct Util: 12.4
Pct Migr: 50.0
Pct Logical: 99.8
High Mig Pct: 90
Low Mig Pct: 70
Migration Delay: 0
Migration Continue: Yes
Migration Processes: 1
Reclamation Processes: 1
Next Storage Pool:
Reclaim Storage Pool:
Maximum Size Threshold: No Limit
Access: Read/Write
Description: Vmware Image Level backup
Overflow Location:
Cache Migrated Files?:
Collocate?: Group


This setting is default when you set up a new primary pool. Why IBM made it default, I have no idea because it should not be that way. If you do not set up collocation groups, this setting means it will collocate each node separately. This means that if you have 50 servers, the system could request 50 different tapes, one for each server. It then will also want to add data for a node to that same tape until it is full so it will request the same tape every day to add more data to it. If you are checking tapes out of the library, the tapes are not available. This causes your mounts & backup jobs to fail because they consistently will keep asking for the same tape.

I am pretty sure you are in this position now. Change this setting immediately and see if things run better.

Update stgp xxx col=no

Then the new backup jobs will take whatever scratch tapes are available.

I am not sure if I explained this very well but if you have questions, let me know.






From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 02, 2016 9:36 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space


Brenda,

I have updated maxscratch=100 now .



Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Brenda,

You have describe it very clearly, I was thinking here and there then I thought lets run a Audit on Library then also I find the same error which you pointed.

2016-11-02 20:39:33    ANR8308I    056: LTO volume KG3856L4 is required for use in library 3573LIB; CHECKIN LIBVOLUME required within 15 minutes.
2016-11-02 20:40:33    ANR8308I    056: LTO volume KG3856L4 is required for use in library 3573LIB; CHECKIN LIBVOLUME required within 14 minutes.
2016-11-02 20:41:33    ANR8308I    056: LTO volume KG3856L4 is required for use in library 3573LIB; CHECKIN LIBVOLUME required within 13 minutes.
2016-11-02 20:42:33    ANR8308I    056: LTO volume KG3856L4 is required for use in library 3573LIB; CHECKIN LIBVOLUME required within 12 minutes.
2016-11-02 20:43:33    ANR8308I    056: LTO volume KG3856L4 is required for use in library 3573LIB; CHECKIN LIBVOLUME required within 11 minutes.

It's trying to search the volume which is not available. let me try the option which you suggested, you are really a life saver right now.

 

Prem

Brenda,

 I did updated to col=no after that the immediate change what i can see is the 5-6 new volume which is showing under libvol now it's not showing.

tsm: ITSM01>q libvol

Library Name Volume Name Status           Owner      Last Use  Home    Device
                                                               Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
3573LIB      CI2980L4    Private          ITSM01               4,103
3573LIB      JK9749L4    Private          ITSM01               4,109
3573LIB      JK9779L4    Private          ITSM01               4,110
3573LIB      KG1650L4    Private          ITSM01     Data      4,102
3573LIB      KG1656L4    Private          ITSM01               4,113
3573LIB      KG1657L4    Private          ITSM01               4,100
3573LIB      KG1658L4    Private          ITSM01               4,099
3573LIB      KG1660L4    Private          ITSM01               4,098
3573LIB      KG5041L4    Private          ITSM01     Data      4,116
3573LIB      NJ3085L4    Private          ITSM01               4,117
3573LIB      NJ9302L4    Private          ITSM01               4,101

after that I ran the command to search the scratch tape, I am assuming that TSM has to read the label once again but my guess was wrong.

checkin libvol 3573lib search=bulk status=private checklabel=yes

checkin libvol 3573lib search=bulk status=scratch checklabel=yes

After running the above command still it's not recongnizing the tapes which is disappear from libvol.

 

Regards

Prem

Command to upgrade status: Update libvol itsm01 cI2980l4 status=scratch

Change status on all of the tapes that do not say ‘Data’ by them. These tapes are in the library but are scratch tapes but were marked unavailable I am guessing.

Once you have done that, run : audit library itsm01 checkl=barcode

It should pick up any other scratch tapes that may be in the library when it does the audit.

Tips:

· If you have tapes in the I/O door, you can use ‘search=bulk’. If the tapes are already in the library and still need to be checked in, you need to use ‘search=yes.

· If you use the checklabel=yes, it will want to mount each tape to check the label. If you use the checklabel=barcode, the library will just scan the tapes.

Brenda

From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 02, 2016 10:46 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space


Brenda,

I did updated to col=no after that the immediate change what i can see is the 5-6 new volume which is showing under libvol now it's not showing.

tsm: ITSM01>q libvol

Library Name Volume Name Status Owner Last Use Home Device
Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
3573LIB CI2980L4 Private ITSM01 4,103
3573LIB JK9749L4 Private ITSM01 4,109
3573LIB JK9779L4 Private ITSM01 4,110
3573LIB KG1650L4 Private ITSM01 Data 4,102
3573LIB KG1656L4 Private ITSM01 4,113
3573LIB KG1657L4 Private ITSM01 4,100
3573LIB KG1658L4 Private ITSM01 4,099
3573LIB KG1660L4 Private ITSM01 4,098
3573LIB KG5041L4 Private ITSM01 Data 4,116
3573LIB NJ3085L4 Private ITSM01 4,117
3573LIB NJ9302L4 Private ITSM01 4,101

after that I ran the command to search the scratch tape, I am assuming that TSM has to read the label once again but my guess was wrong.

checkin libvol 3573lib search=bulk status=private checklabel=yes

checkin libvol 3573lib search=bulk status=scratch checklabel=yes

After running the above command still it's not recongnizing the tapes which is disappear from libvol.



Regards

Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Brenda,

I follow your instruction the volume status went into scratch for a while after that I started  a manual backup from GUI but the result is same now all the volume started showing private in LIbvol.

tsm: ITSM01>q libvol

Library Name Volume Name Status           Owner      Last Use  Home    Device
                                                               Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
3573LIB      CI2980L4    Private          ITSM01               4,103
3573LIB      JK9749L4    Private          ITSM01               4,109
3573LIB      JK9779L4    Private          ITSM01               4,110
3573LIB      KG1650L4    Private          ITSM01     Data      4,102
3573LIB      KG1656L4    Private          ITSM01               4,113
3573LIB      KG1657L4    Private          ITSM01               4,100
3573LIB      KG1658L4    Private          ITSM01               4,099
3573LIB      KG1660L4    Private          ITSM01               4,098
3573LIB      KG5041L4    Private          ITSM01     Data      4,116
3573LIB      KG5042L4    Private          ITSM01               4,111
3573LIB      KG5043L4    Private          ITSM01               4,107
3573LIB      KG5044L4    Private          ITSM01               4,105
3573LIB      KG5045L4    Private          ITSM01               4,108
3573LIB      KG5046L4    Private          ITSM01               4,096
3573LIB      KG5047L4    Private          ITSM01               4,104
3573LIB      KG5048L4    Private          ITSM01               4,112
3573LIB      NJ3085L4    Private          ITSM01               4,117
3573LIB      NJ9302L4    Private          ITSM01               4,101

Attaching the new log file also.

 

Prem

Please send me output of: q vol * f=d

Also, send me: q volhis

Try to check out kg5045l4 with : checkout libvol 3573lib kg5045l4 remove=bulk

Then when the tape is checked out completely, it will be in the I/O door. Remove from the door and re-insert it so the library knows it is coming back in.

Run this command: label livol 3573lib kg5045l4 checkin=scratch overwrite=yes

Let me know if that checks in as a scratch tape then.

Sorry about all the hassle!

From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 02, 2016 12:03 PM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space


Brenda,

I follow your instruction the volume status went into scratch for a while after that I started a manual backup from GUI but the result is same now all the volume started showing private in LIbvol.

tsm: ITSM01>q libvol

Library Name Volume Name Status Owner Last Use Home Device
Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
3573LIB CI2980L4 Private ITSM01 4,103
3573LIB JK9749L4 Private ITSM01 4,109
3573LIB JK9779L4 Private ITSM01 4,110
3573LIB KG1650L4 Private ITSM01 Data 4,102
3573LIB KG1656L4 Private ITSM01 4,113
3573LIB KG1657L4 Private ITSM01 4,100
3573LIB KG1658L4 Private ITSM01 4,099
3573LIB KG1660L4 Private ITSM01 4,098
3573LIB KG5041L4 Private ITSM01 Data 4,116
3573LIB KG5042L4 Private ITSM01 4,111
3573LIB KG5043L4 Private ITSM01 4,107
3573LIB KG5044L4 Private ITSM01 4,105
3573LIB KG5045L4 Private ITSM01 4,108
3573LIB KG5046L4 Private ITSM01 4,096
3573LIB KG5047L4 Private ITSM01 4,104
3573LIB KG5048L4 Private ITSM01 4,112
3573LIB NJ3085L4 Private ITSM01 4,117
3573LIB NJ9302L4 Private ITSM01 4,101

Attaching the new log file also.



Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

 

Hi Brenda,

Pls don't be sorry you are trying your best, I am trying my best. I am attaching the output of requested details, just one thing after updating the stgpool from below syntax one more change I observerd all the tapes from that pool moved into unavailable mode.

upd stg vmpool col=no

I tried to checking and checkout that tape but don't have option to physically take out from Library as suggested by you becuase the DC is almost 50 KM far from my location, today I am going there with Fresh new Tape, lets see how it goes.

Thank you very much for the continuous response and help.

Just one thing I did before landing the issue on my head is updating one volume which is assoicated with that pool where we are facing issue right now.

upd v kg5070l4 access=readw loc=offsite wherestatus=full

Regards

Prem

Can you send me a ‘q libvol’ as well please?

From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Thursday, November 03, 2016 12:40 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space




Hi Brenda,

Pls don't be sorry you are trying your best, I am trying my best. I am attaching the output of requested details, just one thing after updating the stgpool from below syntax one more change I observerd all the tapes from that pool moved into unavailable mode.

upd stg vmpool col=no

I tried to checking and checkout that tape but don't have option to physically take out from Library as suggested by you becuase the DC is almost 50 KM far from my location, today I am going there with Fresh new Tape, lets see how it goes.

Thank you very much for the continuous response and help.

Just one thing I did before landing the issue on my head is updating one volume which is assoicated with that pool where we are facing issue right now.

upd v kg5070l4 access=readw loc=offsite wherestatus=full

Regards

Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Hi,

Pls find the output of Q libvol.

tsm: ITSM01>q libvol

Library Name Volume Name Status           Owner      Last Use  Home    Device
                                                               Element Type
------------ ----------- ---------------- ---------- --------- ------- ------
3573LIB      CI2980L4    Private          ITSM01               4,103
3573LIB      JK9749L4    Private          ITSM01               4,109
3573LIB      JK9779L4    Private          ITSM01               4,110
3573LIB      KG1650L4    Private          ITSM01     Data      4,102
3573LIB      KG1656L4    Private          ITSM01     Data      4,113
3573LIB      KG1657L4    Private          ITSM01               4,100
3573LIB      KG1658L4    Private          ITSM01               4,099
3573LIB      KG1660L4    Private          ITSM01               4,098
3573LIB      KG5041L4    Private          ITSM01     Data      4,116
3573LIB      KG5042L4    Private          ITSM01               4,111
3573LIB      KG5043L4    Scratch                               4,107
3573LIB      KG5044L4    Scratch                               4,105
3573LIB      KG5045L4    Scratch                               4,108
3573LIB      KG5046L4    Private          ITSM01               4,096
3573LIB      KG5047L4    Scratch                               4,104
3573LIB      KG5048L4    Scratch                               4,112
3573LIB      NJ3085L4    Private          ITSM01               4,117
3573LIB      NJ9302L4    Private          ITSM01               4,101

 

Regards

Prem

Hi Brenda,

The good news is it is been fixed after repeated tries ,although this is not the right platform but I am writing here you are very helpful no doubt on that, whenever you are in India a big treat from my side to you. do let me know whenever you are in India. I am attaching the log file here but still I have not much clarity how it is resolved, according to my understanding the issue occur becuase of wrong process of inserting and ejecting tapes from library.

waiting for your take on this.

Prem

Brenda,

Surprisgly this issue occur once again I was monitoring the sever yesterday afternoon I found the same issue . I am attaching the log for reference.

Once the previous volume which is in use has full after that it tries to find the scratch volume and once again it is not able to read the label and went

unavailable .

 

Log-

11/09/2016 16:37:39      ANR0406I Session 10779 started for node BIS (WinNT)       
                          (Tcp/Ip VCMS-TSM.viomnetworks.com(54644)). (SESSION:     
                          10779)                                                   
11/09/2016 16:37:39      ANR0403I Session 10779 ended for node BIS (WinNT).        
                          (SESSION: 10779)                                         
11/09/2016 16:40:25      ANR8341I End-of-volume reached for LTO volume KG1650L4.   
                          (SESSION: 10769)                                         
11/09/2016 16:40:29      ANR0514I Session 10769 closed volume KG1650L4. (SESSION:  
                          10769)                                                   
11/09/2016 16:40:35      ANR8336I Verifying label of LTO volume KG1650L4 in drive  
                          DRIVE1 (mt0.0.0.6). (SESSION: 10769)                     
11/09/2016 16:41:27      ANR8468I LTO volume KG1650L4 dismounted from drive DRIVE1
                          (mt0.0.0.6) in library 3573LIB. (SESSION: 10769)         
11/09/2016 16:42:14      ANR8355E I/O error reading label for volume KG5042L4 in   
                          drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)               
11/09/2016 16:42:58      ANR8381E LTO volume KG5042L4 could not be mounted in drive
                          DRIVE1 (mt0.0.0.6). (SESSION: 10769)                     
11/09/2016 16:42:58      ANR1402W Mount request denied for volume KG5042L4 - volume
                          unavailable. (SESSION: 10769)                            
11/09/2016 16:42:58      ANR1410W Access mode for volume KG5042L4 now set to       
                          "unavailable". (SESSION: 10769)                          
11/09/2016 16:43:39      ANR8355E I/O error reading label for volume KG5045L4 in   
                          drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)               
11/09/2016 16:44:22      ANR8778W Scratch volume KG5045L4 changed to Private Status
                          to prevent re-access. (SESSION: 10769)                   
11/09/2016 16:45:06      ANR8355E I/O error reading label for volume KG5047L4 in   
                          drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)               
11/09/2016 16:45:49      ANR8778W Scratch volume KG5047L4 changed to Private Status
                          to prevent re-access. (SESSION: 10769)                   
11/09/2016 16:46:33      ANR8355E I/O error reading label for volume KG5043L4 in   
                          drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)               
11/09/2016 16:47:18      ANR8778W Scratch volume KG5043L4 changed to Private Status
                          to prevent re-access. (SESSION: 10769)                   
11/09/2016 16:47:59      ANR8355E I/O error reading label for volume KG5048L4 in   
                          drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)               
11/09/2016 16:48:42      ANR8778W Scratch volume KG5048L4 changed to Private Status
                          to prevent re-access. (SESSION: 10769)                   
11/09/2016 16:48:42      ANR1405W Scratch volume mount request denied - no scratch
                          volume available. (SESSION: 10769)                       
11/09/2016 16:49:22      ANR8337I LTO volume KG5041L4 mounted in drive DRIVE1      
                          (mt0.0.0.6). (SESSION: 10769)                            
11/09/2016 16:49:22      ANR0511I Session 10769 opened output volume KG5041L4.     
                          (SESSION: 10769)                                         
11/09/2016 16:50:37      ANR0514I Session 10769 closed volume KG5041L4. (SESSION:  
                          10769)                                                   
11/09/2016 16:50:37      ANR0403I Session 10769 ended for node SQLDB (WinNT).     

 

Regards

Prem

Prem,

Sorry, I have been on call recently and wrapped up in other projects/issues.

When these tapes are put into the library are they brand new tapes? How do you know they are scratch?

Without having the capability of running reclamation, you would almost have to delete the data of the old tapes to ensure that the data is removed once it is expired. If you are not doing this and not doing any reclamation, then the system will not understand that they are scratch.

After the data is gone, you would need to check them in with a ‘label’ command, not just a check-in. What command are you using to check in tapes?

-----------------
Also, I ran across this in your logs:

ANR8325I Dismounting volume KG1656L4 - 30 minute mount
retention expired

You don’t have the ability to wait for a 30 minute mount retention when you are trying to run your environment with 1 drive. The 30 min. is probably a default retention for when the system was set up. I am not sure why anybody wants to waste that much time for a tape to dismount. I have mine set to 3 min.
----------------------------
I am curious what kind of tapes you are using vs. what kind of tape drive you have. Are they compatible?
How many scratch tapes are you able to keep in the library?
When you put new tapes in the library, how to you check them in?

Send me a report with the output from ‘q sys’ and I will see what I can capture from that information.
---------------
If you do a ‘q vol KG5042L4 f=d’, what is the status show of this tape?
If there is data on that tape, do a ‘q content KG5042L4’ and see what that data is?

Do the same for KG5045L4, KG5043L4 AND KG5048L4?

Also, send me a new ‘q volhis’ and I will see if they show up in there.

Brenda

From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 09, 2016 9:08 PM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space


Brenda,

Surprisgly this issue occur once again I was monitoring the sever yesterday afternoon I found the same issue . I am attaching the log for reference.

Once the previous volume which is in use has full after that it tries to find the scratch volume and once again it is not able to read the label and went

unavailable .



Log-

11/09/2016 16:37:39 ANR0406I Session 10779 started for node BIS (WinNT)
(Tcp/Ip VCMS-TSM.viomnetworks.com(54644)). (SESSION:
10779)
11/09/2016 16:37:39 ANR0403I Session 10779 ended for node BIS (WinNT).
(SESSION: 10779)
11/09/2016 16:40:25 ANR8341I End-of-volume reached for LTO volume KG1650L4.
(SESSION: 10769)
11/09/2016 16:40:29 ANR0514I Session 10769 closed volume KG1650L4. (SESSION:
10769)
11/09/2016 16:40:35 ANR8336I Verifying label of LTO volume KG1650L4 in drive
DRIVE1 (mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:41:27 ANR8468I LTO volume KG1650L4 dismounted from drive DRIVE1
(mt0.0.0.6) in library 3573LIB. (SESSION: 10769)
11/09/2016 16:42:14 ANR8355E I/O error reading label for volume KG5042L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:42:58 ANR8381E LTO volume KG5042L4 could not be mounted in drive
DRIVE1 (mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:42:58 ANR1402W Mount request denied for volume KG5042L4 - volume
unavailable. (SESSION: 10769)
11/09/2016 16:42:58 ANR1410W Access mode for volume KG5042L4 now set to
"unavailable". (SESSION: 10769)
11/09/2016 16:43:39 ANR8355E I/O error reading label for volume KG5045L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:44:22 ANR8778W Scratch volume KG5045L4 changed to Private Status
to prevent re-access. (SESSION: 10769)
11/09/2016 16:45:06 ANR8355E I/O error reading label for volume KG5047L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:45:49 ANR8778W Scratch volume KG5047L4 changed to Private Status
to prevent re-access. (SESSION: 10769)
11/09/2016 16:46:33 ANR8355E I/O error reading label for volume KG5043L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:47:18 ANR8778W Scratch volume KG5043L4 changed to Private Status
to prevent re-access. (SESSION: 10769)
11/09/2016 16:47:59 ANR8355E I/O error reading label for volume KG5048L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:48:42 ANR8778W Scratch volume KG5048L4 changed to Private Status
to prevent re-access. (SESSION: 10769)
11/09/2016 16:48:42 ANR1405W Scratch volume mount request denied - no scratch
volume available. (SESSION: 10769)
11/09/2016 16:49:22 ANR8337I LTO volume KG5041L4 mounted in drive DRIVE1
(mt0.0.0.6). (SESSION: 10769)
11/09/2016 16:49:22 ANR0511I Session 10769 opened output volume KG5041L4.
(SESSION: 10769)
11/09/2016 16:50:37 ANR0514I Session 10769 closed volume KG5041L4. (SESSION:
10769)
11/09/2016 16:50:37 ANR0403I Session 10769 ended for node SQLDB (WinNT).



Regards

Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Hi,

I tried to take the manual backup from gui as a test but it's trying to mount the tape from last 20 minutes nothing happened.

tsm: ITSM01>q mo
ANR8379I Mount point in device class LTO_CLASS_1 is waiting for the volume
mount to complete, status: WAITING FOR VOLUME.
ANR8334I         1 matches found.

 

Prem

If you don’t have scratch tapes in the library, it will not run. Update the tapes that are scratch and do another ‘q libvol’ to make sure some show up as scratch.

Cancel that job and start over once you definitely have scratch tapes available.

From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 02, 2016 10:58 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space


Hi,

I tried to take the manual backup from gui as a test but it's trying to mount the tape from last 20 minutes nothing happened.

tsm: ITSM01>q mo
ANR8379I Mount point in device class LTO_CLASS_1 is waiting for the volume
mount to complete, status: WAITING FOR VOLUME.
ANR8334I 1 matches found.



Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Prem,

Here is another message in your activity log that I just noticed.


11/10/2016 05:01:20 ANR0406I Session 10906 started for node VCMS-TSM (WinNT)

(SESSION:

10906)

11/10/2016 05:01:20 ANR0539W Transaction failed for session 10906 for node

VCMS-TSM. This node has exceeded its maximum number of

mount points. (SESSION: 10906)


Enter ‘ q node VCMS-TSM f=d’ and look for number of mountpoints defined. See example below.

tsm: MSPSTG14>q node mdt28084_pm2 f=d

Node Name: MDT28084_PM2
Platform: DB2/AIX64
Client OS Level: 7.1
Client Version: Version 7, release 1, level 0.0
Policy Domain Name: DB_PROD_PT
Last Access Date/Time: 11/15/2016 15:21:56
Days Since Last Access: <1
Password Set Date/Time: 10/24/2012 14:40:03
Days Since Password Set: 1,483
Invalid Sign-on Count: 0
Locked?: No
Contact: DB2
Compression: Client
Archive Delete Allowed?: Yes
Backup Delete Allowed?: Yes
Registration Date/Time: 10/11/2012 18:00:55
Registering Administrator: COLLIB5
Last Communication Method Used: Tcp/Ip
Bytes Received Last Session: 91.35 M
Bytes Sent Last Session: 2,475
Duration of Last Session: 12.69
Pct. Idle Wait Last Session: 0.55
Pct. Comm. Wait Last Session: 93.90
Pct. Media Wait Last Session: 0.00
Optionset:
URL:
Node Type: Client
Password Expiration Period: 0 Day(s)
Keep Mount Point?: No
Maximum Mount Points Allowed: 3


It appears that your node is trying to use 4 sessions and one session failed due to not enough mountpoints defined. If this is a filesystem backup, it is possible in the configuration of the client, they are using the resourceutilization which is defining how many sessions used. In that case, at a minimum, you need to match what they are using. This does also make a difference if you are sending the data to a standard diskpool vs. a diskpool using ‘type=file’.

If it is a database client, you need to talk to the DBA’s regarding how many sessions they use to backup their databases. Then the mountpoints will need to be changed to address that number. (This becomes very important if you were sending data to tape drives using LAN Free processes.)

If you want to go back and see if anymore clients have this issue, you could run the following:
Q actlog begind=1 s=anr0539w

If I am total confusing you, just let me know and I will provide more detail if needed.


Brenda

Brenda,

Thanks a lot for the detail information and you are not confusing me. I will try to answer all the query which you raised.

1. There is no file level backup only VM backup.

2. command which I am using usually while checkin the tape is "checkin libname search=yes status=scratch"

3. what I am doing extra now is runningone more command when scratch tape is in the I/O station.

Command- LABEL LIBVOLUME 3573LIB search=yes labelsource=barcode checkin=scratch overwrite=yes 

4. Max Mount point is allowed is 1 for which node (vcms-tsm) you requested.

What I am guessing is previously someone checkin the tape to ejcting the magzine thats why inventory seems to be corrupted that's my thought.

Additionally I am attaching few output also which you requested. I am attaching one more whenever I insert the new tape or ejecting the used tape this is what i am getting continuosly.

Log-

11/11/2016 12:31:37 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:04 ANR8336I Verifying label of LTO volume KG5042L4 in drive
DRIVE1 (mt0.0.0.6). (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:04 ANR8355E I/O error reading label for volume KG5042L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:04 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:19 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:40 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:48 ANR8437E CHECKOUT LIBVOLUME for volume KG5042L4 in library
3573LIB failed. (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:48 ANR0985I Process 294 for CHECKOUT LIBVOLUME running in the
BACKGROUND completed with completion state FAILURE at 

after all the hit and try I am moving the tape into I/O station and running below command after running checkin command then it's reading the label and updating on Libvol also.

Command-LABEL LIBVOLUME 3573LIB search=yes labelsource=barcode checkin=scratch overwrite=yes 

I was suspecting that kg5042l4 was the culprit that's why i have remove it from the Library.

I am using IBM Library 3100 and tape is IBM LTO4. how i know that is scratch because I am using the new purchase one only if i am using the reused tape then i am deleting it first updating in libvol then only i am using the old tapes. please do let me know if still any clarification required.

 

 

 

Regards

Prem

Prem,


See updates in previous message as well.

Check your stgpools and see what the setting is for this.

Delay Period for Volume Reuse: 0 Day(s)

The output you sent me on ‘KG5048L4’ is strange. It says the tape is empty but it belongs to a stgpool so technically, it is not a scratch tape. It was last updated on 11/10/2016 at 10:28. To look at the actual log to see what happened, you can query it”
Q actlog begind=11/10/2016 begint=10:25 endd=11/10/2016 endt=10:35 s=KG5048L4

If that tape started to get data written on it and then failed, it would show ‘filling’ vs. ‘empty’. If it is showing empty, it could be due to the data on the tape expiring. Again though, I would question why it still belongs to that stgpool. (Unless the reuse delay is set to a number of days.)

If you do a ‘q content’, that will probably show there is no data on the tape. You can get rid of this tape by using the command:
Delete vol ####

You may want to query your stgpools to see if there are more tapes in this state. Q vol * status=empty

If you are running expiration regularly, I would think they would drop off and turn to scratch. If they aren’t in the library though, then that could be where the problem is. It can be deleted manually though with that ‘delete vol’ command. It’s been a while since I worked on this type of issue so I don’t remember exactly the cause of it. I have seen it though and will check my own systems to see if I have any in that state again.

Brenda


From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 16, 2016 1:30 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space - Mountpoint issue.


Brenda,

Thanks a lot for the detail information and you are not confusing me. I will try to answer all the query which you raised.

1. There is no file level backup only VM backup.

2. command which I am using usually while checkin the tape is "checkin libname search=yes status=scratch"

3. what I am doing extra now is runningone more command when scratch tape is in the I/O station.

Command- LABEL LIBVOLUME 3573LIB search=yes labelsource=barcode checkin=scratch overwrite=yes Good! It is better to just just run the ‘label’ command all the time, even with the ‘overwrite=yes’ command, it will not overwrite if there is data on that tape.

4. Max Mount point is allowed is 1 for which node (vcms-tsm) you requested. Change this client to be 6 mount points and see if job runs successfully. VCMS-TSM

What I am guessing is previously someone checkin the tape to ejcting the magzine thats why inventory seems to be corrupted that's my thought.

Additionally I am attaching few output also which you requested. I am attaching one more whenever I insert the new tape or ejecting the used tape this is what i am getting continuosly.

Log-

11/11/2016 12:31:37 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:04 ANR8336I Verifying label of LTO volume KG5042L4 in drive
DRIVE1 (mt0.0.0.6). (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:04 ANR8355E I/O error reading label for volume KG5042L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:04 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:19 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:40 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:48 ANR8437E CHECKOUT LIBVOLUME for volume KG5042L4 in library
3573LIB failed. (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:48 ANR0985I Process 294 for CHECKOUT LIBVOLUME running in the
BACKGROUND completed with completion state FAILURE at

after all the hit and try I am moving the tape into I/O station and running below command after running checkin command then it's reading the label and updating on Libvol also.

Command-LABEL LIBVOLUME 3573LIB search=yes labelsource=barcode checkin=scratch overwrite=yes

I was suspecting that kg5042l4 was the culprit that's why i have remove it from the Library.

I am using IBM Library 3100 and tape is IBM LTO4. how i know that is scratch because I am using the new purchase one only if i am using the reused tape then i am deleting it first updating in libvol then only i am using the old tapes. please do let me know if still any clarification required.







Regards

Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Prem – It could be that the tape is in a read only state. If you change the empty tape to readw, the tape will delete to scratch status.

From: Collins, Brenda [mailto:storage-ti@lists.imwuc.org]
Sent: Thursday, November 17, 2016 8:56 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space - Mountpoint issue.

Prem,


See updates in previous message as well.

Check your stgpools and see what the setting is for this.

Delay Period for Volume Reuse: 0 Day(s)

The output you sent me on ‘KG5048L4’ is strange. It says the tape is empty but it belongs to a stgpool so technically, it is not a scratch tape. It was last updated on 11/10/2016 at 10:28. To look at the actual log to see what happened, you can query it”
Q actlog begind=11/10/2016 begint=10:25 endd=11/10/2016 endt=10:35 s=KG5048L4

If that tape started to get data written on it and then failed, it would show ‘filling’ vs. ‘empty’. If it is showing empty, it could be due to the data on the tape expiring. Again though, I would question why it still belongs to that stgpool. (Unless the reuse delay is set to a number of days.)

If you do a ‘q content’, that will probably show there is no data on the tape. You can get rid of this tape by using the command:
Delete vol ####

You may want to query your stgpools to see if there are more tapes in this state. Q vol * status=empty

If you are running expiration regularly, I would think they would drop off and turn to scratch. If they aren’t in the library though, then that could be where the problem is. It can be deleted manually though with that ‘delete vol’ command. It’s been a while since I worked on this type of issue so I don’t remember exactly the cause of it. I have seen it though and will check my own systems to see if I have any in that state again.

Brenda


From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Wednesday, November 16, 2016 1:30 AM
To: storage-ti@lists.imwuc.org<mailto:storage-ti@lists.imwuc.org>
Subject: [storage-ti] - RE: Server Out of Data Storage Space - Mountpoint issue.


Brenda,

Thanks a lot for the detail information and you are not confusing me. I will try to answer all the query which you raised.

1. There is no file level backup only VM backup.

2. command which I am using usually while checkin the tape is "checkin libname search=yes status=scratch"

3. what I am doing extra now is runningone more command when scratch tape is in the I/O station.

Command- LABEL LIBVOLUME 3573LIB search=yes labelsource=barcode checkin=scratch overwrite=yes Good! It is better to just just run the ‘label’ command all the time, even with the ‘overwrite=yes’ command, it will not overwrite if there is data on that tape.

4. Max Mount point is allowed is 1 for which node (vcms-tsm) you requested. Change this client to be 6 mount points and see if job runs successfully. VCMS-TSM

What I am guessing is previously someone checkin the tape to ejcting the magzine thats why inventory seems to be corrupted that's my thought.

Additionally I am attaching few output also which you requested. I am attaching one more whenever I insert the new tape or ejecting the used tape this is what i am getting continuosly.

Log-

11/11/2016 12:31:37 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:04 ANR8336I Verifying label of LTO volume KG5042L4 in drive
DRIVE1 (mt0.0.0.6). (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:04 ANR8355E I/O error reading label for volume KG5042L4 in
drive DRIVE1 (mt0.0.0.6). (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:04 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:19 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:40 ANR2017I Administrator PREM issued command: QUERY ACTLOG
se=294 begintime=-1 (SESSION: 11197)
11/11/2016 12:32:48 ANR8437E CHECKOUT LIBVOLUME for volume KG5042L4 in library
3573LIB failed. (SESSION: 11197, PROCESS: 294)
11/11/2016 12:32:48 ANR0985I Process 294 for CHECKOUT LIBVOLUME running in the
BACKGROUND completed with completion state FAILURE at

after all the hit and try I am moving the tape into I/O station and running below command after running checkin command then it's reading the label and updating on Libvol also.

Command-LABEL LIBVOLUME 3573LIB search=yes labelsource=barcode checkin=scratch overwrite=yes

I was suspecting that kg5042l4 was the culprit that's why i have remove it from the Library.

I am using IBM Library 3100 and tape is IBM LTO4. how i know that is scratch because I am using the new purchase one only if i am using the reused tape then i am deleting it first updating in libvol then only i am using the old tapes. please do let me know if still any clarification required.







Regards

Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com
-----End Original Message-----

Brenda,

I have check and verify once again volume is on readw mode only. I have check the log also which you refer

tsm: ITSM01>Q actlog begind=11/10/2016 begint=10:25 endd=11/10/2016 endt=10:35 s
=KG5048L4

Date/Time            Message
-------------------- ----------------------------------------------------------
11/10/2016 10:28:40  ANR2017I Administrator PREM issued command: DEFINE VOLUME
                      vmpool kg5048l4  (SESSION: 10959)
11/10/2016 10:28:40  ANR2206I Volume KG5048L4 defined in storage pool VMPOOL
                      (device class LTO_CLASS_1). (SESSION: 10959)

yes my storagepool is set for Delay Period for Volume Reuse: 0 Day(s). I am not able to understand one things everything is going smooth right now also but as soon as the current tape full and it tries to mount the new scratch tape it failed always and change the status to private of scratch tape although these tapes are not assign to any pool.

tsm: ITSM01>run chkscr

SCRATCH_COUNT
-------------
            5
ANR1462I RUN: Command script CHKSCR completed successfully.

 

Currently 5 tapes are scratch which is available in the library current tape where data is filling it is not full yet but once it will full same problem will occur.

 

Regards

Prem

Prem,


Something you may want to do is take those 5 tape volumes and individually check them out (without removing physically from the library).

Checkout libv library_name volume_name remove=no checkl=no


Then check those same tape volumes in using the label command so they get checked back in.

Label libv library_name search=yes labels=barcode checkin=scratch overwrite=yes

I am not quite sure what is going on here but it is very strange behavior. Do you have support with IBM? It might be worth putting in a support call regarding this behavior. I will see what else I can track down. Are these new tapes or did they turn to scratch after being used? If they are new, then I would say the process used to enter the tapes into the library is not right. You should be using ‘label’ command for any new tapes coming in.

Brenda


From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Sunday, November 20, 2016 11:30 PM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space - Mountpoint issue.


Brenda,

I have check and verify once again volume is on readw mode only. I have check the log also which you refer

tsm: ITSM01>Q actlog begind=11/10/2016 begint=10:25 endd=11/10/2016 endt=10:35 s
=KG5048L4

Date/Time Message
-------------------- ----------------------------------------------------------
11/10/2016 10:28:40 ANR2017I Administrator PREM issued command: DEFINE VOLUME
vmpool kg5048l4 (SESSION: 10959)
11/10/2016 10:28:40 ANR2206I Volume KG5048L4 defined in storage pool VMPOOL
(device class LTO_CLASS_1). (SESSION: 10959)

yes my storagepool is set for Delay Period for Volume Reuse: 0 Day(s). I am not able to understand one things are going smooth right now also but as soon as the current tape full and it tries to mount the new scratch tape it failed always and change the status to private although these tapes are not assign to any pool.

tsm: ITSM01>run chkscr

SCRATCH_COUNT
-------------
5
ANR1462I RUN: Command script CHKSCR completed successfully.



Currently 5 tapes are scratch which is available in the library current tape where data is filling it is not full yet but once it will full same problem will occur.



Regards

Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

Brenda,

I followed your instructions checked out and lable those tapes once again, these are scratch tapes.I did not see this kind of behaviour in my 6-7 year experience. But yes I do suspect this issue is occuring becuase of following wrong process to inserting and ejecting tapes. I will update you the same.

I can't log a ticket with IBM support becuase I am using old TSM version which is out of support now.

 

Prem

I understand, I have one of those old TSM servers still in my environment. ☺

I think I had similar issues years ago and I stopped using the check-in command unless we needed to check back in a private tape for a restore. It is situations like these that become opportunities for gaining more trouble-shooting skills. Large or small, every environment has it’s issues. I have worked at a few different companies and there is always something new depending on the size and what they have to deal with for equipment, etc.

If you need anything else, just let me know. I live in Minnesota so I work hours that are offset from yours but I can still help out or give ideas on what to look at.

I am glad this helped you out, have a terrific day!
Brenda

From: Prem Singh [mailto:storage-ti@lists.imwuc.org]
Sent: Tuesday, November 22, 2016 6:23 AM
To: storage-ti@lists.imwuc.org
Subject: [storage-ti] - RE: Server Out of Data Storage Space - Mountpoint issue.


Brenda,

I followed your instructions checked out and lable those tapes once again, these are scratch tapes.I did not see this kind of behaviour in my 6-7 year experience. But yes I do suspect this issue is occuring becuase of following wrong process to inserting and ejecting tapes. I will update you the same.

I can't log a ticket with IBM support becuase I am using old TSM version which is out of support now.



Prem

-----End Original Message-----
[CONFIDENTIALITY AND PRIVACY NOTICE] Information transmitted by this email is proprietary to Medtronic and is intended for use only by the individual or entity to which it is addressed, and may contain information that is private, privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please delete this mail from your records. To view this notice in other languages you can either select the following link or manually copy and paste the link into the address bar of a web browser: http://emaildisclaimer.medtronic.com

 Hi Brenda,

I understand thanks for all the support instead of checkin command what you were using. I tell you my prcoess what i was doing. first I am inserting the scratch tape into I/O station then running the checkin command once it reads the label i run the reply with request id after that it reads the lable started showing into libvol then I assign the tape on specific pool, after every 15 days I have a recomendation to take out the tape from library which is full at the same time i insert few new tapes and few used tape into I/O station one by one few are private and few are scratch why i am inserting private because i have to reuse the same. that time i am deleting the private tape and after that updating in libvol. Please let me know if any other details do you need.I am looking for your take on this what should i follow if i am doing something wrong according to you.

 

Regards

Prem