Storage Management

Expand all | Collapse all

dsmserv is crashing

  • 1.  dsmserv is crashing

    Posted 7 days ago
    Hi All,

    All of a sudden my TSM is getting crashed, I checked on db2diag.log i am not seeing any specific relevant direction why it's crashing my TSM server is 6.3 below is diag log.

    2019-11-29-18.45.28.248321+060 E91880085A472 LEVEL: Severe
    PID : 14024942 TID : 1 PROC : db2dart
    INSTANCE: tsm100 NODE : 000
    EDUID : 1
    FUNCTION: DB2 UDB, oper system services, sqloEDUCodeTrapHandler, probe:1000
    MESSAGE : ADM0502C The DB2 instance has terminated abnormally. To remedy this
    problem, increase the AGENT_STACK_SZ DBM configuration parameter.
    Contact IBM Support for further assistance.

    2019-11-29-18.45.28.249557+060 E91880558A1127 LEVEL: Critical
    PID : 14024942 TID : 1 PROC : db2dart
    INSTANCE: tsm100 NODE : 000
    EDUID : 1
    FUNCTION: DB2 UDB, oper system services, sqloEDUCodeTrapHandler, probe:999
    MESSAGE : ADM14001C An unexpected and critical error has occurred: "Trap". The
    instance may have been shutdown as a result. "Automatic" FODC (First
    Occurrence Data Capture) has been invoked and diagnostic information
    has been recorded in directory "/home/tsm100/sqllib/db2dump/". Please
    look in this directory for detailed evidence about what happened and
    contact IBM support if necessary to diagnose the problem.
    DATA #1 : Signal Number Recieved, 4 bytes

    ------------------------------
    Prem Singh

    ------------------------------


  • 2.  RE: dsmserv is crashing

    Posted 4 days ago
    Guys,

    any suggestions pls.

    Thanks 
    Prem





  • 3.  RE: dsmserv is crashing

    Posted 3 days ago
    Hi Prem,
    a thread has used more memory than allowed.

    Please look for the actual value for the parameter AGENT_STACK_SZ with this command:
    db2 get dbm cfg

    Best regards,
    Jochen

    ------------------------------
    Jochen Meixner
    Principal Consultant Storage & Backup Solutions
    CONET Services GmbH
    Duesseldorf, Germany
    ------------------------------



  • 4.  RE: dsmserv is crashing

    Posted 3 days ago
    Hi Jochen,

    Thanks for the reply I will post the result in the night however I have not changed recently anything on DB2 level. Just to give you more insight it's creating core dump and result is instance directory is getting full on every dump it's creating one fodc folder with long name and inside that we have so many log files if that gives you any clue.

    Thanks 
    Prem 






  • 5.  RE: dsmserv is crashing

    Posted 3 days ago
    Hi Prem,
    is this a system core dump? The whole machine crashes?

    Is there anything in the actlog before the crash occurs?

    Best regards,
    Jochen


    ------------------------------
    Jochen Meixner
    Principal Consultant Storage & Backup Solutions
    CONET Services GmbH
    Duesseldorf, Germany
    ------------------------------



  • 6.  RE: dsmserv is crashing

    Posted 3 days ago
    Hi Jochen,

    It's not system dump because core dump file is creating under instance directory /sqllib/db2dump/fodcwith long name, I checked several times no clue on actlog.

    Thanks 
    Prem 





  • 7.  RE: dsmserv is crashing

    Posted 3 days ago
    Hi Prem,
    ok, I just wanted to verify that I got this correct.
    So it seems to be a problem with memory usage of DB2.

    How much of the available system memory is used? Please check with top

    Best regards,
    Jochen

    ------------------------------
    Jochen Meixner
    Principal Consultant Storage & Backup Solutions
    CONET Services GmbH
    Duesseldorf, Germany
    ------------------------------



  • 8.  RE: dsmserv is crashing

    Posted 3 days ago
    Hi,

    Please find the output.

    Shared Memory:
    m   1048576 0xffffffff D-rw------- pconsole   system pconsole   system      1 536870912 8192254 8192254 15:42:40 no-entry 15:42:40
    m         1 0x010210f7 --rw-rw-r--     root   system     root   system      1      4192 6488072 8519692 15:42:05 15:42:45 15:42:05
    m         2 0x01021067 --rw-rw-r--     root   system     root   system      1      4192 6488166 6488166 15:42:07 no-entry 15:42:07
    m         3 0x01021103 --rw-rw-r--     root   system     root   system      1      4192 4391074 5111824 15:42:12 15:42:18 15:42:10
    m         4 0x7800246d --rw-rw-rw-     root   system     root   system      1 222696000 3866786 6553600 15:42:15 15:42:16 15:42:15
    m         5 0x78000100 --rw-rw-rw-     root   system     root   system      1  33554432 3866786 6094852 15:42:16 15:42:16 15:42:15
    m         6 0x78100100 --rw-rw-rw-     root   system     root   system      1  33554432 3866786 6094852 15:42:16 15:42:16 15:42:15
    m         7 0x780042d6 --rw-rw-rw-     root   system     root   system      1      2656 3866786 6094852 15:42:16 15:42:16 15:42:16
    m   1048584 0x01021113 --rw-rw-r--     root   system     root   system      1      4192 5111828 15138826 15:42:19  0:00:00 15:42:19
    m   1048585 0x01021182 --rw-rw-r--     root   system     root   system      1      4192 6422716 6422716 15:42:22 no-entry 15:42:22
    m   2097162 0x01021167 --rw-rw-r--     root   system     root   system      1      4192 2162826 21561362 15:42:24 15:42:29 15:42:24
    m   3145739 0x0102120f --rw-rw-r--     root   system     root   system      1      4192 6553830 6553830 15:42:26 no-entry 15:42:26
    m   5242892 0x01021258 --rw-rw-r--     root   system     root   system      1      4192 6094974 6094974 15:42:29 no-entry 15:42:29
    m   1048589 0x01021212 --rw-rw-r--     root   system     root   system      1      4192 5767314 5767314 15:42:31 no-entry 15:42:31
    m   3145742 0x61002284 --rw------- pconsole   system pconsole   system      1  10485760 8192254 8192254 15:42:41 no-entry 15:42:41
    m   1048591 0x06347849 --rw-rw-rw-     root   system     root   system      1     65544 8126472 8716338 15:42:49 15:42:49 15:42:48
    m   7340048 0x0c6629c9 --rw-rw-rw-     root   system     root   system      1   2994648 8716338 9568324 15:42:49 15:42:51 15:42:49
    m        17 0x310210c0 --rw-rw-rw-     root   system     root   system      2    131176 5242896 8126472 15:42:49 no-entry 15:42:49
    m   1048594 0xa4f29374 --rw-rw-rw-     tsm1  tsmserv     tsm1  tsmserv     11 140871904 8388698 20709434 19:52:33 19:52:33 15:55:05
    m   2097171 0xa4f29361 --rw-------     tsm1  tsmserv     tsm1  tsmserv      6  56688640 8388698 22020116 20:01:44 12:02:54 15:55:05
    m        20 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      9 268435456 9044100 22020116 16:52:59 12:02:54 15:55:05
    m  13631510 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m   2097175 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      1 163905536 7995396 22020116 20:01:45 12:02:54 20:01:45
    m   2097176 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      1 805306368 7995396 22020116 12:02:54 12:03:38 20:01:45
    m        25 0xa4f29468 --rw-rw----     tsm1  tsmserv     tsm1  tsmserv      1  50331648 9633980 9633980 15:55:09 no-entry 15:55:09
    m  16777242 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m  70254620 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:19 19:51:57 20:03:19
    m  24117277 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:01:09 19:51:57 20:01:09
    m  26214430 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:01:58 19:51:57 20:01:58
    m   4194335 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m 310378528 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:54 18:18:09 17:29:54
    m  48234529 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:20 19:51:57 20:03:20
    m   4194338 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m 1031798819 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:08 18:18:09 18:03:08
    m  83886116 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:45 no-entry 18:59:45
    m   1048613 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:16 19:51:57 20:02:16
    m   1048614 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:16 19:51:57 20:02:16
    m 202375208 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:54 18:18:09 17:29:54
    m 973078569 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2 6174015488 19922986 15859826 18:18:09 18:18:12  9:19:00
    m  71303210 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:57 19:51:57 20:02:57
    m  33554475 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:00 19:51:57 20:03:00
    m 285212716 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:54 18:18:09 17:29:54
    m  38797357 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:20 19:51:57 20:03:20
    m   1048622 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:58 19:51:57 20:02:58
    m  27263023 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m   1048624 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m   1048625 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m   1048626 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m 959447091 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:45 no-entry 18:59:45
    m  10485812 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m  11534389 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m 120586294 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:23 19:51:57 20:03:23
    m  51380279 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:22 19:51:57 20:03:22
    m  96469048 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:29 no-entry 19:29:29
    m   1048633 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m   1048634 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m   1048635 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m 264241213 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:07:35 19:51:57 20:07:35
    m  11534398 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m  14680127 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m   1048640 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:02:59 19:51:57 20:02:59
    m 744489025 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:07:33 no-entry 19:07:33
    m 169869378 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:44 18:18:09 17:29:44
    m 739246148 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:10 18:18:09 18:03:10
    m 815792198 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:04 no-entry 19:00:04
    m 750780489 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:02:03 18:18:09 18:02:03
    m 941621322 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:18:52 no-entry 18:18:52
    m 878706763 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:30:18 no-entry 18:30:18
    m 164626509 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:21 19:51:57 20:03:21
    m 186646606 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:03:11 18:18:09 15:03:11
    m 420479055 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:39:18 18:18:09  9:39:18
    m 271581264 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:18 no-entry 19:00:18
    m 112197713 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:21 19:51:57 20:03:21
    m 186646610 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:06:22 no-entry 19:06:22
    m 803209299 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:45:26 18:18:09 16:45:26
    m 254804052 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:59 no-entry 18:59:59
    m 974127189 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 11:34:16 18:18:09 11:34:16
    m 178258007 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:30:06 no-entry 19:30:06
    m 761266264 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:22 no-entry 19:00:22
    m  40894554 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:01 18:18:09 18:03:01
    m   3145820 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:52:39 no-entry 19:52:39
    m 713031774 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:29 no-entry 19:29:29
    m 116392032 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:00:00 18:18:09 16:00:00
    m 540016737 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:04 no-entry 19:00:04
    m 736100450 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 17:01:49 19:51:57 17:01:49
    m 621805667 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:20:00 18:18:09 17:20:00
    m 144703588 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:52:02 18:18:09 16:52:02
    m 856686693 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:07:42 no-entry 19:07:42
    m 842006630 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:07:33 no-entry 19:07:33
    m 567279721 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 10:57:45 18:18:09 10:57:45
    m 440402033 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:22:21 18:18:09  9:22:21
    m 437256306 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:18:16 no-entry 18:18:16
    m 301990004 0x0ab73e68 --rw-rw----   tsm100  tsmserv   tsm100  tsmserv      1  50331648 14286966 14286966 18:17:45 no-entry 18:17:45
    m 138412149 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:44:41 18:18:09 16:44:41
    m 747634807 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 12:33:18 18:18:09 12:33:18
    m 1038090361 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:48:40 no-entry 19:48:40
    m 822083706 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:45:19 18:18:09 16:45:19
    m 534773885 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:37:56 no-entry 19:37:56
    m 989855871 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:03:29 no-entry 19:03:29
    m 667943040 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:50:21 18:18:09  9:50:21
    m 639631489 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:01 18:18:09 18:03:01
    m 171966595 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:37 no-entry 19:29:37
    m 815792261 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:30:21 18:18:09  9:30:21
    m 436207750 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:19:00 no-entry 18:19:00
    m 465567879 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 14:59:56 18:18:09 14:59:56
    m 828375177 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:42 no-entry 19:29:42
    m 327155854 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:41 no-entry 19:29:41
    m 694157455 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 10:39:29 18:18:09 10:39:29
    m 326107280 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:25 18:18:09 18:03:25
    m 406847633 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:13 18:18:09 18:03:13
    m 395313298 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 14:59:53 18:18:09 14:59:53
    m 1004535955 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:44 18:18:09 17:29:44
    m 485490836 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:54 18:18:09 17:29:54
    m  77594774 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:21 19:51:57 20:03:21
    m 964690071 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:59 no-entry 18:59:59
    m 686817432 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 12:33:18 18:18:09 12:33:18
    m  90177689 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:07 18:18:09 18:03:07
    m 342884506 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:29:51 no-entry 18:29:51
    m 289407131 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:02:00 18:18:09 18:02:00
    m 412090526 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:47:04 no-entry 18:47:04
    m 133169311 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:55:33 no-entry 18:55:33
    m 325058720 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:55:33 no-entry 18:55:33
    m 444596385 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 11:03:16 18:18:09 11:03:16
    m 760217762 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:53 no-entry 19:29:53
    m 696254627 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:45:19 18:18:09 16:45:19
    m 754974884 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:47:04 no-entry 18:47:04
    m 522191013 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:14:27 18:18:09 16:14:27
    m 878706854 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:47:23 no-entry 18:47:23
    m  44040360 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:59:48 18:18:09 17:59:48
    m 132120747 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:59:57 18:18:09 15:59:57
    m 573571244 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:02:07 18:18:09 18:02:07
    m 398459053 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:14:27 18:18:09 16:14:27
    m 942669998 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:19:00 18:18:09  9:19:00
    m 760217781 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:30:06 no-entry 19:30:06
    m 745537718 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:47:13 no-entry 18:47:13
    m 282067129 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 10:39:29 18:18:09 10:39:29
    m 694157499 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 19:51:13 19:51:57 19:51:13
    m 469762236 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  5:32:40 18:18:09  5:32:40
    m 856686781 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:43 no-entry 19:29:43
    m 201326784 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:19:31 18:18:09  9:19:31
    m  20971714 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:14:27 18:18:09 16:14:27
    m 715129028 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:04 no-entry 19:00:04
    m 291504326 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:40:21 18:18:09 15:40:21
    m 297795783 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:59:48 18:18:09 17:59:48
    m 502268104 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:18:11 no-entry 18:18:11
    m 146800841 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 12:33:12 18:18:09 12:33:12
    m 440402122 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:34:16 no-entry 19:34:16
    m 382730443 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:40:31 18:18:09 16:40:31
    m 248512716 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:53 no-entry 19:29:53
    m 599785677 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 11:39:39 18:18:09 11:39:39
    m 843055311 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:48:40 no-entry 19:48:40
    m 266338514 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:34:16 no-entry 19:34:16
    m 633340115 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:45:03 18:18:09 16:45:03
    m 599785685 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:48:28 no-entry 19:48:28
    m 824180953 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:34:37 18:18:09  9:34:37
    m 241172699 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:59:48 18:18:09 15:59:48
    m 794820828 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:01:39 19:51:57 20:01:39
    m 800063709 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      1 163905536 19922986 19333186  9:19:00 18:18:09  9:19:00
    m 750780638 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:45:25 no-entry 19:45:25
    m  37748959 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 13:40:00 18:18:09 13:40:00
    m 563085537 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:20 19:51:57 20:03:20
    m 433062114 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:04 no-entry 19:00:04
    m 166723812 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 21:03:21 19:51:57 21:03:21
    m 900727013 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 11:03:16 18:18:09 11:03:16
    m 504365287 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:45:45 no-entry 19:45:45
    m 1018167528 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:18:22 no-entry 18:18:22
    m 614465769 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:19:01 18:18:09  9:19:01
    m 131072234 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:00:16 18:18:09 18:00:16
    m   8388843 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 19:30:21 19:51:57 19:30:21
    m 750780652 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:06:06 no-entry 19:06:06
    m 465567983 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:29:47 no-entry 18:29:47
    m 594542832 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:01:47 18:18:09 18:01:47
    m 306184434 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:03:29 no-entry 19:03:29
    m 908067059 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 13:40:00 18:18:09 13:40:00
    m 713031924 0x0ab73d74 --rw-rw-rw-   tsm100  tsmserv   tsm100  tsmserv     12 140871904 20119622 14155894 19:52:33 19:52:33 18:17:40
    m 229638389 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:39:18 18:18:09  9:39:18
    m 212861175 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:18:16 no-entry 18:18:16
    m 504365304 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:44 18:18:09 17:29:44
    m 407896313 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:10 18:18:09 18:03:10
    m 944767226 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 19:30:21 19:51:57 19:30:21
    m 1055916283 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:59 no-entry 18:59:59
    m 754974973 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:06:22 no-entry 19:06:22
    m  92274944 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:08:43 19:51:57 20:08:43
    m 740294913 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:18 no-entry 19:00:18
    m 1069547779 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:40:21 18:18:09 15:40:21
    m 208666885 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 12:33:11 18:18:09 12:33:11
    m 350224646 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 21:02:58 19:51:57 21:02:58
    m 408944904 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:08:43 19:51:57 20:08:43
    m 143655177 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:19:16 18:18:09  9:19:16
    m 265289994 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:06:06 no-entry 19:06:06
    m 792723724 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:19:15 18:18:09  9:19:15
    m 546308367 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:02:07 18:18:09 18:02:07
    m 735052049 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:29:47 no-entry 18:29:47
    m 219152658 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:52:39 no-entry 19:52:39
    m 747634963 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:02:00 18:18:09 18:02:00
    m 736100628 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:29:51 no-entry 18:29:51
    m 232784149 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:47:23 no-entry 18:47:23
    m 400556310 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:45 no-entry 18:59:45
    m 995098905 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 12:33:12 18:18:09 12:33:12
    m 864026907 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:28 no-entry 19:29:28
    m   3146012 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:00:22 no-entry 19:00:22
    m 257949981 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 12:33:11 18:18:09 12:33:11
    m 435159326 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:59:57 18:18:09 15:59:57
    m 1009778975 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:00:30 18:18:09 16:00:30
    m 963641634 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:52:02 18:18:09 16:52:02
    m 528482596 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:07:00 19:51:57 20:07:00
    m 365953317 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:59 no-entry 18:59:59
    m 882901286 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:00:30 18:18:09 16:00:30
    m 443547943 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:00:16 18:18:09 18:00:16
    m 629145898 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:59:48 18:18:09 15:59:48
    m 851444012 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:14:32 18:18:09 16:14:32
    m 513802543 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:40:31 18:18:09 16:40:31
    m 566231348 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      9 268435456 20512818 19333186 19:31:51 18:18:09 18:17:41
    m  22020405 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 12:39:49 18:18:09 12:39:49
    m 868221238 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:05 18:18:09 18:03:05
    m 103809337 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:29:44 18:18:09 17:29:44
    m 714080570 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:19:21 18:18:09  9:19:21
    m 621805884 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 17:20:00 18:18:09 17:20:00
    m 1019216189 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:45 no-entry 18:59:45
    m 284164414 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 20:03:21 19:51:57 20:03:21
    m 570425663 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 16121930 19:52:20 no-entry 19:52:20
    m 977273152 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 14:59:56 18:18:09 14:59:56
    m 962593090 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:08:16 no-entry 19:08:16
    m 825229635 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 11:39:39 18:18:09 11:39:39
    m 779092292 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 14:40:10 18:18:09 14:40:10
    m 800063814 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:28 18:18:09 18:03:28
    m 136315207 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:45 no-entry 18:59:45
    m 399507788 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:08 18:18:09 18:03:08
    m 904921423 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:03:25 18:18:09 18:03:25
    m 238027093 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:38:01 no-entry 19:38:01
    m 112197976 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 14:40:10 18:18:09 14:40:10
    m 634388827 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:19:15 18:18:09  9:19:15
    m 775946588 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186  9:32:27 18:18:09  9:32:27
    m 628097373 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:04:17 18:18:09 18:04:17
    m 721420641 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:14:32 18:18:09 16:14:32
    m 592445798 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 14:59:53 18:18:09 14:59:53
    m 637534567 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:45 no-entry 18:59:45
    m 980418920 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:18:52 no-entry 18:18:52
    m 461373802 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:30:18 no-entry 18:30:18
    m 555745643 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:00:00 18:18:09 16:00:00
    m 584057196 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:49:47 18:18:09 15:49:47
    m 403702126 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:44:41 18:18:09 16:44:41
    m 473956720 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:14:27 18:18:09 16:14:27
    m 536871282 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:02:00 18:18:09 18:02:00
    m 231735667 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:59:45 18:18:09 15:59:45
    m 303038836 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:18:22 no-entry 18:18:22
    m 967836025 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:59 no-entry 18:59:59
    m 541065594 0x0ab73d61 --rw-------   tsm100  tsmserv   tsm100  tsmserv      6  56688640 20119622 19333186  5:32:45 18:18:09 18:17:41
    m 485491068 0xffffffff --rw-------     tsm1  tsmserv     tsm1  tsmserv      2    131072 7995396 13565996 19:51:13 19:51:57 19:51:13
    m 770703748 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:48:28 no-entry 19:48:28
    m 620757383 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 15:59:45 18:18:09 15:59:45
    m 692060554 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:19:25 no-entry 18:19:25
    m  45089176 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 18:59:59 no-entry 18:59:59
    m 643826079 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:45:03 18:18:09 16:45:03
    m 766509472 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 18:02:00 18:18:09 18:02:00
    m 848298409 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 19333186 16:45:26 18:18:09 16:45:26
    m 773849519 0xffffffff --rw-------   tsm100  tsmserv   tsm100  tsmserv      2    131072 19922986 21037232 19:29:42 no-entry 19:29:42

    --
    Regards
    Prem 






  • 9.  RE: dsmserv is crashing

    Posted 3 days ago
    One more output for your reference.

                   size       inuse        free         pin     virtual   mmode
    memory      3145728     3134366       11362      724304     2342115     Ded
    pg space     131072        8817

                   work        pers        clnt       other
    pin          622918           0         907      100479
    in use      2342115           0      792251

    PageSize   PoolSize       inuse        pgsp         pin     virtual
    s    4 KB         -     1350750        8817      214784      558499
    m   64 KB         -      111476           0       31845      111476

    --
    Regards
    Prem 





  • 10.  RE: dsmserv is crashing

    Posted 3 days ago
    Hi Prem,
    if I interpret your outputs correctly your system is paging. So your system could be a little short of memory.

    And it seems you are running two Spectrum Protect instances on this machine. Is this correct?

    As your instances are running, did you have any problems up to now?
    Did you try the reclamation process at a time when many other processes were running?


    Best regards,
    Jochen

    ------------------------------
    Jochen Meixner
    Principal Consultant Storage & Backup Solutions
    CONET Services GmbH
    Duesseldorf, Germany
    ------------------------------



  • 11.  RE: dsmserv is crashing

    Posted yesterday
    Hi Jochen,

    These 2 instance is library client and manager however this is running from atleast one decade we observe this problem recently when chassis went down because fan has stopped working and later on it rectified. We use to run reclamation very frequently because as I told earlier we don't have offsiting new purchase of tape at all we mange from these much tapes only we have 4800 + tapes at this moment in the library.

    Thanks 
    Prem 





  • 12.  RE: dsmserv is crashing

    Posted 6 hours ago
    Hi Jochen,

    I am attaching the latest logs again it's crashed.

    Block size        = 4096 bytes
      Total size        = 4429185024 bytes
      Free size         = 1130496 bytes
      Total # of inodes = 6909
      FS name           = N/A
      Mount point       = /home/tsm100
      FSID (major,minor)= 10, 3
      FS type name      = jfs2
      DIO/CIO mount opt = None
      Device type       = N/A
      FS type           = 0x6
    CALLSTCK: (Static functions may not be resolved correctly, as they are resolved to the nearest symbol)
      [0] 0x090000000662A5D8 pdOSSeLoggingCallback + 0x34
      [1] 0x0900000002D47D44 oss_log__FP9OSSLogFacUiN32UlN26iPPc + 0x1C4
      [2] 0x0900000002D48220 ossLogSysRC + 0xA0
      [3] 0x0900000002D66DCC ossErrorIOAnalysis__FCPC21OSSErrorAnalysisParam + 0xC8C
      [4] 0x0900000002D68E68 ossErrorAnalysis@AF12_1 + 0x48
      [5] 0x090000000844AF84 sqloSystemErrorHandler + 0x3E4
      [6] 0x09000000083CE308 sqloSystemErrorHandler@glue7EC + 0x124
      [7] 0x09000000065329B8 sqlowrite + 0x158
      [8] 0x0000000100018FD4 DartMsgOut + 0x354
      [9] 0x000000010001C744 DartMsgDumpPageInHEX__FP12SQLO_FHANDLEP12DartPageDesc@AF19_15 + 0x244

    2019-12-06-21.19.10.809234+060 E7857604A1060      LEVEL: Error (OS)
    PID     : 11600010             TID  : 1           PROC : db2dart
    INSTANCE: tsm100               NODE : 000
    EDUID   : 1
    FUNCTION: DB2 UDB, oper system services, sqlowrite, probe:70
    MESSAGE : ZRC=0x850F000C=-2062614516=SQLO_DISK "Disk full."
              DIA8312C Disk was full.
    CALLED  : OS, -, write
    OSERR   : ENOSPC (28) "No space left on device"
    DATA #1 : File handle, PD_TYPE_SQO_FILE_HDL, 8 bytes
      File Handle              = 3
      File System Block Size   = 0 bytes
      File System Type         = UNKNOWN
      File Handle Flags :
        Require Sector Align   = No
        DIO/CIO Mode           = No
        Raw Block Device       = No
        Reserved Handle        = No
        Flush On Close         = Yes
        Thread-Level Lock      = No
        Write-through Mode     = No
        File Not Tracked       = No
    DATA #2 : unsigned integer, 8 bytes
    62
    DATA #3 : signed integer, 8 bytes
    40
    DATA #4 : String, 105 bytes
    Search for ossError*Analysis probe point after this log entry for further
    self-diagnosis of this problem.

    2019-12-06-21.19.10.811396+060 I7858665A2665      LEVEL: Error (OS)
    PID     : 11600010             TID  : 1           PROC : db2dart
    INSTANCE: tsm100               NODE : 000
    EDUID   : 1
    FUNCTION: DB2 Common, OSSe, ossErrorIOAnalysis, probe:100
    CALLED  : OS, -, write
    OSERR   : ENOSPC (28) "No space left on device"
    DATA #1 : String, 145 bytes
    A total of 5 analysis will be performed :
     - User info
     - ulimit info
     - Target file info
     - I/O attempt
     - File system

     Target file handle = 3
    DATA #2 : String, 188 bytes
      Real user ID of current process       = 5102
      Effective user ID of current process  = 5102
      Real group ID of current process      = 5100
      Effective group ID of current process = 5100
    DATA #3 : String, 379 bytes
    Current process limits (unit in bytes except for nofiles) :
      mem     (S/H) = unlimited / unlimited
      core    (S/H) = unlimited / unlimited
      cpu     (S/H) = unlimited / unlimited
      data    (S/H) = unlimited / unlimited
      fsize   (S/H) = unlimited / unlimited
      nofiles (S/H) = unlimited / unlimited
      stack   (S/H) = unlimited / unlimited
      rss     (S/H) = unlimited / unlimited
    DATA #4 : String, 41 bytes
    current sbrk(0) value: 0x0000000111eedd40
    DATA #5 : String, 261 bytes
    Target File Information :
      Size               = 880640
      Link               = No
      Reference path     = N/A
      Type               = 0x8000
      Permissions        = rw-r-----
      UID                = 5102
      GID                = 5100
      Last modified time = 1575663550
    DATA #6 : String, 33 bytes
    I/O attempt not implemented yet.

    --
    Regards
    Prem