IBM FlashSystem

IBM FlashSystem

Find answers and share expertise on IBM FlashSystem


#Storage
#Datasecurity
#Storage
#FlashSystem
 View Only
  • 1.  DSMSERV is not loading

    Posted 03/26/19 02:29 PM
    Hi All,

    I need your immediate help all of a sudden i am not able to run dsmserv getting below error from instance user.

    Please help

    dsmserv -i /home/tsm1
    Could not load program dsmserv:
    Dependent module /home/tsm1/sqllib/lib64/libdb2.a(shr_64.o) could not be loaded.
    Could not load module /home/tsm1/sqllib/lib64/libdb2.a(shr_64.o).
    System error: Permission denied

    ------------------------------
    Prem Singh

    ------------------------------

    #PrimaryStorage
    #Storage
    #StorageManagementandReporting


  • 2.  RE: DSMSERV is not loading

    Posted 03/26/19 03:54 PM
    Any advise please I am stuck on the issue.

    ------------------------------
    Prem Singh

    ------------------------------



  • 3.  RE: DSMSERV is not loading

    Posted 03/26/19 06:13 PM
    Hi,

    New error reported now.

    R7801I Subsystem process ID is 8126598.
    ANR4979W Use of environment variable DSMSERV_DIR is no longer supported.
    ANR0900I Processing options file /home/tsm1/dsmserv.opt.
    ANR7811I Using instance directory /home/tsm1.
    ANR4726I The ICC support module has been loaded.
    ANR0990I Server restart-recovery in progress.
    DB2SET processing complete, rc = -1092, SQLCODE = -1092
    ANR0186E There is insufficient authority to start the database manager.
    DB2SET processing complete, rc = -1092, SQLCODE = -1092
    ANR0172I rdbdb.c(1722): Error encountered performing action InstanceStop.
    ANR0162W Supplemental database diagnostic information: -1092:**No State Information Available (-2)**:-1092 (**No Other Information Available (-3)**).
    frmrsstsm100:/home/tsm1 #

    ------------------------------
    Prem Singh

    ------------------------------



  • 4.  RE: DSMSERV is not loading

    Posted 03/27/19 01:29 AM
    Hi All,

    Below is the error reporting now .

    2019-03-27-06.09.39.724857+060 I34788270A314      LEVEL: Error
    PID     : 8978518              TID  : 1           PROC : db2bp
    INSTANCE: tsm100               NODE : 000
    EDUID   : 1
    FUNCTION: DB2 UDB, data protection services, sqlpsrllf, probe:317
    MESSAGE : Rollforward failed to connect to database. sqlcode -1032

    --
    Regards
    Prem



    ------Original Message------

    Hi,

    New error reported now.

    R7801I Subsystem process ID is 8126598.
    ANR4979W Use of environment variable DSMSERV_DIR is no longer supported.
    ANR0900I Processing options file /home/tsm1/dsmserv.opt.
    ANR7811I Using instance directory /home/tsm1.
    ANR4726I The ICC support module has been loaded.
    ANR0990I Server restart-recovery in progress.
    DB2SET processing complete, rc = -1092, SQLCODE = -1092
    ANR0186E There is insufficient authority to start the database manager.
    DB2SET processing complete, rc = -1092, SQLCODE = -1092
    ANR0172I rdbdb.c(1722): Error encountered performing action InstanceStop.
    ANR0162W Supplemental database diagnostic information: -1092:**No State Information Available (-2)**:-1092 (**No Other Information Available (-3)**).
    frmrsstsm100:/home/tsm1 #

    ------------------------------
    Prem Singh

    ------------------------------

    #StorageManagementandReporting
    #Storage
    #PrimaryStorage


  • 5.  RE: DSMSERV is not loading

    Posted 03/27/19 07:21 AM
    Hi,

    This is one more log please advise what would be my next step.
    ADM6006E  DB2 encountered an error while reading page "219550" from table space
    "4" for object "19" (located at offset "19998" of container
    "/TSM100/DB8/tsm100/NODE0000/TSMDB1/T0000004/C0000007.LRG").
    2019-03-27-07.21.53.580991   Instance:tsm100   Node:000
    PID:10879032(db2agent (TSMDB1) 0)   TID:3086   Appid:*LOCAL.tsm100.190327061952
    data management  sqldmund Probe:40   Database:TSMDB1
    ADM5550C  The table space "IDXSPACE1" (ID "4") is being removed from the
    rollforward set.  The SQLCODE is "-1655".
    2019-03-27-07.28.50.888587   Instance:tsm100   Node:000
    PID:10682510(db2acd 0)   TID:772   Appid:none
    Health Monitor  HealthIndicator::update Probe:500
    ADM10500E  Health indicator "Database Automatic Storage Utilization"
    ("db.auto_storage_util") breached the "upper" alarm threshold of "90 %" with
    value "93 %" on "database" "tsm100.TSMDB1  ".  Calculation:
    "((db.auto_storage_used/db.auto_storage_total)*100);" = "((344318095360 /
    369098752000) * 100)" = "93 %".  History (Timestamp, Value, Formula): "()"
    2019-03-27-07.28.50.923310   Instance:tsm100   Node:000
    PID:10682510(db2acd 0)   TID:772   Appid:none
    Health Monitor  HealthIndicator::update Probe:500
    ADM10502W  Health indicator "Table Space Operational State" ("ts.ts_op_status")
    is in state "Roll forward pending" on "table space" "tsm100.TSMDB1
    .IDXSPACE1".
    2019-03-27-09.06.34.260122   Instance:tsm100   Node:000
    PID:7995574(db2dart)   TID:1   Appid:none
    data protection services  sqlpgOpenLFH Probe:750
    ADM1713C  The DB2 database manager cannot start the database on database
    partition "0" because the database manager can open neither the primary log
    control file "/home/tsm100/tsm100/NODE0000/SQL00001/SQLOGCTL.LFH.1" nor the
    secondary log control file
    "/home/tsm100/tsm100/NODE0000/SQL00001/SQLOGCTL.LFH.2".
    2019-03-27-11.16.34.867781   Instance:tsm100   Node:000
    PID:10223706(db2wdog 0)   TID:258   Appid:none
    base sys utilities  sqleWatchDog Probe:20
    ADM0503C  An unexpected internal processing error has occurred. All DB2
    processes associated with this instance have been shutdown. Diagnostic
    information has been recorded. Contact IBM Support for further assistance.
    2019-03-27-11.23.30.027177   Instance:tsm100   Node:000
    PID:10158190(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.23.46.269657   Instance:tsm100   Node:000
    PID:9240596(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.24.28.027257   Instance:tsm100   Node:000
    PID:9240610(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.25.52.597948   Instance:tsm100   Node:000
    PID:8650800(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.26.42.537245   Instance:tsm100   Node:000
    PID:10617080(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.27.00.438952   Instance:tsm100   Node:000
    PID:4653102(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.28.08.827737   Instance:tsm100   Node:000
    PID:10223780(db2sysc 0)   TID:258   Appid:none
    common communication  sqlcctcpconnmgr Probe:50
    ADM7006E  The SVCENAME DBM configuration parameter was not configured.  Update
    the SVCENAME configuration parameter using the service name defined in the
    TCP/IP services file.
    2019-03-27-11.28.09.891794   Instance:tsm100   Node:000
    PID:11337896(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.28.18.674616   Instance:tsm100   Node:000
    PID:9830618(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.30.42.437191   Instance:tsm100   Node:000
    PID:11796482(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.30.59.164468   Instance:tsm100   Node:000
    PID:4653248(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.34.08.467202   Instance:tsm100   Node:000
    PID:10944756(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.34.23.414375   Instance:tsm100   Node:000
    PID:10223826(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.42.29.821677   Instance:tsm100   Node:000
    PID:10223756(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.42.44.749545   Instance:tsm100   Node:000
    PID:9830652(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.45.44.280315   Instance:tsm100   Node:000
    PID:10616918(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.46.00.295723   Instance:tsm100   Node:000
    PID:8650858(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.51.28.917361   Instance:tsm100   Node:000
    PID:6947050(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.51.43.769328   Instance:tsm100   Node:000
    PID:6947070(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.55.06.347147   Instance:tsm100   Node:000
    PID:10354798(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.55.21.895496   Instance:tsm100   Node:000
    PID:10354810(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-11.55.42.437113   Instance:tsm100   Node:000
    PID:10354818(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-11.56.01.994359   Instance:tsm100   Node:000
    PID:10616986(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911
    ADM7514W  Database manager has stopped.
    2019-03-27-12.15.16.214175   Instance:tsm100   Node:000
    PID:10354872(db2star2)   TID:1   Appid:none
    base sys utilities  DB2StartMain Probe:911
    ADM7513W  Database manager has started.
    2019-03-27-12.15.34.326043   Instance:tsm100   Node:000
    PID:4653256(db2stop2)   TID:1   Appid:none
    base sys utilities  DB2StopMain Probe:911


    --
    Regards
    Prem



    ------Original Message------

    Hi All,

    Below is the error reporting now .

    2019-03-27-06.09.39.724857+060 I34788270A314      LEVEL: Error
    PID     : 8978518              TID  : 1           PROC : db2bp
    INSTANCE: tsm100               NODE : 000
    EDUID   : 1
    FUNCTION: DB2 UDB, data protection services, sqlpsrllf, probe:317
    MESSAGE : Rollforward failed to connect to database. sqlcode -1032

    --
    Regards
    Prem




    #PrimaryStorage
    #StorageManagementandReporting
    #Storage


  • 6.  RE: DSMSERV is not loading

    Posted 03/28/19 09:39 PM
    Prem,
    A few quick questions:
    1. What OS are you running your TSM server from?
    2. What TSM server version are you running?
    3. What user account are you trying to run the dsmserv process from? (it looks like the account has insufficient privileges to access libraries and filesystems)

    ------------------------------
    Bryan Holmes
    Infrastructure Specialist 4
    State of Ohio - DAS
    Cincinnati OH
    ------------------------------



  • 7.  RE: DSMSERV is not loading

    Posted 03/28/19 10:07 PM
    Thanks Bryan for the help. Pls see my update.

    1 TSM version 6.3.4
    2 AIX Version 7
    3. As far as privileged concerned I am trying to run it from instance owner I'd .

    Although after more deep dig on logs we found it shutdown the tsm server with unknows reason and in the middle db2 started roll forwarding and someone from team didn't check that and rebooted the host later on we checked and found it is stuck on same stage on roll forwarding and it marked tsmdb1 as damaged after that we have no option to restoring the server from previous backup date but we lost 3 days data because we don't have the latest backup.

    Thank you for all your comments.
    Learning for us while roll forwarding don't reboot the host.

    Thanks
    Prem 


    ------Original Message------

    Prem,
    A few quick questions:
    1. What OS are you running your TSM server from?
    2. What TSM server version are you running?
    3. What user account are you trying to run the dsmserv process from? (it looks like the account has insufficient privileges to access libraries and filesystems)

    ------------------------------
    Bryan Holmes
    Infrastructure Specialist 4
    State of Ohio - DAS
    Cincinnati OH
    ------------------------------

    #StorageManagementandReporting
    #Storage
    #PrimaryStorage