High Performance Computing Group

 View Only
  • 1.  systemd service files for Explorer services (pmc, perf)?

    Posted Wed August 25, 2021 01:29 PM
    Hi,

    unfortunately IBM doesn't provide systemd service files for `pmc` and `perf` to allow for an automated start on system boot.  Has anyone already created such files and would be prepared to share them?  Or how do you ensure proper and reliable automated start of those services on systemd managed Linux servers?

    Cheers, Frank

    ------------------------------
    Frank Thommen
    ------------------------------

    #SpectrumComputingGroup


  • 2.  RE: systemd service files for Explorer services (pmc, perf)?

    Posted Thu August 26, 2021 08:45 AM
    Actually, Franks statement is only partially true.  In the LSF Suites, there is a unit file called 'acd'.  The 'acd' unit file will manage all services as a single service.  I would expect that IBM support could provide this unit file upon request if this is a standalone version of the Application Center tool.

    Here is the example output below:

    [root@vmhost7 ~]# systemctl status acd
    ● acd.service - IBM Spectrum LSF Application Center
    Loaded: loaded (/etc/systemd/system/acd.service; enabled; vendor preset: disabled)
    Active: active (running) since Thu 2021-08-26 08:43:24 EDT; 6s ago
    Process: 1848274 ExecStop=/opt/ibm/lsfsuite/ext/gui/3.0/bin/ac_daemons stop (code=exited, status=0/SUCCESS)
    Process: 1850611 ExecStart=/opt/ibm/lsfsuite/ext/gui/3.0/bin/ac_daemons start (code=exited, status=0/SUCCESS)
    Process: 1850607 ExecStartPre=/bin/bash -c (timer=12; while (( $timer )); do if [ ! -d /opt/ibm/lsfsuite/ext/gui/conf ]; then sleep 5; else exit 0; fi; timer=$[$timer>
    Tasks: 331 (limit: 100128)
    Memory: 931.1M
    CGroup: /system.slice/acd.service
    ├─1851233 /opt/ibm/lsfsuite/ext/perf/1.2/etc/wsm -f /opt/ibm/lsfsuite/ext/perf/conf/wsm/wsm_plc_2.conf
    ├─1851235 /opt/ibm/lsfsuite/ext/perf/jre/linux-x86_64/bin/java -Xms1024m -Xmx16g -Dcom.sun.management.jmxremote=true -Dcom.ibm.jsse2.overrideDefaultTLS=true >
    ├─1851290 /opt/ibm/lsfsuite/ext/perf/1.2/etc/wsm -f /opt/ibm/lsfsuite/ext/perf/conf/wsm/wsm_plc_3.conf
    ├─1851292 /opt/ibm/lsfsuite/ext/perf/jre/linux-x86_64/bin/java -Xms1024m -Xmx16g -Dcom.sun.management.jmxremote=true -Dcom.ibm.jsse2.overrideDefaultTLS=true >
    ├─1851342 /opt/ibm/lsfsuite/ext/perf/1.2/etc/wsm -f /opt/ibm/lsfsuite/ext/perf/conf/wsm/wsm_plc.conf
    ├─1851344 /opt/ibm/lsfsuite/ext/perf/jre/linux-x86_64/bin/java -Xms1024m -Xmx16g -Dcom.sun.management.jmxremote=true -Dcom.ibm.jsse2.overrideDefaultTLS=true >
    ├─1851409 /opt/ibm/lsfsuite/ext/perf/1.2/etc/wsm -f /opt/ibm/lsfsuite/ext/perf/conf/wsm/wsm_purger.conf
    ├─1851411 /opt/ibm/lsfsuite/ext/perf/jre/linux-x86_64/bin/java -Xms64m -Xmx512m -Dcom.ibm.jsse2.overrideDefaultTLS=true -DPERF_TOP=/opt/ibm/lsfsuite/ext/perf>
    ├─1851679 python /opt/ibm/lsfsuite/ext/gui/3.0/wlp/usr/servers/platform/apps/platform.war/pac/include/novnc/utils/websockify/run --web /opt/ibm/lsfsuite/ext/>
    ├─1851772 /bin/bash /opt/ibm/lsfsuite/ext/gui/3.0/bin/pmcadmin start
    ├─1851845 /bin/sh /opt/ibm/lsfsuite/ext/gui/3.0/wlp/bin/server start notification
    ├─1852015 /bin/sh /opt/ibm/lsfsuite/ext/gui/3.0/wlp/bin/server start platform
    ├─1852040 /opt/ibm/lsfsuite/ext/perf/jre/linux-x86_64/bin/java -javaagent:/opt/ibm/lsfsuite/ext/gui/3.0/wlp/bin/tools/ws-javaagent.jar -Djava.awt.headless=tr>
    ├─1852041 /opt/ibm/lsfsuite/ext/perf/jre/linux-x86_64/bin/java -javaagent:/opt/ibm/lsfsuite/ext/gui/3.0/wlp/bin/tools/ws-javaagent.jar -Djava.awt.headless=tr>
    ├─1852078 /opt/ibm/lsfsuite/ext/../../jre/bin/java -javaagent:/opt/ibm/lsfsuite/ext/gui/3.0/wlp/bin/tools/ws-javaagent.jar -Djava.awt.headless=true -Xms2048m>
    └─1852079 /opt/ibm/lsfsuite/ext/../../jre/bin/java -javaagent:/opt/ibm/lsfsuite/ext/gui/3.0/wlp/bin/tools/ws-javaagent.jar -Djava.awt.headless=true -DSERVER_>

    The unit's file is quite simple.  See below:

    [root@vmhost7 ~]# cat /etc/systemd/system/acd.service
    [Unit]
    Description=IBM Spectrum LSF Application Center
    After=network.target nfs.service autofs.service gpfs.service

    [Service]
    Type=forking
    ExecStartPre=/bin/bash -c '(timer=12; while (( $timer )); do if [ ! -d /opt/ibm/lsfsuite/ext/gui/conf ]; then sleep 5; else exit 0; fi; timer=$[$timer-1]; done; echo "/opt/ibm/lsfsuite/ext/gui/conf not found." 1>&2; exit 1;)'
    ExecStart=/opt/ibm/lsfsuite/ext/gui/3.0/bin/ac_daemons start
    ExecStop=/opt/ibm/lsfsuite/ext/gui/3.0/bin/ac_daemons stop

    [Install]
    WantedBy=multi-user.target


    ------------------------------
    Larry Adams
    ------------------------------



  • 3.  RE: systemd service files for Explorer services (pmc, perf)?

    Posted Thu August 26, 2021 10:18 AM
    Hi Larry,

    thanks. That's interesting. There is no such service and no "/opt/ibm/lsfsuite/ext/gui/3.0/bin/ac_daemons" in our PAC (10.2.0.8) installation.  Could that be a difference between the "LSF Suite" (which we don't have) an the "standalone" LSF? Anyway PAC does provide some automated startup via init files (/etc/init.d/perf and /etc/init.d/pmc) . That's a little bit old-fashioned and the scripts are not working 100% correctly, but it works for autostarting the service at system boot :-)

    However my question was anyway aimed at LSF Explorer and not PAC.  From the LSF support I got the information, that IBM does not provide systemd startup scripts for LSF Explorer.  But rethinking it, I might be able to use the init files from PAC and adapt them to the Explorer, as the 'perf' and 'pmc' services seem to be the same.  I'll give it a try.

    Cheers, Frank

    ------------------------------
    Frank Thommen
    ------------------------------



  • 4.  RE: systemd service files for Explorer services (pmc, perf)?

    Posted Thu August 26, 2021 11:15 AM
    Edited by System Fri January 20, 2023 04:48 PM
    Frank,

    What I would recommend is that you open an RFE.  Bill McMillan, the Offering Manager, will pass some final determination.  Also, he may simply ask support to provide you the two scripts.  My suggestion is that they should have done this for Explorer from the beginning.

    I have not installed the standalone Explorer in some time.  I believe version 10.2.0.12 is out.  However, there are all sorts of requirements for the ElasticSearch in this version that are problematic (aka time consuming and currently error prone) if you are not already at ElasticSearch 7.x.

    So, before you go down this road, pay special attention to what is required and the amount of time required to upgrade both ElasticSearch and the various indexes.  It's very time consuming, and the upgrade will take quite a bit of time.  My suggestion would be that this be done using a parallel process entirely outside of the upgrade script.  However, it would be good to have an official script to do this in order to minimize downtime.

    If in the mean time, you want to write you own ac_daemons, it's quite simple.  Here it is below.  Just take this and my other comment and you will have it done.

    [root@vmhost7 ~]# more /opt/ibm/lsfsuite/ext/gui/3.0/bin/ac_daemons
    #!/bin/bash
    source /opt/ibm/lsfsuite/ext/profile.platform
    OP=$1
    if [ "x${OP}" = "x" ]; then
    exit 1
    fi
    perfadmin ${OP} all
    pmcadmin ${OP}
    exit 0

    [root@vmhost7 ~]# more /opt/ibm/lsfsuite/ext/gui/3.0/bin/ac_daemons
    #!/bin/bash
    source /opt/ibm/lsfsuite/ext/profile.platform
    OP=$1
    if [ "x${OP}" = "x" ]; then
    exit 1
    fi
    perfadmin ${OP} all
    pmcadmin ${OP}
    exit 0

    ------------------------------
    Larry Adams
    ------------------------------



  • 5.  RE: systemd service files for Explorer services (pmc, perf)?

    Posted Sat August 28, 2021 09:14 AM
    I wanted to submit an RFE through https://www.ibm.com/developerworks/rfe/execute?use_case=submitRfe, but for Spectrum LSF I am now redirected to some other website (https://ibm-data-and-ai.ideas.ibm.com/). Interestingly the link has been named "Spectrum LRF". Is that a new thing?

    We are currently running Explorer 10.2.0.11 still with the LSF-provided Elasticsearch packages (elasticsearch-for-lsf), but we are looking into replacing it with a standalone ES. However we have to build up some internal ES knowhow first.

    Thanks for your suggestions.

    Cheers, Frank

    ------------------------------
    Frank Thommen
    ------------------------------