High Performance Computing Group

High Performance Computing Group

Connect with HPC subject matter experts and discuss how hybrid cloud HPC Solutions from IBM meet today's business needs.

 View Only
  • 1.  setting up docker and other basics

    Posted Mon May 05, 2025 09:45 AM

    I'm setting up a cluster using vagrant to learn some basics. I've got the master node up, lsf.shared, lsf.cluster.cluster1 setup for Docker and I've got the 'docker1' host up and it can run containers locally. I have setup an lsf.applications file and can submit a job but it does not seem to be firing a container and just sending me to the host in the application group.

    What are my next steps? TIA

    grep -iR docker /opt/lsf/conf/

    /opt/lsf/conf/lsf.shared:   docker     Boolean ()       ()          (Docker containers)
    /opt/lsf/conf/lsf.cluster.cluster1:docker1      !       !       1       (docker)

    [lsfadmin@master ~]$ lshosts  | grep docker
    docker1      X86_64 Intel_Pl  15.0     2   1.9G   1.9G    Yes (docker)

    #lsf.applications

    Begin Application
    NAME = docker_app
    DESCRIPTION = Run jobs inside a Docker container
    #SUBMIT = docker # invalid keyword
    End Application

    # lsb.queues

    Begin Queue
    QUEUE_NAME = docker.q
    DESCRIPTION = For Docker jobs
    HOSTS = docker_hosts
    #DEFAULT_APPLICATION = docker_app # invalid keyword!
    End Queue

    # lsb.hosts

    Begin HostGroup
    GROUP_NAME    GROUP_MEMBER      #GROUP_ADMIN # Key words
    docker_hosts    docker1
    End HostGroup

    #bsub -q docker.q -a "docker_app" -app docker_app -env "LSF_DOCKER_IMAGE=ubuntu" -Is /bin/s
    Job <207> is submitted to queue <docker.q>.
    <<Waiting for dispatch ...>>
    <<Starting on docker1>>
    sh-5.1$ hostname  
    docker1
    sh-5.1$ cat /etc/os-release | grep PRETTY 
    PRETTY_NAME="Rocky Linux 9.4 (Blue Onyx)"



    ------------------------------
    Kevin Kramer
    ------------------------------


  • 2.  RE: setting up docker and other basics

    Posted Mon May 05, 2025 12:21 PM

    Hope following LSF doc links will help.

    https://www.ibm.com/docs/en/spectrum-lsf/10.1.0?topic=docker-preparing-lsf-run-jobs

    https://www.ibm.com/docs/en/spectrum-lsf/10.1.0?topic=docker-configuring-lsf-run-jobs



    ------------------------------
    YI SUN
    ------------------------------