High Performance Computing Group

Spectrum Computing

Connect with Spectrum Computing subject matter experts and discuss how hybrid cloud Solutions from IBM meet today's business needs.

 View Only
  • 1.  Spark Instance Group create fails with Zeppelin 0.5.5

    Posted 04/19/16 01:26 PM

    Originally posted by: thloeber


    I've Installed Spark version 1.5.2 and the latest notebook Zeppelin 0.5.5 is also available for 1.5.2. When trying to create a Spark instance group using 1.5.2 and selecting the Zeppelin 0.5.5 the create fails trying to install Zeppelin-0.5.5 with this message. I've checked the 3 items mentioned. There is plenty of space available and gunzip is installed.  I'm not sure what is meant by #3 "the package is too large to be decompressed". 

     

    Failed to create Spark instance group. Error: Domain <Application>: The package <Zeppelin-0.5.5.tar.gz> failed to install. The deployed package file could not be decompressed. Check if: (1) the decompression utility is available, (2) there is enough disk storage for decompressing the file, or (3) the package file is too large to be decompressed.

    The same error occurs if I select the Zeppelin-0.5.5.tar.gz file to be uploaded as part of the creation. Where is the file being decompressed to? Are there log messages that will help be determine what is causing this error. At this point I am unable to create a spark instance group.


    #SpectrumComputingGroup


  • 2.  Re: Spark Instance Group create fails with Zeppelin 0.5.5

    Posted 04/19/16 03:51 PM

    Originally posted by: Jenna Lau-Caruso


    Hi Thomas,

    It looks like the error is coming from attempt to decompress the Zeppelin-0.5.5.tar.gz archive to a temporary directory on your management host. The location used will be one of the following:
    1) System temp directory if writable by your cluster administrator
    2) $EGO_TOP/soam/work 

    On linux, we actually use the tar utility to extract the package, but since you are seeing this error on the Zeppelin package, not Spark, it is likely that the tar utility is working fine. 

    Please check the system temp directory to ensure there is enough disk space there for decompressing the file.

    If disk space is not the issue, you might find more information in the $EGO_TOP/eservice/rs/log/rs.<hostname>.log or $EGO_TOP/asc/logs/rs.<hostname>.log files.


    #SpectrumComputingGroup


  • 3.  Re: Spark Instance Group create fails with Zeppelin 0.5.5

    Posted 04/20/16 09:08 AM

    Originally posted by: thloeber


    I used scp to copy the Zeppelin-0.5.5.tar.gz to the /tmp directory on the master host and tried tar zxvf Zeppelin-0.5.5.tar.gz to decompress it and got this error

    $ tar zxvf Zeppelin-0.5.5.tar.gz

    gzip: stdin: invalid compressed data--format violated
    deployment.xml
    package/
    package/zeppelin-0.5.5-incubating-conductor.tar.gz
    tar: Unexpected EOF in archive
    tar: Unexpected EOF in archive
    tar: Error is not recoverable: exiting now


    I downloaded the Zeppelin 0.5.5 package again from the IBM site through https://www.ibm.com/developerworks/servicemanagement/tc/pcs/index.html added the package using package management and tried the create one more time. This time the instance group was created but now the deploy fails. This is a very frustrating IBM product to install and configure.


    #SpectrumComputingGroup