Originally posted by: julienyu

Have you tried our new product offering IBM Platform Conductor for Spark V1.1? If you have, you might have found that only Spark 1.4.1 and Apache Zeppelin 0.5 are available to choose when creating a Spark instance group.

This is because Spark 1.4.1 and Zeppelin 0.5 are built-in for Platform Conductor V1.1, but Platform Conductor enables you to plug in other supported Spark versions with workable Zeppelin versions. We post new versions to IBM Fix Central, which you can download and install as required.

With that in mind, we are excited to announce that Spark 1.5.2 and Zeppelin 0.5.5 have just been released on IBM Fix Central! Download fix pack , and follow the instructions either in the attached readmes or as described here to import the package to Platform Conductor.

1. Download the Spark 1.5.2-Zeppelin 0.5.5 package from Fix Central.
2. Log in to the Platform Management Console (PMC) and navigate to Workload > Spark > Version Management:

3. Click Add; then, select the package that you downloaded in step 1.

4. Click Add.

The Spark 1.5.2-Zeppelin 0.5.5 package is added to Platform Conductor. For detailed information on adding Spark versions, see Managing Spark versions in the IBM Knowledge Center.

5. Navigate to Workload > Spark > Notebook Management:

6. Add the new Zeppelin 0.5.5 notebook by clicking the Add button, and enter the required fields in the Deployment Settings tab as follows:

• Name: Zeppelin
• Version: 0.5.5
• Package: Click Browse and provide the new Zeppelin 0.5.5 package.
• Prestart command: ./scripts/prestart_zeppelin.sh
• Start command: ./scripts/start_zeppelin.sh
• Stop command: ./scripts/stop_zeppelin.sh
• Job Monitor command:  ./scripts/jobMonitor.sh

7. Zeppelin 0.5.5 supports Spark 1.4.1 and Spark 1.5.2 in Platform Conductor. Specify the supported_spark_version variable to be one of the following three options:

• 1.4.1
• 1.5.2
• 1.4.1, 1.5.2

8. Click Add.

The Zeppelin 0.5.5 version is enabled for use with Spark instance groups in Platform Conductor. For detailed information on adding notebook versions, see Managing notebooks in the IBM Knowledge Center.

Now when you create a new Spark instance group from Workload > Spark > Spark Instance Groups, you will see options to select Spark 1.5.2 and Zeppelin 0.5.5. For more information on creating Spark instance groups, see Creating Spark instance groups in the IBM Knowledge Center.

So get started with the updates for Platform Conductor! If you are interested in trying out Platform Conductor, download an evaluation version from our Service Management Connect page.