I am working on a pipeline in IBM Cloud Pak for Data and need help understanding how to view and use the output of a Notebook node. My goal is to create a conditional execution path in the pipeline based on the Notebook's results.
-
How can I inspect the runtime output of a Notebook node after it runs in the pipeline?
-
Is it possible to access and pass the Notebook output directly to a condition or another part of the pipeline? If so, how?
What I’ve tried so far:
-
Environment Variables & Bash Scripts: I attempted to set environment variables and use Bash scripts for passing data between nodes, but this approach resulted in errors.
-
Pipeline Parameters: I tried using pipeline parameters to share data across nodes but couldn’t figure out how to directly link these parameters to the Notebook node output.
-
Notebook Configuration Output: I explored configuring the Notebook node Output, but I couldn’t figure out how to link it to a variable from the notebook itself.