StreamSets

StreamSets

Connect with experts and peers to elevate technical expertise, solve problems and share insights.

 View Only
Back to discussions
Expand all | Collapse all

What's the difference between a job and a pipeline?

  • 1.  What's the difference between a job and a pipeline?

    Posted Fri January 14, 2022 06:25 PM

    A pipeline describes the flow of data from the origin system to destination systems and defines how to transform the data along the way.

    A job is the execution of a pipeline. A job instance defines the pipeline to run and the engine that runs the pipeline. Pipeline is like a java class and job is the instance of the class.