StreamSets

StreamSets

Connect with experts and peers to elevate technical expertise, solve problems and share insights.

 View Only

Job History Not Available and Pipeline Version Control

  • 1.  Job History Not Available and Pipeline Version Control

    Posted Thu March 16, 2023 08:56 PM

    The Issue:

    • Your job history is not available

    • Error running the job: “Error reading entity from input stream”.

    Prerequisites: 

    • The job is not using the latest pipeline version

    • The latest pipeline version has been removed or deleted

     

    The Solution/Best Practices: 

    There are a few best practices you can implement to avoid this undesirable outcome. 

     

    1. - Edit the updated job to use the previous version of the pipeline

              - Choose not to delete the unused new pipeline version

              - Your job history will remain intact, and your job will continue to run without error. 

     

    1. - When creating new versions for your pipeline, create a new job for each version 

              - History from each version will be maintained

              - You can delete pipeline versions/jobs without affecting older version’s history