Data Integration

 View Only
  • 1.  Load data on Databricks using Datastage

    Posted Fri May 24, 2024 09:57 AM

    Hello, 

    I want to perfom a test to load data on Databricks using Datastage. 

    I am actually using a jdbc connection to Databricks, but the performance are not good (the insert is line by line) i dont know how i cant change it to bulk insert ?

    Do you have any suggestion on that. 

    Thank you for your help. 

     



    ------------------------------
    othmane Hafiane
    ------------------------------


  • 2.  RE: Load data on Databricks using Datastage

    Posted Mon May 27, 2024 09:29 AM

    That should be controlled with the parameter "Batch size" if the jdbc driver supports it.



    ------------------------------
    Udo Neumann
    ------------------------------