Db2 Tools for zOS

 View Only
  • 1.  DVM will support Spark on Z/OS

    Posted Fri April 23, 2021 03:53 PM

    DVM will support the Spark on Z/OS ? Could you please let me know the procedure how to setup this process.

    Generally Spark is support IZODA. Is Spark on Z/OS will support DVM as well ?

    I have a Virtual Tables in DVM and i have to move the data from DVM virtual tables to Hive by  using Spark on Z/OS.


    Naveen Srikakolapu


  • 2.  RE: DVM will support Spark on Z/OS

    Posted Mon April 26, 2021 10:27 AM

    Hi Naveen ... DVM is a component of the IBM Open Data Analytics for z/OS (IzODA) bundle. So any Spark client should be able to access DVM Server.  Your use case seems to be to move the data (ETL) from the mainframe to Hadoop. I am not sure of the size of the tables, but would you be able to do either:

    1) select * from tab insert into Local table or CTAS into the Apache Hive metastore or CTAS 

    2) use Apache Sqoop JDBC driver to connect and import from DVM to Local. Apache Flume allows the ability to schedule as a service, I believe.

    Doug Dailey