Hi Naveen ... DVM is a component of the IBM Open Data Analytics for z/OS (IzODA) bundle. So any Spark client should be able to access DVM Server. Your use case seems to be to move the data (ETL) from the mainframe to Hadoop. I am not sure of the size of the tables, but would you be able to do either:
1) select * from tab insert into Local table or CTAS into the Apache Hive metastore or CTAS
2) use Apache Sqoop JDBC driver to connect and import from DVM to Local. Apache Flume allows the ability to schedule as a service, I believe.
------------------------------
Doug Dailey
------------------------------
Original Message:
Sent: Fri April 23, 2021 04:27 AM
From: Naveen Srikakolapu
Subject: DVM will support Spark on Z/OS
Hi,
DVM will support the Spark on Z/OS ? Could you please let me know the procedure how to setup this process.
Generally Spark is support IZODA. Is Spark on Z/OS will support DVM as well ?
I have a Virtual Tables in DVM and i have to move the data from DVM virtual tables to Hive by using Spark on Z/OS.
Regards,
Naveen
------------------------------
Naveen Srikakolapu
------------------------------
#Db2Toolsforz/OS