Apache Spark is an open-source big data processing framework built around speed, ease of use, and sophisticated analytics. The BI tools commonly use Spark, a computational engine that can perform transformations on data and analyze it. Spark comes with Spark SQL which is a Query engine and can directly query over Hive Metastore.

QMF's Spark support enables you to:

·         Create all QMF Object and perform operations on it.

·         Conduct all SQL Operations by creating virtual tables using Spark Data Source.

·         Import and Export Data.

·         Use a JDBC connection to access Spark data sources from QMF for Workstation, QMF for WebSphere, and QMF for Server.

·        Can combine data from Spark and other data sources by constructing analytical queries, utilizing the result sets to manipulate the data, evaluate it in different formats, and construct reports based on the findings.

Illustration

·         When you launch QMF, Spark Data Source is visible on Left side of QMF.

·         Here is the user interface for creating a spark data source. Simply enter the data source name, port, database, and necessary credentials in the "Set User Information" section, click "Test Connection", Finish and you're ready to go!

Thank you for Reading! 

#Db2 #QMF #Db2tools #Db2QMF#QMFSpark