Accelerating your Datalake Tables with Db2 Warehouse ( MQT's) on Native Cloud Object Store

 View Only

Accelerating your Datalake Tables with Db2 Warehouse ( MQT's) on Native Cloud Object Store 

Tue May 21, 2024 01:50 PM

A fundamental piece of the integration of watsonx.data and Db2 Warehouse are the new Datalake tables. A new kind of table allows users to define an “external” Datalake tables from your Lakehouse, stored as open data formats (ODF). To access these tables, Db2 uses a Scheduler that splits the multiple objects that form the Datalake table in order to distribute them across the Db2 nodes.
Each time the query is executed, the external table must be accessed by the corresponding Db2 node from the source location, which incurs the full communication and data processing costs. In order to alleviate those challenges, the Db2 Warehouse 11.5.9 introduced the full support of MQTs (Materialized Query Tables) over Datalake tables.

With this support, you can create a column organized MQT as a Native Cloud Object Storage (COS) MQT over a Datalake table and get the full performance benefit of both column organized tables and Native COS tables. This webinar will present how to make these MQTs on ODF tables, some rules of thumb to make them, and show some performance benefits that were obtained by using them in a workload.

Statistics

0 Favorited
13 Views
2 Files
0 Shares
4 Downloads
Attachment(s)
mp4 file
Accelerating your Datalake tables with Db2 Warehouse Mate....mp4   94.17 MB   1 version
Uploaded - Tue May 21, 2024
pdf file
Db2Webinar2024onAccelerationWithMQTs.pdf   3.17 MB   1 version
Uploaded - Tue May 21, 2024