Presto Console is a web-based UI that is provided by Open Source Presto. It shows Presto "CLUSTER OVERVIEW", including a query list, and "QUERY DETAILS" for each query. We can use this wonderful tool in watsonx.data also.

How to get the Presto Console URL in watsonx.data

The URL to the Presto Console is available on the engine details screen of the Infrastructure Manager.　

(1) Go to Infrastructure Manager and Click Presto engine

(2) In the "Engine details", the "External host" is displayed. It is the URL to the Presto Console. Click on the copy icon to copy the URL.

• You can access the Presto Console using the URL on the External host. Click on the copy icon to copy the URL.

After you paste the URL to the browser , you will get an authorization panel. With watsonx.data userid and password, you can login to Presto Console.

Presto Console : Cluster Overview

When you enter the Presto Console, you see "CLUSTER OVERVIEW" at the top which shows cluster status. For example, image below shows 

• RUNNING QUERIES: the number of Queries that are running. 14 queries are running.
• ACTIVE WORKERS : 3 workers have been in operation. 
• QUEUED QUERIES : it shows 14 queries were in queue and now there is no query in queue.

Below of "CLUSTER OVERVIEW", you can see a query list named "QUERY DETAILS".　Here you can see a list of what is running and what has recently finished.
You can see Query id, state, and summary of resource usage of each Query.

Presto Console : QUERY DETAILS

In the query list of "CLUSTER OVERVIEW", when you find a query which you are interested in, click query id. Then you will get detailed information about the query like below.

Overview, left side image,  has

• Session, Execution, Resource Utilization Summary, Timeline, Runtime Statistics
• Full text of query is shown in "Query".
• Error Information is showed when an error is detected.
• Stage Status

You can use tabs like "Live Plan", "Stage Performance", "Splits". They show beautiful graphical images of Presto transactions.

Use the "JSON" tab to show query event data in JSON format. Displayed JSON become over 50,000 lines frequently. ( It depends on the complexity of the configuration and query.) You will be surprised at how much information is provided by beautiful UI. 

When Query Optimizer is used, JSON includes "wxdQueryOptimized: true" which means the original query has been optimized and rewritten after watsonx.data 2.1.

Conclusion

In this article, I showed next.

• How to get the Presto Console URL in watsonx.data
• Presto Console : Cluster Overview
• Presto Console : Query Details

However, I love to use Presto Console which provivdes detailed "query event data" to understand easily by beautiful UI, "query event data" are not available after a while.
watsonx.data worked this difficulty and release feature named Query History Monitoring and Management (QHMM). I am going to show QHMM later!!!

Environment

Introducing the environment. The example introduced this time is run in the following environment.

• OCP Version : 4.16
• CP4D 5.1.2 . 5.1.3 
  • watsonx.data 2.1.2 , 2.1.3
• About Presto engines configured
  • P01(Presto Java)
    • Type : Presto (Java) v0.286
    • Size : Starter
  • PCpp (Presto(C++))
    • Type : Presto (C++) v0.286
    • Size : Starter

#watsonx.data