IBM Guardium

Hello Team, Hope all is well.

We have a plan to collect data for a long time using Guardium data marts (distributed reports). I would like to ask if there is any possibility to collect reports "Datamarts(Distributed Reports) Occupied Space Overview"? Or can I create a new report about the size of the datamarts? We need this information for monitoring and analysis. Does anyone know anything about this?

Kind Regards,

Vadym

Hi Vadym,

Datamarts are table or file "exports" of the data for a specific time. The size of each export depends on the query result and number of columns in the report. The data being exported is either zipped and tarred and sent to another location for "processing" or it is placed in the DM_EXTRACTION_STATE table.  

Datamarts are tricky so be sure your use case is a match for a datamart. Aggregators are made for keeping large amounts of data for reporting/auditing.  

Please see the full documentation at Data Mart.

Be sure to create and test one so you see how it behaves and works.  What kind of data are you wanting to get out? if you want some large report, be aware that this can lock up your collector if it is pretty huge.  Keep in mind the definition of the report/datamart is on the CM while the actions are run on the collectors.

If you want the sizes, you can get them from the file sizes on the scp location for the datamarts or the extraction logs.

Hope this helps.

Jennifer

Hello Team, Hope all is well.

We have a plan to collect data for a long time using Guardium data marts (distributed reports). I would like to ask if there is any possibility to collect reports "Datamarts(Distributed Reports) Occupied Space Overview"? Or can I create a new report about the size of the datamarts? We need this information for monitoring and analysis. Does anyone know anything about this?

Kind Regards,

Vadym

Hi Jennifer,

I extract the result into a "Table" from which the aggregator/CM automatically gather data from all of the Guardium managed units. In the extraction logs I only see "Extracted records" (see screenshot) but nothing about the size of those logs.

Hi Vadym,

Datamarts are table or file "exports" of the data for a specific time. The size of each export depends on the query result and number of columns in the report. The data being exported is either zipped and tarred and sent to another location for "processing" or it is placed in the DM_EXTRACTION_STATE table.  

Datamarts are tricky so be sure your use case is a match for a datamart. Aggregators are made for keeping large amounts of data for reporting/auditing.  

Please see the full documentation at Data Mart.

Be sure to create and test one so you see how it behaves and works.  What kind of data are you wanting to get out? if you want some large report, be aware that this can lock up your collector if it is pretty huge.  Keep in mind the definition of the report/datamart is on the CM while the actions are run on the collectors.

If you want the sizes, you can get them from the file sizes on the scp location for the datamarts or the extraction logs.

Hope this helps.

Jennifer

Hello Team, Hope all is well.

We have a plan to collect data for a long time using Guardium data marts (distributed reports). I would like to ask if there is any possibility to collect reports "Datamarts(Distributed Reports) Occupied Space Overview"? Or can I create a new report about the size of the datamarts? We need this information for monitoring and analysis. Does anyone know anything about this?

Kind Regards,

Vadym

Hello Team, Hope all is well.

We have a plan to collect data for a long time using Guardium data marts (distributed reports). I would like to ask if there is any possibility to collect reports "Datamarts(Distributed Reports) Occupied Space Overview"? Or can I create a new report about the size of the datamarts? We need this information for monitoring and analysis. Does anyone know anything about this?

Kind Regards,

Vadym

Hi Vadym,

This might not fully answer your queries but regarding size, you can utilize this cli command to get a rough idea-
support show db-top-tables db DATAMART

Hello Team, Hope all is well.

We have a plan to collect data for a long time using Guardium data marts (distributed reports). I would like to ask if there is any possibility to collect reports "Datamarts(Distributed Reports) Occupied Space Overview"? Or can I create a new report about the size of the datamarts? We need this information for monitoring and analysis. Does anyone know anything about this?

Kind Regards,

Vadym

Hello Team, Hope all is well.

We have a plan to collect data for a long time using Guardium data marts (distributed reports). I would like to ask if there is any possibility to collect reports "Datamarts(Distributed Reports) Occupied Space Overview"? Or can I create a new report about the size of the datamarts? We need this information for monitoring and analysis. Does anyone know anything about this?

Kind Regards,

Vadym

A bit off-topic, but if you enable Health analyzer alerts on collectors, you might get email notification with top tables and files on disk if you're worried about heavy loaded collectors. Also, though not directly related to data marts, Deployment health views may add a few more hints. 

Hello Team, Hope all is well.

We have a plan to collect data for a long time using Guardium data marts (distributed reports). I would like to ask if there is any possibility to collect reports "Datamarts(Distributed Reports) Occupied Space Overview"? Or can I create a new report about the size of the datamarts? We need this information for monitoring and analysis. Does anyone know anything about this?

Kind Regards,

Vadym