Cognos Analytics

Cognos Analytics

Connect, learn, and share with thousands of IBM Cognos Analytics users! 

 View Only
Expand all | Collapse all

Extract meta data from data modules

  • 1.  Extract meta data from data modules

    Posted Fri March 11, 2022 09:54 AM
    Hi all,

    did anyone try to get some meta data out of data modules?

    With meta data i mean information about tables, columns and all information we
    put into the data module to help our consumer (comments, screen tip etc.).

    I thought i would find these information in tables of the content store but until now
    i was not successful.

    Are data modules stored in the content store?

    At the end the idea behind is to extract all meta data and create a kind of "data catalog" or
    "glossary"  (with a Analytics report) for our users derived from data modules as no dedicated data catalog is in place yet.

    If someone has a different approach how to describe all objects in our Analytics environment (data rooms, tables, columns etc)
    i am also very interested in.

    Thanks in advance.

    BR
    Andreas

    ------------------------------
    Andreas Wycisk
    ------------------------------

    #CognosAnalyticswithWatson


  • 2.  RE: Extract meta data from data modules

    Posted Fri March 11, 2022 10:12 AM
    Hi Andreas,

    have you tried looking in the data module spec for those informations? The shortcut works with an English keyboard only (afaik):
    https://www.ibm.com/support/pages/how-copy-cognos-analytics-1117-data-module-or-dashboard-spec-json-one-environment-another

    I cannot try it out by myself as I don't use data modules. Jens is still "working" on me to switch from Framework Manager to DMs ;)


    ------------------------------
    Robert Dostal
    Team Leader BI
    GEMÜ
    Ingelfingen
    ------------------------------



  • 3.  RE: Extract meta data from data modules

    Posted Mon March 14, 2022 03:42 AM
    Hi Robert,

    thanks for your answer. I found this IBM technote as well but the mentioned shortcut did not work for me
    (i tried all common browser).
    Maybe it changed in 11.2 ?

    For us in our current situation DM are a very good option and woth to have a closer look at ;-)

    BR
    Andreas

    ------------------------------
    Andreas Wycisk
    ------------------------------



  • 4.  RE: Extract meta data from data modules

    Posted Mon March 14, 2022 03:56 AM
    Hi Andreas,

    did you set your keyboard to English?

    I also have to say that the specification in the content store might be the better option than exporting it manually - but I also have no idea in which tables it is stored.

    ------------------------------
    Robert Dostal
    Team Leader BI
    GEMÜ
    Ingelfingen
    ------------------------------



  • 5.  RE: Extract meta data from data modules

    Posted Mon March 14, 2022 04:24 AM
    Hi Andreas,

    It is still working even in 11.2.1.
    You should follow the advice from @Robert Dostal about the keyboard, it is not working properly with a non-English keyboard layout (it will not work if you use ctrl / q on your keyboard​).

    Best regards,


    ------------------------------
    Patrick Neveu
    Positive Thinking Company
    ------------------------------



  • 6.  RE: Extract meta data from data modules

    Posted Tue March 15, 2022 10:01 AM
    Hi, Patrick, hi Robert,

    thanks for the tip regarding keyboard layout - that worked ;-)

    BR
    Andreas

    ------------------------------
    Andreas Wycisk
    ------------------------------



  • 7.  RE: Extract meta data from data modules

    Posted Mon March 14, 2022 01:03 PM
    Hi Andreas, For me ctrl + / + q only works if I select the / from the numpad part of the keyboard. 

    ------------------------------
    Philipp Hornung
    ------------------------------



  • 8.  RE: Extract meta data from data modules

    Posted Fri March 11, 2022 10:30 AM
    Can you try out cogbox and let me know if the data item viewer provides the information you need? I can add a download to excel button to export the information. 

    https://pmsquare.com/cogbox

    In DM click on the cogbox button and then Show Data Items. It will list all of the items in your model, and the various metadata information I thought was relevant.

    ------------------------------
    Paul Mendelson
    ------------------------------



  • 9.  RE: Extract meta data from data modules

    Posted Mon March 14, 2022 03:46 AM
    Hi Paul,

    i thought i had a look at your cogbox but will check again. 
    If all meta data (including the descriptions of all items) of a model
    can be exported in excel for example, that would be very helpful.

    I am still confused where the data model is stored (in content database yes/no)
    and if yes, where i can find it ?!?

    I give it a try and let you know.

    Thanks for your help.

    BR
    Andreas

    ------------------------------
    Andreas Wycisk
    ------------------------------



  • 10.  RE: Extract meta data from data modules

    Posted Mon March 14, 2022 07:08 AM
    Hi Paul,

    i checked again your COGBOX and this could be an option.

    Some information are missing from the property windows on the right side if u select an item:

    - represents
    - comments
    - screen tip
    - members

    If i can use COGBOX to export to Excel - this would be great ;-)

    BR
    Andreas

    ------------------------------
    Andreas Wycisk
    ------------------------------



  • 11.  RE: Extract meta data from data modules

    Posted Fri March 18, 2022 08:56 AM
    Hey Andreas,

    Thanks so much! I'll definitely add the export to Excel. I'm pretty sure I can find the first three, but I'm not sure about members. I'll dig into it to see what I can find. The model itself is stored as JSON, but I haven't found it in the content store yet. I'm pulling the details through the internal Data Modules API.

    Expect a new version in April(ish) with the new features!

    Cheers,
    Paul

    ------------------------------
    Paul Mendelson
    ------------------------------



  • 12.  RE: Extract meta data from data modules

    Posted Mon March 21, 2022 08:15 AM
    Hi Paul,

    new version in april that would be great !!

    I think "members" are not that important but comments and quick tip would be very helpful.

    Big thanks in advance.

    BR
    Andreas

    ------------------------------
    Andreas Wycisk
    ------------------------------



  • 13.  RE: Extract meta data from data modules

    Posted Mon March 21, 2022 09:25 AM
    Hi Andreas, Paul,
    Please note that 'members' are computed at runtime and are not stored in the metadata.

    There is a rest endpoint that returns the 'flattened' version of the metadata for a data module. 
    It is the method used by the internal clients of the product, e.g. Reporting, Dashboard , Explore.
    Is that the method that you are using ?  E.g: http://localhost:9300/bi/v1/metadata/modules/i2C1F99AA922F42E1BC7AC3103F137C84/metadata
    Trying to use the objects stored in the Content Store directly isn't going to be the 'supported' way. It is can change without notice, has no upgrade methods and is used significantly different depending on the environment.

    I hope this helps.

    ------------------------------
    Kind regards,
    HENK CAZEMIER
    ------------------------------



  • 14.  RE: Extract meta data from data modules

    Posted Mon March 21, 2022 04:58 PM
    Hi Henk,

    I'm actually going through the rootStore via the application itself. Since this is a tool to be used in data modules itself, it didn't make sense to me to pull the specs via the rest endpoint. 

    That being said, I am very satisfied with the changes I've added to the extension. You can now export the table to Excel. It automatically ungroups the data and adds extra columns to show the query name and identifier for each row. 



    As you mentioned, the members are processed at runtime, so adding members to the output just isn't possible.



    ------------------------------
    Paul Mendelson
    ------------------------------



  • 15.  RE: Extract meta data from data modules

    Posted Wed March 23, 2022 05:31 AM
    Interesting - gifs don't seem to play here. What's up with that, IBM? 

    I've added represents, comment, and screen tip.



    You can edit label, comment, and screen tip from there. 

    If you search for something downloading will only return the matching rows:



    ------------------------------
    Paul Mendelson
    ------------------------------



  • 16.  RE: Extract meta data from data modules

    Posted Thu March 24, 2022 09:54 AM
    Hi Paul,

    looks great. 

    Can´t wait to test in our environment ;-)

    BR
    Andreas

    ------------------------------
    Andreas Wycisk
    ------------------------------



  • 17.  RE: Extract meta data from data modules

    Posted Mon March 14, 2022 11:47 AM

    Hi Paul,

    Do you have a cogbox version for 11.1.7?



    ------------------------------
    Amy Rivito
    ------------------------------



  • 18.  RE: Extract meta data from data modules

    Posted Fri March 18, 2022 08:54 AM
    Hi Amy,

    Cogbox definitely works for 11.1.7. My current client is still on that (upgrading to 11.2 over the next few weeks), and I use the features on it all the time.

    ------------------------------
    Paul Mendelson
    ------------------------------



  • 19.  RE: Extract meta data from data modules

    Posted Tue March 22, 2022 09:18 AM
    It would be great to export it so that we can put into version control. Then if needed to restore from version control. There has been conversations in this community about Data Modules and the desire to have access to extract it into file format. This is what we do with reports. I don't know why after 4 years that isn't a feature.


    Wayne Machamer
    Project Lead/Data Architect
    Office of Information Technology (OIT)
    St. John Fisher College


    ------------------------------
    Wayne Machamer
    ------------------------------