Cognos Analytics

Cognos Analytics

Connect, learn, and share with thousands of IBM Cognos Analytics users! 

 View Only
  • 1.  Cognos Dataset Evaluation

    Posted Thu March 03, 2022 06:02 PM
    Edited by System Admin Fri January 20, 2023 04:44 PM

    Hi

    For an Upcoming project we are evaluating few BI tools in the market and plan is to pick a BI tool with high merits comparing to the other tools. Writing few points comparing Cognos Dataset to its competitors and need assistance with below points

     

    1. Is there plan to add incremental load option (with insert, update and delete) in Cognos dataset and if there is any timeframe this option will be added?

     

    1. Any thoughts or experience on Cognos Dataset handling large data volumes (billion plus records) for non aggregated data and performance impact?

     

    1. Backend Cognos Dataset file (Apache Parquet file) sitting on the Content Store/Cognos server can this be remapped to another windows file directory to reduce the size on cognos server?

     

    Thanks



    ------------------------------
    Enigmatic Forever
    ------------------------------
    #CognosAnalyticswithWatson


  • 2.  RE: Cognos Dataset Evaluation

    Posted Fri March 04, 2022 03:15 AM
    Hi Enigmatic Forever,

    About Question #3, the answer is yes. Taken from the documentation (https://www.ibm.com/docs/en/SSEP7J_11.2.0/pdf/inst_cr_winux.pdf):
    ​You can configure Content Manager to store report output and datasets to a local drive or network share by defining an external object store. Report output is available through the portal and IBM Cognos SDK, but the report output is not stored in the content store database.
    Using an external object store for report output reduces the size of the content store and provides performance improvements for Content Manager.

    Best regards,

    ------------------------------
    Patrick Neveu
    Positive Thinking Company
    ------------------------------



  • 3.  RE: Cognos Dataset Evaluation

    Posted Fri March 04, 2022 05:44 AM
    Hi, I have big doubts that Data Sets are suitable for non-aggregated billion plus records (but can't remember where I read official information about this). I recommend to consider direct database access for this purpose (no matter if via Framework Manager or via Data Modules). Since Data Sets are more or less equivalent to report queries I can't imagine that delta updates are on the IBM roadmap.

    ------------------------------
    Philipp Hornung
    ------------------------------



  • 4.  RE: Cognos Dataset Evaluation

    Posted Fri March 04, 2022 06:23 AM
    Hi,
    I'd like to throw in Dynamic Cubes as they can rule all your three questions. Depending on what you want to compare and what your underlying database vendor is, I can really recommend Dynamic Cubes if you have a regular and supported database as your source for data. See https://www.ibm.com/docs/en/cognos-analytics/11.1.0?topic=cubes-verify-system-requirements-cognos-dynamic

    1. Dynamic Cubes allow incremental data loads per default via a transaction column.
    2. Dynamic Cubes are designed for handling very large data as they have five cache levels for fast response time + the ability to use pre-aggregated data in the database.
    3. Hardware requirements can be calculated in Dynamic Cube Designer itself, but they depend on your amount of data records and dimensions structures.

    As positive "side effect": users have to be trained a little bit how to get data out of a cube instead of using flat tables with columns.​ That's a plus point in my opinion as cube hierarchies are much easier to use as flat tables.

    If you'd like to know more just ask.

    ------------------------------
    Robert Dostal
    Team Leader BI
    GEMÜ
    Ingelfingen
    ------------------------------



  • 5.  RE: Cognos Dataset Evaluation

    Posted Sat March 05, 2022 06:49 PM
    Edited by System Admin Fri January 20, 2023 04:10 PM
    Thanks a lot for all of your suggestions.

    Can I please get official confirmation from IBM Cognos team if there is a plan to open and extend the APIs or use some others means to the Cognos Dataset to insert, update, delete records in future releases ?




    ------------------------------
    Enigmatic Forever
    ------------------------------



  • 6.  RE: Cognos Dataset Evaluation

    Posted Wed March 09, 2022 11:55 PM

    If your goals are to ingest billions of rows, and perform DML on the data etc, then you should consider using one of the products CA supports.

    https://www.ibm.com/support/pages/node/6441017#11.2.1r



    ------------------------------
    NIGEL CAMPBELL
    ------------------------------