Planning Analytics

Planning Analytics

Get AI-infused integrated business planning

 View Only
Back to discussions
Expand all | Collapse all

Data Import Automation

  • 1.  Data Import Automation

    Posted Thu July 25, 2019 08:50 AM
    Hi, complete beginner here,

    I would like to connect Cplex and Planning Analytics on Cloud but I couldn't find any examples.
    How can I setup data conection between an excel file and PA cube? I tried to create a process that reads excel data and then updates the related cubes but I am unable to find such function that reads data from a csv file. Anyting helps at this moment, thank you in advance.

    ------------------------------
    AAydgn
    ------------------------------

    #PlanningAnalyticswithWatson


  • 2.  RE: Data Import Automation

    Posted Thu July 25, 2019 09:11 AM
    Allot of clients are using Cognos Command Center as part of executing work with excel flat files

    https://www.ibm.com/us-en/marketplace/process-automation or https://www.youtube.com/watch?v=6nYkVLCf8yg&t=171s

     If you like more information on Cognos Command Center then email me at paul.young@ca.ibm.com



    ------------------------------
    paul YOUNG
    ------------------------------

    Original Message


  • 3.  RE: Data Import Automation

    Posted Mon May 17, 2021 04:09 PM
    Can someone give me a sample CCCommand call to import-file? (Using the command line)
    Any idea where is the CCCommand executable on the server machine? (path)

    Dave


    ------------------------------
    David Lucas
    ------------------------------

    Original Message


  • 4.  RE: Data Import Automation

    Posted Fri July 26, 2019 04:03 AM
    Hi, 

    to import data from outside Planning Analytics System, you have to use Turbo Integrator Scripting. 
    Data source can be any text file, RDBS through ODBC, and If I am not mistaken there is new feature to get data from other OLAP throug MDX query. 

    Veronika



    Original Message


  • 5.  RE: Data Import Automation

    Posted Fri July 26, 2019 04:21 AM
    Flat files are supported, but not via ODBC process. The CCC process has been used by many BP and Clients

    There is secure gateway and chores that can be used when connecting with data warehouse

    IBM Planning Analytics Secure Gateway
    eCapital Advisors remove preview
    IBM Planning Analytics Secure Gateway
    Are you a current or future TM1 user interested in loading on premises data into IBM Planning Analytics Cloud? This blog post describes how to set up a secure connection to safely transmit data to the IBM Planning Analytics Cloud from on premises databases.
    View this on eCapital Advisors >


    ------------------------------
    paul YOUNG
    ------------------------------

    Original Message


  • 6.  RE: Data Import Automation

    Posted Fri July 26, 2019 04:26 AM
    yes correct. flat files importing is not through ODBC. ODBC is a connection bridge to any RDBMS. 
    Flat file can be imported directly using Turbo Integrator



    Original Message


  • 7.  RE: Data Import Automation

    Posted Fri July 26, 2019 04:32 AM
    Hi Veronica, That is true if the files are on the cloud. I think the above posters needs to clarify how the client wants to handle the files.

    ------------------------------
    paul YOUNG
    ------------------------------

    Original Message


  • 8.  RE: Data Import Automation

    Posted Fri July 26, 2019 04:44 AM
    Hi Paul, 

    ok, I missed this 'setup data conection'

    Agree with you. 


    Regards,
    Veronika



    Original Message


  • 9.  RE: Data Import Automation

    Posted Mon July 29, 2019 06:55 AM
    Hi, my flat files are not on cloud but on premise. Can I still import them via Turbo Integrator? Also, thank you so much both

    ------------------------------
    Kon Ami
    ------------------------------

    Original Message


  • 10.  RE: Data Import Automation

    Posted Mon July 29, 2019 10:21 AM
    Hi,

    If that the case you can simply use turbo integrator with datasource text file. Maybe your problem is your text file located in different machine?
    If that the case you have to make sure that the location is accessible from TM1 server

    Veronika

    Sent from my iPhone


    Original Message


  • 11.  RE: Data Import Automation

    Posted Mon July 29, 2019 04:40 PM
    Edited by System Admin Fri January 20, 2023 04:24 PM
    If you are using the new version of Planning Analytics Workspace (2.0.7+ / 2.0.42+) you are able to import data just clicking on  cube name with  right button, and click on upload data "Import Data".


    ------------------------------
    Paulo Klein
    ------------------------------

    Original Message


  • 12.  RE: Data Import Automation

    Posted Tue July 30, 2019 02:20 AM
    Hi Paulo,
    Thank you, I am using PA cloud trial to learn it and I've used that approach for importing data but now I want to automate that data import process with coding. Do you have any resources that shows examples of how to this with Turbo Integrator in terms of coding and modelling? 
    Thank you

    ------------------------------
    Kon Ami
    ------------------------------

    Original Message


  • 13.  RE: Data Import Automation

    Posted Tue July 30, 2019 08:57 AM
    Hello, 
    Probably, the first thing you need to do, is automate the process to send your files to IBM FTP on cloud.
    As mentioned by @paul YOUNG, you can use ​Cognos Comand Center, but I like to use Microsoft Flow (Automate processes + tasks | Microsoft Flow). When I put a file in my folder on OneDrive, they send it to IBM FTP automatically -  OneDrive to FTP. 

    When are uploaded the files to IBM FTP, the steps becomes easier, becase the files sent to IBM FTP are located on \\data\s  folder on TM1Server (see welcome kit for more information) .

    For CSV files, you can use Turbo Integrator using Architect to map the columns on csv file, and load the data to the Cube.

    For Excel files(*.xls, *.xlsx), I'm not sure, but I believe you can use the Performance Modeler create new Process to map your excel file and load the data to the Cube.

    PAW Create New Process has not yet seen the files located in the FTP folder, but the process created on Architect can be run by PAW, so just create a button in  Workspace to run the TI Process created with architect. The process can be executed on demand, by click, or just schedule the by chore.

    You just have to ensure that the files in OneDrive need to be up to date before running the process.




    ------------------------------
    Paulo Klein
    ------------------------------

    Original Message


  • 14.  RE: Data Import Automation

    Posted Wed August 07, 2019 10:20 AM
    Hi Kon,

    Just to support what has already been relayed to you, Cognos Command Center is an automation tool which uses protocols like SFTP. If the bulk of your flat files are on premise and you want to automate the fetching of these files, you can give CCC a heartbeat to continuously check into a directory for a flat file, once present it can upload this to the cloud. Then with a trigger, it can launch a TI process to upload the new data or other content into the cube. CCC is capable of automating this process as well as quite a few others. 

    Here's some videos which might help you as well. https://www.youtube.com/results?search_query=cognos+command+center&pbjreload=10
    Regards,
    Robert Vautour

    ------------------------------
    Robert VAUTOUR
    ------------------------------

    Original Message


  • 15.  RE: Data Import Automation

    Posted Sun July 19, 2020 05:08 PM
    Hi,

    have you had a look at https://github.com/IBMDecisionOptimization/do-ws-pa ?

    regards

    ------------------------------
    ALEX FLEISCHER
    ------------------------------

    Original Message


Related Content