Planning Analytics

Planning Analytics

Get AI-infused integrated business planning

 View Only
Expand all | Collapse all

How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

  • 1.  How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Mon November 25, 2024 10:43 AM
    Dear community,
     
    I hope this message finds you well. I have a question regarding IBM Planning Analytics Workspace (PAW) and TurboIntegrator processes:
     
    Is it possible to directly access a file exported by a TurboIntegrator process within PAW for an analyst/consumer profile?
    Here is the use case:
    The user clicks an action button in a PAW book, which triggers a TurboIntegrator process that generates a CSV file. The goal is for the user to access or download this CSV file after the process has run.
    If accessing or downloading such exported files is feasible, could you please advise on the best practices for retrieving or locating such files? Are there specific configurations, settings, or permission adjustments required to make these exported files accessible directly in the workspace, or does this require external file management?
    My current setup includes PAW version 2.0.91 and a local PA environment.
     
    Any insights or examples based on your experience would be greatly appreciated. Thank you in advance for your support!


    ------------------------------

    Best regards,

    ------------------------------
    Tin NGUYEN
    Co-founder at Treekala
    IBM Planning Analytics and VBA enthusiast
    ------------------------------
    ------------------------------


  • 2.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Mon November 25, 2024 11:01 AM
    Edited by George Tonkin Mon November 25, 2024 11:02 AM

    Hi Tin,

    Yes it should be possible via a drill, not currently via a process - look at this article which uses 

    ReturnCSVTableHandle();

    This allows you to drill to a text file and based on your delimiters return it as a grid/matrix or single column.

    You could link the drill to a cell or view that is updated via the process and signals the user to drill.



    ------------------------------
    George Tonkin
    Business Partner
    MCI Consultants
    Johannesburg
    ------------------------------



  • 3.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed November 27, 2024 02:31 AM

    Hi George,

    Thank you so much for your detailed explanation and for pointing me to the ReturnCSVTableHandle() function. It's very helpful to know that this can be achieved via a drill rather than directly from the process. Sorry for my late reply but I'll review the article and test the approach you've outlined.

    The idea of linking the drill to a cell or view updated by the process is particularly interesting, and I can see how it could enhance the user experience. I'll give it a try and let you know how it works in my setup.

    I truly appreciate your time and guidance!

    Best regards,



    ------------------------------
    Tin NGUYEN
    IBM Planning Analytics an Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 4.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed November 27, 2024 11:30 AM

    Hi George,

    Thank you again for your guidance on this. I've had the chance to test the solution using ReturnCSVTableHandle() and the drill approach, and it has resolved almost everything I was aiming to achieve.

    However, there's still one small issue that remains: the first row of the exported csv file contains the column letter (A, B, C, D, E, etc). The real fields name start on the second row. 

    If you have any further insights or suggestions to address this, I'd greatly appreciate it. Your help has already been invaluable, and I'm almost there thanks to your advice!

    Best regards,



    ------------------------------
    Tin NGUYEN
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 5.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed November 27, 2024 11:37 AM

    Hi Tin, really glad to hear that it is working out for you.

    I am hoping that all you need to do now is add the following to the top of Prolog:
    DatasourceASCIIHeaderRecords = 1;



    ------------------------------
    George Tonkin
    Business Partner
    MCI Consultants
    Johannesburg
    ------------------------------



  • 6.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed November 27, 2024 11:45 AM

    I tried. It won't just display the headers and start directly with the first row of data. The A, B, C, D, etc will still be displayed. 😆



    ------------------------------
    Tin NGUYEN
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 7.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed November 27, 2024 01:26 PM

    This is what I have in my Prolog and changing the number of records does change where the file starts i.e. no headers.

    #=====SET DATA SOURCE=====
    #--Configure the data source and use a colon as a separator to keep object/file name in column A and other details in subsequent columns
    DataSourceType = 'CHARACTERDELIMITED';
    DatasourceASCIIDelimiter=':';
    DatasourceNameForServer=sFilename;
    DatasourceASCIIHeaderRecords = 1;
    #=========================



    ------------------------------
    George Tonkin
    Business Partner
    MCI Consultants
    Johannesburg
    ------------------------------



  • 8.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed November 27, 2024 02:00 PM

    Ok I wasn't clear enough. After drilling, we have the possibility to download the related csv file. It is in this csv file that I have an issue. When I open this csv file in Excel or a text editor, the first row that appears are A, B, C, D, E, etc. Not the real headers. I attached some printscreens so you can see what I get.

    Thx for your help



    ------------------------------
    Tin NGUYEN
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 9.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed November 27, 2024 11:47 PM

    HI Tin, those look to be added by the PAW process creating the extract file that is saved locally.
    Doubt anything can be done at this stage unless you log an idea to have a change made.



    ------------------------------
    George Tonkin
    Business Partner
    MCI Consultants
    Johannesburg
    ------------------------------



  • 10.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Mon December 02, 2024 10:29 AM

    Hi Tin,

    I love the approach from George.

    We have a use case where we want to provide "uploadfiles" with predefined structures for TI processes.

    The predefined structure csv files are saved in the tm1web folder in a specific subfolder:

    "...\Program Files\ibm\cognos\tm1web\webapps\tm1web\Exports"

    In PAW we have action buttons for different "uploadfiles" with the "tm1web-url" as a hyperlink:

    ".../tm1web/Exports/test_file_csv.csv"

    this opens a new tab and you can see the csv file and just save it with "strg + s"



    ------------------------------
    Thilo Thurner
    ------------------------------



  • 11.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Tue December 03, 2024 10:18 AM

    Hi Thilo,

    Thank you for sharing your approach; it's interesting to see how you've implemented it.

    I really like George's solution and have been exploring it, but I encountered a specific issue that I'll address in another post to keep things organized.

    Regarding your solution, I'm particularly curious about the part involving the "tm1web-url" and the location for saving the CSV file. Could you clarify how the URL is structured and where exactly the CSV file should be placed in the TM1Web folder? Additionally, do any specific permissions or configurations need to be set for this to work seamlessly?

    I tried to put my csv file here: D:\Program Files\ibm\cognos\tm1web\Exports\my_csv_file.csv

    In the action button on PAW, I put this URL: https://servername:9510/tm1web/Exports/my_csv_file.csv

    It opens a window telling me that it couldn't find the file.

    I appreciate your input, and I look forward to hearing more details!

    Best regards



    ------------------------------
    Tin Nguyen
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 12.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Tue December 03, 2024 10:44 AM

    Hi Tin,

    I think you are in the wrong directory.

    You need to place the file into the subfolder of the webapps/tm1web.

    As I wrote in the previous post, it should look like that (or in your case und D:\):

    C:\Program Files\ibm\cognos\tm1web\webapps\tm1web\Exports

    I guess the tm1web URL only works under the "webapps\tm1web\" folder.

    So If you place the file there, your PAW URL Hyperlink should work.

    Best regards

    Thilo



    ------------------------------
    Thilo Thurner
    ------------------------------



  • 13.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Tue December 03, 2024 11:06 AM

    My bad! Thank you for your detailed explanation. I tested your approach, and it works perfectly-thank you for sharing it!

    I put the file here: D:\Program Files\ibm\cognos\tm1web\webapps\tm1web\Exports\my_csv_file.csv

    The URL in the PAW action button: https://servername:9510\tm1web\Exports\my_csv_file.csv

    The only concern I have is regarding the export location in the "Program Files" directory. While it works technically, I'm wondering if it's a good idea to allow users to interact with files in this location. My main worry is that it could quickly become unorganized if multiple users or processes start adding files there without clear management or structure.

    Have you faced similar challenges in your implementation? Do you have any suggestions for keeping things clean and manageable?

    Thanks again for your great input-it's much appreciated!

    Best regards,

    Tin



    ------------------------------
    Tin Nguyen
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 14.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Tue December 03, 2024 11:24 AM

    Hi Tin,

    as mentioned in my first post, we only use it from the "admin" side to provide predefined upload csv files for users who want to upload data with the paw function mentioned from Stuart.

    Its a way to distribute current csv formats which are tailored for specific TI processes.

    So in our case the users don't upload into the directory with TIs.

    I just wanted to show there is a possibility, but you are totally right, there is no file management in place.

    If the data is imported through a TI you could probably make a folder for each user and put it in there accordingly.

    For cleaning up and manage disk space you need additional powershell scripts, I would imagine.

    Best regards,

    Thilo



    ------------------------------
    Thilo Thurner
    ------------------------------



  • 15.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Tue December 10, 2024 05:10 PM

    Tin - I think you missed going far enough down in the directory to create the exports folder and place your file.

    You said: I tried to put my csv file here: D:\Program Files\ibm\cognos\tm1web\Exports\my_csv_file.csv

    It needs to go to : D:\Program Files\ibm\cognos\tm1web\webapps\tm1web\Exports\my_csv_file.csv



    ------------------------------
    Rob Baierle
    PMsquare
    ------------------------------



  • 16.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Thu December 12, 2024 01:26 AM

    Hi Rob,

    Thank you for pointing that out! You're absolutely right-I realized that I hadn't gone far enough down the directory path. I've already corrected it and placed the file in the appropriate folder (webapps\tm1web\Exports), and everything is working as expected now.

    I really appreciate your attention to detail and your support!

    Best regards,



    ------------------------------
    Tin Nguyen
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 17.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Tue December 03, 2024 07:49 AM

    Hi Tin,

    Looks like you already got some good advice from the regulars!

    I would like to build a feature in Workspace books to address this requirement.  We could potentially build a feature that works similar to the action button file upload feature (https://www.ibm.com/docs/en/planning-analytics/2.0.0?topic=buttons-upload-files-database-action-button).  This feature would generate a file name that is passed to the TI process as a parameter and if the process completes successfully it would download that file.  The TI process would need to be written to export data to the named file.

    We are currently working on support for hyperlinks in string cells in the Workspace cube viewer.  This might also be helpful in providing access to files that are generated by TI processes.

       



    ------------------------------
    Stuart King
    Product Manager
    IBM Planning Analytics
    ------------------------------



  • 18.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Tue December 03, 2024 11:30 AM

    Hi Stuart,

    Thank you so much for taking the time to weigh in on this thread-I really appreciate it!

    The idea of building a feature in Workspace books to address this requirement sounds fantastic. A functionality similar to the file upload action button, where the TI process could export data to a named file and then automatically trigger a download upon successful completion, would be a game-changer for use cases like mine. It would streamline the process and significantly enhance the user experience.

    I'm also excited to hear about the upcoming support for hyperlinks in string cells within the Workspace cube viewer. That sounds like another great step toward providing better access to files generated by TI processes. It could open up new possibilities for interacting with exported data directly from Workspace.

    Thank you again for sharing these insights-it's reassuring to know that these kinds of enhancements are being considered for future releases. If there's anything I can contribute in terms of feedback or testing when these features are rolled out, I'd be more than happy to help!

    Best regards,
    Tin



    ------------------------------
    Tin Nguyen
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 19.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Wed December 11, 2024 10:13 AM

    Tin,

    If the PA export files the users need are not huge, less than 20 MB or so, you could have them emailed to the user at the end of the TI process that the user runs. The user still receives the file automatically, albeit, in their InBox with a little email processing lag, but they get the file.

    The following IBM URL details how PA Cloud can call PowerShell via a TI process and ExecuteCommand to send emails that can have attachments that are files that the PA service account can access. This email method can readily be modified for an on-premises situation connecting to your email provider, but might take some initial work configuring. Also, there will likely be attachment size limitations in your email system.

    https://www.ibm.com/support/pages/node/1115787



    ------------------------------
    Walter Coffen
    Technology Manager
    QueBIT Consulting, LLC
    ------------------------------



  • 20.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Thu December 12, 2024 01:33 AM

    Hi Walter,

    Thank you for your suggestion and for sharing the IBM URL-much appreciated!

    I had indeed considered the option of emailing the exported files directly to users. While it's a viable approach, I find it less ideal in my case because it requires additional configuration, particularly for on-premises setups. It also introduces some dependency on email system limitations, such as attachment size and potential delays.

    That said, I truly value your input, and it's always good to have alternative solutions in mind. Thanks again for your time and support!

    Cheers



    ------------------------------
    Tin Nguyen
    IBM Planning Analytics and Excel VBA enthusiast
    Co-founder at Treekala
    ------------------------------



  • 21.  RE: How to access exported files (CSV) from a TurboIntegrator process in PAW (for Analyst/Consumer users)

    Posted Thu December 12, 2024 01:55 PM

    Just wanted to share a couple of thoughts:

    1. Sharing files via TM1Web URLs might pose a security risk, as it could expose restricted data to unauthorized users.

    2. Instead of saving data as a local CSV file, consider uploading it to a secure platform like Google Drive, Dropbox, or similar services, where you can control access.

    3. If Google Sheets is an option, you could use the TeamOne add-on to seamlessly retrieve and interact with data from IBM Planning Analytics.


    ------------------------------
    Vlad Didenko
    Founder at Succeedium
    TeamOne Google Sheets add-on for IBM Planning Analytics / TM1
    https://succeedium.com/teamone/
    Succeedium Planning Analytics Cloud Extension
    https://succeedium.com/space/
    ------------------------------