Planning Analytics

Planning Analytics

Get AI-infused integrated business planning

 View Only
Expand all | Collapse all

Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

  • 1.  Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Mon January 13, 2025 04:50 PM

    Hi everyone:

    I am looking for someone to "sanity check" the experience that I am about to describe. Is it only me? Am I missing some vital piece of intelligence? THANK YOU!

    Here's the story: since Perspectives is going away, we are republishing all our TM1 Web websheets from Planning Analytics for Excel (PAfE 2.1.1) to make sure they can be maintained going forward.

    There are some things we expected to need to change/fix including Action Buttons, and some of our dynamic reports (TM1RPTROW) since PAfE is a little less forgiving of some omissions. Mostly things have progressed well.

    But we have a couple of large websheets (with ~20 sheets) that won't even open in TM1 Web after being republished from PAfE but for which the old Perspectives-published edition opens INSTANTANEOUSLY in our old TM1 Web 2.0.x. The contrast is striking!

    Does anyone have any wisdom they can share INCLUDING (perhaps) some insights into how the PAFE-published websheets are processed differently from the Perspectives-published ones? 

    Surely I am not the only person running into this?

    Thank you.

    A.G.



    ------------------------------
    Ann-Grete Tan
    agtan@tensorresearch.com
    ------------------------------


  • 2.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 02:16 AM

    Hi Anne.  We have found that some larger web forms  reared I. perspectives with conditional formatting can have significantly degraded performance in PAfE.  Do your web pages include conditional formatting?



    ------------------------------
    Paul Coggan
    ------------------------------



  • 3.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 03:54 AM
    Edited by Bernd Siebert Tue January 14, 2025 03:55 AM

    Check the TM1 Web configuration file tm1web_config.xml for the parameter WorkBookMaxCellCount.
    If it is set to a numeric value, by default it is set "500000", set it to "0" or to blank "".


    Link:

    Planning Analytics Spreadsheet Services/TM1 Web configuration parameters

    The configuration parameters for Planning Analytics Spreadsheet Services are stored in the tm1web_config.xml file.

    WorkbookMaxCellCount
    Specifies the maximum cell count of a workbook as a number with no thousands separators.
    Leaving this parameter blank or setting it to 0 or less indicates that an unlimited cell count for workbooks is allowed.



    ------------------------------
    Bernd Siebert
    ------------------------------



  • 4.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 05:39 AM

    HI AG,

    PAfE and Perspectives are very different beasts indeed!

    I am thinking along the lines of the JVM running out of memory. You may want to check the logs for any indications of this as in the past I have had a similar experience where you wait and then nothing.

    This article may help but you could also check in Cognos Configuration on the memory assigned:

    https://www.ibm.com/support/pages/how-manage-your-tm1-application-server-java-memory

    Assuming you tweak the memory and things work, you could then look into what is pushing the memory up - used ranges, millions of custom styles, loads of named ranges (and invalid ones) etc. etc.

    Happy hunting and good luck!



    ------------------------------
    George Tonkin
    Business Partner
    MCI Consultants
    Johannesburg
    ------------------------------



  • 5.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 09:12 AM

    Hi AG,

    If you save the file to disk from PAfE is the file size much bigger than the original report file in Perspectives?  Hopefully you have a copy of the file from before it was opened in PAFE.  Maybe this is just the old problem where the report area that is defined by the Excel client is much bigger than it needs to be (e.g the report area somehow became all columns, including the empty columns to the right, in Excel).

    I did quickly check with our development lead for PAfE and PASS.   They confirmed that PASS simply deserializes the content in the Excel file.  PASS does not know if the websheet was published from Perspectives or PAfE. 

    Worth noting that PAfE 2.1.1 is actually a bit behind now.  We added this table (https://www.ibm.com/docs/en/planning-analytics/2.1.0?topic=21-understanding-planning-analytics-local-component-versions) to our documentation to explain the relationship between the 2.0.x and 2.1.x releases of each Planning Analytics component.  Might be worth retesting in PASS 2.1.7 in case there is a performance issue we addressed. 



    ------------------------------
    Stuart King
    Product Manager
    IBM Planning Analytics
    ------------------------------



  • 6.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 09:31 AM

    Thank you Stuart, George, Bernd, Paul and Saif for all the responses. I will investigate further and report back!



    ------------------------------
    Ann-Grete Tan
    agtan@tensorresearch.com
    ------------------------------



  • 7.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 12:15 PM

    Stuart:

    Is this what you were referring to when you suggested retesting in 2.1.7? "PH61584: LARGE CUSTOM WEBSHEETS DO NOT RENDER AFTER UPGRADING TO PLANNINGANALYTICS AS A SERVICE" (https://www.ibm.com/mysupport/s/defect/aCIKe00000001iY/dt386636?language=en_US)

    If so, are you in a position to provide any details on what was actually fixed here? Also please confirm that both PASS and PAfE would need to be updated?

    The reason I am asking is because this client is a large, very security and audit-conscious organization, so the process to "try a different release" requires some justification.

    Beyond that I can tell you that the file sizes are not different between the original Perspectives workbook and the saved-from-PAfE workbook, and small at around 147 kB despite the 20+ sheets which are almost all dynamic reports saved in an "unexpanded" state by specifying a blank (error) default SUBNM selection. 

    According to the tm1web.log file, it does look as though the JVM ran out of memory (heapspace) (thanks George), so I am going through a rebuild exercise to figure out where the breakpoint is.

    Thanks again!

    AG



    ------------------------------
    Ann-Grete Tan
    agtan@tensorresearch.com
    ------------------------------



  • 8.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 12:33 PM

    Hi AG,

    That APAR is very specific to the Planning Analytics SaaS (on AWS or Azure) offering.  The new SaaS offering does not yet use the 2.1.x versioning.  I'm assuming this is on-premise because you have access to the tm1web.log file.

    I'm suggesting the Websheet report area somehow became much larger when it was opened and published from PAfE.  This could cause the PASS service to run our of memory (consistent with what George suggested).  Note that the TM1Web memory settings are not found in Cognos Configuration in current releases.  Please see: https://www.ibm.com/support/pages/how-manage-your-tm1-application-server-java-memory  



    ------------------------------
    Stuart King
    Product Manager
    IBM Planning Analytics
    ------------------------------



  • 9.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 12:52 PM

    Hi Stuart:

    Thanks for the quick clarification! I should have paid more attention to the description on the APAR. Yes this is PA Local. Would you still see any scenario where going to 2.1.7 may be helpful?

    As I rebuild I will be on the lookout for expanded websheet report area issues.

    Thank you!

    AG



    ------------------------------
    Ann-Grete Tan
    agtan@tensorresearch.com
    ------------------------------



  • 10.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 02:00 PM

    Hi AG, what are the file sizes of the non-working websheets in the }Externals folder after re-publishing from PAfE?



    ------------------------------
    Vlad Didenko
    Founder at Succeedium
    TeamOne Google Sheets add-on for IBM Planning Analytics / TM1
    https://succeedium.com/teamone/
    Succeedium Planning Analytics Cloud Extension
    https://succeedium.com/space/
    ------------------------------



  • 11.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 02:33 PM

    Hi Vlad:

    The file sizes are not very different between the original working workbook published from Perspectives and the not-working saved-from-PAfE workbook. Both are small at around 147 kB despite having 20+ sheets which are almost all dynamic reports saved in an "unexpanded" state by specifying a blank (error) default SUBNM selection.

    I am going through the exercise of re-adding sheets one by one until it breaks. There's definitely something that causes the JVM to run out of memory (per the tm1web.log file).

    Thank you,

    AG  



    ------------------------------
    Ann-Grete Tan
    agtan@tensorresearch.com
    ------------------------------



  • 12.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Tue January 14, 2025 02:40 PM

    Spotting the issue might be tricky, but you're on the right path. Deleting and re-adding sheets one at a time, then do the same with the formulas and formatting on the problematic sheet. This should help you identify the source of the problem.



    ------------------------------
    Vlad Didenko
    Founder at Succeedium
    TeamOne Google Sheets add-on for IBM Planning Analytics / TM1
    https://succeedium.com/teamone/
    Succeedium Planning Analytics Cloud Extension
    https://succeedium.com/space/
    ------------------------------



  • 13.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Wed January 15, 2025 04:12 AM

    I had an issue with a large Perspectives report that I was transitioning to PAfE. The fix for me was to copy all the sheets into a fresh new Excel book. I copied them over one by one to check which of them tipped it over the edge but then after moving all of them it worked just fine. I put it down to something I couldn't see lurking around in an old version of the original Excel book it was created in.



    ------------------------------
    Lindsey Brooks
    ------------------------------



  • 14.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Wed January 15, 2025 09:03 AM

    Thanks Lindsey!

    Yes indeed, the step by step rebuild is the tried-and-true method for getting this done when all else fails!

    And so far it's been helping me find the issues which so far - interestingly - relate to inefficient MDX expressions in dynamic reports. What's puzzling is that this same workbook, with these same MDX expressions, has been working fine in "old" Perspectives/TM1 Web for years but in the new world are causing the Java Virtual Machine to run out of memory!

    Thanks,

    AG



    ------------------------------
    Ann-Grete Tan
    agtan@tensorresearch.com
    ------------------------------



  • 15.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Wed January 15, 2025 09:14 AM
    Hello Ann-Grete,
    I have a customer (saas cloud) who has been fighting for months with IBM support because tm1web crashes regularly due to run ot of memory.
     
    We have asked support to increase the Ram, but to no avail.
     
    Support identified some "insignificant" reporting that consumed several GB of ram in tm1web.
     
    So, with what you've seen ......
    1°) Can you give me more details on the type of mdx used in tm1rmprow that's causing problems?
    2°) can you send a case to support asking them to explain this strange behavior (and see if the symptoms are similar to those in ticket TS017249871)?
     
    Thank you very much,
    Philippe
     


    ------------------------------
    Philippe CHAMPLEBOUX
    EPM Project director
    Next Decision
    NANTES
    ------------------------------



  • 16.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Wed January 15, 2025 11:02 AM
    Edited by Ann-Grete Tan Wed January 15, 2025 11:07 AM

    Hi Philippe:

    Thank you for asking this question, and I am very interested in hearing from @STUART KING or maybe even @Hubert Heijkers as to why this dynamic report performs so differently between the two versions - note though that this is ALL PA Local, and I am not sure how much it would apply to PA SaaS:

    • The OLD version published from Perspectives to TM1 Web 2.0.x has been working acceptably since 2019
    •  But when republished from PAfE 2.1.1 to TM1 2.1.1 the JVM ran out of memory and in one case crashed the TM1 Web service.

    The Excel file has about 20 sheets and publishes to the same small file size, but has several dynamic reports. So far I have found one sheet that was causing a problem (I do not know if this is the ONLY one, but it was certainly a part of it).

    Here's the structure of the MDX that was working fine when published from Perspectives (since 2019), but which caused problems when republished from PAfE in 2025:

    { HIERARCHIZE(

    {TM1FILTERBYLEVEL(

    {FILTER(  {TM1SUBSETALL([ dimension ])},  FilterCondition1 }

    + {FILTER(  {TM1SUBSETALL([ dimension ])},  FilterCondition2 )}, 0 )})}

      

    Here's the new MDX that resolved/improved the situation:

    { HIERARCHIZE(

    {FILTER(  {TM1FILTERBYLEVEL(TM1SUBSETALL([ dimension ]), 0)},

    FilterCondition1 OR FilterCondition2)}

    )}

    As you can hopefully see, the second one requires fewer filter iterations, and the filter conditions may be quite expensive as they involve cube look ups but ultimately they are not wildly different in complexity. I expect the HIERARCHIZE (sort) step to be the most expensive, but in both cases the input set should be similar in size. I should add that I am not sure what HIERARCHIZE is doing for us when everything is filtered to level 0 anyway :-) but right now I am more focused on optimizing syntax than semantics and minimizing functional changes. 

    If anything I thought MDX processing would be more efficient in the new world :-)

    I'll try and look up your ticket but because I am in PA Local which is quite different from PA SaaS I am not sure how comparable they are. However, perhaps there are some code overlaps somewhere - perhaps in the PAfE piece? - that this example may help narrow down?

    Best regards,

    AG 

     



    ------------------------------
    Ann-Grete Tan
    agtan@tensorresearch.com
    ------------------------------



  • 17.  RE: Moving TM1 Web websheet maintenance from Perspectives to PAfE (Help?)

    Posted Wed January 15, 2025 12:45 PM

    Hello AG,

    the hierarchize function allows you to arrange elements in a hierarchical fashion (as you only have level 0s, it's not useful).
    another aspect of the Hierarchize function (undocumented) is to remove duplicates (I think), which in the case of your MDX doesn't seem useful either.
     
    I'm going to ask my customer to check for MDX in the tm1rptrow functions.
     
    When I suggested getting in touch with ticket TS017249871, it was more, in the event that you put in a ticket to IBM support, to suggest that they talk to the team in charge of this ticket to see if the problem wasn't the same after all ;-).
     
    In any case, many thanks for this information, which confirms that I should always suspect dynamic subsets in case of problems! (so many performance problems in my IT processes!)
     
    With all my thanks,
    Philipp
     

     



    ------------------------------
    Philippe CHAMPLEBOUX
    EPM Project director
    Next Decision
    NANTES
    ------------------------------