IBM Sterling Transformation Extender

 View Only
Expand all | Collapse all

Processing large file makes Design studio close down/crash with Eclipse error

  • 1.  Processing large file makes Design studio close down/crash with Eclipse error

    Posted Fri May 24, 2024 05:17 AM

    Hi. 
    I have run into a problem that I don't know how to solve. 

    I have a quite large XML file (38M) that I try to process. When I run my mapping locally on my Windows machine Design studio reacts in one of two ways. It either closes down without any warnings or explanation, or it closes down with a Eclipse error (see picture below).

    I am pretty sure that this has something to do with the size of the file. Because when i limit the file to 2-3M it works fine. When I increase the file size it suddenly starts to fail again. 

    I have tried to tune the Map Settings in different ways. I have:

    • first of all turned all map trace options OFF (to minimize system use of system resources) 
    • tried to set Workspace to Memory instead of File. Memory seemed to work better (it processed more records before crashing)
    • tried to increase the values of PageSize and PageCount 

    But none of the above made the whole file process. I have processed large files in earlier projects, and I have never encountered this kind of error. 

    Hope someone can help!

    This is what the Eclipse error looks like. I have run the mapping countless times, and the error message is the same except the value of "exitdata" on line 35.That value changes between runs. Don't know if that's relevant at all, just a mention...



    ------------------------------
    Jan Thomas Flaate
    ------------------------------


  • 2.  RE: Processing large file makes Design studio close down/crash with Eclipse error

    Posted Fri May 24, 2024 11:04 AM

    First of all, what version of the Design Studio are you experiencing this problem? Secondly, which version worked for you with large file?

    Finally when I have large files, I usually increase both the PageSize and PageCount to improve performance. You may want to increase them and see if you are still getting the crash. I would start with 1024/32.



    ------------------------------
    Rex Chan
    ------------------------------