Originally posted by: raj1

i have a map with 800M.B input data.I am getting "not enough memory to execute map".
I tried all settings like workspace,burst,reuse etc. But i could not get it resolved .can anybody help me to resolve this. I am attaching the map
#IBMSterlingTransformationExtender
#DataExchange
#IBM-Websphere-Transformation-Extender

Originally posted by: raj1

Here is the map
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: janhess

Where?
Could be your PC doesn't have enough memory to run the map.
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: raj1

i tried to attach 2 times.But it was not attached due to the file size.Any how i am attaching the map. I will try to attach the input file separately.
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: janhess

if input card 1 is the large file, try using burst mode. If input card 2 is the large file then you shouldn't be searching it for data, switch the member rule round.
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: janhess

Sorry, got the second part back to front. If card 2 is the large file use burst mode and if input card 1 is the large file switch the member rule round.
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: raj1

janhess,
My second input card is the large file.I tried with burst mode setting still i am getting the same error.I am attaching the first input file.
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

I have same problem. We runs on Window. IBM Support said that Window has limit that when you reach to certain size, it does not work.

The map I have is in the server, not my desktop. We have 10 GB virtual memory. No matter how you set the work space, it still takes "not enough memory to execute map". I can run it on my desktop without any problem.

File about 500 MB works, but not more than that.

What I have to do is:

Input card 1: file with 500 MB
Output card 1: target: "file", and give it the file name. You can default output card name as same as input card name with different directory.

Output card can't be "sink", that's when it uses the "internal memory".

Huong
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: SystemAdmin

did you try to change the dtx.ini setting. There is a stream size setting defaulting to 500MB, which can be changed.
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: janhess

;When data passed to/from an adapter exceeds this size (in Mbytes), data will be
;paged to a temporary file to limit the memory consumption of the process

;StreamMaxMemLimit=500

;When data passed to/from an adapter exceeds the size specified by
;StreamMaxMemLimit, a temporary file will be created in the following directory
;for paged data. Ensure this path points to a directory with sufficient filespace.

;StreamMaxMemDirectory=/tmp
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

Have you also tried to lower the page size settings an the save and rebuild and run the map? tht might also be on solution which worked for me recently. The zip file that you have attached seems to be corrupted and I could not look at your map.
Thanks
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: raj1

I tried all the page settings from 8/64 to 1024/1024 but there is no change.I reduced streammaxmemlimit all the way to 10MB still noway.I tried burst with different fetchunit values still noway.Please suggest me whether there is anyway to resolve this.Do I need to change the input tree structure inorder to use burst mode?I am attaching the input tree.
my input is 750MB and output is almost of same size.
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

attach 2 records input that your type tree reads successfully. from that I can make 750mb file and test for you.

the best method is map set to burst mode and fetch unit is 1000.
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender

Originally posted by: raj1

Thanks Nagesh for the way you responded.But i resolved it by changing the tree and removing some cards temporarily.
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender