Originally posted by: johnxp

Hello, We are getting disk write error(16) when processing more then 1 gb output.

According to this:

https://www.ibm.com/developerworks/community/forums/html/topic?id=7779e680-05bd-4569-933c-9cadd4b8765e

It's supposed to be fixed in 9.0.0.2, but we are still getting this error.

What we have tried below are not working.

1. Increase StreamMaxMemLimit=8192 in dtx.ini.

2. Set JVM Options to 8 gb.

3. Set work file in memory.

4. Set work file as file.

In the map there is no file writing, only memory operations, we are using sink only. It seems like WTX is not able to write big data to memory.

Any help except raising PMR? It's taking long time to get response from PMR.

Originally posted by: Laurent(Satisco)

Hi,

not sure this will satisfy you, but if you're writing 1Gb to Sink this could cause issues.

As a usual practice, I'd rather use file !create for such big temporary storage.

And excuse me if I did not understand your requirement !

Originally posted by: johnxp

FYI, we are running on AIX. Any settings we can use to avoid this? ulimit?

Originally posted by: Laurent(Satisco)

I'm no AIX expert, but don't think ulimit would help, since "disk write error" seems to indicate and ssue with a disk controller or similar issue.

Since you're using sink, I'd rather suspect there is an issue when it tries to "swap away" part of your data, but this is only a supposition

Originally posted by: johnxp

If I reduce the number of records in DB (we are retrieving data from DB) there is no error.

Only when we process around 1 M records which will create about 1 GB data in memory, we will get this disk write error, so I suspect there is a bug in memory operation in WTX 9.0.0.2.

WTX is not able to properly handle big memory (1-2 GB) usage, so sad.

Originally posted by: PaulBrett

Perhaps you could look into these two settings in the dtx.ini file:

;When data passed to/from an adapter exceeds this size (in Mbytes), data will be

;paged to a temporary file to limit the memory consumption of the process
;Default value is 500M
;StreamMaxMemLimit=500

;When data passed to/from an adapter exceeds the size specified by             
;StreamMaxMemLimit, a temporary file will be created in the following directory
;for paged data.  Ensure this path points to a directory with sufficient filespace.
;Default value on Windows is system temp dir and on UNIX /tmp dir

;StreamMaxMemDirectory=/tmp

Thank you.

Paul

Follow me on Twitter

Originally posted by: johnxp

Have tried this, set to StreamMaxMemLimit=4000 or 8000, it's not working.

Can anyone try this in AIX, read or write 2+ or 4+ GB data in Memory or to file? you will see this error easily.

Originally posted by: johnxp

Any updates for this?

Thanks.

Originally posted by: PaulBrett

There have been a few core engine fixes related to files >2Gb since 9.0.0.3.

I recommend you open a support case, and get a tip-of-tree core engine fix.

Thank you.

Paul

Follow me on Twitter