Originally posted by: SystemAdmin

Consider a file that contains multiple records that need to be processed individually and transferred on success.

How are you handling an error on one of the transfers?

-If you fail the map and leave the input file, on restart of the system, the records that were successfully processed the first time will be duplicated and this is not acceptable.

You could pre-split the records into multiple files and process each file individually through a map with wildcards as source event.

-If you do not fail the map, you could somehow backup the failing record and continue with the other records. This would complicate the process though and imply manual intervention on error.

What do you think? How do you handle such error/failure situations?
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

I have used 2 methods to solve this

1. Read the input file in burst mode of 1 with onfailure set to commit and use getndset to change a value on the input record after successful processing. If a failure occurs and the map is restarted, the map rule ignores records wit the new value.

2. Don't fail the map but put failed records out to a file with a unique name and createoncontent. Have a second map listening for that file and run map 1 to reprocess the records. You need to make sure you don't get into a loop here with a record always failing.
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

Thanks for the help, never actually used GETANDSET.

Do you know whether the function works with LOOKUP functions.

GETANDSET(
LOOKUP(Field1:Record, Field2:Record = "LookupValue"),
"Value",
"1"
)

Will Field1:Record get updated with "Value"?
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: SystemAdmin

I'm not sure but why would you want to do a lookup - you only have 1 record if using burst mode.
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: SystemAdmin

Sorry for the confusion, did not mean to apply this to the current case. Had another use in mind.

Does not wok by the way, just tried it. Get a "fixed-item-obj-name expected" error.
#IBMSterlingTransformationExtender
#DataExchange
#IBM-Websphere-Transformation-Extender

Originally posted by: SystemAdmin

getandset only works on items of fixed size.
Jan
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender