Originally posted by: SystemAdmin

I'm currently in the process of moving our development box from 7.5 to 8.1 There are about 15 systems all together, and I'm moving them one at a time, just redeploying the 8.1 maps over the 7.5 maps, then switching the system in event server 7.5 to launcher 8.1.

I was asked to do a performance test to see how long a certain amount of transactions from one system would take between the 7.5 and 8.1 versions, and 7.5 is so much better; more then 5 times faster. It took 10 minutes to get to 6515 "History Successes" in Managment console, while 8.1 is at 2349 in 15 minutes.

The thing is; I stop the system, wait for the number of input files to build, then start it up. It seems that for the 8.1 system, it started off good, but after about a minute, the number of transaction processing within 10 second started to decline from about a 100, to 15-30.

I made sure the dstx.ini's matched, then tried it again.

Has anyone else noticed that processing take longer in the 8.X versions then in 7.5.

Any info, help, and suggestion are greatly appreciated.

thanks
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: SystemAdmin

Attached is a jpg showing the byte count (B) and the time (C) it took to process 5125 files; 8.1 taking 29.439 second longer to process the same exact data.

The results are far less dramtic as my last test, but this system was only 2 maps; one the got kicked off, created a back up, and ran a translation map. The last time I tested, there was an ftp step. I'm going to see if that step makes that much of a difference, once I get a test FTP site and I'll post back the results.

If anyone has noticed any difference between the versions, please let me know.

Thanks.
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: DianeC

We have noticed a definite increase in processing time. If you come up with a solution, or at least why it does this, please let me know as we'd also like to get the same times that 7.5 gave us. And I'm not sure what OS you're running on, but we're on AIX 5.3.
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: SystemAdmin

Hi Diane.
We are on Unix-HP.....11 maybe. (I ran in Windows in my past life).

We have a meeting today with our "Capacity Performance management" team today, where we'll be inquiring on a way to check the resources in a controlled test (running 10,000 files in 7.5, then the same files in 8.1 on the same box). We want to know whether it’s just the beginning to end time of testing x number of files, or whether it also takes more resources to process. If the discrepency is large, we may put a call into IBM, but I have a feeling I already know what they're going to say; yes, there is an increase, and, adjust the ".ini" file.

I’ll be sure to post any results.
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: jvanboga

Looks like one of the transactions processed slightly faster in 8.1. Is that true every time that item is handled?

I also noticed, in the jpg file that the later items took substatially longer to run. If you reorder the processing do they continue to take longer? ie.. is it the data or when the data is processed?

Is there anything else running on the machine?
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender

Originally posted by: jvanboga

Have you tried running each version of your map(s) with performance tuning turned on? It might be interesting to know if the whole map is running slower or parts of a map.

Please confirm, are both versions installed on the same box?

Have you confirmed that you have all of the related patches for your environment?

Did you litterally just recompile and deploy in 8.1? Does 8.1 produce any additional files (traces, logs etc) that aren't produced in 7.5?

Message was edited by: jvanboga
#IBMSterlingTransformationExtender
#DataExchange
#IBM-Websphere-Transformation-Extender

Originally posted by: SystemAdmin

DianeC;
My meeting got canceled, so I have to touch base about the resource.
jvanboga
Um...performance tuning? Is that an 8.1 ability? I'm going through DataStage TX Performance Guide now, but I'm not exactly sure what you mean.

Originally, I had tested on our (shared) dev box, but now I'm on our dedicated failover, with nothing else running, getting around the same percentage. If anyone cares to look, attached is a csv of the results of all the files running. It's the same exact files, though they processed at different times, but it’s sorted on size.

7.5 and 8.1 are on all our boxes. In the one I posted prior, it’s a shared box, so there is other stuff running, but in the one I'm currently testing and the results are attached, 7.5 event server is up, but none of the (separate) systems are started, and the only 8.1 system is the one I'm testing. To upgrade, I take a 7.5 system, move it to an 8.1 desktop, rebuild the type trees/maps, deploy and switch it eventserver/launcher.

I see no extra log files, but I do know that management console 8.1 has extra debugging functions, which I haven't gotten to use yet, and maybe while I may not have them set to on, it's doing something behind the scenes. I'll look into that. (thank you!).

But I see what you mean; some entries do run as fast or faster in 8.1, but the majority take longer. In the attachment, the last field is the 8.1 time – 7.5, so all the negative amounts are when 8.1 ran better then 7.5. The data running was a translation from X12 322 to flat file, then an FTP step.

As for patches; I was under the impression that 8.1, build 114 was the latest version, but I will see if any patches exist.

Thanks so much for taking a look, and I hope the research can benefit you or any ot
#IBMSterlingTransformationExtender
#DataExchange
#IBM-Websphere-Transformation-Extender

Originally posted by: jvanboga

Use the 'Profiler' for performance tuning. 8.n has it and I think 7.5 has also. If the same files are consistantly running slower it might give you an insight.
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: SystemAdmin

If you mean "dtxprof", it's only in 8.1. It listed in the 8.1 Performance recommendation, and not in 7.5, and it's in 8.1_install/bin, and not in 7.5_install/bin (or anyhere under 7.5_install/).

weeps

Message was edited by: rep
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

This upgrade it draining the life out of me.

After doing even more testing, it seems that the processing time between the two versions balanced out more on a different server.

And in case anyone does an upgrade to 8.1...and that's 8.1, not 8.1.0.3 (the latest 8.1 version), a patch was required from IBM for the libcoreapi.sl file (Unix). One of the systems had a problem with the substitute function in a map rule and would stop processing. Now it works.
#IBMSterlingTransformationExtender
#DataExchange
#IBM-Websphere-Transformation-Extender