Content Management and Capture

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

Did you checked the RRS log level for Find Details in verify panel?

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

Hi Varun,

Yes - I've checked the Find Details RRS Logs. There's nothing obvious in them, except the fact that in DC9.1.9 the actions take longer to execute. 

For example:

In DC 8.1, AllowOnlyChars action executes in 0 milliseconds:

16:57:34.629 0       func "Allow Characters Function"16:57:34.629 0          action AllowOnlyChars ("0123456789,.-()")16:57:34.629 1  hr_locale = en-US16:57:34.629 1  rrunner: Changed RRS Locale from '2057 (en-GB)' ' to '1033 (en-US)' English (United States)16:57:34.629 1  Dynamic Locale: locale set to: 'en-US'16:57:34.629 1  Invoice - AllowOnlyChars16:57:34.629 1  start value:''16:57:34.629 1  Remove Pattern:'[^0123456789\,\.\-\(\)]+', Character Start Index:'1', Replace Removed pattern with:'', Number of matches:'0'.16:57:34.629 1  End value:''16:57:34.629 1  Removed all characters NOT included in '0123456789\,\.\-\(\)'.16:57:34.629 0

In DC919, the equivalent action takes 63 milliseconds:

17:03:39.527       func "Allow Characters Function"17:03:39.527          calling action AllowOnlyCharacters ("@F","0123456789.-()") on F:Shipping17:03:39.527  hr_locale = en-GB17:03:39.578 C:\Program Files (x86)\Datacap\dcshared\NET\ValidationsAndTextAdjustments.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.25 64Bit: False17:03:39.590 DCSmart Metaword sArgument: 0123456789.-()17:03:39.590 Smart return: ''17:03:39.590 start value:''17:03:39.590 Remove Pattern:'[^0123456789\.\-\(\)]+'17:03:39.590 CurrentDCO Object ID: Shipping17:03:39.590 Calling Object ID: Shipping17:03:39.590 Eval Node '@F'17:03:39.590 DCONav returning node having ID of:'Shipping'17:03:39.590 No match found: DeletePattern '[^0123456789\.\-\(\)]+'InsertString ''StartIndex '0'MaxMatches '0' -------------- Start Value:''Searching Value:''found 0 matches.17:03:39.590 End value:''17:03:39.590 Removed all characters NOT included in '0123456789\.\-\(\)'.17:03:39.590             action returned true

Did you checked the RRS log level for Find Details in verify panel?

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

Instead of ValidationsAndTextAdjustments use Validations action library. 

I don't need to go over the different in 8.1 vs 9.19.  There's the db migration and the verify DDK panel you need to update.
Also it's in miliseconds.  Are we talking about the same image here.

One is s Great Britain vs US for local.  

hr_locale = en-GB

Hi Varun,

Yes - I've checked the Find Details RRS Logs. There's nothing obvious in them, except the fact that in DC9.1.9 the actions take longer to execute. 

For example:

In DC 8.1, AllowOnlyChars action executes in 0 milliseconds:

16:57:34.629 0       func "Allow Characters Function"16:57:34.629 0          action AllowOnlyChars ("0123456789,.-()")16:57:34.629 1  hr_locale = en-US16:57:34.629 1  rrunner: Changed RRS Locale from '2057 (en-GB)' ' to '1033 (en-US)' English (United States)16:57:34.629 1  Dynamic Locale: locale set to: 'en-US'16:57:34.629 1  Invoice - AllowOnlyChars16:57:34.629 1  start value:''16:57:34.629 1  Remove Pattern:'[^0123456789\,\.\-\(\)]+', Character Start Index:'1', Replace Removed pattern with:'', Number of matches:'0'.16:57:34.629 1  End value:''16:57:34.629 1  Removed all characters NOT included in '0123456789\,\.\-\(\)'.16:57:34.629 0

In DC919, the equivalent action takes 63 milliseconds:

17:03:39.527       func "Allow Characters Function"17:03:39.527          calling action AllowOnlyCharacters ("@F","0123456789.-()") on F:Shipping17:03:39.527  hr_locale = en-GB17:03:39.578 C:\Program Files (x86)\Datacap\dcshared\NET\ValidationsAndTextAdjustments.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.25 64Bit: False17:03:39.590 DCSmart Metaword sArgument: 0123456789.-()17:03:39.590 Smart return: ''17:03:39.590 start value:''17:03:39.590 Remove Pattern:'[^0123456789\.\-\(\)]+'17:03:39.590 CurrentDCO Object ID: Shipping17:03:39.590 Calling Object ID: Shipping17:03:39.590 Eval Node '@F'17:03:39.590 DCONav returning node having ID of:'Shipping'17:03:39.590 No match found: DeletePattern '[^0123456789\.\-\(\)]+'InsertString ''StartIndex '0'MaxMatches '0' -------------- Start Value:''Searching Value:''found 0 matches.17:03:39.590 End value:''17:03:39.590 Removed all characters NOT included in '0123456789\.\-\(\)'.17:03:39.590             action returned true

Did you checked the RRS log level for Find Details in verify panel?

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

Hi @Blue Devil,

Thanks for your very valid suggestions.

1. We saw that Validations had been deprecated so we migrated all of those actions to ValidationsAndTextAdjustments:
   
2. All databases from 8.1 have been migrated and updated to the latest schemas (SQL Server).
3. The DDK panel has also been updated.
4. It's the same image being processed in both environments.
5. Would the Locale affect performance?

Instead of ValidationsAndTextAdjustments use Validations action library. 

I don't need to go over the different in 8.1 vs 9.19.  There's the db migration and the verify DDK panel you need to update.
Also it's in miliseconds.  Are we talking about the same image here.

One is s Great Britain vs US for local.  

hr_locale = en-GB

Hi Varun,

Yes - I've checked the Find Details RRS Logs. There's nothing obvious in them, except the fact that in DC9.1.9 the actions take longer to execute. 

For example:

In DC 8.1, AllowOnlyChars action executes in 0 milliseconds:

16:57:34.629 0       func "Allow Characters Function"16:57:34.629 0          action AllowOnlyChars ("0123456789,.-()")16:57:34.629 1  hr_locale = en-US16:57:34.629 1  rrunner: Changed RRS Locale from '2057 (en-GB)' ' to '1033 (en-US)' English (United States)16:57:34.629 1  Dynamic Locale: locale set to: 'en-US'16:57:34.629 1  Invoice - AllowOnlyChars16:57:34.629 1  start value:''16:57:34.629 1  Remove Pattern:'[^0123456789\,\.\-\(\)]+', Character Start Index:'1', Replace Removed pattern with:'', Number of matches:'0'.16:57:34.629 1  End value:''16:57:34.629 1  Removed all characters NOT included in '0123456789\,\.\-\(\)'.16:57:34.629 0

In DC919, the equivalent action takes 63 milliseconds:

17:03:39.527       func "Allow Characters Function"17:03:39.527          calling action AllowOnlyCharacters ("@F","0123456789.-()") on F:Shipping17:03:39.527  hr_locale = en-GB17:03:39.578 C:\Program Files (x86)\Datacap\dcshared\NET\ValidationsAndTextAdjustments.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.25 64Bit: False17:03:39.590 DCSmart Metaword sArgument: 0123456789.-()17:03:39.590 Smart return: ''17:03:39.590 start value:''17:03:39.590 Remove Pattern:'[^0123456789\.\-\(\)]+'17:03:39.590 CurrentDCO Object ID: Shipping17:03:39.590 Calling Object ID: Shipping17:03:39.590 Eval Node '@F'17:03:39.590 DCONav returning node having ID of:'Shipping'17:03:39.590 No match found: DeletePattern '[^0123456789\.\-\(\)]+'InsertString ''StartIndex '0'MaxMatches '0' -------------- Start Value:''Searching Value:''found 0 matches.17:03:39.590 End value:''17:03:39.590 Removed all characters NOT included in '0123456789\.\-\(\)'.17:03:39.590             action returned true

Did you checked the RRS log level for Find Details in verify panel?

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

The 32 bit still can be used.  I don't know if locale will affect this but try matching them up.   Unless you are on Datacap 9.19 fix3 than no need to worry about the 32 vs 64 bit cause that's all been fixed in ifix 3. 

I hate to say this but these are in milliseconds.   Are the rule on a share UCN over the WAN?  Same image and same batch size where you see increases?
System resources and horse power could make a different. 

Hi @Blue Devil,

Thanks for your very valid suggestions.

1. We saw that Validations had been deprecated so we migrated all of those actions to ValidationsAndTextAdjustments:
   
2. All databases from 8.1 have been migrated and updated to the latest schemas (SQL Server).
3. The DDK panel has also been updated.
4. It's the same image being processed in both environments.
5. Would the Locale affect performance?

Instead of ValidationsAndTextAdjustments use Validations action library. 

I don't need to go over the different in 8.1 vs 9.19.  There's the db migration and the verify DDK panel you need to update.
Also it's in miliseconds.  Are we talking about the same image here.

One is s Great Britain vs US for local.  

hr_locale = en-GB

Hi Varun,

Yes - I've checked the Find Details RRS Logs. There's nothing obvious in them, except the fact that in DC9.1.9 the actions take longer to execute. 

For example:

In DC 8.1, AllowOnlyChars action executes in 0 milliseconds:

16:57:34.629 0       func "Allow Characters Function"16:57:34.629 0          action AllowOnlyChars ("0123456789,.-()")16:57:34.629 1  hr_locale = en-US16:57:34.629 1  rrunner: Changed RRS Locale from '2057 (en-GB)' ' to '1033 (en-US)' English (United States)16:57:34.629 1  Dynamic Locale: locale set to: 'en-US'16:57:34.629 1  Invoice - AllowOnlyChars16:57:34.629 1  start value:''16:57:34.629 1  Remove Pattern:'[^0123456789\,\.\-\(\)]+', Character Start Index:'1', Replace Removed pattern with:'', Number of matches:'0'.16:57:34.629 1  End value:''16:57:34.629 1  Removed all characters NOT included in '0123456789\,\.\-\(\)'.16:57:34.629 0

In DC919, the equivalent action takes 63 milliseconds:

17:03:39.527       func "Allow Characters Function"17:03:39.527          calling action AllowOnlyCharacters ("@F","0123456789.-()") on F:Shipping17:03:39.527  hr_locale = en-GB17:03:39.578 C:\Program Files (x86)\Datacap\dcshared\NET\ValidationsAndTextAdjustments.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.25 64Bit: False17:03:39.590 DCSmart Metaword sArgument: 0123456789.-()17:03:39.590 Smart return: ''17:03:39.590 start value:''17:03:39.590 Remove Pattern:'[^0123456789\.\-\(\)]+'17:03:39.590 CurrentDCO Object ID: Shipping17:03:39.590 Calling Object ID: Shipping17:03:39.590 Eval Node '@F'17:03:39.590 DCONav returning node having ID of:'Shipping'17:03:39.590 No match found: DeletePattern '[^0123456789\.\-\(\)]+'InsertString ''StartIndex '0'MaxMatches '0' -------------- Start Value:''Searching Value:''found 0 matches.17:03:39.590 End value:''17:03:39.590 Removed all characters NOT included in '0123456789\.\-\(\)'.17:03:39.590             action returned true

Did you checked the RRS log level for Find Details in verify panel?

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

Did you checked the RRS log level for Find Details in verify panel?

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Uploading the RRS file from 919 with the deprecated actions.

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

Uploading the RRS file from 919 with the deprecated actions.

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Thanks Varun,

I've made the changes you suggested in DC 9.1.9 ifix03 with the legacy actions and reduced the execution time from 90 seconds to 53 seconds. It's an improvement, but still doesn't come close to the 15 seconds performance time that we see in DC 8.1.

Are there any other changes that you can think of?

Many thanks for your help so far.

Shaun

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

Uploading the RRS file from 919 with the deprecated actions.

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

Please share the latest log file from 9.1.9 environment

Thanks Varun,

I've made the changes you suggested in DC 9.1.9 ifix03 with the legacy actions and reduced the execution time from 90 seconds to 53 seconds. It's an improvement, but still doesn't come close to the 15 seconds performance time that we see in DC 8.1.

Are there any other changes that you can think of?

Many thanks for your help so far.

Shaun

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

Uploading the RRS file from 919 with the deprecated actions.

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Varun,

Many thanks - log file attached.

Kind regards,

Shaun

------------------------------
Shaun McDowall
------------------------------

Original Message:
Sent: Thu August 03, 2023 11:12 AM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Please share the latest log file from 9.1.9 environment

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 08:20 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I've made the changes you suggested in DC 9.1.9 ifix03 with the legacy actions and reduced the execution time from 90 seconds to 53 seconds. It's an improvement, but still doesn't come close to the 15 seconds performance time that we see in DC 8.1.

Are there any other changes that you can think of?

Many thanks for your help so far.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

I found a way to completely disable the logs. Try this and observe the performance:

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Varun,

Thanks again - 

That has improved it to 45 seconds. I think that's probably the best we can do?

Shaun

I found a way to completely disable the logs. Try this and observe the performance:

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

I believe this is the root cause of more time. There are around 1200 occurrences of it in the log. At the end of the rule something is happening which is very hard to say unless I have the DCO

Hi Varun,

Thanks again - 

That has improved it to 45 seconds. I think that's probably the best we can do?

Shaun

I found a way to completely disable the logs. Try this and observe the performance:

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Varun,

I think you're right - I hadn't noticed previously but those entries seem to appear in every RRS Log for Datacap 9.1.9. I even noticed it in VScan.rrs for a TravelDocs batch. So I guess the question is, is it a global setting or is it application-specific? There's nothing that I can find in the DCO.

Is it the same on your system?

Many thanks,

Shaun

Hi Shaun,

I believe this is the root cause of more time. There are around 1200 occurrences of it in the log. At the end of the rule something is happening which is very hard to say unless I have the DCO

Hi Varun,

Thanks again - 

That has improved it to 45 seconds. I think that's probably the best we can do?

Shaun

I found a way to completely disable the logs. Try this and observe the performance:

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

We are on 9.1.8 but I saw the same entries as well but did not see that much lag. Also I am not sure if there is a way to disable it.

My recommendation would be to open a case with IBM at this moment.

Hi Varun,

I think you're right - I hadn't noticed previously but those entries seem to appear in every RRS Log for Datacap 9.1.9. I even noticed it in VScan.rrs for a TravelDocs batch. So I guess the question is, is it a global setting or is it application-specific? There's nothing that I can find in the DCO.

Is it the same on your system?

Many thanks,

Shaun

Hi Shaun,

I believe this is the root cause of more time. There are around 1200 occurrences of it in the log. At the end of the rule something is happening which is very hard to say unless I have the DCO

Hi Varun,

Thanks again - 

That has improved it to 45 seconds. I think that's probably the best we can do?

Shaun

I found a way to completely disable the logs. Try this and observe the performance:

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Varun,

I will do that. I want to thank you and @Blue Devil for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Fri August 04, 2023 10:09 AM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

We are on 9.1.8 but I saw the same entries as well but did not see that much lag. Also I am not sure if there is a way to disable it.

My recommendation would be to open a case with IBM at this moment.

------------------------------
Varun Gupta

Original Message:
Sent: Fri August 04, 2023 05:16 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

I think you're right - I hadn't noticed previously but those entries seem to appear in every RRS Log for Datacap 9.1.9. I even noticed it in VScan.rrs for a TravelDocs batch. So I guess the question is, is it a global setting or is it application-specific? There's nothing that I can find in the DCO.

Is it the same on your system?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 01:44 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I believe this is the root cause of more time. There are around 1200 occurrences of it in the log. At the end of the rule something is happening which is very hard to say unless I have the DCO

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 01:14 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Thanks again - 

That has improved it to 45 seconds. I think that's probably the best we can do?

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 01:06 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I found a way to completely disable the logs. Try this and observe the performance:

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 12:56 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 12:47 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 12:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 12:37 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 11:54 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 03:21 PM
From: K Mohan
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

I am curious to see if you have found the root cause of the time lag between rrRuleEnd and  nDefaultRtn entries in the log. We are experiencing something similar and wondering if IBM was able to assist you.

Regards

------------------------------
Mohan

Original Message:
Sent: Fri August 04, 2023 10:34 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

I will do that. I want to thank you and @Blue Devil for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Fri August 04, 2023 10:09 AM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

We are on 9.1.8 but I saw the same entries as well but did not see that much lag. Also I am not sure if there is a way to disable it.

My recommendation would be to open a case with IBM at this moment.

------------------------------
Varun Gupta

Original Message:
Sent: Fri August 04, 2023 05:16 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

I think you're right - I hadn't noticed previously but those entries seem to appear in every RRS Log for Datacap 9.1.9. I even noticed it in VScan.rrs for a TravelDocs batch. So I guess the question is, is it a global setting or is it application-specific? There's nothing that I can find in the DCO.

Is it the same on your system?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 01:44 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I believe this is the root cause of more time. There are around 1200 occurrences of it in the log. At the end of the rule something is happening which is very hard to say unless I have the DCO

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 01:14 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Thanks again - 

That has improved it to 45 seconds. I think that's probably the best we can do?

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 01:06 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I found a way to completely disable the logs. Try this and observe the performance:

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 12:56 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Please set the below to False. Close and reopen dcdesktop again to try:

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 12:47 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

I had to make it a .docx in order to upload. You will need to remove the .docx extension in order to view.

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 12:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Many thanks - DCDesktop.exe.config attached.

Kind regards,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Thu August 03, 2023 12:37 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

------------------------------
Varun Gupta

Original Message:
Sent: Thu August 03, 2023 11:54 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 03:21 PM
From: K Mohan
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------

Hi Shaun,

DcDesktop logging cannot be turned off completely even after setting Writelog = False in the dcdesktop.exe.config. 

Can you share your env dcdesktop.exe.config file?

Hi K Mohan,

This seems like a bug - I also tried setting the Rulerunner Service Log to 1 as the tool tip says that should disable logging, but that setting is ignored and log files are still created:

Logs are not generally required for Find Details, so if there was a way of turning those off, performance might improve.

Hello team,

(Sorry about posting in this thread). Will try to post separately, please ignore)
We recently upgraded to 9.1.9 and seeing similar issues.

Thanks,
Kavitha

------------------------------
K Mohan

Original Message:
Sent: Wed August 02, 2023 02:34 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

Try the below steps:

1. Change localhost to server IP or the actual directory path and observe performance
   1. In 8.1 you have C:\Datacap\TAC\batches
   2. In 9.1.9 you have \\localhost\Datacap\TAC\batches
2. Turn off the Flush buffer under verify task settings
   1. 

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 01:41 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Uploading the RRS file from 919 with the deprecated actions.

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:37 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun,

Yes - I've uploaded both RRS Log files below.

Many thanks for your help.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Wed August 02, 2023 12:08 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Shaun,

I am not sure about the 64 and 32 bit actions as I have never used 64 bit action.

Would you be able to share the complete RRS logs from 8.1 and 9.1.9?

------------------------------
Varun Gupta

Original Message:
Sent: Wed August 02, 2023 06:22 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi Varun / Blue Devil,

I replaced all of the newer actions in my Find Details ruleset with the old deprecated ones in Datacap 9.1.9 iFix03.

The Find Details ruleset in both versions is now identical. The locale has now been fixed also.

Here are the statistics:

Datacap 8.1: Find Details takes 15 seconds.

Datacap 9.1.9 with new actions: Find Details takes 90 seconds.

Datacap 9.1.9 with deprecated actions: Find Details takes 60 seconds.

My conclusion is that the deprecated actions are a little faster than their replacements but even using them, Datacap 9.1.9 still takes 4 times longer to execute the same ruleset and logic as Datacap 8.1.

Both servers are identical in terms of their CPU and RAM specification (4 vCPU, 8Gb RAM) and I tested using the same document.

I don't understand why the performance in the latest version should be so much worse than in Datacap 8.1. What else do you think I should be checking?

I do have one other question:

I noticed in the RRS Log Files that when running with the new 64-bit actions, I often see lines similar to this:

16:26:20.485 C:\Datacap\dcshared\NET\RuleRunnerLogic.dll. AssemblyVersion: 9.1.8.0. AssemblyFileVersion: 9.1.9.10 64Bit: False

If running the 64-bit action, shouldn't 64Bit be True?

Many thanks,

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:44 PM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Thanks Varun,

I shall try this tomorrow and update here.

Shaun

------------------------------
Shaun McDowall

Original Message:
Sent: Tue August 01, 2023 03:13 PM
From: Varun Gupta
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

I have a suggestion.

Please use the action from the deprecated library in 9.1.9 and check the performance. This will eliminate the possibility of slowness due to the new DLL.

------------------------------
Varun Gupta

Original Message:
Sent: Mon July 31, 2023 11:17 AM
From: Shaun McDowall
Subject: Batch Processing Slowness in Datacap 9.1.9 compared to Datacap 8.1

Hi,

We have carried out an upgrade from Datacap 8.1 to Datacap 9.1.9 iFix03. The customer is in UAT and has noticed that batch processing takes significantly longer in the new system compared to the old.

The upgrade did not make any major code or logic changes, merely replaced deprecated actions with the latest ones. However, both batch profiler and Find Details which is invoked from the Verify Panel take orders of magnitude longer under Datacap 9.1.9 than they used to. 

For example, if I click Find Details in 8.1, it takes 15 seconds to execute against a test document. The same code, logic and document in 9.1.9 takes 1 minute and 30 seconds to execute.

I have been through the RRS log files and can find no obvious bottlenecks, just that the actions take longer to execute in 9.1.9. I have also compared the Registry settings for Rulerunner etc, but they are identical.

Has anyone else noticed this, and how did you overcome it? Alternatively, any suggestions are very welcome.

Many thanks,

Shaun

------------------------------
Shaun McDowall
------------------------------