Sterling Managed File Transfer

Come for answers, stay for best practices. All we're missing is you.

View Only

Back to Blog List

Reduce Correlation Data When using FTP and SFTP Protocol Adapters

By Tanvi Kakodkar posted Mon January 27, 2020 03:31 PM

Originally updated on February 19, 2015 by VinceTkac

B2Bi/SFG collects a significant amount of tracking data on certain protocol activities. If you want to squeeze a little more performance out of your system (and you don't care about this additional data) you can disable the data collection. Disabling the data collection will make ftp/sftp/mailbox faster, reduce your DB size/load and reduce the time it takes purge to cleanup.

These flags were added in 5.2.4 but are not widely known.

Here are the interesting parameters with their default values (all set to true):

## PROPERTY_START
## PROPERTY_NAME: makeCorrelationForMailbox
## PROPERTY_TYPE: Boolean
## PROPERTY_DESCRIPTION
## Allows to enable/disable the creation of Mailbox Correlation records.
## If makeTrackingExtensions is set to false, no Mailbox Correlation entries will be 
##   created if this property is set to true.
makeCorrelationForMailbox=true

## PROPERTY_START
## PROPERTY_NAME: makeCorrelationForFTP
## PROPERTY_TYPE: Boolean
## PROPERTY_DESCRIPTION
## Allows to enable/disable the creation of FTP Correlation records.
makeCorrelationForFTP=true

## PROPERTY_START
## PROPERTY_NAME: makeCorrelationForSFTP
## PROPERTY_TYPE: Boolean
## PROPERTY_DESCRIPTION
## Allows to enable/disable the creation of SFTP Correlation records.
makeCorrelationForSFTP=true

## PROPERTY_START
## PROPERTY_NAME: makeTrackingExtensions
## PROPERTY_TYPE: Boolean
## PROPERTY_DESCRIPTION
## Allows to enable/disable the creation of System Tracking Extension records.
makeTrackingExtensions=true

You can override these all to false in the customer_overrides.properties file:

doc_tracking.makeCorrelationForMailbox=false
doc_tracking.makeCorrelationForFTP=false
doc_tracking.makeCorrelationForSFTP=false
doc_tracking.makeTrackingExtensions=false

With the values set to true, you see the following in CORRELATION_SET after ftping a file named "hosts" to a directory named "test".