Content Management and Capture

 View Only
  • 1.  Maximum Rulerunner Thread recommendation

    Posted Wed August 31, 2022 11:23 AM
    Hi,
    According to Infomation Center,
    "The maximum number of threads is 150% of the number of processors."

    https://www.ibm.com/docs/en/datacap/9.1.9?topic=applications-rulerunner-thread-configuration

    However, I believe 150% recommendation isn't always true.
    There should be a different recommended Rulerunner thread count for every different CPU core configuration.
    How many Rulerunner threads have you assigned to a Ruleruner Server when the server had:

    4 Cores
    6 Cores

    If 150% recommendation is always true, 6 threads for 4 cores, and 9 threads for 6 cores.
    However, I believe more cores means more idle time for cores. 
    So in my current project, I'd like to estimate up to 8 threads for 4 cores and 12 threads for 6 cores.
    My estimation is twice the number of CPU cores beyond 4 cores.
    How do you calculate Rulerunner threads to CPU core ratio?

    ------------------------------
    dsakai
    ------------------------------


  • 2.  RE: Maximum Rulerunner Thread recommendation

    Posted Fri September 02, 2022 04:17 PM
    150% is an average. Some high compute processes like OCR might benefit from one thread per core, while other processes that are lower demand can get away with more than 1.5 per core.

    ------------------------------
    Tod DeBie
    ------------------------------



  • 3.  RE: Maximum Rulerunner Thread recommendation

    Posted Sun September 04, 2022 10:32 PM
    Thank you for your insight.

    Are these high compute processes that may need one thread per core?
    Do you think 2 threads per core for these actions isn't feasible?

    RecognizePageOCR_A
    Recognize (Abbyy)

    RecognizePageOCR_S
    Recognize (Nuance)

    GetBarcode


    ------------------------------
    dsakai
    ------------------------------



  • 4.  RE: Maximum Rulerunner Thread recommendation

    Posted Tue September 06, 2022 09:40 AM
    The ideal 150% of core ratio doesn't work as one size fit all bill. Ideally in a production scenario loading the cores with 1:2 thread ratio have proven to create bottle necks in peak business loads. Always we need to consider some compute for your core windows service, monitoring tools and other background process. As Tod DeBie mentioned, the queuing is always based on the process intensity of the particular task associated with the thread, in real time implementations we always prefer going with the 1:1.5 thread ratio with mixed queuing. Allocate two or more (rare scenario) tasks to a single thread and shuffle the priority tasks across. This ensures all the threads are utilized at optimum levels without much idle time.

    ------------------------------
    Karthick Ramanujam
    ------------------------------



  • 5.  RE: Maximum Rulerunner Thread recommendation

    Posted Wed September 07, 2022 01:25 AM
    Thank you for your suggestion.
    I am beginning to estimate the number of threads in 1:1.5 ratio.
    " in real time implementations we always prefer going with the 1:1.5 thread ratio with mixed queuing."


    ------------------------------
    dsakai
    ------------------------------



  • 6.  RE: Maximum Rulerunner Thread recommendation

    Posted Wed September 07, 2022 05:33 PM
    Not all thread are equal depending on what task you are processing.  The 150% is just a base guideline.
    Start out with one thread per core.  You can add my thread to core but pay attention to CPU not to exceed 80%. 
    Normal practice is 1 core per thread.  You can add more thread to core up to 1.5 but not to exceed CPU over 80%. 

    Hope that helps.

    ------------------------------
    Blue Devil
    ------------------------------



  • 7.  RE: Maximum Rulerunner Thread recommendation

    Posted Thu September 08, 2022 12:19 AM
    Thank you for your suggestion. Since Datacap is PVC and expensive, one thread per core is pretty hard.

    ------------------------------
    dsakai
    ------------------------------