Decision Management & Intelligence (ODM, DI)

Decision Management & Intelligence (ODM, DI)

Connect with experts and peers to elevate technical expertise, solve problems and share insights

 View Only
  • 1.  Validation on 15millions string values against given value

    Posted Fri August 29, 2025 10:45 AM

    Hi All,

    Requesting to suggest the best approach to validate 15 million string values(employee ids) against given value.
    Ex: if employee id of the employee is one of {"a1","a2","a3",................"a150k"}

          then set status of employee to Active.

    Note: Given employee ids in excel sheet.



    ------------------------------
    Ali B
    ------------------------------


  • 2.  RE: Validation on 15millions string values against given value

    Posted Fri August 29, 2025 11:22 AM

    Hi,

    This is a complex problem, I would say for sure don't put the values in the rules directly. 

    I would think a possible way would be to include the excel spreadsheet in the XOM  and using the POI java library (for example) to search in the excel file directly in java or B2X. 

    My 2 cents



    ------------------------------
    Alain Robert
    ------------------------------



  • 3.  RE: Validation on 15millions string values against given value

    Posted Fri August 29, 2025 12:34 PM
    Edited by Ali B Fri August 29, 2025 12:35 PM

    Thank you so much @Alain Robert for your quick response, Sure will use POI java library.



    ------------------------------
    Ali B
    ------------------------------



  • 4.  RE: Validation on 15millions string values against given value

    Posted Tue September 02, 2025 09:32 AM

    Hi,

    What you want to expose explicitly in the rules is what you want the business analysts to see or be able to change when business requirements change. Therefore of course you do not want to expose such huge lists in the rules and change the rules everytime there is a new employee. The BAL and editors have not been designed for that anyway.

    As Alain wrote, you can maintain such lists in Excel and access them through POI as long as they are not too long. It is not going to work with 15 million records as Excel does not scale to that level, and you do not want to do a Java search against 15 million values in the ODM process.

    A more scalable approach consists in exposing a verbalized REST/SQL method "belongs to list". This allows to pass contextual info, such as "country", "period", etc

    Francis Friedlander



    ------------------------------
    Francis Friedlander
    ------------------------------



  • 5.  RE: Validation on 15millions string values against given value

    Posted Tue September 02, 2025 12:39 PM

    Thanks Francis Friedlander 



    ------------------------------
    Ali B
    ------------------------------