IBM Security QRadar

 View Only
Expand all | Collapse all

Event Enrichment

  • 1.  Event Enrichment

    Posted Wed July 10, 2019 09:05 AM
    Hi,

    i want to do event enrichment with informations that are not present in the payload ?

    what are the solutions to do that in Qradar plz ? :)

    thx !


  • 2.  RE: Event Enrichment

    Posted Wed July 10, 2019 01:03 PM
    Hi @Pipotron 2.0,

    Can you elaborate any more on what are you looking to enrich the events with? Threat intelligence would be a good place to start FWIW.

    Best,
    Jeremy


    ------------------------------
    Jeremy Goldstein
    Product Marketing Manager
    IBM QRadar
    ------------------------------



  • 3.  RE: Event Enrichment

    Posted Wed July 10, 2019 06:05 PM
    hey ;)
    something like :
    when there is an IP in the event i want add the ISP, ASN etc
    when i have an URL i want add the length of the query or the DGA for the domain  ;)

    i want add as many as informations to have to speed up the analysis

    thx

    ------------------------------
    Pipotron 2.0
    ------------------------------



  • 4.  RE: Event Enrichment

    Posted Thu July 11, 2019 10:14 AM
    Hi Pipotron,

    I think you are best off using the included X-Force Threat Intelligence feed. When configured, it will bring up URL and IP reputations from within an offense. Here's some info on setting that up: https://www.ibm.com/support/knowledgecenter/en/SS42VS_7.3.2/com.ibm.extensions.doc/t_IBM_threat_xforce.html

    https://www.youtube.com/watch?v=YkREukAOqts&feature=youtu.be

    Best,
    Jeremy

    ------------------------------
    Jeremy Goldstein
    Product Marketing Manager
    IBM QRadar
    ------------------------------



  • 5.  RE: Event Enrichment

    Posted Fri July 12, 2019 03:26 AM
    hey Jeremy ,

    thx but it's not what i want.. ;)
    i need to add context / information to events like i did it on logstash

    ex :
    i have a python script which calcul the domain generation algorithm. how to use it to add the results directly in the events ? 
    thx !

    ------------------------------
    Pipotron 2.0
    ------------------------------



  • 6.  RE: Event Enrichment

    Posted Fri July 12, 2019 01:59 PM
    Hi,

    you have the rule actions that can run your script when the rule triggers. You could probably, through your script, add the info required into your offense using the console API. I haven't yet explore this domain, so I can't give you any tips unfortunately. If you do find something, please share your find.

    Regards,

    ------------------------------
    Anthony Gayadeen, Videotron Ltd
    Montreal QC
    ------------------------------



  • 7.  RE: Event Enrichment

    Posted Mon July 15, 2019 03:48 AM
    Hello Anthony,

    yep i tought about the script when the rule triggers but
    i will not have any enrichment for all events :(
    and i need to know how to modify the payload of events with a script ;)

    thanks



    ------------------------------
    Pipotron 2.0
    ------------------------------



  • 8.  RE: Event Enrichment

    Posted Mon July 15, 2019 04:05 AM
    and i need add the enrichment before the normalization step if i want the informations parsed

    i could add a syslog or ELK to do the job before sending to EC but i would prefer have a solution with qradar

    ------------------------------
    Pipotron 2.0
    ------------------------------



  • 9.  RE: Event Enrichment

    Posted Mon July 15, 2019 10:05 AM
    This would be great. Per my discussions with IBM, they have no plans to add such capabilities, and the platform is limited to be able to do such enrichment. The event pipeline would need to be re-architected to support such capabilities like the enrichment you can do in Logstash.

    With offenses, you would think you can enrich there, but still nothing within QRadar. IBM unfortunately wants to sell you Resilient to do these things. SOC analysts should not have to right click to get basic information. This is sometimes useful, but it does not make a SOC analysts job any easier, just adds frustration.

    ------------------------------
    Steve Slivoski
    ------------------------------



  • 10.  RE: Event Enrichment

    Posted Tue July 16, 2019 03:58 AM
    One way would be to create a custom property which uses AQL to retrieve data from a reference table 

    Another way is to create a custom AQL function and use the results in a 'after the fact' report.


    ------------------------------
    Regards,
    Nico de Smidt
    ________________________________________________
    CTE Security Intelligence BeNeLux
    ------------------------------



  • 11.  RE: Event Enrichment

    Posted Tue July 16, 2019 04:06 AM
    As I understood this, the idea of enrichment was to assist the incident response (I apologize for the remainder if the assumption was wrong)? I'd say generally that a best practice approach to IR within a SOC / CSIRT would be having a NextGen SIEM as a central detection point, but for proper tracking of response/resolution process (and lessons learned afterwards) a connected tool/platform dedicated to this use would be needed (and it would allow adding artifacts on-the-go). IBM's Resilient may be an example of such a tool, but there are several open-source solutions available (which are used by a number of CSIRTs). QRadar has a published and documented API, so integration should be within reach.

    ------------------------------
    Dusan VIDOVIC
    ------------------------------



  • 12.  RE: Event Enrichment

    Posted Tue July 16, 2019 11:10 AM
    Hey :)

    Let's take an example 
    Here a simplified payload from a DNS event

    SystemTime = 2019-16-07T16 :00 :00.6545646546Z
    EventID = 3006
    Computer = WINDOWS88
    QueryName = Google.Fr
    QueryType = 28

     Qradar will parse the payload and only extract the 5 properties

     But as enrichment, i want to add in my payload the informations below

    Query_length = 9  
    IP = 216.58.206.227
    NetRange = 216.58.192.0 - 216.58.223.255
    CIDR = 216.58.192.0/19
    OriginAS = AS15169
    RegDate = 2000-03-30
    Updated = 2018-10-24
    Country = US
    Domain_Top_level = fr
    Domain_Second_Level = google
    Domain_Generational_Algorithm = 0.23
    Etc…

     With little scripts you can easy get those informations but… how add them to the events ?

     as Steve Slivoski said it's seem to be impossible on Qradar.. need to use Syslog or ELK for enrichment :(

     



    ------------------------------
    Pipotron 2.0
    ------------------------------



  • 13.  RE: Event Enrichment

    Posted Tue July 16, 2019 04:56 PM
    you could write an app to enrich with hoverover on IP, similar to the
    recorded future TIP application but that doesn't jam it into payload
    as requested. To do that using a log aggregation/processing layer to
    tack it on the payload and send the payload to qradar would be one
    approach. I don't know of a way to slam that into the payload.




  • 14.  RE: Event Enrichment

    Posted Wed July 17, 2019 03:17 AM
    As stated above, and in you example, you should consider using AQL properties or AQL custom.functions to do this.

    Main reason why qradar does not work like arcsight is that we need the original event to be forensic evidence, meaning adding, changing, removing parts of it etc. makes it hard to use it in a court of law. So it's not so logical to do this as part of the main event pipeline.

    Second reason  is that for QRadar to be able to ingest and correlate 2.5 Million EPS, You don't want any expensive lookups in the first steps.

    That said, another way of doing this is using historic correlation and add this information later.

    If it for DNA specifically we do have a free DNA analytics app in the qradar appstore.

    Hope this help

    ------------------------------
    Regards,
    Nico de Smidt
    ________________________________________________
    CTE Security Intelligence BeNeLux
    ------------------------------



  • 15.  RE: Event Enrichment

    Posted Wed July 17, 2019 07:11 AM
    hi,

    your right about keeping original Payload and avoid expensive lookups in the first steps ;)

    but while adding information later using historic correlation, those informations can be add into indexed properties or simple properties ? 

    same question with AQL properties or AQL custom.functions, can i add the information into indexed properties ?

    thx !! ;)


    ------------------------------
    Pipotron 2.0
    ------------------------------



  • 16.  RE: Event Enrichment

    Posted Fri March 27, 2020 09:34 AM
    Hi Pipotron 2.0,

    Were You able to actually do this? This is something we desperately need and we still lack a solution.

    thx!

    -Mikko

    ------------------------------
    Mikko Salonen
    ------------------------------



  • 17.  RE: Event Enrichment

    Posted Sun November 24, 2019 11:03 AM
    One way is to make a custom property which utilizes AQL to recover information from a reference table

    Another route is to make a custom AQL capacity and utilize the outcomes in a 'sometime later' report.

    Best Regards
    DigitalNetwor99

    ------------------------------
    Sumit Kumar
    Ceo & Founder
    Digital Network99
    Roorkee
    ------------------------------



  • 18.  RE: Event Enrichment

    Posted Mon November 25, 2019 08:18 PM
    This is the exact way to do it... Either load the enrichment data into a ref table and access it using ref functions, or write a custom AQL function and return it that way.. Looking at the above example its domain name lookup. This is probably a custom AQL function like this app has done...

    ------------------------------
    Christopher Meenan
    ------------------------------



  • 19.  RE: Event Enrichment

    Posted Mon November 25, 2019 08:18 PM
    https://exchange.xforce.ibmcloud.com/hub/extension/d2ec23672bf532f75a47ec3b0290b1fe

    ------------------------------
    Christopher Meenan
    ------------------------------