MQ

MQ

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
  • 1.  Create a network/relationship graph with a filter and clickable nodes

    Posted Thu April 21, 2022 02:03 PM
      |   view attached

    Our shop is pretty large and the one thing we find lacking is our understanding of our environment. What queue manager has what queue, how that connects to other regions over what channel, etc. So I'm trying to do something about it.

    I spent a lot of time figuring out a way to display my data and came across pyvis. It does a great job at defining nodes and edges in a meaningful way. We run weekly makedefs against all of our queue mangers which displays all of our MQ data. Channels, queues, and other definitions which we use as our input to the script I wrote. While it works great at displaying the data in a meaningful way, it doesn't have support for filtering or clickable nodes. I need these two features for the following reasons:

    1. Filtering - There is the possibility of having hundreds of nodes. It's hard to find a needle in the haystack.
    2. Clickable nodes - I would really like to store data inside of the nodes that could be dynamic and show real-ish time data.

    Is there a better product out there other than pyvis? I'm not attached to pyvis for any reason other than it was as close as I could get for the actual visualization part. I looked at matplotlib but I have too much data for that to work. My other issue is that while my python skills are pretty decent, my other languages are lacking. So using something else would be challenging but not impossible.

    Here's a picture that shows kind of what I have so far. The crude drawing in red is what I would like to see. This is only a partial of our environment showing nine connected qmgrs.

    Pink nodes - QMGR
    Green nodes - queues
    Yellow/grey nodes - channels
    Pink nodes - qremotes


    Thanks,
    Ryan Podany



    ------------------------------
    Ryan Podany
    ------------------------------


  • 2.  RE: Create a network/relationship graph with a filter and clickable nodes

    Posted Fri April 22, 2022 03:03 AM
    Have you tried using gojs https://gojs.net/latest/index.html ?
    You can customize the actions when clicking through js function that can display stuff differently. May be it is enough to change the hover function?

    ------------------------------
    Francois Brandelik
    ------------------------------



  • 3.  RE: Create a network/relationship graph with a filter and clickable nodes

    Posted Fri April 22, 2022 05:14 AM
    Ryan,

    What you are doing is showing what is configured. You might find that some queue managers are not used for processing messages.  

    You might want to sample your system and collect only 10 seconds of trace data every day, but do it at different times of day so you get a sampled profile over time.   If you have a very active system, you could get a lot of data.  There is a slight performance impact of using activity trace,  so sampling the data can minimise the impact.

    You could also use display chstatus to collect information about channel usage.

    There is a REST API for MQ, and  you can use the MQWEB server to get your data back in JSON format.

    You can use this data/charts to identify single points of failure, "there is only one channel between here and the (single) server"

    Colin





  • 4.  RE: Create a network/relationship graph with a filter and clickable nodes

    Posted Fri April 22, 2022 09:21 AM

    If you are using IBM Cloud then you should check out this project to visualise your MQ estate: https://github.com/VisualMQ/VisualMQ

    I know you said you were mostly comfortable in Python, but I wonder if you could adapt their code to skip the IBM Cloud integration section and plug in your own data directly. Probably not the answer you were looking for, but I thought I'd still post in case someone else reads this thread with a similar question.



    ------------------------------
    Ben Durrans
    ------------------------------