IBM Storage Insights development team have now open sourced an observability chat bot to evangelize and promote ecosystem integration for our product.
In its present form, the chat bot will service users of IBM Storage who have registered their devices with IBM Storage Insights.
Packaged as a container image, the bot can be installed by users in their enterprise premise.
The bot leverages a set of Rest APIs exposed by IBM Storage Insights to extract the dynamic statuses of registered storage systems. It further leverages Large Language Models (LLMs) hosted at IBM watsonx.ai platform for intent detection, entity extraction response generation from Rest API outputs. The system therefore will need a subscription for watsonx.ai (trial or regular).
Some of the salient features of the chat bot includes
- Conversation in Natural Language, retention and retrieval of past user conversations
- Surfacing Tenant Alert and notifications from IBM Storage Insights
- Detailed listing of storage systems, volumes as well as their metrics, alerts and notifications captured at IBM Storage Insights
Being open sourced, the chat bot can potentially be enhanced
- To source data from additional APIs and/or leverage alternate LLM models
- To extend capabilities
- for semantic search and RAG based suggestions based on published artifacts
- Text2Query for direct database queries
- Agentic features for task orchestration and workflow management.
A Big thanks to the core and extended team for the great work done. This includes
· LLM evaluations for accuracy for intent classification, entity extraction and response generation
· Cost and Performance analysis (response time)
· Analysis of bundled SLMs, LLMs versus LLMs hosted as service
The development experience, user experience, feedback and suggestions will be valuable for implementation of regular chat bot assistant in IBM Storage Insights.
References:
- Please use this Github repo link to access the open source project in Git hub repository
- For a video demonstration of IBM Storage Insights Observability Chatbot feature, please refer our YouTube channel (StorageGuru) link IBM Storage Insights - Opensource Observability Chatbot
- For details on IBM Storage Insights, please refer our product page https://www.ibm.com/products/storage-insights
- For a hands-on experience with IBM Storage Insights, please use our demonstration link https://demo.insights.ibm.com/
- For a quick summary of recent features released with IBM Storage Insights, please refer https://www.ibm.com/docs/en/storage-insights?topic=whats-new
Thank you.
Binayak Dutta
AI-Architect & Lead Data Scientist
IBM Storage Insights