I'm looking forward to presenting two sessions at the TechXchange 2024 event in Las Vegas, on how to realise enterprise grade Q&A with RAG with watsonx.ai + watsonx Discovery, and how to use watsonx Assistant with watsonx.ai for intelligent Assistants with Gen AI.
Enterprise grade Q&A with RAG with watsonx.ai + watsonx Discovery / Elastic Search [2796]
Using the Question Answering with RAG Accelerator from the watsonx resource hub as an example, we explain how to build RAG applications with watsonx.ai and watsonx Discovery / Elastic Search at scale. We introduce a Python pipeline in watsonx.ai for document conversion, splitting, bulk import of chunks and vector indexing with ELSER vector embeddings in watsonx Discovery. We show how the Q&A with RAG Python function deployment end point can be invoked from applications, how all questions, retrieval results, answers, and end user feedback on answers can be collected in a log index in watsonx Discovery, and how the data in the log index can be analyzed using a Notebook in watsonx.ai to detect topics and report by topic how answers were rated by end users.
Thursday, Oct 24 8:30 AM - 9:30 AM PDT South, South Seas J, Level 3
Using watsonx Assistant with watsonx.ai for intelligent Assistants with Gen AI [2797]
Using an example of watsonx Assistant calling a customizable Q&A with RAG Python function on watsonx.ai, we explain the architecture for how these products can be used together. We explain how to build an assistant with call outs to invoke the watsonx.ai REST API to pass a question and get an answer, and to subsequently pass end user feedback on the answer to be recorded and analyzed in watsonx.ai. We show how this scenario works end to end in the user interface from the point of view of a person using the assistant that is powered by the LLM on watsonx.ai. Finally, we explain the setup and deployment options for using watsonx Assistant + watsonx.ai as software or as a service on the IBM Cloud.
Thursday, Oct 24 10:00 AM - 11:00 AM PDT South, South Seas J, Level 3
#ai-featured-area-3