Thanks Jason
Did researched the step you suggested.
We mainly use Extension:OpenAi assistant connector to send query to Azure Openai platform for smarter and nicer response, ( did tried watsonx ai before, not meeting academic expectations, if watsonx could adopt more smarter LLM models like gpt4o, and complete file api access, that would solve the needs )
We wish no need to send user files to Azure file respository, as there would be too many user files to manage.
So we use some js to extract file information then send the file text or image description through Watsonx chat in the background, this way it would still allow further communications with the file(s) to happen.
The 2048 chars could be not enough in some cases, that's why am suggesting if it could be extended to 4k, similar to the Copilot pane's.
Hope this explains.
Thanks again.
------------------------------
Wen-Chen Hol
------------------------------
Original Message:
Sent: Fri December 06, 2024 01:00 PM
From: Jason Leiby
Subject: Is there any way we can extend watsonx chatbot text input length from 2048 to higher?
Hi Wen-Chen,
Are you looking to perform the file upload on a per session basis? If so, then I would suggest looking at this tutorial: Enable a file upload capability within your watsonx Assistant web chat. Providing an upload capability will then free up the text length of the chat so that users can just ask questions regarding the document rather than trying to paste it in.
I would also look at the Conversational Search feature with watsonx Assistant if these are documents that will be regularly referred to.
------------------------------
Jason Leiby
Principal WW Data & AI Technical Sales Specialist
jason.leiby@ibm.com
Dillon, CO USA
Original Message:
Sent: Thu November 28, 2024 10:47 PM
From: Wen-Chen Hol
Subject: Is there any way we can extend watsonx chatbot text input length from 2048 to higher?
As title. With image/office file upload, ai to describe image or export file content in the input box, the 2048 text length is really limiting the chatbot ability.
Is there any plan or way that the chatbox text input length could be bigger? copilot pane with 4096 characters.
------------------------------
Wen-Chen Hol
------------------------------