Hey everyone, I'm currently working on a chatbot that communicates with WatsonX Assistant via Microsoft Teams. In some cases, user messages can be very large. At the moment, the maximum number of input tokens is limited to 2048 (I couldn't find any official documentation about this limit - I tested it directly in the chat). When a message exceeds this limit, I receive a response like "Hmmm... I'm experiencing some technical problems at the moment."
Is there any way to increase this token limit?
Alternatively, has anyone encountered a similar limitation and found a workaround or best practice to handle large user messages?
Thanks in advance for any insights or suggestions.