watsonx Assistant

 View Only
Expand all | Collapse all

GPT4 API Response - Typewriter style to stream

  • 1.  GPT4 API Response - Typewriter style to stream

    Posted Wed September 13, 2023 10:04 AM

    Hi Community Members,

    We have successfully integrated Watson Assistant with Watson Discovery, NeuralSeek with GPT4 API. We used client's business documents to discover content and everything works fine. But the response gets displayed in Watson Assistant with a noticable delay. This is due to the GPT4 API which renders response to NeuralSeek in typewriter style. Do you know how to render the NeuralSeek/GPT4 response to Watson Assistant as a stream of words without delay instead of the delayed response. Appreciate your comment / help on this.

    Thanks and Rgds

    Syed



    ------------------------------
    Syed Niyaz Basha
    ------------------------------