Live Input Visibility During Conversation
I want to develop an AI bot that can converse with users and help them complete tasks. During the conversation, I want to see the bot's real-time output, corresponding to the streaming output of the LLM. Currently, I have to wait for the LLM output to completely finish before sending a message to the user. This requires waiting.