we really need something configurable, I built chatgpt mattermost bot but yes, response time can vary. 30s is a lot of time but given we cannot stream we need to wait for the entire response.
we really need something configurable, I built chatgpt mattermost bot but yes, response time can vary. 30s is a lot of time but given we cannot stream we need to wait for the entire response.