In this demo I’m using the FastChat application to provide a local AI using the mpt-30b-chat model. Thanks to FastChat OpenAI compatible API I can easily integrate that with my own local Mattermost and start using AI 100% on prem and with full control over the models used.
Here is the demo, I hope you like it:
