Possible memory leak

agriesser · March 8, 2023, 2:12pm

Hi @torbengb ,

could you check the possible solutions in this GitHub issue and let me know if one of them worked for you?

github.com/mattermost/mattermost-server

Mattermost suddenly goes out of memory (OOM) and reboots

opened 08:38AM - 11 Jul 22 UTC

DummyThatMatters

Bug Report/Open

#### Summary Mattermost goes for an unexpected reboot periodically (every 1-2 w…orking days appox.) due to sudden increase in memory consumption. #### Steps to reproduce Mattermost 7.0.1 Team Edition, deployed on a pod in openshift (tryed to allocate from 2.6GB to 5.5GB RAM with the same result). Postgres 14.2 as a DB. Around ~4000 users, ~1200 of them are active ~ 26000 messages per day load. #### Expected behavior Mattermost workes stably without reboots. #### Observed behavior (that appears unintentional) Mattermost goes for a reboot every 1-2 working days. The cause of reboot is OOM. Here is the example of log of the memory consumption: ![image](https://user-images.githubusercontent.com/51426114/178220724-6768c54c-d0a8-401b-af2e-a0027a5fa94c.png) ![image](https://user-images.githubusercontent.com/51426114/178221161-eb008954-3d9c-45f1-af5d-7fbb98a00a9d.png) The same increase of load can be observed on CPU part as well: ![image](https://user-images.githubusercontent.com/51426114/178221465-bef40bc3-c22a-4612-8fc7-0f9cc4e61d32.png) As you can see there is sudden growth of resource utilisation out of nowhere. The logs are relatevely clean and logs raito didnt show any increase of operations number or increased user activity. We have done our small investigation and we think that it can be caused by unproper functioning of getPostsForChannel method. That assumption being done by inspecting mattermost go profile. Here is example of heap tree made via pprof tool: ![profile003](https://user-images.githubusercontent.com/51426114/178222825-11427639-3bfe-4366-a4c1-ba1f23641406.svg) Please help with investigating, we can provide additional info if it needed (if it can be collected via our tools and does not contain corporate data)

Topic		Replies	Views
[SOLVED] Mattermost suddenly crashed and after reboot Web Container doesn't response Troubleshooting	14	5414	March 8, 2023
Mattermost Ubuntu server stops suddenly Troubleshooting	11	595	June 24, 2023
Mattermost consumes more memory day by day Troubleshooting	4	2350	September 16, 2016
White Screen of Death while upgrading from 5.35.5 to 5.36.2 Troubleshooting	2	717	February 21, 2022
Can not export process of mattermost running on docker Command Line Interface	0	630	January 6, 2022

Possible memory leak

Related topics