Would it be possible to integrate an API for bots to edit messages in a channel? For instance, if a user posted:
Hey guys, I found a problem in pull request #200
Which the bot could edit into the following message:
Hey guys, I found a problem in pull request
This is a current feature in Gitter (another messaging app), and it certainly helps against having a bot pushing messages every time something is referenced.