Not Able To Change SMTP Email In Settings

We want to change the SMTP settings to a new company email address with new host server and address. I can make the changes and hit save. Then hit “Test Connection” button and everything works. However when I check the email that the test sent its still from the old address.

Any help would be greatly appreciated.