The "Save" button in the "Profile preferences" is a bit misleading I guess - it perhaps should be an "Ok" button as all it means is that the settings are applied to the currently running game - they are not "saved" until the profile itself is saved - by any of:
* the "Autosave" mechanism
* the "Save profile" button in the editor
* at the end of the session where either
* the "Save profile on Exit" option, if enabled, activates...