I can remove the invitation you have setup with the current email address for Ad Manager.
Can you please let me know if the current email is your Adsense email? To setup Ad Manager you should use your Adsense account email address.
If i remove the current setup you will then be able to re-enter your new details. I have resent the invite to the current setup you have in case the email just hasn't gone though.