Smart Send Alerts in new Outlook

Hi,

has anyone managed to get the "Remind about unsaved emails" alert working in New Outlook?

I have it enabled on the client side but no alert appears after sending. Other add-in features work fine.

 I also can't find where this should be configured on the admin side – is there a server-side setting for this? 

Thanks!