Hello,
not sure if that approach will solve the problem. In my opinion, task assignee should be removed, notification should not be sent and no Exception should be raised. Only in the case where assignee is populated (not null or empty), the notification is sent.
Thanks,
Gonzalo