Hi Anand,
Are you mean that if one of forked execution being removed, the processInstance can not be removed?
If you use default configuration and do not change ends attribute of end activity to 'execution', the end activity will terminal the whole process instance.