Sources say the party leadership is still hoping to convince Annamalai to stay, but he seems to have made up his mind