No, when a user is removed from having meeting access, and a new user has been granted access to the same meetings, the new user(s) will not be able to see the comments or annotations of the earlier participants.