No, it is not not deleted.
When a person is added to a project with Consultant status or higher, a Notes_UserName.xml file is created for them to record their notes activity. If a person’s Notes_ file were deleted when they were removed from the project, that could seriously corrupt the notes. For example, any notes they resolved would become unresolved.