Yes, it is possible to add or remove users from the list of possible respondents even if the survey is currently open. Users can be added or removed from within survey options for the survey.
If you are storing respondent details then, if you remove a user that has already responded, their responses are not deleted and will still appear in the survey results area.
