Skipping a vote is not a bad idea. It is way better that nobody is ejected, rather than an innocent player. Remember, the imposter wants to kill everyone – your bad vote helps them achieve that.