Be Careful of the Goals You Seek with Bad Data