Some members of the committee said such a ban, proposed two months after a prominent conservative activist was caught meeting with a famous white supremacist, might be a “slippery slope” or too vague.