Rachel and Estelle don't believe the motel key was in Carl's pants, until Harriette also finds a Twinkie in them. It should've been obvious since no one else in the family wears the same size pants Carl does.
When Carl enters and says, "Good evening, ladies", he closes the door. But a hand can be seen grabbing at the door as if to latch it.