That's just objectively a foul. Of course the ref blew the whistle.

Refs aren't supposed to just decide that "the situation" didn't warrant a call.