Perfectly Reasonable Explanation
When questioned by the boys, the larger man stated that he was the girl’s father. The boys assumed that she might’ve been caught drinking while underaged or something down that line, and they backed off.
The girl didn’t go against the men either. She didn’t ask the boys for help or go against what the man said, so the boys decided to drop it. But something about the situation just didn’t feel right.