Other Customers Complained
The customers that complained about the presence of the man were more the exception than the rule. And without exception, they were the snobby kind of customers that did so, the stuck-up people that Benny had to deal with on a daily basis.
He did not enjoy this and therefore he did not feel the need to please them.
However, not everyone agreed with Benny on this matter.