Eating At Him
Walter approached his staff, including James, and told them to keep operating as they did before James arrived. He was effectively throwing the rules out of the window, and James wasn’t pleased.
But the whole situation was eating at Walter, and he needed to end it before it was too late.
So when James gave him an ultimatum, he gave one right back.