Local Authority
The Environment Agency generally deal with larger deposits (more than a single tipper load), or more hazardous deposits, or where there is evidence of organized criminality to the deposit.
Where there is a greater harm to the environment or human health, the Environment Agency is more likely to get involved rather than the Local Authority. They will do so whether this takes place on public or private land, depending on whether they can be encouraged to investigate.