It turns out the Environment Agency have done a LiDAR scan of England. They provide point clouds with 1 metre lat/lon resolution, showing the measured height of the terrain at each point, across the entire country.