I think if you put just stone in the ruts i doubt anyone would moan. Building waste is a different matter.
Any council, forestry etc would just order in a wagon of aggregate to repair tracks.
For instance in wales where slate is order of the day a tonne of broken stone from a quarry divided...