I think the incrementally better argument is missing the idea that we could do something else with the material or fix it before we start using it. By making buildings or roads or whatever out of material that leaches toxic chemicals over time, we are still putting toxic waste everywhere which can slowly have large effects to our environment.

Just imagine being alongside Henry Ford and him making the same argument, "Yeah, gasoline stinks a little but it's definitely better than horse droppings!" Then fast forward to our current global climate problems.