Reverts #50951.
Some exploits arose that highlighted some areas in material code that need a rework, so it's best to revert this and make a fresh PR once the rework is finished.
Fixes#51540Fixes#51516Fixes#51406Fixes#51402Fixes#51393Fixes#51368Fixes#51344