It's not just gatekeeping though. The reason you get a qualified, credentialed structural engineer to sign off on your house instead of just YOLOing the build is so that you (and your insurance company) can sue their pants off if it collapses.
If a future version of Claude ever gets less error prone than a human, I might prefer the smaller chance of a building collapse from Claude than the larger but insured chance from a human engineer.
That future version of Claude will still be mediated by an error prone human who in this case would be a non-engineer. So even if Claude is not error prone, it could be giving correct answers to the wrong questions and correct designs for the wrong constraints because the human getting Claude to do things doesn't know any better.
