Sounds like property based testing. Maybe the humans will tell the AI to write code according to some contract or signature. And then the human will also write the tests. But the AI will do the actual implementation.