No, they started without conversation and only reinforcement learning on games, directly comparable to DeepMind.

“In the summer of 2018, simply training OpenAI's Dota 2 bots required renting 128,000 CPUs and 256 GPUs from Google for multiple weeks.”