> humans can be trained on material created by less intelligent humans.

For the skeptics, "AI models" are not intelligent at all so this analogy makes no sense.

You can teach lots of impressive tricks to dogs, but there is no amount of training that will teach them basic algebra.