The people who build today’s most capable artificial intelligence can describe exactly how they train it. They can write down the architecture, the optimisation procedure and the objective the system is rewarded for meeting. What they cannot do, in any complete way, is explain how a finished model arrives at many of its particular answers. The training is understood. The thing the training produces is not.
This is not a sensational claim, and it is not the same as saying nobody knows how AI works. It is a narrower and stranger point. We understand the process that grows these systems far better than we understand the systems themselves.
To read more, click here.