Polyglot reflects Greek forms built from many and tongue or language. The bodily metaphor is familiar in English too: someone can speak in another tongue without growing another physical one.
This view explains the components. They are pieces of one construction, not consecutive borrowing stages.