Summary: What Is ChatGPT Doing … and Why Does It Work?

But it’s a representation that’s readily usable by the neural net.

And then there’s the representation in the neural net of ChatGPT.

But it’s a neural net that’s particularly set up for dealing with language.

In many ways this is a neural net very much like the other ones we’ve discussed.

And, yes, that’s still a big and complicated system—with about as many neural net weights as there are words of text currently available out there in the world.

Similar Articles

What Is ChatGPT Doing … and Why Does It Work?

Stephen Wolfram explores the broader picture of what’s going on inside ChatGPT and why it produces meaningful text. Discusses models, training neural nets, embeddings, tokens, transformers, language syntax.

Read the complete article at: writings.stephenwolfram.com