Roman Mazurenko's third life. Personality models on LLM / Habr

A person is 30 trillion cells, each with 500 megabytes of DNA. Supernanotechnology life machine. And in total, it's an alcoholic going for a bottle, or a girl going to study. A typical situation when something simpler is made from supermaterial at the next level. But the material itself can't produce this simple thing. You can't get an alcoholic without 30 trillion cells.

If we talk specifically about the example, there are 100 billion neurons in the brain. If each neuron has 10 thousand inputs, at each input there is a synaptic slit with a changing transmission coefficient of 1 byte, then you can calculate the weights. There will be 1 quadrillion of them. There are no such models now, but it seems that everything is going to this. There are models with several trillion parameters. Another thing, they are superior to any person. A person has an incredible redundancy in the brain. Side-loading is based on the idea that a person is a program that works on top of some "hardware". It consists of information that we can discover. There are no hidden scales important for the model.

There were studies of the volume of human conscious memory. This is about 1-2 gigabytes, which a person can turn to for reading and writing. This includes knowledge of languages, childhood memories, professional knowledge. It's very little. If we could pump out these 2 gigabytes, we could create a very accurate personality model.