

One activity occurs in a hazily understood chemical system with near completely unobservable states in interplay with activities and systems which have effects on the main system that are barely recognized, much less fully understood. The other is a constructed, completely defined system with near total observability of states affected by probabilities based on inputs defined by human written, completely known tokenization systems.
Will they next speculate about the similarity of ‘preferences’ between a robot from Japan and the nearest non-terrestrial intelligent species?


You can look at a pair of meshed gears and understand it just as readily as you can understand a single transformation by running the math on paper with a pencil, but I don’t think anyone will ever be able to comprehend the fullness of any useful-scale model for the same reason they would never comprehend a clockwork with the same number of gears as an LLM has transformers or indices. It’s a non-intuitable space with too much complexity which cannot be simplified without oversimplifying.