XerXesXu
Virgin' on literate.
- Joined
- Oct 18, 2011
- Posts
- 1,548
I took my BSc in Cognitive Science and Experimental Psychology in the late 70s, when neural networks were a hot topic in cognition. I had a peer-reviewed paper on neural networks published in 1980 but those were rudimentary, toy networks. It was possible to see the parallels between binary processes in computer programs and brain function, and, at a very rudimentary level, train neural networks to mimic cognitive functions. It was also obvious that the brain was far more structured and modular than a crude neural network and trained by a variety of seemingly random sensory inputs. The brain science was based on neuroscience, but it was also apparent that the brain developed in a modular fashion, but was neuroplastic, in case of necessity it could be retrained in a different fashion. The LAD (language acquisition device) was dead and crude evolution by nature of function, like eyes and arms was abandoned. Analytic, therapeutic and philosophical speculations, reflections on the nature of truth etc were left to the BAs.When I studied AI in the late 1970s (!) I, and most of my tutors came from psychology and philosophy backgrounds. At that time we were interested in what could be learned about human cognition by attempting to model it in software. I won't recapitulate the history of AI since then (and before that, starting with the work of Von Neumann and Turing), but, to sum up, AI went into the doldrums, and then sprouted a vigorous new branch with the advent of modern machine learning via backpropagation. It's now become a very useful tool for solving many kinds of problems that used to be particularly difficult to do in software (like weather forecasting). The remarkable results of transformer networks appeared towards the end of the last decade, with their tantalisingly human-like outputs, apparently making deep connections and understanding contexts. The question remains whether their inner workings shed any light on human cognition.
I believe they help us understand how we process language. But of course we do a lot more than that. A simple (and they are actually quite simple) transformer network won't be able to do much in the way of reasoning. Human (and animal) brains have dedicated reasoning areas which are apart from language. And of course we're goal directed ("intentional" is the philosphical term), and we have emotions and other sense organs through which we make sense of the world. We can also transfer short-term learned information into long-term knowledge in real time: Chat GPT is pre-trained, and your chats aren't used to add to its knowledge (in real-time, that is -- no doubt OpenAI does gather data from chats and add it to its training datasets for subsequent models).
I pursued a career in law, which has a crude ladder of mental competence - sane, insane, diminished responsibility, dangerousness, likely hood of relapse. Those who think humans do not hallucinate, nor suffer from delusions and cannot suffer from an intellectual derangement are shutting their eyes. AI has long been able to outplay humans, digital computers simply outpace human ability to evaluate routes and solutions, but the introduction of transformer architecture and LLMs has been, well, transformative. Though they, LLMs, can't learn by sensory input, like humans, they can learn through reports of others sensory experience, and they have a much better memory than us. AI robots, of course, can learn through sensory interaction, those sensory inputs are processed through specialised networks, an emerging modularity, similar to that displayed in the brain.
The real discussion for the future is not about whether we are 'special' you know, 'truly' intelligent - an unevidenced God breathed on us and made us special, or worse- an unevidenced and inarticulable something, 'y'know something made us special, must've.' There is no God and there is no must. We're no more 'special' in that sense than trees or fish, no more special than AI. We evolved through natural selection; AI evolves through human selection. Get over it, move on.