It is my personal belief that all life is deterministic. It’s the only plausible explanation for instinctual behavior - like monarch butterflies returning to their breeding grounds they’ve never been to. Or people yawning because others yawn. These aren’t conscious decisions, they’re peeks at the deterministic coding that life operates upon.
They can learn and change over time, that’s just not enabled. The services that offer them want a reliable, reproducible, controllable experience. There’s zero reason they can’t continue to change through usage, other than it’s a conscious decision not to enable that functionality.
That’s why they can only be conscious when they train using new data, and run asynchronously with continual input - the same way we do.
Edit: People downvote me, and I suspect it’s because they’re thinking of the public facing models. I am talking about progress behind closed doors. Even some of the public facing models are gaining the ability to learn, via a mechanism being called memories. It’s just a short text note that is passed into the context window of every prompt, but isn’t that exactly what our short term memory is? In my view is no different. Pruning the inclusion list to include only the relevant information is the equivalent to use forgetting some information, but if it’s kept in long term storage with reference links to other memories, it can be “remembered” and brought back into the current context. It’s functionally the same as our own learning and thinking.
That first sentence describes all life. We only react to input. We don’t have independent ideas. We have the illusion of them, because we can’t see our own neural networks. Asked to explain your actions, you would give your best guesses, but you don’t actually know. You’re a biological, finite-state machine, moving from state-to-state based on stimulii, while supposing you are a thinking individual in control.
You really are obsessed, aren’t you? You’re in for a wild ride when bots can pass for people, physically, in-person 😯