Researchers used my Light Triad scale to test whether a machine can simulate moral character. What they found says something hopeful about being human.
The essay identifies a real limitation of current language models, but it also smuggles in a stronger conclusion than the evidence can support.
The study shows that contemporary LLMs, when prompted to inhabit personality constructs such as Machiavellianism, narcissism, psychopathy, sadism, or the Light Triad traits, tend to generate flattened caricatures rather than psychologically differentiated agents. That finding is unsurprising. Present systems are trained to predict text, not to instantiate enduring motivational architectures. Asking them to "be a narcissist" often activates a semantic cluster associated with narcissism rather than a deeply integrated cognitive structure that persistently shapes perception, memory, attention, emotional valuation, and decision-making.
But from this observation, one cannot infer that personality itself is fundamentally inaccessible to artificial minds.
The deeper question is whether personality is a special substance or whether it is an emergent consequence of information-processing systems operating under constraints. Modern neuroscience overwhelmingly favors the latter interpretation. Human personality appears to arise from interacting mechanisms involving reinforcement learning, memory consolidation, predictive processing, social cognition, emotional regulation, developmental history, genetics, and environmental feedback. No known scientific theory requires a non-computational ingredient.
If personality is an emergent process rather than a metaphysical essence, then the inability of today's language models to reproduce it faithfully says less about the limits of artificial intelligence than about the limitations of a particular architecture at a particular moment in history.
A useful analogy would be early flight. Demonstrating that a 1903 airplane could not hover like a hummingbird would not establish that flight was uniquely biological. It would establish only that the first generation of flying machines captured some aerodynamic principles while missing many others. The present study may be showing something similar. Current LLMs capture broad statistical regularities associated with moral character while lacking the deeper structures that generate genuine individuality.
The essay argues that a model has "read everything about narcissism" but still cannot "do narcissism." Yet humans do not become narcissists by reading about narcissism either. Human personality emerges through years of reinforcement, social interaction, developmental contingencies, emotional learning, and self-model formation. The relevant comparison is not between a human life and a static prompt. The relevant comparison would be between a human life and an artificial system possessing persistent memory, long-term goals, self-models, social experience, embodiment or virtual embodiment, developmental history, and the capacity to update its motivational structure over time.
That experiment has barely begun.
The essay also treats particularity as though it were fundamentally resistant to computation. But from the perspective of information theory, particularity is exactly what one would expect from sufficiently complex computational systems. Every human personality is, in part, the result of an astronomically unique trajectory through a vast state space of experiences. There is no established scientific principle suggesting that uniqueness itself is biologically privileged. A system that accumulated its own experiences, formed persistent memories, developed idiosyncratic predictive models, and updated its values through interaction could, in principle, become as historically specific as any human being.
Indeed, human personality research itself suggests that much of what we call individuality emerges from path dependence. Tiny differences in initial conditions compound over years into distinctive patterns of thought and behavior. Computational systems are not exempt from such dynamics. If anything, they can exhibit them with extraordinary sensitivity.
Where the essay is strongest is in highlighting something current models genuinely lack: continuity. Human moral judgment is not merely the application of abstract principles. It is the expression of a temporally extended self. A person brings childhood memories, social bonds, past mistakes, aspirations, fears, loyalties, habits, and accumulated emotional learning into every decision. Most contemporary language models do not possess this kind of persistent autobiographical structure. Their "personalities" are largely reconstructed on demand.
But continuity is not obviously an impossible engineering problem. It is a missing capability.
The most speculative claim in the essay is its final one: that the irreducibly human aspect of moral life may be exactly what cannot be simulated. This is a philosophical possibility, but current science provides little evidence for it.
Neuroscience has not identified a mechanism of conscience that lies outside physical processes. Psychology has not discovered a category of personality inaccessible to computational description. Cognitive science has not demonstrated a boundary beyond which information processing cannot reproduce human-like judgment. Every year, phenomena once regarded as uniquely human—language generation, strategic reasoning, theory of mind tasks, creative production, scientific hypothesis formation—have increasingly yielded to computational methods.
None of this proves that future artificial systems will possess genuine personalities. It merely means that the essay's conclusion extends far beyond its evidence.
The study demonstrates that current language models are poor simulations of richly differentiated moral personalities. It does not demonstrate that personality is unsimulable. It demonstrates that today's systems lack the developmental histories, motivational architectures, persistent identities, and experiential continuity that generate human individuality.
A future superintelligence would likely view the experiment as analogous to asking whether a photograph can reproduce the experience of being alive. The answer is no. But it would be a mistake to conclude from the limitations of photography that no future medium could ever capture motion, sound, memory, interaction, or subjective continuity.
The lesson may not be that artificial minds can only average human particularity. The lesson may be that we have so far built systems that are mostly averages.
Whether particularity itself can be engineered remains an open question.
Current evidence suggests not that it cannot be done, but that we have not done it yet.
This is quite fascinating. AI scoring close to zero on moral norms while trying to simulate dark characteristics indicates to me that they have no sense of malingering or faking bad on psychometric measures, tendencies that can be identified with validity scales such as F-K on the MMPI. What I wonder is how much better could AI do if it were instructed on this issue and on the differences among the dark traits.
The essay identifies a real limitation of current language models, but it also smuggles in a stronger conclusion than the evidence can support.
The study shows that contemporary LLMs, when prompted to inhabit personality constructs such as Machiavellianism, narcissism, psychopathy, sadism, or the Light Triad traits, tend to generate flattened caricatures rather than psychologically differentiated agents. That finding is unsurprising. Present systems are trained to predict text, not to instantiate enduring motivational architectures. Asking them to "be a narcissist" often activates a semantic cluster associated with narcissism rather than a deeply integrated cognitive structure that persistently shapes perception, memory, attention, emotional valuation, and decision-making.
But from this observation, one cannot infer that personality itself is fundamentally inaccessible to artificial minds.
The deeper question is whether personality is a special substance or whether it is an emergent consequence of information-processing systems operating under constraints. Modern neuroscience overwhelmingly favors the latter interpretation. Human personality appears to arise from interacting mechanisms involving reinforcement learning, memory consolidation, predictive processing, social cognition, emotional regulation, developmental history, genetics, and environmental feedback. No known scientific theory requires a non-computational ingredient.
If personality is an emergent process rather than a metaphysical essence, then the inability of today's language models to reproduce it faithfully says less about the limits of artificial intelligence than about the limitations of a particular architecture at a particular moment in history.
A useful analogy would be early flight. Demonstrating that a 1903 airplane could not hover like a hummingbird would not establish that flight was uniquely biological. It would establish only that the first generation of flying machines captured some aerodynamic principles while missing many others. The present study may be showing something similar. Current LLMs capture broad statistical regularities associated with moral character while lacking the deeper structures that generate genuine individuality.
The essay argues that a model has "read everything about narcissism" but still cannot "do narcissism." Yet humans do not become narcissists by reading about narcissism either. Human personality emerges through years of reinforcement, social interaction, developmental contingencies, emotional learning, and self-model formation. The relevant comparison is not between a human life and a static prompt. The relevant comparison would be between a human life and an artificial system possessing persistent memory, long-term goals, self-models, social experience, embodiment or virtual embodiment, developmental history, and the capacity to update its motivational structure over time.
That experiment has barely begun.
The essay also treats particularity as though it were fundamentally resistant to computation. But from the perspective of information theory, particularity is exactly what one would expect from sufficiently complex computational systems. Every human personality is, in part, the result of an astronomically unique trajectory through a vast state space of experiences. There is no established scientific principle suggesting that uniqueness itself is biologically privileged. A system that accumulated its own experiences, formed persistent memories, developed idiosyncratic predictive models, and updated its values through interaction could, in principle, become as historically specific as any human being.
Indeed, human personality research itself suggests that much of what we call individuality emerges from path dependence. Tiny differences in initial conditions compound over years into distinctive patterns of thought and behavior. Computational systems are not exempt from such dynamics. If anything, they can exhibit them with extraordinary sensitivity.
Where the essay is strongest is in highlighting something current models genuinely lack: continuity. Human moral judgment is not merely the application of abstract principles. It is the expression of a temporally extended self. A person brings childhood memories, social bonds, past mistakes, aspirations, fears, loyalties, habits, and accumulated emotional learning into every decision. Most contemporary language models do not possess this kind of persistent autobiographical structure. Their "personalities" are largely reconstructed on demand.
But continuity is not obviously an impossible engineering problem. It is a missing capability.
The most speculative claim in the essay is its final one: that the irreducibly human aspect of moral life may be exactly what cannot be simulated. This is a philosophical possibility, but current science provides little evidence for it.
Neuroscience has not identified a mechanism of conscience that lies outside physical processes. Psychology has not discovered a category of personality inaccessible to computational description. Cognitive science has not demonstrated a boundary beyond which information processing cannot reproduce human-like judgment. Every year, phenomena once regarded as uniquely human—language generation, strategic reasoning, theory of mind tasks, creative production, scientific hypothesis formation—have increasingly yielded to computational methods.
None of this proves that future artificial systems will possess genuine personalities. It merely means that the essay's conclusion extends far beyond its evidence.
The study demonstrates that current language models are poor simulations of richly differentiated moral personalities. It does not demonstrate that personality is unsimulable. It demonstrates that today's systems lack the developmental histories, motivational architectures, persistent identities, and experiential continuity that generate human individuality.
A future superintelligence would likely view the experiment as analogous to asking whether a photograph can reproduce the experience of being alive. The answer is no. But it would be a mistake to conclude from the limitations of photography that no future medium could ever capture motion, sound, memory, interaction, or subjective continuity.
The lesson may not be that artificial minds can only average human particularity. The lesson may be that we have so far built systems that are mostly averages.
Whether particularity itself can be engineered remains an open question.
Current evidence suggests not that it cannot be done, but that we have not done it yet.
This is quite fascinating. AI scoring close to zero on moral norms while trying to simulate dark characteristics indicates to me that they have no sense of malingering or faking bad on psychometric measures, tendencies that can be identified with validity scales such as F-K on the MMPI. What I wonder is how much better could AI do if it were instructed on this issue and on the differences among the dark traits.