Implicit Humanization in Everyday LLM Moral Judgments

Recent adoption of conversational information systems has expanded the scope of user queries to include complex tasks such as personal advice-seeking. However, we identify a specific type of sought advice-a request for a moral judgment (i.e. "who was wrong?") in a social conflict-as an implicitly humanizing query which carries potentially harmful anthropomorphic projections. In this study, we examine the reinforcement of these assumptions in the responses of four major general-purpose LLMs through the use of linguistic, behavioral, and cognitive anthropomorphic cues. We also contribute a novel dataset of simulated user queries for moral judgments. We find current LLM system responses reinforce implicit humanization in queries, potentially exacerbating risks like overreliance or misplaced trust. We call for future work to expand the understanding of anthropomorphism to include implicit userside humanization and to design solutions that address user needs while correcting misaligned expectations of model capabilities.

More from arXiv cs.AI

Towards Understanding the Expressive Power of GNNs with Global Readout

arXiv cs.AI·2

Avionic Main Fuel Pump Simulation and Fault-Diagnosis Benchmark

arXiv cs.AI·2

Probing Visual Planning in Image Editing Models

arXiv cs.AI·2

IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review

arXiv cs.AI·2

MAE-Based Self-Supervised Pretraining for Data-Efficient Medical Image Segmentation Using nnFormer

arXiv cs.AI·4

SwarmDrive: Semantic V2V Coordination for Latency-Constrained Cooperative Autonomous Driving

arXiv cs.AI·2