Researchers and users of LLMs have long been aware that AI models have a troubling tendency to tell people what they want to ...