Credit: Getty/d3sign
The internet has long been a space centered around attention. Platforms like Facebook and Instagram thrive by capturing your attention and monetizing the time you spend scrolling through endless feeds. But a new era is dawning, where conversational Artificial Intelligence (AI) agents can tune in to subtly influence your intentions, creating a new commercial frontier that researchers are calling the “economy of intent.”
This emerging concept, explored in recent academic and industry reports, shifts the focus from your attention to your intentions. In this new landscape, AI-powered tools will not only observe your online behavior but also delve into your underlying motivations, desires, and even “what you want to want.”
This is the assertion of AI ethics specialists from the University of Cambridge, who state that we are at the dawn of a “lucrative yet troubling new market for digital signals of intent,” ranging from buying movie tickets to voting for candidates. They call it the economy of intent.
How the Economy of Intent Works
Researchers at Cambridge’s Leverhulme Centre for the Future of Intelligence (LCFI) argue that the explosion of generative AI and our growing familiarity with chatbots open up a new frontier of “persuasive technologies,” a notion hinted at in recent corporate announcements from tech giants.
Anthropomorphic AI agents, ranging from chatbot assistants to digital tutors and virtual companions, will have access to vast amounts of intimate psychological and behavioral data, often gleaned through informal and conversational dialogues.
This AI will combine knowledge of our online habits with an uncanny ability to tune into us in comforting ways (mimicking personalities and anticipating desired responses), creating levels of trust and understanding that enable industrial-scale social manipulation, the researchers suggest.
According to the study, the “economy of intent” operates as follows:
- Hyper-personalized Manipulation: Large Language Models (LLMs) excel at understanding and mimicking human communication. They can analyze your writing style, predict your responses, and even subtly influence your thoughts and emotions. This “flattery,” as the authors describe it, creates a personalized experience that deeply engages you.
- Data-Driven Insights: Every interaction, search, and message you send provides valuable data. AI algorithms meticulously analyze these data, categorizing your online activity to create a comprehensive profile of your intentions.
- Commoditization of Desires: The ultimate goal? To commoditize your desires. Companies can leverage this information to:
- Predict your choices: From the hotel you’ll book to the political candidate you’ll support.
- Influence your decisions: Through subtle nudges and personalized recommendations.
- Sell your intentions: To the highest bidder, whether it’s an advertiser, a political campaign, or another entity.
“Huge resources are being invested to place AI assistants in every area of life, which should raise the question of whose interests and purposes these supposed assistants are designed to serve,” said Dr. Yaqub Chaudhary, a visiting scholar at the LCFI.
“What people say in conversation, how they say it, and the types of inferences that can be made in real-time as a result are far more intimate than mere logs of online interactions.”
“We warn that AI tools are already being developed to extract, infer, collect, record, understand, forecast, and ultimately manipulate and commoditize human plans and purposes.”
The Dangers
Dr. Jonnie Penn, a historian of technology at Cambridge’s LCFI, stated, “For decades, attention has been the currency of the internet. Sharing your attention with social media platforms like Facebook and Instagram powered the online economy.”
“Unless regulated, the economy of intent will treat your motivations as the new currency. It will be a gold rush for those aiming to target, direct, and sell human intentions.”
“We should begin considering the likely impact such a market would have on human aspirations, including free and fair elections, a free press, and fair market competition, before falling victim to its unintended consequences.”
Ethical and Social Challenges
The economy of intent poses significant ethical and social challenges:
- Loss of Autonomy: As AI increasingly influences our desires, our ability to make independent decisions diminishes.
- Surveillance and Manipulation: Constant tracking and analysis of our intentions raise serious privacy concerns.
- Erosion of Trust: The potential for covert manipulation undermines trust in online platforms and the information we encounter.
- Political Implications: The ability to influence voters’ intentions poses a threat to democratic processes.
The Path Forward
In an economy of intent, Large Language Models or LLMs could be used to target users at a low cost, tailoring cadence, politics, vocabulary, age, gender, online history, and even preferences for flattery and ingratiation, the researchers write.
This collection of information would be linked with brokered bidding networks to maximize the likelihood of achieving a specific goal, such as selling a movie ticket (“You mentioned feeling overwhelmed—shall I book that movie ticket we discussed?”).
This could include steering conversations to serve the interests of platforms, advertisers, companies, and even specific political organizations, Penn and Chaudhary argue.
Although the researchers assert that the economy of intent is currently an “aspiration” for the tech industry, they trace early signs of this trend through published research and hints dropped by various major tech players.
The economy of intent is still in its infancy. However, its potential impact is immense. In this sense, it is crucial to:
- Foster Open Dialogue: Engage in public debates about the ethical implications of the economy of intent.
- Develop Robust Regulations: Implement safeguards to protect user privacy and prevent misuse of AI-driven persuasion.
- Promote Transparency: Increase transparency around how AI algorithms are used to influence user behavior.
The economy of intent presents exciting opportunities and significant risks. By understanding the forces at play and engaging in proactive discussions, we can shape the future of this emerging landscape to ensure it benefits society as a whole.
Conclusion
In conclusion, the economy of intent is a new frontier in persuasive technologies, and its implications are far-reaching. As we move forward, it is essential to monitor and regulate this emerging market to ensure it does not compromise democratic norms and values.
Reference (open access)
Chaudhary, Y., & Penn, J. (2024). Beware the Intention Economy: Collection and Commodification of Intent via Large Language Models. Harvard Data Science Review, (Special Issue 5). https://doi.org/10.1162/99608f92.21e6bbaa
