Generative AI could be an authoritarian breakthrough in brainwashing

Generative AI is poised to be the next free world’s great gift to authors. The viral launch of ChatGPT — a system with eerily human-like capabilities in composing essays, poetry and computer code — has awakened the world’s dictators to the transformative power of generative AI to create unique, compelling content at scale.
But the fierce debate that has ensued among Western industry leaders on the risks of releasing advanced generative AI tools has largely missed where their effects are likely to be most pernicious: within autocracies. AI companies and the US government alike must institute stricter norms for the development of tools like ChatGPT in full view of their game-changing potential for the world’s authoritarians — before it is too late.
So far, concerns around generative AI and autocrats have mostly focused on how these systems can turbocharge Chinese and Russian propaganda efforts in the United States. ChatGPT has already demonstrated generative AI’s ability to automate Chinese and Russian foreign disinformation with the push of a button. When combined with advancements in targeted advertising and other new precision propaganda techniques, generative AI portends a revolution in the speed, scale and credibility of autocratic influence operations.
But however daunting Chinese and Russian foreign disinformation efforts look in a post-GPT world, open societies receive only a small fraction of the propaganda that Beijing and Moscow blast into their own populations. And whereas democratic powers maintain robust communities of technologists dedicated to combating online manipulation, autocrats can use the full power of their states to optimize their propaganda’s influence.
In 2019, China’s Xi Jinping demanded just that when he ordered his party-state to leverage AI to “comprehensively increase” the ability of the Chinese Communist Party to mold Chinese public opinion. Russia’s Vladimir Putin has similarly doubled down on AI-enabled propaganda in the wake of his Ukraine invasion, including a fake video of Ukrainian President Volodymyr Zelensky calling for Ukrainians to surrender. These efforts are buttressed by a dizzying array of Chinese and Russian agencies tasked with thought control, cultivating a competitive ecosystem of digital propaganda tools underwritten by multibillion-dollar budgets each year.
China and Russia are, in other words, fertile ground for generative AI to usher in a historic breakthrough in brainwashing — a recipe for more international catastrophes, greater human rights abuses, and further entrenched despotism. As China refines and exports its techno-authoritarianism, would-be tyrants to the world over are likely