Why this guide is relevant
The guide published by the National Cyber Security Directorate analyses how artificial intelligence is radically changing the information ecosystem. Beyond the obvious benefits of AI technologies, the document highlights how they can be used to manipulate perceptions, amplify disinformation, and conduct social engineering attacks far more sophisticated than in the past.
By automating content generation and the ability to analyse large volumes of data about user behaviour, AI can turn information manipulation into a faster, more credible, and more easily scalable process.
How AI is used in information manipulation
AI technologies enable the rapid creation of digital content that can imitate people, institutions, or legitimate information sources. This makes manipulative messages more convincing and harder to identify.
Auto-generated persuasive texts
Automatic generation of persuasive texts adapted to a person's profile.
Audio and video deepfakes
Creation of audio and video deepfakes that can imitate a real person's identity.
Virtual influencers and automated accounts
Use of automated accounts or virtual influencers to amplify certain narratives.
Coordinated distribution of false content
Coordinated distribution of false or manipulative content on digital platforms.
By combining these techniques, attackers can create complex influence campaigns capable of affecting public trust, organisational reputation, or users' decision-making processes.
Social engineering in the age of artificial intelligence
AI amplifies the efficiency of traditional social engineering techniques. Instead of generic messages, attackers can create personalised communications based on publicly available information about the target – interests, professional relationships, or online activity.
- auto-generated phishing or fraud messages adapted to context
- seemingly legitimate requests from imitated persons or institutions
- public opinion manipulation through false content distributed at scale
These techniques significantly increase the probability that users will consider the received information as credible.
How manipulation can be prevented
The guide provides practical recommendations for reducing the risks associated with information manipulation in the AI era.
For users
- verifying the source of information before sharing
- analysing the context and credibility of content
- identifying signs specific to AI-generated content
- using digital verification tools
For organisations
- developing awareness programmes on social engineering risks
- implementing verification procedures for sensitive requests
- monitoring the information environment and online reputation
- promoting an organisational culture based on critical thinking and information verification
Why this guide is important
- AI-generated content is becoming increasingly realistic and easier to produce
- The ability to distinguish between authentic and manipulated information is becoming essential
- The guide provides a clear perspective on risks and protective measures
- The document is a useful resource for users, organisations, and professionals
Complete DNSC resource
For complete details and recommendations, the guide can be accessed here:
Access the DNSC guide