Deepfake faces generated via artificial intelligence (AI) have become so realistic that they routinely fool people, with some research suggesting there may be USD 40 billion worth of deepfake-related fraud annually by 2027.
Not only do most people struggle to spot AI faces, but as long ago as 2023 we discovered some AI faces are “hyperreal” – they look more real than actual human faces. It was also found that people are overconfident they can spot AI faces, with the most confident people making the most errors.
Software-based deepfake detectors do exist, but they can’t really explain the reasons for their detections – and they suffer from serious weaknesses. Some can be fooled simply by converting the image type, such as from png to jpg.
But it turns out most people can learn to spot AI faces with an hour or so of practice. In a research published in PNAS, it was shown that there’s a straightforward way to improve detection of deepfakes, by training people to pick up the tell-tale clues through experience rather than direct instruction.
The difference between human and AI faces
In an earlier research, a key difference between AI and human faces was discovered. AI faces are hyperaverage.
This means AI faces tend to be more symmetrical, proportional and attractive than human faces. But they’re less expressive and memorable – less likely to stand out in a crowd.
Intriguingly, people can accurately and reliably judge these qualities, but frequently misinterpret the clues. For example, people often think that faces that look a bit odd are AI-generated, when in fact human faces are more likely to have distinctive, unusual features.
Although most people struggle to decide whether a face is AI or real, there is one group who are naturally good at picking up on these clues. So-called super-recognisers, who have exceptional human face perception, seem to be attuned to hyperaverageness, making them better at spotting AI faces.
But, for those of us who aren’t super-recognisers, can AI detection abilities be trained like other forms of perceptual expertise?
Learning to spot AI
In a study, 45 participants were invited and asked them to rate around 100 faces on six qualities that can be used to tell AI faces apart from real ones: distinctiveness, memorability, proportionality, symmetry, attractiveness and expressiveness.
The participants were not told how these clues might help them distinguish an AI face from a real one – they had to figure that part out for themselves.
They were told which faces were AI and which were human, but were not told that the AI faces were more symmetrical or less expressive, for example. They had to learn these clues through experience rather than direct instruction.
Before and after training, participants’ ability to tell AI faces apart from human ones with new faces that were not used in the training were tested.
Training works
In one test, participants were shown three faces – two human and one AI – and asked to select the face that was AI. On this task, average accuracy doubled from 40 per cent before training to 80 per cent afterwards.
Impressively, all participants improved in their AI detection abilities and several achieved close to 100 per cent accuracy. Participants also became faster and more confident in their correct judgements.
The training was also just as effective when it was administered online rather than in person, which suggests it could be a cost-effective remote intervention in deepfake detection.
How to improve your chances of spotting AI faces
If you want to get better at recognising AI-generated faces, looking at a lot of examples is a good start. You can see plenty at websites such as Which Face Is Real or This Person Does Not Exist.
While you’re looking, bear in mind the six key factors we identified:
how distinctive is the face?
how memorable is it?
how proportional is it?
how symmetrical is it?
how attractive is it?
how expressive is it?
This exercise may improve your deepfake radar. But the more important takeaway is that AI deepfakes are improving very quickly – they can easily fool us, even if we think we can spot them.
The clues are no longer obvious: they are not based on specific details but on facial impressions which people form rapidly and naturally, but which can be misleading.
At the same time, there is hope. We have shown it is possible to train people to detect AI faces. By combining our human-centred approach with algorithmic detection, we may yet keep up in this cat-and-mouse game of advancing technology. (The Conversation)
