In July, the US government made it clear that artificial intelligence (AI) companies wanting to do business with the White House will need to ensure their AI systems are “objective and free from top-down ideological bias”. In an executive order on “preventing woke AI in the federal government”, President Donald Trump refers to diversity, equity and inclusion (DEI) initiatives as an example of a biased ideology.
The apparent contradiction of calling for unbiased AI while also dictating how AI models should discuss DEI shows the notion of ideologically free AI is a fantasy.
Multiple studies have shown most language models skew their responses to left-of-centre viewpoints, such as imposing taxes on flights, restricting rent increases, and legalising abortion.
Chinese chatbots such as DeepSeek, Qwen and others censor information on the events of Tiananmen Square, the political status of Taiwan, and the persecution of Uyghurs, aligning with the official position of the Chinese government.
AI models are not politically neutral nor free from bias. More importantly, it may not even be possible for them to be unbiased. Throughout history, attempts to organise information have shown that one person’s objective truth is another’s ideological bias.
Lying with maps
Humans struggle to organise information about the world without distorting reality.
Take cartography, for example. We might expect maps to be objective – after all, they reflect the natural world.
But flattening a globe onto a two-dimensional map means having to distort it somehow. American geographer Mark Monmonier has famously argued maps necessarily lie, distort reality, and can be tools for political propaganda.
Think of the classic world map that uses the Mercator projection, hung in every primary school classroom. It converts the globe into a cylinder and then lays it flat. I grew up thinking Greenland must be massive compared to the rest of the world.
In fact, Africa is 14 times larger than Greenland, despite appearing to be roughly the same size on this type of map. In the 1970s, German historian Arno Peters argued Mercator’s distortions contributed to a skewed perception of the inferiority of the global south.
Such distortions could be an analogy for the current state of AI. As Monmonier wrote in his book How To Lie With Maps: “A single map is but one of an indefinitely large number of maps that might be produced for the same situation or from the same data.” Similarly, a single large language model’s response is one of an indefinitely large number of responses which might be produced for the same situation or from the same data.
Think of the many ways a chatbot could formulate a response when prompted about something like diversity, equity and inclusion.
A built-in bias
Other historic attempts at organising information have shown the bias of their designers and users too.
The widely used Dewey decimal classification (DDC) system for libraries, published in 1876, has been known to be racist and homophobic.
Over the course of the 20th century, LGBTQIA+ books have been categorised under Mental Derangements, Neurological Disorders, or Social Problems in the DDC, with more recent efforts being made to eliminate outdated and derogatory terms from the classification.
Under Religion, roughly 65 sections out of 100 are dedicated to Christianity because the library where the classification was originally developed had a strong focus on Christianity. While Islam has an estimated 2 billion followers to Christianity’s 2.3 billion today, in the DDC Islam only has a single section dedicated to it.
AI learns from humans
The large language models that power AI chatbots are trained on countless pieces of text, from historical works of literature to online discussion forums. Biases from these texts can unknowingly creep into the model, such as negative stereotypes of African Americans from the 1930s.
Just having raw information is not enough. Language models must be trained how to retrieve and present this information in their answers.
One way to do this is to have them learn to copy how humans respond to questions. This process does make them more useful, but studies have found it also makes them align with the beliefs of those who are training them.
AI chatbots also use system prompts: instructions that tell them how to act. These system prompts are, of course, defined by human developers.
For users, understanding whose worldview these models represent is just as important as knowing who draws the lines on a map. (The Conversation)