This is a primer for what is AI, what is AI fairness, why fairness is important, how bias creeps up into the system, how to tackle algorithmic bias, and the profit tradeoff. This is a broad and complex topic. So to narrow down the scope, this article is not about:
Note on terms: Algorithms, artificial intelligence, automated decision making systems (ADMs), machine learning, and models are used interchangeably in this paper.
Artificial intelligence means different things to different parties. The diagram below helps delineate the differences. Computer scientists would define AI broadly as techniques that mimic human behavior, this includes if-then programs, knowledge bases, and machine learning among others. Corporations typically refer to machine learning, a subset of AI. Machine learning (ML) is a computer program that learns from data to perform a particular task (e.g. prediction, classification). ML includes algorithms such as regression, random forests, and deep learning among others.
Advances in artificial intelligence discussed in media today typically refers to advances in machine learning, particularly deep neural networks Neural networks loosely mimic how the brain works by modeling each interconnected neuron as a mathematical function receiving inputs and produces an output. As more neurons are added, the network increases its ability to model more complex relationships and increases model accuracy [1]. To oversimplify it, think of neurons as building blocks of our brains. More neurons = smarter (potentially).
In statistics, bias means an inaccurate representation of what is true (e.g. the underlying population). In a social context, bias is a preference for an outcome or group of people, whether it is fair and unfair. Colloquially and in this article, bias means unfair or unwanted bias.
There is no one definition of what is fair. What is considered fair depends on the context. This challenge also presents a need and opportunity for people to critically think, explicitly express, and quantify what is considered fair. Decades ago, it was considered “normal” for “blacks” to be slaves in the United States. During the Spanish occupation of the Philippines, Chinese (like me) who were forced to live in the outside cities because of their race. Now, discriminating based on skin color or race is both illegal and socially unacceptable.