Pre-Emptive Justice: The Ethics of Using AI to Predict and Prevent Crime
Key Findings
Predictive Policing Data
Predictive policing cannot rely on past arrest data in places with strong privacy laws because legal limits on data retention and transparency block the feedback loops needed to train the systems.
Predictive policing systems rely on large amounts of past arrest data to find patterns over time. These systems assume that data collection will continue without limits. But in places like the European Union, strict privacy laws limit how long personal data can be kept. Laws such as the GDPR also give people the right to understand automated decisions. This means police cannot always use historical data to train algorithms. Without continuous access to data, the algorithms cannot learn from past patterns. When data use is restricted, the feedback loop from past arrests to future predictions breaks down. Legal rules that protect privacy and fairness reduce the risk that biased data will repeat old policing patterns. In countries that enforce these rights, the data needed for predictive policing is not always available. This weakens claims that biased data will always shape where police focus their efforts.
Predictive Policing Bias
Predictive policing does not always increase surveillance because legal rules can block biased data use and change how the systems operate.
Predictive policing algorithms use old crime data. These data reflect past police activity, not actual crime levels. In cities with deep social divides, police historically watched some neighborhoods more closely. This means the data count more arrests in those areas, not more crime. The algorithms learn from this flawed data. They target the same communities again. This increases police presence where people already face more scrutiny. The system repeats the past. But this cycle only continues if no rules block it. In places with strong privacy laws or court rulings, data use is limited. The European Union restricts how data can be reused. U.S. courts have upheld privacy rights. Legal challenges by groups like the ACLU have forced changes. Many predictive systems now face strict limits. Without these legal checks, the tools would deepen bias. With them, the outcome shifts. So the claim that these tools always increase police reach is not fully true. It ignores how laws can change the result. Legal rules can stop the cycle. They alter how the systems work in practice. The effect of predictive policing depends on oversight.
Predictive Policing Feedback Loop
Predictive policing reinforces surveillance in over-policed areas because it relies on historical crime data, creating a feedback loop that diminishes when legal oversight demands transparency and fairness.
Predictive policing systems guide police resources based on past crime data. These systems focus more surveillance on communities already heavily policed. More policing leads to more reported crimes in those areas. This creates a cycle where historical data shapes future enforcement. The cycle persists when no one reviews the system critically. It weakens when laws limit data use or require transparency. Courts in some regions have challenged unchecked automated decisions. This shifts the focus from pure prediction to fairness and accountability. When systems must provide auditable explanations or face legal limits, the logic shifts. The cycle breaks when rules demand justification over prediction. Oversight changes how these tools operate in practice.
Crime Prediction Tools
Crime prediction tools spread because tight budgets favor measurable tech fixes over social programs, making cost savings the main force behind their use.
Courts and police now use algorithms to assess crime risk. These tools spread because governments choose them over social programs. Funding for public safety often skips housing or job support. Instead it pays for tech solutions. This saves money in the short term. Algorithms turn complex lives into simple risk scores. These scores fit neatly into budget plans. But they ignore root causes of crime. Things like job loss or unstable housing. Governments track data from these tools more easily than social needs. Austerity makes this worse. Poorer cities adopt predictive systems faster. International reports confirm this trend. The real driver is not policing data or law changes. It is the need to show savings. Algorithms seem efficient. They produce numbers that justify tight budgets. So cities use them more. This reduces focus on prevention. The tools shape policy more than crime itself. Data feedback and legal checks matter less than cost savings.
Predictive Policing Feedback Loop
Predictive policing increases police presence in over-policed neighborhoods because the algorithms learn from biased data and create a cycle of surveillance that reinforces itself.
Predictive policing systems use data like 911 calls and housing problems to mark neighborhoods as high-risk. These systems often ignore actual crime reports. Instead they rely on statistics that reflect past policing patterns. In New York City the Domain Awareness System was built with Microsoft and the NYPD. It uses these flawed data to guide police activity. Areas already heavily watched get more police attention. This happens because algorithms learn from old arrest data. Those data come from over-policed communities. The models then predict more crime there. This leads to more patrols. A feedback loop forms. More patrols lead to more arrests. More arrests feed the algorithm. This cycle makes the model seem accurate. But it only reinforces bias. The system treats suspicion as normal for certain areas. It does not treat crime as something uncertain. This changes how cities govern. Surveillance becomes routine. It feels normal. But it targets the same neighborhoods. Civil rights oversight is weakest there. Most big U.S. cities use such systems. They have not lowered violent crime. But they have increased police presence. This creates a form of justice that acts before crimes occur. It assumes some people should always be watched.
Predictive Policing Gaps
Predictive policing fails to produce reliable crime forecasts because most cities lack the integrated, shared data systems needed to continuously update the models.
Predictive policing tools rely on data to guide police patrols. These tools assume that arrest records feed into centralized systems. The systems then update models to predict future crime. But most U.S. cities lack integrated data networks. Police departments use separate databases that do not share information well. Data sharing often happens in informal, temporary ways. This fragmentation breaks the feedback loop the models need. Arrest data does not flow reliably into the prediction systems. Without constant updates from real-world enforcement, models cannot improve. Most cities cannot sustain the data flow needed. As a result, the models fail to produce accurate crime forecasts over time.
Policing By Prediction
Predictive policing repeats old biases because it uses biased arrest data to decide where police go, making crime seem higher in already over-policed areas.
Predictive algorithms are used in law enforcement to decide where patrols should go. These systems rely on old arrest data. That data reflects past bias, not real crime patterns. Police are sent more often to neighborhoods already over-policed. More patrols lead to more arrests in those areas. This makes crime appear more common there. The data then shows more crime, justifying more patrols. It becomes a cycle. The algorithm treats this loop as evidence of risk. This feedback locks in historical bias. The result is not better predictions. It is more police attention where there was already too much. This happens even if actual crime is no higher. Systems like CompPol in New York show this pattern. Scholars from the Brennan Center have documented the effect. The outcome looks fair because it uses data. But it repeats old patterns of unequal policing.
