AI in Local Governance: Navigating the Unseen Risks and Ethical Challenges
In recent years, artificial intelligence (AI) has quietly integrated into local governance, influencing everything from public safety to urban planning. However, this surge in AI adoption often proceeds with scant public awareness and a lack of clear, comprehensive policies to guide its ethical use.
A striking example from 2017 in Rotterdam, the Netherlands, reveals the potential pitfalls. The city deployed an AI system to assess the likelihood of welfare fraud among recipients. The system, however, developed biases, disproportionately flagging young women, mothers, and those with limited Dutch language skills as high-risk. This bias led to an eventual suspension of the system in 2021 after an ethics review highlighted its flaws.
This case exemplifies the broader challenges local governments face as they increasingly rely on AI. Our study examined 170 local governments worldwide and found only 16% had established AI policies by May 2023. This lack of regulation raises concerns about data privacy, algorithmic bias, and accountability.
The Integration of AI in Public Services
The integration of AI in public services spans five key domains:
- Administrative Services: In Madrid, AI chatbots like VisitMadridGPT offer personalized tourism advice, enhancing visitor experiences.
- Healthcare and Wellbeing: Boston’s AI-driven chatbot facilitated contactless food delivery during the COVID-19 pandemic, addressing both hunger and health concerns.
- Transportation and Urban Planning: Cities like Logan in Australia use AI for real-time parking availability, reducing congestion and emissions with optimized public transport routes.
- Environmental Management: Hangzhou, China, employs AI to classify waste, improving recycling efficiency significantly.
- Public Safety and Law Enforcement: Chicago’s AI systems have reportedly decreased gun violence by identifying crime hotspots, though not without concerns about potential racial profiling.
Despite these advancements, the absence of robust AI policies leaves local governments vulnerable to ethical violations. Algorithms could unintentionally discriminate, affecting decisions on public housing or healthcare access, as seen in Rotterdam.
Among the few governments with AI policies, Barcelona stands out. The city emphasizes transparency and explainability in AI decision-making, setting a precedent for others to follow.
Public Awareness and Policy Development
A recent survey conducted in Australia, Spain, and the US highlighted a significant gap in public awareness. While 75% of respondents recognized AI’s growing role in daily life, many were unaware of its use in local governance. Over 68% had no knowledge of existing or potential AI policies.
This disconnect underscores the need for greater transparency and public engagement. As AI becomes more embedded in urban management, informing and involving citizens is crucial for building trust and ensuring ethical oversight.
Looking ahead, local governments must prioritize the development of comprehensive AI policies that ensure fairness, accountability, and ethical use of data. Simultaneously, citizens need education on AI’s role in governance to foster informed dialogue and collaboration.
AI has the potential to revolutionize public service delivery, but without careful guidance, it risks perpetuating biases and undermining public trust. By working together, governments and citizens can navigate the challenges and harness AI’s potential for good.
