Automated decision-making systems in the welfare state have produced discriminatory outcomes at scale, as critical schol arship has extensively documented. This article examines the mechanisms through which such outcomes are produced by tracing the cultural, institutional, and technical determinants embedded in their design and use. Drawing on qualitative research conducted in the Netherlands between 2023 and 2024, it combines semi-structured interviews, ethnographic observation, and documentary analysis across three cases: SyRI, the childcare benefits scandal (Toeslagenaffaire), and Rotterdam’s welfare fraud detection system. Rather than asking whether automated systems discriminate, the article asks how discriminatory social classifications become translated into algorithmic risk and acquire the authority of seemingly objective decisions. The analysis identifies four recurring mechanisms: manual pre-selection of groups for scrutiny, the use of records of past suspicion as training data, proxy substitution for sensitive attributes, and the cumulative, intersec tional layering of risk indicators. To conceptualize these dynamics, the article develops the notion of network determin ism: the practical closure produced when administrative institutions, databases, policy objectives, statistical categories, organizational routines, and computational systems repeatedly reinforce one another, turning contingent classifications into effectively deterministic outcomes for those subjected to them. The findings show that discrimination cannot be attributed to algorithms alone, but emerges from chains of human and institutional choices that distribute both decision-making and responsibility. The Dutch cases therefore demonstrate why technical or legal corrections are insufficient without addressing the socio-cultural assumptions that automated systems are built to operationalize.

“Unprecedented Injustice”: Network Determinism in the Dutch Digital Welfare State / D. Huyskes. - In: AI AND ETHICS. - ISSN 2730-5961. - 6:(2026 Sep 15), pp. 527.1-527.17. [10.1007/s43681-026-01350-6]

“Unprecedented Injustice”: Network Determinism in the Dutch Digital Welfare State

D. Huyskes
Primo
2026

Abstract

Automated decision-making systems in the welfare state have produced discriminatory outcomes at scale, as critical schol arship has extensively documented. This article examines the mechanisms through which such outcomes are produced by tracing the cultural, institutional, and technical determinants embedded in their design and use. Drawing on qualitative research conducted in the Netherlands between 2023 and 2024, it combines semi-structured interviews, ethnographic observation, and documentary analysis across three cases: SyRI, the childcare benefits scandal (Toeslagenaffaire), and Rotterdam’s welfare fraud detection system. Rather than asking whether automated systems discriminate, the article asks how discriminatory social classifications become translated into algorithmic risk and acquire the authority of seemingly objective decisions. The analysis identifies four recurring mechanisms: manual pre-selection of groups for scrutiny, the use of records of past suspicion as training data, proxy substitution for sensitive attributes, and the cumulative, intersec tional layering of risk indicators. To conceptualize these dynamics, the article develops the notion of network determin ism: the practical closure produced when administrative institutions, databases, policy objectives, statistical categories, organizational routines, and computational systems repeatedly reinforce one another, turning contingent classifications into effectively deterministic outcomes for those subjected to them. The findings show that discrimination cannot be attributed to algorithms alone, but emerges from chains of human and institutional choices that distribute both decision-making and responsibility. The Dutch cases therefore demonstrate why technical or legal corrections are insufficient without addressing the socio-cultural assumptions that automated systems are built to operationalize.
Algorithmization; Network determinism; Automated decision-making; Algorithmic discrimination; Digital welfare state; Science and technology studies
Settore GSPS-06/A - Sociologia dei processi culturali e comunicativi
15-set-2026
Article (author)
File in questo prodotto:
File Dimensione Formato  
s43681-026-01350-6.pdf

accesso aperto

Tipologia: Publisher's version/PDF
Licenza: Creative commons
Dimensione 1.05 MB
Formato Adobe PDF
1.05 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1272772
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact