Berlin's Digital Archivists Are Quietly Winning the Battle Against Duplicate Images — But the Job Is Far Done

Berlin's Senate Department for Culture and Social Cohesion confirmed this spring that the city's publicly maintained image databases — covering everything from urban planning records to publicly funded arts documentation — contained an estimated 340,000 duplicate or near-duplicate files, a figure that had quietly accumulated over more than a decade of decentralised digital storage. The department has now begun a structured deduplication and replacement programme, targeting completion of the first phase by the end of 2026.

The timing matters. Berlin, like a growing number of European capitals, is under pressure to modernise its digital infrastructure ahead of new EU data governance requirements taking effect in early 2027. Bloated image libraries cost money — in server capacity, in staff hours spent mis-cataloguing assets, and in the reputational damage that comes when a city's public-facing portals serve citizens the same photograph three times over. For a city already stretching its budget across a contested rent-cap programme and the ongoing BVG transport investment cycle, efficiency savings in digital administration are politically useful.

What Berlin Is Actually Doing

The operational work is split between two institutions. The Zentralen Landesbibliothek Berlin, based in Blücherplatz in Kreuzberg, is handling deduplication for cultural and archival holdings, using a combination of perceptual hashing software and human review teams. Separately, the Berlin Senate's own IT service arm, ITDZ Berlin, headquartered in Alt-Moabit, is running a parallel process for administrative image assets used in planning documents, press communications, and the city's official web presence. The two programmes are coordinated but not merged — a structural choice that some digital archivists have noted creates its own inefficiencies, since assets sometimes overlap across the two institutions.

The approach contrasts with what Amsterdam rolled out in 2024. The Dutch capital centralised all public image deduplication under a single municipal digital unit within its Stadsarchief, giving one team authority over both cultural and administrative holdings. Amsterdam's municipal government reported that the consolidated approach reduced duplicated storage costs by roughly 22 percent within the first eight months. Berlin's bifurcated model has not yet published comparable figures, and ITDZ Berlin declined to provide interim statistics before a planned progress report due in September 2026.

Tokyo, managing a far larger bureaucratic apparatus, has taken a different route entirely, contracting out deduplication to a consortium of private technology firms under a 2025 smart-city procurement framework. That model has generated debate about data sovereignty — concerns that carry particular resonance in Berlin, where institutional memory of surveillance and data misuse runs deep, and where the city's SPD-led coalition has publicly committed to keeping sensitive civic data in public hands.

The Practical Pressure Behind the Push

For Berlin's Mitte district planning office, which handles permit documentation for one of Europe's most contested urban development zones, duplicate images are not an abstract problem. Planners working on Alexanderplatz redevelopment submissions have flagged cases where duplicate site photographs filed under different reference numbers caused confusion in version-control workflows, requiring manual reconciliation that delayed review timelines. The Senate has not released figures on how frequently this occurs, but the issue was cited in a February 2026 internal audit summary that was later published on the Senate's transparency portal.

The European comparison benchmark that Berlin officials appear most focused on is Vienna. The Austrian capital completed a comprehensive duplicate-image replacement programme across all municipal departments in March 2026, after a three-year project that cost approximately €4.2 million and was funded partly through an EU digital transition grant. Vienna's model used open-source deduplication tools built on the FOSS community's Perceptual Image Hash Library, which Berlin's ITDZ is also evaluating.

For Berliners with a practical stake — architects filing planning applications in Friedrichshain-Kreuzberg, journalists requesting image assets from the Senate press office, or community groups accessing Bezirk-level documentation — the immediate advice from digital governance advocates is straightforward: cross-reference any image pulled from Berlin's official portals against the upload date and reference code, since assets uploaded before January 2025 are most likely to carry legacy duplication errors. The Senate has published a guidance note on its service portal advising exactly this, as the first-phase clean-up works its way through the backlog.