Berlin Leads Europe on Purging Duplicate Images From City Records — But Amsterdam and Vienna Are Closing the Gap

Berlin's Senate Department for Urban Development confirmed earlier this year that its digital cadastral database — maintained jointly with the Stadtentwicklung office on Württembergische Straße — had eliminated more than 340,000 duplicate image files accumulated since the archive's partial digitisation began in 2009. The clean-up, which ran through the first quarter of 2026, affects planning permits, housing inspection photographs, and street-level infrastructure records stored across the city's 12 borough administrations.

The timing matters. Germany's national Registermodernisierungsgesetz, the registry modernisation law that came into force in stages from 2023 onward, requires all Länder to meet federal data-quality benchmarks by the end of 2027. Duplicate image records create chain errors — a photograph misfiled under two separate parcel IDs, for example, can delay a housing permit by weeks because automated compliance checks flag the discrepancy for manual review. With Berlin's housing shortage still acute and rent-cap debates dominating SPD coalition meetings at the Rotes Rathaus, those delays carry political weight.

What Berlin Is Doing Differently

The city contracted Fraunhofer FOKUS, the Berlin-based digital public services research institute on Kaiserin-Augusta-Allee, to build a perceptual-hash deduplication tool tailored to low-resolution archival scans. Standard commercial deduplication software, which compares exact file checksums, missed visually identical images that had been re-scanned at slightly different resolutions or with metadata timestamps altered during a 2015 server migration. Fraunhofer FOKUS's approach compares visual fingerprints rather than binary data, catching an estimated 94 percent of near-duplicate pairs that earlier tools ignored, according to the project summary published by the institute in March 2026.

Borough-level implementation has been uneven. Mitte and Friedrichshain-Kreuzberg — both of which run newer content-management infrastructure — completed their deduplication passes by February. Neukölln and Lichtenberg, whose archive servers were last replaced in 2016, are still working through backlogs. Neukölln's borough office told The Daily Berlin it expects to finish by September 2026, though no formal completion date has been announced publicly.

How Berlin Compares Globally

Amsterdam's Gemeente Amsterdam began a comparable project in 2024 under its Digitale Stad programme, focusing on building-permit imagery stored in the Stadsarchief on Vijzelstraat. The Dutch capital adopted a vendor solution — a licensed platform from a Dutch govtech firm — rather than a bespoke research partnership. Amsterdam officials have said publicly that their tool processed roughly 1.2 million files, though the percentage of duplicates removed has not been disclosed in any public report reviewed by this newspaper.

Vienna went a different route. The city's MA 41 — the municipal surveying and geodata office — integrated deduplication directly into its GeoServer pipeline in late 2023, meaning new duplicates are caught at the point of upload rather than in retrospective batch runs. That architecture is more efficient long-term but required a full rebuild of the ingestion workflow, a project that cost Vienna approximately €2.1 million over 18 months, according to the city's 2024 annual digitalisation report. Berlin's Senate has not published a comparable cost figure for the Fraunhofer FOKUS engagement.

London's approach has been fragmented, handled borough by borough rather than centrally. The Greater London Authority's data standards team published guidance in January 2025 recommending deduplication best practices, but implementation remains voluntary. Tower Hamlets and Hackney have started pilots; most other boroughs have not. Experts in data governance who study municipal systems have noted the contrast with cities that mandate centralised standards, though no London authority has issued a formal comparison with Berlin's programme.

For Berliners waiting on planning decisions — particularly in high-demand areas like Prenzlauer Berg or along the Tempelhofer Feld development corridor — the practical effect should be visible within months. The Senate's own project documentation, released in April 2026, projected that eliminating duplicate records would reduce automated-processing errors in planning applications by roughly 18 percent. Whether borough offices translate that efficiency into faster permit turnarounds will become clearer once Neukölln and Lichtenberg complete their work later this year. Any Berliner whose planning file stalled in a borough still running the old system can request a manual status review through their local Bürgeramt — a step the Senate's housing helpline, reachable at the Tempodrom-adjacent advice centre on Möckernstraße, has been advising applicants to take since May.