How Berlin's Digital Archives Ended Up Full of the Same Image Twice: The Story Behind the Duplicate Problem

Berlin's public institutions hold millions of digital images — photographs of city landmarks, housing projects, planning documents, cultural events — and a growing share of them are exact or near-exact copies filed under different names, different departments, and sometimes different budget lines. The problem is structural, and it did not happen overnight.

The roots go back roughly fifteen years, to the period between 2010 and 2015 when Berlin's borough administrations — all twelve of them, from Mitte to Treptow-Köpenick — began digitising physical archives at speed. Each borough ran its own IT procurement. Each bought different content management software. Pankow used one system; Neukölln used another. When images crossed departmental boundaries — a photograph of a Kreuzberg housing block needed by both the Stadtentwicklungsamt and the press office of the Senatsverwaltung für Stadtentwicklung — staff simply re-uploaded the file rather than linking to an existing record. The duplicate was born.

A Fragmented System Built on Urgency, Not Standards

The pressure to digitise fast came partly from federal requirements tied to the E-Government-Gesetz, the national e-government framework law that took effect in 2013 and pushed public bodies to make records accessible online within defined timescales. Berlin's administrations interpreted the mandate loosely. The law said make records accessible; it said little about deduplication standards or shared asset registries.

By the time the Berlin Senate's central IT agency, the ITDZ Berlin, began pushing for a unified digital infrastructure in the early 2020s under the city's Digitalisierungsstrategie programme, the damage was already embedded in the databases. A 2023 audit by the Berliner Rechnungshof — the city's Court of Auditors — identified wasteful digital storage practices across multiple Senate departments, though the court's published findings stopped short of quantifying duplicate image files specifically. Storage costs for public digital assets across the Senate administration ran into the millions of euros annually, the audit noted, without specifying a single figure for the image problem alone.

The cultural sector felt it differently. The Stadtmuseum Berlin, whose collections span sites including the Märkisches Museum on the Köllnischer Park and the Ephraim-Palais in the Nikolaiviertel, has been working since 2021 to migrate holdings onto a shared platform compatible with the Deutsche Digitale Bibliothek, the national digital library network. Staff there discovered that images contributed by partner institutions — borough museums, university archives, the Berlinische Galerie on Alte Jakobstraße — frequently duplicated assets the Stadtmuseum already held, often at lower resolution, because no shared lookup existed before the migration began.

The Cost of Doing Nothing Rises

Duplicate images are not merely an administrative irritant. In Berlin's current political environment, where the SPD-led Senate coalition is under pressure to demonstrate fiscal discipline while simultaneously funding housing construction and the BVG's multi-billion-euro transport modernisation programme, unnecessary storage expenditure draws scrutiny. Cloud storage costs have risen sharply since 2022 alongside European energy prices. Keeping redundant files has a real, recurring cost.

There is also a legal dimension. Under the EU's General Data Protection Regulation, images containing identifiable individuals — faces captured at public events, for instance, or photographs taken during social housing inspections in Marzahn-Hellersdorf — must be managed, corrected, or deleted upon request. Duplicate records make compliance harder: deleting one copy does not delete the others, and administrators may not know how many copies exist.

The ITDZ Berlin is currently piloting a deduplication tool across three Senate departments as part of the broader Berlin Digital Strategy 2030 roadmap, according to publicly available programme documents. The pilot, which began in the first quarter of 2026, is expected to produce a report with citywide rollout recommendations before the end of the year. Borough IT teams will then face a choice: integrate into the central registry, or continue managing their own asset libraries with new interoperability requirements attached. For archives staff at institutions from the Zentralarchiv in Wedding to the borough offices in Spandau, that decision will determine how much of the next decade is spent cleaning up the last one.