Berlin's Digital Archives Face a Reckoning Over Duplicate Images: The Key Decisions Ahead

Berlin's network of public archives, municipal agencies and cultural institutions is confronting a problem that has quietly compounded since at least 2018: tens of thousands of duplicate digital images clogging government servers, distorting search results and costing taxpayers real money in unnecessary storage contracts. The Senatsverwaltung für Kultur und Gesellschaftlichen Zusammenhalt, which oversees coordination across the city's major cultural bodies, is now under pressure to act — and the window for decision is narrow.

The issue matters now because several major framework contracts for cloud storage are due for renewal before the end of January 2027. If the city rolls over those contracts without first auditing and culling redundant files, it risks locking in costs that independent IT consultants in the municipal sector have estimated can run 20 to 30 percent higher than necessary for institutions carrying significant image duplication. The Landesarchiv Berlin, based on Eichborndamm in Reinickendorf, and the Stadtmuseum Berlin, which manages collections across sites including the Ephraim-Palais in the Nikolaiviertel, are both understood to be part of the renegotiation process.

What the Duplication Problem Actually Looks Like

The mechanics are straightforward and the consequences underappreciated. When different departments digitise the same photograph, scan the same document cover, or download the same press image from a shared portal, copies accumulate across siloed drives. Metadata tags differ. File names drift. A single image of, say, the Oberbaumbrücke commissioned for a 2019 tourism campaign can exist in seventeen slightly different compressed versions across four separate municipal departments, none of which knows the others have it.

The Zentrales IT-Dienstleistungszentrum Berlin, the city's central IT services body known as ITDZ Berlin, has been piloting a deduplication software trial across a subset of Senatsverwaltung servers since March 2026. The trial covers roughly 4.2 terabytes of image data drawn from three participating agencies. Early internal assessments circulated to procurement officers suggest duplication rates in some departments exceed 35 percent of total image storage volume, though those figures have not yet been published or independently verified.

For the Stadtbibliothek branches and the digitisation teams working out of Amerika Gedenkbibliothek on Blücherplatz in Kreuzberg, the practical consequence is search failure: staff querying the shared digital asset management system encounter multiple near-identical results, slow load times and version-control confusion that delays public access to materials.

The Decisions That Will Define the Outcome

Three choices now sit on the desks of senior officials and they cannot be deferred much longer. First, the city must decide whether to mandate a single deduplication standard across all participating institutions or allow each body to procure its own solution — a debate that mirrors the broader tension in Berlin's SPD-led coalition between central coordination and institutional autonomy. Centralisation is cheaper at scale; autonomy preserves flexibility for organisations like the Berlinische Galerie, whose image rights and licensing arrangements are considerably more complex than a standard municipal photo library.

Second, and more politically charged, is the question of what gets deleted and who decides. Some duplicate files carry different rights statuses or watermarks; a bulk automated purge risks destroying the only copy of a legitimately distinct version. The decision on governance — whether a cross-institutional review board or a single designated authority like ITDZ Berlin holds the final call — needs to be made before the deduplication tools are deployed at scale.

Third, the city must choose a timeline. Procurement officials have indicated that a decision framework needs to be in place by September 2026 if new storage contracts are to incorporate revised capacity projections. That gives institutions roughly ten weeks to align their internal assessments and submit recommendations upward through the Senatsverwaltung chain.

For Berliners, the stakes are less abstract than they sound. Slower digital access to public records, inflated IT budgets and degraded search tools in public libraries are direct consequences of inaction. The next moves — a governance decision, a technical standard, a procurement deadline — will determine whether the city finally brings its digital house in order or signs another multi-year contract to store the same photograph of the Oberbaumbrücke seventeen times over.