Berlin's Digital Archives Face a Reckoning Over Duplicate Images: What Happens Next and the Key Decisions Ahead

Berlin's network of public archives, cultural institutions, and government agencies is sitting on a problem that has quietly compounded for years: vast stores of duplicate digital images clogging servers, inflating storage costs, and undermining the reliability of public records. The question now is not whether to act, but who decides how, and by when.

The issue crystallised this spring when the Berliner Senatsverwaltung für Stadtentwicklung, Bauen und Wohnen—the city's urban development authority—flagged that its digital document management system contained an estimated 40 percent redundancy rate across image-based planning files, according to an internal review summary circulated to coalition partners in June. For a department already under strain from the housing shortage debate and the ongoing rent cap negotiations, duplicated planning maps and architectural scans represent both a financial drain and a legal liability: if two versions of a document exist and differ even slightly, disputes over which is authoritative can stall proceedings.

A City-Wide Problem With No Single Owner

The Stadtbibliothek Berlin, headquartered on Breite Straße in Mitte, and the Landesarchiv Berlin on Eichborndamm in Reinickendorf are among the institutions now being drawn into a working group convened by the Senatskanzlei. Both hold tens of thousands of digitised photographs and maps, some scanned multiple times across different projects over the past two decades. The working group, which held its first formal session on 18 June 2026, is expected to deliver a framework recommendation by the end of September.

The stakes are practical as well as financial. Cloud storage costs for the city's public-sector IT infrastructure are billed through the ITDZ Berlin—the state's central IT service provider—and the agency has indicated that deduplication across major departments could reduce storage expenditure by a meaningful margin, though firm figures depend on audit results still underway. For context, ITDZ Berlin manages infrastructure serving roughly 80,000 public-sector workstations across the capital.

Berlin's startup sector is watching closely. Several companies operating out of hubs like Factory Berlin on Rheinsberger Straße in Prenzlauer Berg have built products around AI-assisted image deduplication for enterprise clients. A consolidation push by the city government would represent a procurement opportunity—but also a test of whether Berlin's SPD-led coalition will favour established vendors or open the process to local tech entrants through the city's existing Vergaberecht procurement rules.

Key Decisions Ahead—and the Timeline That Matters

Three decisions will shape the outcome. First, the Senatskanzlei working group must agree on a technical standard: whether to adopt perceptual hashing, metadata-matching, or a hybrid approach for identifying duplicates. Each carries different cost and accuracy profiles. Second, institutions need clarity on data sovereignty—who has deletion authority when a duplicate image straddles two departments, as frequently happens with cross-agency planning documents. Third, and most politically charged, is the budget question. Any deduplication programme of meaningful scale will require capital spending, and with Berlin's 2026-27 Haushalt already under pressure from BVG public transport investment commitments and Energiewende retrofit subsidies, finding a dedicated line item will require coalition negotiation.

The September deadline for the working group's framework is tight but not arbitrary. The city needs a decision before the 2027 budget drafting cycle opens in October, or deduplication risks being deferred again—as it was in both 2022 and 2024. Institutions that have already begun informal audits, including the Stadtbibliothek's digital services team, will likely push for a standardised toolkit rather than leaving each house to improvise its own solution.

For Berliners, the immediate effects are invisible—but the downstream consequences are not. Planning disputes, freedom-of-information requests, and digitised historical records all depend on clean, authoritative image data. Getting the governance model right before the budget window closes is the only realistic path to a solution that holds.