A former member of the Dutch navy puts on a VR headset and finds himself standing on the naval site as it looked decades ago. He approaches a large iron entrance gate, passes through it, and hears the loud slam of the gate closing behind him. Memories of his training come rushing back — unpleasant ones. He later told historian Floribert Baudet: “When I heard that gate slamming shut, I felt shivers down my spine. For a moment, I felt exactly that same sense of being locked in again.”

For Baudet, an associate professor at the University of Amsterdam (UvA), that reaction is exactly what the Kattenburg Virtual Memories project is meant to achieve. The initiative, which began about three years ago, combines historical research with modern digital tools to make the lost neighbourhood of Kattenburg visible and tangible again.

“I find it utterly fascinating that we can use cutting-edge technology to visualise things that would otherwise be lost,” Baudet told UvA’s news service. “And not just the buildings, but also the experiences of the people who lived and worked there.”

Kattenburg is an artificial island created in the 17th century, which grew into an important centre for Dutch shipbuilding and the navy. A lively residential neighbourhood developed alongside the enclosed naval site, with daily life closely tied to the activities behind the wall. Over the 20th century, the area changed dramatically: shipbuilding disappeared, much of the housing fell into disrepair after the Second World War, and large-scale clearance eventually forced many original residents to leave permanently.

To document this history, Baudet developed the Kattenburg Atlas together with historian Djoeke van Netten and students on the Master’s programme in Military History (Strategic Studies). They collected historical maps, overlaid them digitally, and analysed how the area had changed over the centuries. They also gathered numerous personal stories from former naval personnel and former residents.

“There is no single story of Kattenburg,” Baudet emphasised. “There are hundreds of stories of Kattenburg. And it is incredibly interesting to see how military and civilian life became intertwined.”

To bring those stories to life, researchers and experts from the creative industries built a mixed-reality walk around the Marineterrein — the former naval site. Visitors wear a special headset that overlays historical imagery onto the present-day location. Buildings that have disappeared reappear; at certain points the entire environment shifts — it gets dark, streetlights come on, and visitors find themselves walking through the Marineterrein of the past.

The reconstruction is based not only on historical maps but also on the memories of former residents and naval personnel. “You can create a wonderful virtual reconstruction that people can fly through, but it only really comes to life when you add stories,” said Tijl Akkermans, a designer at Autres Directions, a creative studio involved in the project.

During interviews, the team experimented with a method called Synthetic Memory, which uses generative AI to create images based on personal recollections. Former residents and naval personnel were asked to describe their former surroundings as precisely as possible — what the buildings looked like, what the atmosphere was like, what daily life was like. The AI-generated images often helped trigger further memories.

“Once people start telling their stories, more and more memories surface. These were also reinforced by the images we generated,” Akkermans told UvA.

At the same time, the researchers were careful to account for the subjectivity of memory. They drew a clear distinction between research-based historical reconstructions and AI-generated interpretations of personal stories — recognising that two people may have experienced the same event very differently.

The initial results have been presented, but the team views the project as unfinished. Currently, the mixed-reality walk is still a prototype, mainly employed to investigate the capabilities of the technology. Additional work is required to broaden access to the experience.

Baudet views the Kattenburg Atlas as an evolving resource that future cohorts of students can help expand. He additionally plans to conduct additional interviews with past inhabitants and navy members to preserve narratives that could otherwise disappear. Akkermans, meanwhile, perceives possibilities for employing comparable methods in other historic districts — both to inform tourists about history and to increase locals' awareness of their own area's past.

In the end, Baudet says the initiative aims to highlight all these varied viewpoints. “Memories can differ quite a lot. You can perfectly well present them side by side, without saying: ‘You’re lying and you’re right.’”

For students, the project offers a concrete example of how digital humanities, oral history and emerging technologies can intersect — and how universities can use AI and mixed reality not just for research, but to reconnect communities with their own past.