As the European Union prepares to adopt legislation that would formalise the reuse of building materials, researchers at Cornell Tech have developed a tool designed to solve a practical problem with reclaimed components: they are rarely perfect, and those imperfections can cause expensive, time-consuming disruptions on construction sites.
The tool, called Pentimento, uses video, audio and computer simulation to document the flaws and history of salvaged materials such as timber, then makes that information accessible through a web interface that all parties involved in a project can consult. The researchers described their work in a paper titled "Building Drift: Documenting On-Site Construction Adaptations Across Material Lifecycles," which won the Best Paper Award at the Association for Computer Aided Design in Architecture (ACADIA'26) conference, held in Detroit from October 22 to 24.
The concept of "building drift" is central to the research. It refers to the gradual divergence between a structure's original design and what is actually built, as on-site teams make unplanned adjustments to accommodate the quirks of reclaimed materials. According to Ritik Batra, a doctoral candidate in information science at Cornell Tech and lead author of the paper, the team wanted to understand the sources of those changes. "One example is the environment itself, environmental conditions," Batra said. "In the digital world, you can do whatever you want, it's perfect. But in the real world, it's not. You need to adjust."
The European Union is expected to adopt the Circular Economy Act this year, which would establish a single market for secondary raw materials and increase the supply of high-quality recycled materials, the Cornell Chronicle reported. But even high-quality reclaimed materials will carry imperfections from their previous use. Pentimento, Batra explained, is designed as a low-effort way for construction workers to record what they are doing and document any flaws, so that everyone downstream can refer to that information.
The tool accounts for five factors that contribute to building drift: environmental conditions; constraints from available materials and tools, especially on remote sites; the hidden history of materials; imperfections and limitations of available tools; and knowledge gaps between site owners, designers, builders and other stakeholders.
Pentimento was tested on a pavilion called ReShelter, built with reclaimed materials near Hvalsø, Denmark, west of Copenhagen. Batra was on site during construction and used smart glasses to capture video and verbally document the process. When he returned to the campus of the Royal Danish Academy's Centre for Information Technology and Architecture (CITA), where he was a visiting scholar in winter and spring of 2026, the video and audio were uploaded to Pentimento's web interface.
The system runs a structure-from-motion script called COLMAP to estimate camera positions, then generates a 3D Gaussian splat reconstruction that can be overlaid onto the 3D model of the actual structure. The result is a realistic, shareable 3D scene that can be viewed from any angle within a web browser. According to the researchers, this allows stakeholders to locate and understand sources of drift relative to the original design.
Thijs Roumen, an assistant professor at Cornell Tech and co-author of the paper, said he had used Gaussian splatting in previous projects focused on machinery, overlaying a CAD model onto the splat to troubleshoot problems. Applying the same technology to architecture was new territory. "Rather than a machine's bolt being off," Roumen said, "now it's more like the whole world is off. That's why we were so happy to see people at the conference get excited about how this work, which is already being used in HCI (human-computer interaction), actually makes sense in architecture, too."
Co-authors also include Steven Jackson, vice provost for academic innovation and professor of information science at Cornell Bowers, and researchers from CITA.
For university students studying architecture, engineering, construction management or sustainability, the research highlights a practical challenge in the push toward a circular economy: how to make reclaimed materials reliable enough for mainstream use. Tools like Pentimento could become part of the workflow on future construction sites, potentially creating new roles for graduates who understand both digital documentation and sustainable building practices.