Tracking Flaws in Used Building Materials Aids Reuse

In circular construction, materials from old buildings are salvaged and reused in other building projects. The European Union this year has proposed legislation that would formalize and expand this concept.

While these reclaimed materials will likely be serviceable, they will not be perfect - and those imperfections can lead to unexpected construction delays and added cost.

Researchers from Cornell Tech and the Cornell Bowers College of Computing and Information Science have developed a documentation tool, Pentimento, that uses video, audio and computer simulation to better match on-site adaptations to the architects' and engineers' visions for a project.

The team described their tool in "Building Drift: Documenting On-Site Construction Adaptations Across Material Lifecycles," which won the Best Paper Award at the Association for Computer Aided Design in Architecture (ACADIA'26), held Oct. 22-24 in Detroit.

With Pentimento, the history of a reclaimed piece of lumber, for example, is documented and stored in a web interface that can be accessed by all relevant parties. This can minimize delays due to unforeseen challenges that result in what's known as "building drift" - a gradual straying from the structure's initial vision and design.

Credit: Ritik Batra/Provided

Pentimento, developed in the lab of Thijs Roumen at Cornell Tech, uses video, audio and computer simulation to better match on-site adaptations to the architects' and engineers' visions for a project using recycled building materials.

"With building drift, what we were trying to explore is, what are the sources of change that happen through that journey of making," said Ritik Batra, a doctoral candidate in information science at Cornell Tech, and lead author of the paper. "One example is the environment itself, environmental conditions. In the digital world, you can do whatever you want, it's perfect. But in the real world, it's not. You need to adjust."

Co-authors include Thijs Roumen, assistant professor at Cornell Tech and the Cornell Ann S. Bowers College of Computing and Information Science; Steven Jackson, vice provost for academic innovation and professor of information science (Cornell Bowers); and researchers from the Royal Danish Academy's Centre for Information Technology and Architecture (CITA).

Pentimento leverages both human and computerized input in an attempt to present a complete picture of a material's history and condition. Five factors contributing to building drift are considered in painting this picture: environmental conditions; constraints due to available materials and tools, particularly if the building site is in a remote location; the hidden history of the materials; the imperfections and limitations of available tools; and knowledge gaps between site owners, designers, builders and other stakeholders.

The European Union is scheduled this year to adopt the Circular Economy Act, which among other things will establish a single market for secondary raw materials and increase the supply of high-quality recycled materials. But while these materials will likely be very good, they will not be perfect.

Pentimento, Batra said, is a way to document and track any flaws or imperfections that could impact future use.

"The challenge is that you have an imperfect reflection of how the materials were used in previous buildings," Batra said. "What we're hoping is Pentimento can be used as a low-effort way for construction site people to be able to record what they're doing, document it, and then everyone down the line can refer to it and get the information they need.'

This work was conducted in the winter and spring of 2026, when Batra was a visiting scholar at CITA. Pentimento was tested on ReShelter, a pavilion built with reclaimed materials near Hvalsø, Denmark, west of Copenhagen. Batra was on site during its construction, and used smart glasses to both capture video and verbally document the construction process.

Video and audio were then uploaded to the Pentimento web interface when Batra returned to the CITA campus and had internet access. The system runs a structure-from-motion script (COLMAP) to estimate camera poses, then generates a 3D Gaussian splat reconstruction that can be overlaid onto the 3D model of the actual structure, resulting in a realistic, shareable 3D scene that can be rendered from any viewpoint within a web browser.

Pentimento's realistic rendering, the researchers wrote, enables stakeholders to locate and interpret sources of drift relative to the original model.

Roumen said he's used Gaussian splatting in previous projects focused on machinery - overlaying a CAD model onto the splat to troubleshoot a problem with the machine. But using this technology in architecture is uncharted territory.

"Rather than a machine's bolt being off," he said, "now it's more like the whole world is off. That's why we were so happy to see people at the conference get excited about how this work, which is already being used in HCI (human-computer interaction), actually makes sense in architecture, too."

/Public Release. This material from the originating organization/author(s) might be of the point-in-time nature, and edited for clarity, style and length. Mirage.News does not take institutional positions or sides, and all views, positions, and conclusions expressed herein are solely those of the author(s).View in full here.