AI 融合图形学与波动光学,打造更逼真全息 VR/AR 显示

编辑:Lisa Lock,审核:Robert Egan
本文已按照 Science X 的编辑流程与政策完成审核。编辑在确保内容可信度的前提下,重点标注了以下属性:
同行评审出版物
添加到首选来源
香港大学全息显示研究的概念示意图。该研究将保留三维几何与深度的基于网格的全息图生成技术,与可建模光传输和材质外观的 HoloPathTracer 相结合,旨在打造更逼真的全息 VR/AR 体验,具备自然的对焦线索和视角相关的视觉效果。图片来源:香港大学
香港大学(HKU)的研究人员将计算机图形学、波动光学与基于 AI 的校准相结合,开发出两项技术,可帮助全息显示再现更自然的对焦、透视和材质外观变化。
该团队由香港大学工程学院电机电子工程系教授 Yifan Evan Peng 带领,将三维计算机模型与光如何传播和干涉的计算联系起来。其中一项技术在场景转化为全息图的过程中保留其几何结构与深度;另一项技术则追踪光在场景中反射、折射和散射的过程。
这些方法通过计算机模拟和实验室显示原型得到了验证,解决了未来虚拟现实与增强现实(VR/AR)面临的一项关键挑战:如何将细节丰富的数字世界转化为令人信服的三维视觉体验。
当人们在房间里环顾四周时,近处和远处的物体会在不同距离上进入焦点。从一个角度看不到的表面会从另一个角度显现,高光也会在光泽材质表面移动。全息显示旨在通过重建光波来再现这些人们熟悉的线索,而不是仅仅呈现一幅平面图像。
但计算这些光波并不容易。许多现有方法首先用选定深度或视角的图像来描述一个场景,然后再把这些图像转换为全息图。重要信息可能在两个阶段之间丢失,从而产生不自然的模糊变化、错误的可见性,或只在某些观看位置才成立的视觉效果。
未来全息 AR 体验的概念示意图,其中虚拟三维物体看起来自然地融入了现实世界。全息图生成技术的进步,旨在轻量化的近眼显示设备中再现真实的深度、对焦、视角变化和材质外观。图片来源:香港大学
保持场景完整
在一项发表于 Nature Communications 的研究中,研究人员从多边形网格入手——即动画、工程和科学可视化中用于构建 3D 模型的相连表面片块。这使全息图计算获得对场景表面和深度的描述,而不仅仅是一组平面图像。
“使用网格让我们能够在整个全息图生成过程中保留场景的 3D 结构,”两项研究的共同第一作者 Xiangyu Meng 表示。
团队还把目光投向图像亮度之外。其优化方法同时保留了光波的振幅——与光的强度相关,以及相位——描述光在振荡周期中的位置。二者共同决定了光如何传播,以及如何在不同的深度处形成图像。
基于 AI 的校准有助于弥合计算与真实显示器之间的差距。利用相机测量,学习得到的模型会将光学系统中的缺陷纳入考量。在实验室测试中,该方法在焦点变化上产生更平滑的过渡,图像细节更清晰,同时使从一个观察位置被遮挡的物体能从另一个位置变得可见。
在发表于 ACM Transactions on Graphics 的第二项研究中,HoloPathTracer 应对了另一项挑战——光如何与材料相互作用。镜子反射其周围的场景,玻璃使穿过它的光发生折射,而有光泽的表面会向不同方向反射不同强度的光。
为了捕捉这些效果,研究人员将路径追踪与波动光学相结合;路径追踪是一种计算机图形学技术,用于追踪光在虚拟场景中的路径。该方法不是只计算图像的亮度,还保留了形成全息图所需的相位信息。
“HoloPathTracer 进一步模拟了光如何与场景几何结构和材料发生物理相互作用,”两项研究的共同第一作者 Wenbin Zhou 表示。
由此生成的全息图再现了反射、折射、变化的高光以及间接光照等效果,同时还能自然呈现焦点和视角变化。团队还通过在以快速连续方式生成多张用于显示的全息图时复用光路,以及缓存场景照明的部分内容,来减少重复计算。
迈向日常显示
这两项研究针对的是同一目标的不同环节。基于网格的方法提供了一条经过校准的路径,把人们熟悉的三维模型转化为全息图像;而 HoloPathTracer 则通过建模光与材料之间更复杂的相互作用,扩展了这些图像所能呈现的内容。
这项工作仍处于研究原型阶段。要实现实时消费级应用,还需要更快的计算能力,以及空间光调制器——即全息显示中用于调制光线的器件——和配套光学系统的进一步突破。
“我们相信,这一方向有助于为未来的 VR 和 AR 系统带来更自然、视觉上更逼真的全息体验。”Peng 表示。
Xiangyu Meng 等,Mesh-represented and learning-empowered hologram synthesis for full 3D holographic displays(基于网格表示与学习赋能的全息图合成,用于全 3D 全息显示),Nature Communications(2026)。DOI: 10.1038/s41467-026-74557-0
Wenbin Zhou 等,HoloPathTracer: Fast and Accurate Wave Path Tracing for Holography(HoloPathTracer:面向全息术的快速精确波路径追踪),ACM Transactions on Graphics(2026)。DOI: 10.1145/3811351
期刊信息:Nature Communications
这篇报道的背后是谁?
艺术史学士,物质文化硕士。曾任博物馆编辑、急救员和器官移植协调员。自 2021 年起在 Science X 从事编辑工作。完整简介 →
数学生物学学士,创意写作硕士。游历广泛,对科学与语言有独到见解。查看完整简介 →
引用信息:AI、计算机图形学与波动光学相结合,打造更逼真的全息 VR/AR 显示(2026年11月10日),2026年11月10日检索自 https://techxplore.com/news/2026-11-ai-graphics-optics-combine-realistic.html
本文件受版权保护。除为私人学习或研究目的进行的合理使用外,未经书面许可不得复制任何部分。内容仅供参考之用。
获取即时摘要文本(要点)
基于网格的全息图生成结合 AI 校准,在实验室显示中保持了深度,并改善了焦点与视点线索。波动光学路径追踪在保留相位信息的同时,重现了反射、折射与间接光照。两种方法均仍属原型;实时 VR/AR 需要更快的计算速度和更优的显示硬件。
本摘要由 LLM 自动生成。完整免责声明
译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。
查看英文原文(AI, computer graphics and wave optics combine for more realistic holographic VR/AR displays)
edited by Lisa Lock, reviewed by Robert Egan
This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:
peer-reviewed publication
Add to Preferred Sources
Conceptual illustration of HKU’s holographic display research. By combining mesh-based hologram generation, which preserves 3D geometry and depth, with HoloPathTracer, which models light transport and material appearance, the work aims to produce more realistic holographic VR/AR experiences with natural focus cues and view-dependent visual effects. Credit: The University of Hong Kong
Combining computer graphics, wave optics and AI-based calibration, researchers at The University of Hong Kong (HKU) have developed two techniques that help holographic displays reproduce more natural changes in focus, perspective and material appearance.
Led by professor Yifan Evan Peng from the Department of Electrical and Computer Engineering of the Faculty of Engineering at HKU, the team connects 3D computer models with calculations of how light travels and interferes. One technique preserves a scene's geometry and depth as it becomes a hologram; the other follows light as it reflects, bends and scatters through the scene.
Demonstrated through computer simulations and laboratory display prototypes, the methods address a key challenge for future virtual and augmented reality (VR/AR): turning detailed digital worlds into convincing three-dimensional visual experiences.
When people look around a room, nearby and distant objects come into focus at different distances. Surfaces hidden from one angle appear from another, and highlights shift across glossy materials. Holographic displays aim to reproduce these familiar cues by reconstructing light waves, rather than simply presenting a flat image.
But calculating those waves is difficult. Many existing methods first describe a scene using images at selected depths or viewpoints, then convert those images into a hologram. Important information can be lost between the two stages, producing unnatural changes in blur, incorrect visibility or visual effects that work only from certain viewing positions.
Conceptual illustration of a future holographic AR experience, in which a virtual three-dimensional object appears naturally integrated into the real world. Advances in hologram generation aim to reproduce realistic depth, focus, viewpoint changes, and material appearance in lightweight near-eye displays. Credit: The University of Hong Kong
Keeping the scene intact
In one study, published in Nature Communications, the researchers begin with polygon meshes—the connected patches of surface used to build 3D models in animation, engineering and scientific visualization. This gives the hologram calculation a description of the scene's surfaces and depth, rather than only a collection of flat images.
"Using meshes allows us to retain the 3D structure of a scene throughout hologram generation," said Xiangyu Meng, co-first author of both studies.
The team also looks beyond image brightness. Its optimization preserves both the amplitude of the light wave, which relates to its strength, and its phase, which describes its position within an oscillation cycle. Together, these help determine how light propagates and forms an image at different depths.
AI-based calibration helps bridge the gap between the calculation and a real display. Using camera measurements, a learned model accounts for imperfections in the optical system. In laboratory tests, the approach produced smoother changes in focus and clearer image detail, while allowing objects hidden from one viewing position to become visible from another.
Credit: HoloPathTracer generates holograms from complex 3D scenes and reconstructs realistic depth and focus cues with various visual effects. ACM Transactions on Graphics (2026). DOI: 10.1145/3811351
In the second study, published in ACM Transactions on Graphics, HoloPathTracer tackles another challenge—how light interacts with materials. A mirror reflects the scene around it, glass bends light passing through it, and a glossy surface sends different amounts of light in different directions.
To capture these effects, the researchers combine path tracing, which is a computer graphics technique that follows light through a virtual scene, with wave optics. Instead of calculating only the brightness of an image, the method also retains the phase information needed to form a hologram.
"HoloPathTracer further models how light physically interacts with scene geometry and materials," said Wenbin Zhou, the co-first author of both studies.
The resulting holograms reproduce effects including reflections, refractions, shifting highlights and indirect illumination, alongside natural changes in focus and viewpoint. The team also reduces repeated computation by reusing light paths when generating multiple holograms for display in rapid succession and by caching parts of the scene's lighting.
Toward everyday displays
The two studies address different parts of the same goal. The mesh-based approach provides a calibrated route from familiar 3D models to holographic images, while HoloPathTracer extends what those images can show by modeling more complex interactions between light and materials.
The work remains at the research-prototype stage. Real-time consumer applications will require faster computation and further advances in spatial light modulators—the devices that shape light in a holographic display—and the surrounding optics.
"We believe this direction could help enable more natural and visually realistic holographic experiences for future VR and AR systems," said Peng.
Xiangyu Meng et al., Mesh-represented and learning-empowered hologram synthesis for full 3D holographic displays, Nature Communications (2026). DOI: 10.1038/s41467-026-74557-0
Wenbin Zhou et al., HoloPathTracer: Fast and Accurate Wave Path Tracing for Holography, ACM Transactions on Graphics (2026). DOI: 10.1145/3811351
Journal information:Nature Communications
Who's behind this story?
BA art history, MA material culture. Former museum editor, paramedic, and transplant coordinator. Editing for Science X since 2021. Full profile →
Bachelor's in mathematical biology, Master's in creative writing. Well-traveled with unique perspectives on science and language. Full profile →
Citation: AI, computer graphics and wave optics combine for more realistic holographic VR/AR displays (2026, November 10) retrieved 10 November 2026 from https://techxplore.com/news/2026-11-ai-graphics-optics-combine-realistic.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
Get Instant Summarized Text (Gist)
Mesh-based hologram generation with AI calibration preserved depth and improved focus and viewpoint cues in laboratory displays. Wave-optical path tracing reproduced reflections, refraction and indirect illumination while retaining phase information. Both approaches remain prototypes; real-time VR/AR requires faster computation and improved display hardware.
This summary was automatically generated using LLM. Full disclaimer
This site uses cookies to assist with navigation, analyse your use of our services, collect data for ads personalisation and provide content from third parties. By using our site, you acknowledge that you have read and understand our Privacy Policy and Terms of Use.
原文为英文,正文由自动抓取并保留原文。
原文发布于 TechXplore(AI, computer graphics and wave optics combine for more realistic holographic VR/AR displays),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。
