王立辉教授

王立辉，男，辽宁辽阳人，www.优德88.cpm 教授，博导。日本东京大学博士，正高级工程师，民建会员，地方政协委员。IEEE高级会员，中国光学学会高级会员。留日学习工作十余年，师从石川正俊（Masatoshi Ishikawa）教授，在研究组内进行以高速视觉为核心的技术攻关，长期从事新一代超高速机器视觉和动态三维显示系统的技术研发工作。通过观察发现在毫秒级高速机器视觉系统中，传统的光学系统已经成为整个系统的瓶颈，提出利用透明液体来替代传统固体镜头，成功研发大口径全焦点高分辨率可变焦液体镜头，并将其推广至高速机器视觉及可穿戴智能眼镜等领域，该成果受到日本东京电视台专题报道，并作为中国科技部部长和重大专项办公室主任访问东京大学时接待参观项目之一，受到了学术界及商业的密切关注。率团队同日系光学公司研发了世界首台用于汽车驾驶系统的三维增强现实抬头显示器，并分别出展日本东京全球汽车技术博览会和德国汉诺威工业展会，备受汽车界高度关注。近年成功研发出为医学领域中的治疗计划系统的动态三维显示器，为医疗三维图像提供动态三维低延迟的人机交互环境，成果出展于世界顶级人机交互学年会、美国计算机图形学年会和日本数字信息展会出展。主持参与科研项目十余项、发表科研论文七十余篇，科研成果获美国计算机图形学会特别奖、日本经济产业省数字信息协会科技创新奖和赞助商奖、华创杯及深创赛等赛事奖励，多次受到日本东京电视台、日刊产业新闻、日本经济新闻、中国科技日报等国内外媒体报道。

Research and Applications （研究范围及应用场景）

光学仪器、自适应光学设备

– 变焦/调焦液体透镜、智能老花眼眼镜

– 超高速视觉追踪

先进制造、智能制造

– 高速机器视觉、机器人导航控制

– 柔性传感器、精密器件抓取

安防、监控摄像设备

– 高速目标追踪、可疑目标提示

新型显示、虚拟/增强/混合现实

– 动态光雕投影显示技术

– 三维车载抬头显示器

– 医疗手术辅助导航

In Detail/具体展开

1 Active Vision/主动视觉

1-1 Variable Focus Lens/可变焦液体透镜

In order to change focus with traditional solid lenses, which have fixed optical properties, two or more lenses have to be jointly moved mechanically. In contrast, a variable focus lens can dynamically control its focal length by only using a single lens element. Liquid-filled variable focus lenses are based on the physical deformation of refractive surfaces, which changes their curvature.

We proposed a novel variable focus lens with a large optical aperture. The lens consists of two chambers separated by a membrane. The chambers were infused with two different liquids characterized by their similar density but different refractive indices. Thus its deformation was in the interface between the two liquids, and it acted as a refractive surface due to the difference in refractive index of these liquids. If one fluid was made to flow into and out of its chamber, while the other was locked, the lens could shift its power dynamically by means of a syringe pump.

Reference/ 参考

1. Zenghong Duan, Lihui Wang*, Zhi Li, Jian Fu, Susheng Fu, Boqian Chen, Yuxun Chen, and Yong Zhao, “Dynamic performance of a membrane-based variable focus lens with a large aperture,” Appl. Opt. 62, 4609-4617 (2023)[DOI:10.1364/AO.486278]

2. Lihui Wang, Hiromasa Oku, Masatoshi Ishikawa, Paraxial ray solution for liquid-filled variable focus lenses, Japanese Journal of Applied Physics, Volume 56, Number 12, 122501 (2017)[DOI:10.7567/JJAP.56.122501]

3. Lihui Wang, Hiromasa Oku, Masatoshi Ishikawa, An improved low-optical-power variable focus lens with a large aperture, Optics Express, Vol.22, Issue 16, pp. 19448-19456 (2014)[DOI:10.1364/OE.22.019448]

4. Lihui Wang, Hiromasa Oku, Masatoshi Ishikawa, Variable-focus lens with 30 mm optical aperture based on liquid-membranes-liquid structure, Applied Physics Letters, Vol.102, 131111 (2013)[DOI:10.1063/1.4800603]

1-2 Active Visual Tracking/主动视觉追踪

在追踪具有高度非线性轨迹的高速随机运动目标时，传统光电主动视觉系统存在目标丢失、视觉追踪失效的问题。课题组通过搭建了一套毫秒级光电主动视觉系统。采用光电云台结构、感兴趣区域提取、并行计算、高速运动目标追踪算法，实现响应时间≤2ms毫秒级的目标跟踪。

Reference/参考

1. Jiaqi Li, Lin Li, Lihui Wang*, Lei LI, Shaoyong Li, and Masatoshi Ishikawa, Adaptive milliseconds tracking and zooming optics based on a high-speed gaze controller and liquid lenses, Optics Express, Vol.32, Issue 2, pp. 2257-2270 (2024) [DOI:10.1364/OE.512003]

2. Ruimin Cao, Jian Fu, Hui Yang, Lihui Wang*, and Masatoshi Ishikawa, “Robust optical axis control of monocular active gazing based on pan-tilt mirrors for high dynamic targets,” Optics Express 29, 40214-40230 (2021) [DOI: 10.1364/OE.439083]
   

3 High-Speed 3D & Depth Imaging/成像

A large open aperture in an optical system can capture high-resolution images but yields a shallow depth of field. In order to keep the high-resolution and enlarge the DOF at the same time, back-and-forth movement of the lens should be driven by the rack and pinion motion of a motor.

However, continual forward and reverse rotation is a high-power-consumption task, because positive and negative current are used alternately to control the motor, which quickly triggers a safety stop to prevent overheating. Moreover, it is quite difficult to achieve high-speed responses in such conditions.

Reference/参考

1. Huayu Cheng, Lihui Wang*, Yuan He, , High-speed all-in-focus 3D imaging technology based on the liquid lens focus scanning, SPIE/COS Photonics Asia (Beijing, 2023.10.16) / (Oral 12767-11) doi: https://doi.org/10.1117/12.2686779

2. Lihui Wang, Jianjiang Cui, Satoshi Tabata, Masatoshi Ishikawa, Low-cost, readily available 3D microscopy imaging system with variable focus spinner, Optics Express, Vol.26, Issue 23, pp. 30576-30587 (2018).[DOI:10.1364/OE.26.030576]

4 High-Speed 3D Projection Mapping/显示

Projection mapping (PM) is attractive as a fundamental technology for the advancement of various subjects, such as media art, entertainment, and augmented reality. However, conventional projectors have a shallow depth of field (DOF); therefore, sharp images are only visible in the limited depth range. In the case of dynamic projection mapping (DPM), which can project images on the surface of the moving objects, the shallow DOF limits the permissible motion of the object, because the projected images become blurred when the object is outside the DOF.

Our laboratories have developed a high-speed focal tracking projection system, which includes the technologies of high-speed vision, high-speed projector, and high-speed variable focus optics. In this system, the variation of the object’s distance and posture was captured using the high-speed vision technology that served as immediate feedback to the liquid lens and high-speed projector. As a result, the focal distance is compensated, and the projected images are updated in real-time to fit the moving object. Therefore, a well-focused image projection was achieved even when the motion involved large depth range movement.

This system could ensure that the projected images were sharp and clear at variable distances, while the object was moving dynamically in a large three-dimensional area. Hence, this approach can be effectively applied to applications such as Volume Slicing Display. Furthermore, it can turn any physical surface into an interactive display, and enable the manipulation of their appearance to provide detailed information. Our system provides the essential technology for expanding such applications.

The following three awards were given to the project “High-speed focal tracking projection system based on liquid lens”.

1. ACM SIGGRAPH Special Prize, (Association for Computing Machinery)

2. Innovative Technologies 2019, (Digital Content Association of Japan)

3. Innovative Technologies 2019, Sponsor Award (CGWORLD) 2019, (Digital Content Association of Japan)

Reference/ 参考

1. Lihui Wang*, Satoshi Tabata, Hongjin Xu, Yunpu Hu, Yoshihiro Watanabe, and Masatoshi Ishikawa, Dynamic depth-of-field projection mapping method based on a variable focus lens and visual feedback, Optics Express, 31(3), pp. 3945-3953 (2023) [DOI:10.1364/OE.478416]

2. Lihui Wang, Hongjin Xu, Satoshi Tabata, Yunpu Hu, Yoshihiro Watanabe, and Masatoshi Ishikawa: High-Speed Focal Tracking Projection Based on Liquid Lens, ACM SIGGRAPH 2020 Emerging Technologies (SIGGRAPH ’20) (Virtual Event, USA, 2020.8.24-28) [DOI: 10.1145/3388534.3408333]

3. Lihui Wang, Hongjin Xu, Yunpu Hu, Satoshi Tabata, Masatoshi Ishikawa, Dynamic Depth-of-Field Projection for 3D Projection Mapping, ACM CHI Conference on Human Factors in Computing Systems (CHI’19) (Glasgow, Scotland, UK. 2019.05.05-09) [DOI: 10.1145/3290607.3313246]

4. Lihui Wang, Yunpu Hu, Hongjin Xu, Masatoshi Ishikawa, Dynamic focal tracker display, SPIE Photonics West 2019 (San Francisco, California, USA. 2019.02.07)/ (Oral Session) [DOI: 10.1117/12.2506958]

5 3D Augmented Reality Head-Up-Display / 三维增强现实车载抬头显示器

Head-Up-Display (HUD) enables a driver to view information with his head positioned “up” and looking forward, instead of angled down looking at lower instruments. By adding the Augmented Reality technology, targets, like people and cars, can be marked to alarm to the drivers to avoid the potential accidents.

Traditional 2D AR HUD projects information messages at a certain distance away from the driver. It asks a driver to observe the projection along the optical axis at a certain point. When the driver moves his head, a miss-matching projection occurs between the projected data and the target in the real world.

In this 3D AR HUD technology, a 3D virtual display can be projected in front of the driver. AR messages will be dynamically projected according to the 3D locations of the targets. In our 3D HUD, a virtual display is projected into a three-dimensional world, so there will be no mismatch when the driver moves.

The following demos were recorded by two cameras, which were placed at different places. When the camera was placed along the optical axis, 2D and 3D markers were all perfectly matched. When the camera was placed at an angle to the optical axis, a mismatch was found in 2D HUD, but 3D HUD was still well matched.

This work was conducted by a collaborate research project with Ishikawa Laboratory and Konica Minolta Inc..

6 Smart Actuator and sensor/软体驱动器和传感器

触觉感知和交互作为人-机交互的主要方式之一，其通常需要人工设备具备良好的触觉感知能力。为丰富人工设备所能感知的触觉信息，基于混合感知机理的触觉传感器近年来受到了广泛关注。然而，对于可穿戴或柔性人工设备而言，开发具有简单结构、易制备、成本低、功耗低、易于维护和集成的触觉传感器仍然是一项艰巨挑战。

在此背景下研究团队提出了一种新型的摩擦电-光电混合触觉传感器，其采用模块化分体式结构，包括两个单元：基于单电极摩擦电纳米发电机设计的摩擦电单元，用于接收外部触觉刺激；以及基于可变焦液体透镜结构的光电单元，用于将触觉刺激转化为光电信号。两个单元均采用单腔体结构，可轻松实现对单元零部件的拆卸与更换。此外，摩擦电单元可根据其输出信号控制光电单元内部所嵌光源的开/关行为，从而降低传感单元功耗，提高触觉响应速度。光电单元具有优越的电磁干扰抗性，使得传感器能够准确、定量地感知接触力。通过开展感知性能测试实验，表现出响应时间短（～9 ms）、输出线性度高（R2≈0.9952）、耐久性和稳定性好等特点。基于上述特点，通过进一步设计-开展文字键入、图形绘制、音乐演奏等触觉交互实验，展示了本传感器在触觉交互任务中的实用性，进而说明其在人-机交互设备领域中具有广阔的应用前景。

Reference/参考

1. Hui Yang, Tianzhao Bu*, Wenbo Liu, Jiaqi Liu, Yunzhi Ling, Meixia Wu, Weirui Liu, Changan Wang*, Xifeng Gao*, Lihui Wang*, A novel triboelectric-optical hybrid tactile sensor for human-machine tactile interaction, Nano Energy, 125, pp. 109592 (2024) [DOI:10.1016/j.nanoen.2024.109592] (IF=17.6)

2. Ronghua Hu, Hui Yang, Lihui Wang*, and Longfei Fan, Flexible optical tactile sensor based on a liquid-membrane lens structure, Applied Optics, 62(26), 6952-6960 (2023) [DOI:10.1364/AO.496741](IF=1.905)

3. Hui Yang, Jiaqi Liu, Wenbo Liu, Weirui Liu, Zilong Deng, Yunzhi Ling, Changan Wang, Meixia Wu, Lihui Wang*, and Li Wen*, Compliant Grasping Control for a Tactile Self-Sensing Soft Gripper, Soft Robotics, (2023) [DOI:10.1089/soro.2022.0221] (IF=7.784)

Media and others （媒体报道等）

1.Dynamic Projection Mapping（动态光雕投影）

1)ITmedia News. 液体レンズを用いた高速焦点追従投影システム[https://dip-labs.com/news/20210128-01/](2021.01) (日本語)
译：ITmedia News，基于液体的动态光雕投影系统。

2)中国科技网/科技日报. “液体透镜带来光学镜头革命”[http://www.stdaily.com/index/kejixinwen/2019-11/21/content_817911.shtml?from=singlemessage](2019.11) (in Chinese)

3)日刊工業新聞. “動く物体に絵を投影できるプロジェクション技術、どんな用途に使う”[https://newswitch.jp/p/20672?fbclid=IwAR3MP-srPICwf7SsFN333tQQ-9pA-Jddmu1eq8ElD61jKqIMw6nge9yeGrU] (2020.01) (in Japanese)
译：日刊工业新闻。可在移动物体表面绘画的光雕投影技术，潜在用途是？

2.Variable Focus Lens（可变焦液体镜头）

1)テレビ東京ワールドビジネスサテライトトレンドたまご[オートフォーカスの老眼鏡!?][https://txbiz.tv-tokyo.co.jp/wbs/trend_tamago/post_124134/] (2017.01) (in Japanese)
译：东京电视台，全球财经卫视Trend Tamago专题，自动对焦老花眼眼镜！

3.3D AR Head-Up-Display for ADAS Automotive（车载三维抬头显示器）

1)Konica Minolta Release. “Konica Minolta Develops the World’s First* Automotive 3D Augmented Reality Head-up Display” [https://www.konicaminolta.com/newsroom/2017/0227_01_01.html]. (2017.02)
译：柯尼卡美能达，世界首发车载三维增强现实抬头显示器

2)コニカミノルタニュースリリース.“コニカミノルタ 世界初*の車載用3D 拡張現実ヘッドアップディスプレイを開発” [https://www.konicaminolta.com/jp-ja/newsroom/2017/0113_01_01.html].(2017.01) (in Japanese)
译：柯尼卡美能达，世界首发车载三维增强现实抬头显示器

3)日本経済新聞. “車載用3D拡張現実ヘッドアップディスプレーを開発” [https://www.nikkei.com/article/DGXLRSP433224_T10C17A1000000/].(2017.01) (in Japanese)
译：日本经济新闻，车载三维增强现实抬头显示器

欢迎对光机电一体化、可变焦液体透镜、高速视觉追踪、动态 光雕投影交互等方向感兴趣的青年学者或同学联系！

团队长期同日本东京大学、东京工业大学、群马大学、东京理科大学、香港城市大学等国外高校合作。

王立辉www.优德88.cpm 未来科学与工程学院 教授

〒215222 江苏省苏州市吴江区久泳西路1号未来科创中心510室

e-Mail:wanglihui [at] suda.edu.cn

https://web.suda.edu.cn/wanglihui/

Team/团队

Alumni/毕业生