论文标题

i-flatcam:253 fps,91.49 $μ$ j/frame Ultra-Croct智能摄像机,用于实时和高效的眼动摄像机,在VR/AR中

i-FlatCam: A 253 FPS, 91.49 $μ$J/Frame Ultra-Compact Intelligent Lensless Camera for Real-Time and Efficient Eye Tracking in VR/AR

论文作者

Zhao, Yang, Li, Ziyun, Fu, Yonggan, Zhang, Yongan, Li, Chaojian, Wan, Cheng, You, Haoran, Wu, Shang, Ouyang, Xu, Boominathan, Vivek, Veeraraghavan, Ashok, Lin, Yingyan Celine

论文摘要

我们提出了一个名为i-flatcam的首个超连接智能相机系统,包括带有计算(Comp。)芯片的无镜头相机。它突出了(1)预测的焦点眼镜跟踪管道,可提高效率而不损害准确性,(2)单芯片处理的统一压缩方案和每秒改进的帧速率(FPS),以及(3)专用内部内部内部内部的重复使用重复使用,以增加深度脉动脉动脉动层(DW-dw-conviations)。 i-flatcam用无透镜相机演示了第一个眼动管道,并达到了3.16度的准确性,253 fps,91.49 $μ$ j/frame和6.7mm x 8.9mm x 1.2mm x 1.2mm摄像头函数,为下一代增强现实(AR)和虚拟现实(VR)设备铺平了道路。

We present a first-of-its-kind ultra-compact intelligent camera system, dubbed i-FlatCam, including a lensless camera with a computational (Comp.) chip. It highlights (1) a predict-then-focus eye tracking pipeline for boosted efficiency without compromising the accuracy, (2) a unified compression scheme for single-chip processing and improved frame rate per second (FPS), and (3) dedicated intra-channel reuse design for depth-wise convolutional layers (DW-CONV) to increase utilization. i-FlatCam demonstrates the first eye tracking pipeline with a lensless camera and achieves 3.16 degrees of accuracy, 253 FPS, 91.49 $μ$J/Frame, and 6.7mm x 8.9mm x 1.2mm camera form factor, paving the way for next-generation Augmented Reality (AR) and Virtual Reality (VR) devices.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源