メインコンテンツへスキップ

Tag

Efficient Hybrid Zoom using Camera Fusion on Mobile Phones Reading Notes

·2944 文字·14 分
Abstract # DSLR cameras can achieve various zoom levels by changing the lens distance or swapping lens types. However, due to space constraints, these techniques are not feasible on mobile devices. Most smartphones adopt a hybrid zoom system: typically using a wide-angle (W) camera for low zoom levels and a telephoto (T) camera for high zoom levels. To simulate zoom levels between W and T, these systems crop and digitally enlarge images from W, resulting in significant detail loss. In this paper, we propose an efficient hybrid zoom super-resolution system for mobile devices. This system captures synchronized W and T image pairs and utilizes a machine learning model to align and transfer details from T to W. We further develop an adaptive blending method that can handle depth of field mismatches, scene occlusions, motion uncertainties, and alignment errors. To minimize domain differences, we design a dual smartphone camera setup to capture real scene inputs and real label data for supervised training. In extensive evaluations on real scenes, our method can generate 12-megapixel images on mobile platforms in 500 milliseconds, achieving TA.