Research Contents

Research Contents

PROJECTS > Research Contents

3-4 smart camera system

Topic 1 : Mobile 3D Camera System
  • Chong-Min Kyung, KAIST (Electrical Engineering), CISS
  • Ki-Yeong Park, CISS
  • Implementation of smart camera hardware platform including ISP(Image Signal Processor) and DMP(Depth Map Processor)
  • Development of novel 3D imaging system with lower-power compact optics and embedded computing
Research Contents
  • Development of depth estimation algorithm: Obtaining depth information from camera consumes heavy resource, because its algorithm requires long computing time, high memory usage and high hardware complexity. We develop fast and accurate depth estimation algorithms which can extract depth information from blur based image using single camera. It requires low-power, low hardware complexity and it should be performed in real-time with high accuracy.
  • Multi-sensor based hybrid 3D imaging approach: Traditional 3D imaging system is designed on either active or passive scanning mechanism. This project will focus on a hybrid approach, mixing an infrared based acquisition and stereoscopic acquisition. It also utilizes information from multi sensors such as accelerometer and gyroscope in the embedded system.
  • Color reproduction, deblurring, depth estimation on the module of Dual Aperture: There are three important problems in DA software. First, The depth map from DA contains many holes incurred by featureless regions on the scene. Second, the RGB image from DA module is blurred, which needs to be deblurred in order to produce an all-in-focus RGB image. Finally, the RGB sensor of DA absorbs unwanted IR rays resulting in a color problem to a RGB image.
Expected Contribution
  • As the smart camera is manufactured at low price, its application area is widely expanded so that they will make immense impact on diverse industry.
  • Especially ultra-low power depth estimation camera will create whole new application area, and will lead market growth.
  • This will accelerate research and development of novel security surveillance camera, and play a pivotal role in solving social issue which recently came to the fore worldwide.
  • The mobile 3D imaging system that this project will develop allows us to capture any 3D solid objects easily with their mobile devices.
  • Such 3D contents could be consumed as input of 3D printers and 3D light field display.
  • 3D imaging system could be integrated to intangible computing interface.
  • Hands and body motion could be used to control a TV or game characters in a video game.
  • 3D imaging system could be used as a 3D sensing unit of a robot and auto-driving vehicle which needs real time performance.
Topic 2 : Development of Image Sensors for DA Camera
  • Sang-Jin Lee, CISS
  • JongHo Park, CISS
  • Development of high-sensitivity CMOS image sensors for Dual-Aperture (DA) cameras
  • Implementation of high-sensitivity CIS using low noise analog circuit design methods
  • Chip fabrication and performance optimization
Research Contents
  • Technology development of high-sensitivity CIS for DA and surveillance cameras. Design of low noise column-parallel CIS readout circuitry that can obtain high SNR images under low light condition.

Expected Contribution
  • Enhancement of depth extraction performance of DA camera
  • Acquirement of high-sensitivity CIS technology for DA and surveillance cameras
Topic 3 : Development of freeform reflective imaging system
  • Seunghyuk Chang, CISS
  • The purpose of the project is to develop freeform reflective imaging system, which is low cost and has wide field of view
Research Contents
  • Obstruction-free freeform reflective imaging system
    - Optical design with no optical path interference
    - Minimization of various aberrations caused by off-axis configuration
    - Study on baffle system for freeform reflective imaging system
Expected Contribution
  • Improve the performance of camera system by eliminating chromatic aberration
  • Improve the optical alignment due to simple holding mechanism of freeform mirrors
Topic 4 : Development of CMOS image sensor pixels with improved IR sensitivity
  • Jang-Kyoo Shin, Kyungpool National Univ. (Electronics Engineering)
  • Development of the CMOS image sensor with pixel aperture technology for detecting depth information in real-time
Research Contents
  • Design and development of novel structure for the pixel aperture.
  • Analysis of pixel characteristic using optical simulation with various aperture sizes, incidence angles and microlens.
Expected Contribution
  • The technology of pixel aperture in RGB/W pixels can be applied to various areas such as indoor/outdoor violence/accidents observation, black box for cars. Therefore it has competitiveness in future vision sensor market.
Topic 5 : 3D Body Scanner
  • Chul Hee Lee, Kallion Inc.
  • Research for developing fast and high resolution 3D body scanner with the low-cost part which can open a mass market.
Research Contents
  • Development of photogeometric depth measuring technique using a high-resolution structured light with DLP and multiple cameras.
    - Better depth resolution and accuracy employing a photogeometric method which combines benefits of structured-light and stereo-photometry.
    - New image processing and structured-lighting methods for additional accuracy.
  • Research for fast and accurate calibration method for multiple cameras and projectors.
  • Development of the depth measuring technique for fast and high –resolution surround scanning.

Expected Contribution
  • Development of 3D body scanner using photogeometric method.
  • Low-cost , high- resolution , high-speed human body scanning technique which can open up new markets.
  • Expansion to 3D scanning market of medical , Printing & Publishing , industry , national defense , science , etc.
  • Creating new demand in junction with the 3D printing market.
Topic 6 : Development of multi-dimensional depth camera
  • Min H. Kim, KAIST (Electrical Engineering)
  • Development of a novel camera design which enables us to estimate multi-dimensional images and a depth map
Research Contents
  • Designing an optimal camera for multi-dimensional data acquisition
  • Developing a depth estimation algorithm using a novel camera design
  • Acquiring high resolution images with a custom-built camera
Expected Contribution
  • Application of depth and multi-dimensional images for various areas: graphics, disease classification, agriculture.
  • Technical development of a novel camera design which enables us to obtain multi-dimensional data of lights.