Research Contents

Research Contents

PROJECTS > Research Contents

3-4 smart camera system

Topic 1 : Mobile 3D Camera System
  • Chong-Min Kyung, KAIST (Electrical Engineering), CISS
  • Ki-Yeong Park, CISS
  • Dongseok Kim, CISS
  • Junho Mun, CISS
  • Implementation of smart camera hardware platform including ISP(Image Signal Processor) and DMP(Depth Map Processor)
  • Development of novel 3D imaging system with lower-power compact optics and embedded computing
Research Contents
  • Development of depth estimation algorithm: Obtaining depth information from camera consumes heavy resource, because its algorithm requires long computing time, high memory usage and high hardware complexity. We develop fast and accurate depth estimation algorithms which can extract depth information from blur based image using single camera. It requires low-power, low hardware complexity and it should be performed in real-time with high accuracy.
  • Multi-sensor based hybrid 3D imaging approach: Traditional 3D imaging system is designed on either active or passive scanning mechanism. This project will focus on a hybrid approach, mixing an infrared based acquisition and stereoscopic acquisition. It also utilizes information from multi sensors such as accelerometer and gyroscope in the embedded system.
  • Color reproduction, deblurring, depth estimation on the module of Dual Aperture: There are three important problems in DA software. First, The depth map from DA contains many holes incurred by featureless regions on the scene. Second, the RGB image from DA module is blurred, which needs to be deblurred in order to produce an all-in-focus RGB image. Finally, the RGB sensor of DA absorbs unwanted IR rays resulting in a color problem to a RGB image.
Expected Contribution
  • As the smart camera is manufactured at low price, its application area is widely expanded so that they will make immense impact on diverse industry.
  • Especially ultra-low power depth estimation camera will create whole new application area, and will lead market growth.
  • This will accelerate research and development of novel security surveillance camera, and play a pivotal role in solving social issue which recently came to the fore worldwide.
  • The mobile 3D imaging system that this project will develop allows us to capture any 3D solid objects easily with their mobile devices.
  • Such 3D contents could be consumed as input of 3D printers and 3D light field display.
  • 3D imaging system could be integrated to intangible computing interface.
  • Hands and body motion could be used to control a TV or game characters in a video game.
  • 3D imaging system could be used as a 3D sensing unit of a robot and auto-driving vehicle which needs real time performance.
Topic 2 : Development of Image Sensors for DA Camera
  • Sang-Jin Lee, CISS
  • JongHo Park, CISS
  • Development of high-sensitivity CMOS image sensors for Dual-Aperture (DA) cameras
  • Implementation of high-sensitivity CIS using low noise analog circuit design methods
  • Chip fabrication and performance optimization
Research Contents
  • Technology development of high-sensitivity CIS for DA and surveillance cameras. Design of low noise column-parallel CIS readout circuitry that can obtain high SNR images under low light condition.

Expected Contribution
  • Enhancement of depth extraction performance of DA camera
  • Acquirement of high-sensitivity CIS technology for DA and surveillance cameras
Topic 3 : Development of freeform reflective imaging system
  • Seunghyuk Chang, CISS
  • The purpose of the project is to develop freeform reflective imaging system, which is low cost and has wide field of view
Research Contents
  • Obstruction-free freeform reflective imaging system
    - Optical design with no optical path interference
    - Minimization of various aberrations caused by off-axis configuration
    - Study on baffle system for freeform reflective imaging system
Expected Contribution
  • Improve the performance of camera system by eliminating chromatic aberration
  • Improve the optical alignment due to simple holding mechanism of freeform mirrors
Topic 4 : Development of CMOS image sensor pixels with improved IR sensitivity
  • Jang-Kyoo Shin, Kyungpool National Univ. (Electronics Engineering)
  • Development of the CMOS image sensor with pixel aperture technology for detecting depth information in real-time
Research Contents
  • Design and development of novel structure for the pixel aperture.
  • Analysis of pixel characteristic using optical simulation with various aperture sizes, incidence angles and microlens.
Expected Contribution
  • The technology of pixel aperture in RGB/W pixels can be applied to various areas such as indoor/outdoor violence/accidents observation, black box for cars. Therefore it has competitiveness in future vision sensor market.
Topic 5 : The development of Sensor Noise Model based Low-level Image Processing
  • Youngbae Hwang, Korea Electronics Technology Institute
  • Development of noise model and low-level image pre-processing methods
  • Development of ISP by HW dedicated IP and low-power and area optimization
  • Depth accuracy enhancement by semantically meaningful edge extraction robust to lens blur and illumination changes
Research Contents

  • Development of noise removal method by modeling sensor noise itself in low-light condition
    - Development of blur removal method based on correct motion estimation by calibrating vision and IMU
    - Low-power and area optimization of noise removal algorithm for implementing ASIC
    - Development of a dedicated hardware IP to satisfy the performance with low-power simultaneously
    - Development of depth extraction method using RGB and IR image pair
    - Development of robust edge detection method using RGB and depth
Expected Contribution
  • Market activation of security systems and smart devices with ISP having strong noise and distortion removal ability in low-light condition
  • Market activation of security systems and smart devices with ISP having strong noise and distortion removal ability in low-light condition
Topic 6 : Development of Low Power Image Sensor System for Gesture Recognition and Event Detection using Color and Depth Information
  • Moongu Jeon, Gwangju Institute of Science and Technology
  • The development of efficient low-power image sensor by using an automated image analysis technologies.
Research Contents

  • The proposed gesture recognition framework consists of two major parts:1) Image pre-processing part and 2) gesture recognition part. The research of each part is described as follow:
    - Image pre-processing: Research for noise reduction and background subtraction for improving the accuracy of gesture recognition
    - Gesture recognition: Research for feature extraction and gesture recognition using pre-processed image.
  • The secondary purpose is to develop the analog-digital converter which can provide low-power and high-resolution. This development is divided into two stage
    - Column Parallel AD: it is used that is that Analog-digital converter of delta-sigma with 2nd Order CIFF architecture
    - To implement a low-power system, we consider the self-biased amplifier
Expected Contribution
  • Using both color and depth information which are extracted from the dual-aperture sensor, we can improve gesture recognition performance better than the case only using color. Moreover, we can provide our gesture recognition system which can used at low-power situations.
  • In intelligent image analysis market, The technological gap between Korean companies and the leading companies such as IBM and AXIS, is growing every year. Moreover, the amount of export of Korean companies is decreasing. In this situation, our researches can provide promising technologies to Korean corporations by using our low-power and gesture-recognition image sensor technology.
Topic 7 : 3D Body Scanner
  • Chul Hee Lee, Kallion Inc.
  • Research for developing fast and high resolution 3D body scanner with the low-cost part which can open a mass market.
Research Contents
  • Development of photogeometric depth measuring technique using a high-resolution structured light with DLP and multiple cameras.
    - Better depth resolution and accuracy employing a photogeometric method which combines benefits of structured-light and stereo-photometry.
    - New image processing and structured-lighting methods for additional accuracy.
  • Research for fast and accurate calibration method for multiple cameras and projectors.
  • Development of the depth measuring technique for fast and high –resolution surround scanning.

Expected Contribution
  • Development of 3D body scanner using photogeometric method.
  • Low-cost , high- resolution , high-speed human body scanning technique which can open up new markets.
  • Expansion to 3D scanning market of medical , Printing & Publishing , industry , national defense , science , etc.
  • Creating new demand in junction with the 3D printing market.
Topic 8 : Development of smart insect eye camera module for omni-directional motion detection
  • Youngmin Song, Gwangju Institute of Science and Technology
  • Development of smart insect eye camera module for omni-directional motion detection
    - Development of the smart compound eye camera that can recognize the color (RGB) of objects, high sensitivity (quantum efficiency > 15%) and speed(25 frame/sec), and adaptively response to external environment (light-source integrated structure).
Research Contents
  • Development of core technologies for insect eye image sensor
    - Development of non-distortion, extreme wide field of view (FOV>160º) image sensor based on compound eye optics technology
    - Development of thin-film color filter integrated structures for recognizing colors.
    - Development of nano-photonic structure integrated silicon photodetector for enhanced external quantum efficiency (EQE)
    - Development of light-source integrated structure for adaptive response to external environment
  • Development of modularization and image processing technologies for smart insect eye camera
    - Development of image processing algorithm
    - Development of hardware platform for image processing
    - Development of Digital signal processor IC
    - Development of prototype of smart insect eye camera module

Expected Contribution
  • Since bio-inspired compound eye camera have many advantages such as omni-directional imaging without the geometrical distortion, compact module, and low power consumption, it is one of promising candidates for the motion detection units from UAV to Unmanned robot. In addition, the following applications are expected.
    - New type of sensor systems that overcome the disadvantages of the existing obstacle avoidance sensor technologies (IR sensor, radar, ultrasonic sensor)
    - Possibility of new regulation on safey navigation and safety drive
    - Pioneering new direction for the motion detection technologies based on compound eye cameras (e.g. Elementary Motion Detection, EMD)

Topic 9 : Development of multi-dimensional depth camera
  • Min H. Kim, KAIST (Electrical Engineering)
  • Development of a novel camera design which enables us to estimate multi-dimensional images and a depth map
Research Contents
  • Designing an optimal camera for multi-dimensional data acquisition
  • Developing a depth estimation algorithm using a novel camera design
  • Acquiring high resolution images with a custom-built camera
Expected Contribution
  • Application of depth and multi-dimensional images for various areas: graphics, disease classification, agriculture.
  • Technical development of a novel camera design which enables us to obtain multi-dimensional data of lights.