iSight: computer vision based system to assist low vision

Lynne Grewe; Archana Kashyap; Krishnan Chandran; Allen Shahshahani; Jake Shahshahani

doi:10.1117/12.2305233

27 April 2018 iSight: computer vision based system to assist low vision

Lynne Grewe, Archana Kashyap, Krishnan Chandran, Allen Shahshahani, Jake Shahshahani

Proceedings Volume 10646, Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII; 1064613 (2018) https://doi.org/10.1117/12.2305233
Event: SPIE Defense + Security, 2018, Orlando, FL, United States

Abstract

iSight is a mobile application to assist low vision people with the everyday task of sight. Specifically, the goal of the system is using 2D computer vision to refocus and visualize specific objects recognized in the image in an Augmented Reality scheme. This paper discusses the development of the application that uses a deep learning TensorFlow module to perform recognition of objects in the scene the user is looking at and consequently directs the formation of an augmented reality scene which is presented to the user to enhance their visual understanding. Both indoor and outdoor environments are tested and results are given. The success and challenges faced by iSight are presented along with future avenues of work.

Conference Presentation

Citation Download Citation

Lynne Grewe, Archana Kashyap, Krishnan Chandran, Allen Shahshahani, and Jake Shahshahani "iSight: computer vision based system to assist low vision", Proc. SPIE 10646, Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII, 1064613 (27 April 2018); https://doi.org/10.1117/12.2305233

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available