Face-It-Up: a scientific app for face processing using mobile devices and machine learning APIs

Oge Marques; Jhanon James; Emilio Barcelos

doi:10.1117/12.2307765

14 May 2018 Face-It-Up: a scientific app for face processing using mobile devices and machine learning APIs

Oge Marques, Jhanon James, Emilio Barcelos

Proceedings Volume 10668, Mobile Multimedia/Image Processing, Security, and Applications 2018; 106680S (2018) https://doi.org/10.1117/12.2307765
Event: SPIE Commercial + Scientific Sensing and Imaging, 2018, Orlando, FL, United States

Abstract

Image Processing and Computer Vision solutions have become commodities for software developers, thanks to the growing availability of Application Programming Interfaces (APIs) that encapsulate rich functionality, powered by advanced algorithms. Tech giants like Apple, Google, IBM, and Microsoft have made APIs and micro-services available in the cloud for the agile integration of machine learning and intelligent features onto everyday applications. As privacy and cyber welfare become prime concerns, special efforts have been devoted in the field of face processing and recognition. In this context, this paper provides a friendly, intuitive and fun to use mobile app that leverages the state-of-the-art APIs for face, age, gender and emotion recognition. The Face- It-Up app was implemented for the iOS platform and uses the Microsoft Cognitive Services APIs as a tool for human vision and face processing research. Experimental work on image compression, upside-down orientation, the Thatcher effect, negative inversion, high frequency, facial artifacts, caricatures and image degradation were performed to test the application. For this purpose, we used the Radboud and 10k US Adult Faces Databases. The app benefits from accessing high-resolution imagery and touch input from the smart-devices, allowing for a wide range of new experiments from the user perspective. Furthermore, our approach serves as a potential framework for new initiatives in image-based biometrics, the Internet of Things, and citizen science.

Citation Download Citation

Oge Marques, Jhanon James, and Emilio Barcelos "Face-It-Up: a scientific app for face processing using mobile devices and machine learning APIs", Proc. SPIE 10668, Mobile Multimedia/Image Processing, Security, and Applications 2018, 106680S (14 May 2018); https://doi.org/10.1117/12.2307765

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image compression

Facial recognition systems

Image processing

Image quality

Computer vision technology

Machine vision

Machine learning

Show All Keywords

Keywords/Phrases

Search In:

Publication Years