Multi-modal biometrics for mobile authentication

Hagai Aronowitz, Min Li, Orith Toledo-Ronen, Sivan Harary, Amir Geva, Shay Ben-David, Asaf Rendel, Ron Hoory, Nalini Ratha, Sharath Pankanti, David Nahamoo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

25 Scopus citations


User authentication in the context of a secure transaction needs to be continuously evaluated for the risks associated with the transaction authorization. The situation becomes even more critical when there are regulatory compliance requirements. Need for such systems have grown dramatically with the introduction of smart mobile devices which make it far easier for the user to complete such transaction quickly but with a huge exposure to risk. Biometrics can play a very significant role in addressing such problems as a key indicator of the user identity and thus reducing the risk of fraud. While unimodal biometrics authentication systems are being increasingly experimented by mainstream mobile system manufacturers (e.g., fingerprint in iOS), we explore various opportunities of reducing risk in a multimodal biometrics system. The multimodal system is based on fusion of several biometrics combined with a policy manager. A new biometric modality: chirography which is based on user writing on multi-touch screens using their finger is introduced. Coupling with chirography, we also use two other biometrics: face and voice. Our fusion strategy is based on inter-modality score level fusion that takes into account a voice quality measure. The proposed system has been evaluated on an in-house database that reflects the latest smart mobile devices. On this database, we demonstrate a very high accuracy multi-modal authentication system reaching an EER of 0.1% in an office environment and an EER of 0.5% in challenging noisy environments.

Original languageEnglish
Title of host publicationIJCB 2014 - 2014 IEEE/IAPR International Joint Conference on Biometrics
PublisherInstitute of Electrical and Electronics Engineers
ISBN (Electronic)9781479935840
StatePublished - 23 Dec 2014
Externally publishedYes
Event2nd IEEE/IAPR International Joint Conference on Biometrics, IJCB 2014 - Clearwater, United States
Duration: 29 Sep 20142 Oct 2014

Publication series

NameIJCB 2014 - 2014 IEEE/IAPR International Joint Conference on Biometrics


Conference2nd IEEE/IAPR International Joint Conference on Biometrics, IJCB 2014
Country/TerritoryUnited States

ASJC Scopus subject areas

  • Biotechnology


Dive into the research topics of 'Multi-modal biometrics for mobile authentication'. Together they form a unique fingerprint.

Cite this