March 11, 2019

Automatic Smile and Frown Recognition with Kinetic Earables

  • Chang Y.
  • Kawsar F.
  • Lee S.
  • Mathur A.
  • Min C.
  • Montanari A.
  • Song J.

In this paper, we introduce inertial signals obtained from an ear- able placed in the ear canal as a new compelling sensing modality for recognising two key facial expressions: smile and frown. Bor- rowing principles from Facial Action Coding Systems (FACS), we first demonstrate that an inertial measurement unit of an earable can capture facial muscle deformation activated by a set of tem- poral micro-expressions. Building on these observations, we then present three different learning schemes - shallow learning with statistical features, hidden Markov model, and deep neural net- works to accurately recognise smile and frown expressions from inertial signals. The experimental results show that in controlled non-conversational settings, we can identify smile and frown across a diverse user population with high accuracy (F1 score: 0.88).

View Original Article

Recent Publications

May 01, 2020

A Packaged 0.01-26-GHz Single-Chip SiGe Reflectometer for Two-Port Vector Network Analyzers

  • Chung H.
  • Ma Q.
  • Rebeiz G.
  • Sayginer M.

© 1963-2012 IEEE. This article presents a packaged SiGe BiCMOS reflectometer for 0.01-26-GHz two-port vector network analyzers (VNAs). The reflectometer chip is composed of a resistive bridge coupler and two wideband heterodyne receivers for coherent magnitude and phase detection. In addition, a high-linearity receiver channel is designed to accommodate 20 ...

August 01, 2019

Protecting photonic quantum states using topology

  • Blanco-Redondo A.

The use of topology to protect quantum information is well-known to the condensed-matter community and, indeed, topological quantum computing is a bursting field of research and one of the competing avenues to demonstrate that quantum computers can complete certain problems that classical computers cannot. In photonics, however, we are only ...

May 01, 2019

Digital networks at the nexus of productivity growth

  • Kamat S.
  • Prakash S.
  • Saniee I.
  • Weldon M.

This paper takes a fresh look at the debate over the relationship between digital technology and productivity. The argument of economic historian Robert J. Gordon is that digital technology will not lead to increases in productivity such as we saw in the last century, based on his analysis of the ...