Facial Action Coding System

The Facial Action Coding System (FACS) is a system to

In 2009, a study was conducted to study spontaneous facial expressions in sighted and blind judo athletes. They discovered that many facial expressions are innate and not visually learned.^[4]

Method

Using the FACS^[5] human coders can manually code nearly any anatomically possible facial expression, deconstructing it into the specific "action units" (AU) and their temporal segments that produced the expression. As AUs are independent of any interpretation, they can be used for any higher order decision making process including recognition of basic emotions, or pre-programmed commands for an ambient intelligent environment. The FACS manual is over 500 pages in length and provides the AUs, as well as Ekman's interpretation of their meanings.

The FACS defines AUs, as contractions or relaxations of one or more muscles. It also defines a number of "action descriptors", which differ from AUs in that the authors of the FACS have not specified the muscular basis for the action and have not distinguished specific behaviors as precisely as they have for the AUs.

For example, the FACS can be used to distinguish two types of smiles as follows:^[6]

• the insincere and voluntary
  zygomatic major
  alone
• the sincere and involuntary
  orbicularis oculi
  .

The FACS is designed to be self-instructional. People can learn the technique from a number of sources including manuals and workshops,^[7] and obtain certification through testing.^[8]

Although the labeling of expressions currently requires trained experts, researchers have had some success in using computers to automatically identify the FACS codes.^[9] One obstacle to automatic FACS code recognition is a shortage of manually coded ground truth data.^[10]

Uses

Use in medicine

The use of the FACS has been proposed for use in the analysis of

Thus, the FACS can be used to compare facial repertoires across species due to its anatomical basis. A study conducted by Vick and others (2006) suggests that the FACS can be modified by taking differences in underlying morphology into account. Such considerations enable a comparison of the homologous facial movements present in humans and chimpanzees, to show that the facial expressions of both species result from extremely notable appearance changes. The development of FACS tools for different species allows the objective and anatomical study of facial expressions in communicative and emotional contexts. Furthermore, a cross-species analysis of facial expressions can help to answer interesting questions, such as which emotions are uniquely human.[21]

The Emotional Facial Action Coding System (EMFACS)^[22] and the Facial Action Coding System Affect Interpretation Dictionary (FACSAID)^[23] consider only emotion-related facial actions. Examples of these are:

Computer-generated imagery

FACS coding is also used extensively in computer animation, with facial expressions being expressed as vector graphics of AUs.^[24] FACS vectors are used as weights for blendshapes corresponding to each AU, with the resulting face mesh then being used to render the finished face.^[25] Deep learning techniques can be used to determine the FACS vectors from face images obtained during motion capture acting or other performances.^[26]

Codes for action units

For clarification, the FACS is an index of facial expressions, but does not actually provide any bio-mechanical information about the degree of muscle activation. Though muscle activation is not part of the FACS, the main muscles involved in the facial expression have been added here.

Action units (AUs) are the fundamental actions of individual muscles or groups of muscles.

Action descriptors (ADs) are unitary movements that may involve the actions of several muscle groups (e.g., a forward‐thrusting movement of the jaw). The muscular basis for these actions has not been specified and specific behaviors have not been distinguished as precisely as for the AUs.

For the most accurate annotation, the FACS suggests agreement from at least two independent certified FACS encoders.

Intensity scoring

Intensities of the FACS are annotated by appending letters A–E (for minimal-maximal intensity) to the action unit number (e.g. AU 1A is the weakest trace of AU 1 and AU 1E is the maximum intensity possible for the individual person).

• A Trace
• B Slight
• C Marked or pronounced
• D Severe or extreme
• E Maximum

Other letter modifiers

There are other modifiers present in FACS codes for emotional expressions, such as "R" which represents an action that occurs on the right side of the face and "L" for actions which occur on the left. An action which is unilateral (occurs on only one side of the face) but has no specific side is indicated with a "U" and an action which is bilateral but has a stronger side is indicated with an "A" for asymmetric.

List of AUs and ADs (with underlying facial muscles)

Main codes

Head movement codes

Eye movement codes

Visibility codes

Gross behavior codes

These codes are reserved for recording information about gross behaviors that may be relevant to the facial actions that are scored.

See also

• Computer facial animation
• Computer processing of body language
• Emotion classification
• Facial electromyography
• Facial feedback hypothesis
• Facial muscles
• Microexpression

References