OCOsense Glasses
The OCOsense glasses are wireless, contact-free, and highly accurate facial sensing devices. The glasses can be used to track:
- Facial Expressions
- Activities
- Eating Behavior
- Attention
- Engagement and Valence
Components
The OCOsense glasses incorporate the following components:
- Six OCO™ Sensors
- Six Proximity Sensors
- 9-axis IMU
- Altimeter
- Dual Speech Detection Microphones
- Detachable Camera
OCO™ (Navigation) Sensors
Proximity Sensors
IMU
OCO™ Sensors
The OCO™ sensors use optomyography (OMG), an optical, non-contact technology, to track skin movement caused by muscle activity in two dimensions. These sensors are optical surface tracking devices that measure relative movement across the skin's surface along the X and Y axes. They operate accurately within a range of 4 mm to 30 mm without direct skin contact.
Proximity Sensors
The proximity sensors measure the distance to the skin along the Z axis, adding depth data to the tracking system.
IMU
The IMU in the OCOsense glasses tracks motion and orientation using a 9-axis sensor system:
- 3-Axis Accelerometer: Measures linear acceleration (X, Y, Z).
- 3-Axis Gyroscope: Tracks angular velocity (X, Y, Z).
- 3-Axis Magnetometer: Detects magnetic field strength (X, Y, Z).
Outputs
- Accelerometer:
- X, Y, Z: Measures linear movement along each axis.
- Gyroscope:
- X, Y, Z: Measures rotational movement along each axis.
- Magnetometer:
- X, Y, Z: Measures orientation using the magnetic field.
- Euler Angles:
- X (Yaw), Y (Roll), Z (Pitch): Represents orientation based on the IMU data.
Detachable Camera
The detachable camera enhances the functionality of the OCOsense glasses by enabling video recording alongside sensor data. Key features and usage instructions are as follows:
- Attachment: The camera can be attached to the OCOsense glasses frame.
- Connection Options: Available with micro USB or USB-C (with adapter) for versatile connectivity.
- Device Compatibility: Compatible with Android phones and iPads.
- App Requirement: Requires a third-party USB camera app.
- Data Synchronization: To synchronize sensor data with video, make recognizable actions in both data and video:
- Tap the glasses to create an accelerometer peak and match it with the video frame.
- Smile to generate a corresponding signal in proximity data, matching it with the video frame.
- The camera can be detached to capture the wearer's face during the synchronization step.
Hardware Notifications
1. Vibration Notifications and Actions
Condition | State | Action |
---|---|---|
Short Burst | Glasses out of range on face | Reset glasses position on face |
Continued Burst | Battery lower than 30% | Plug the glasses to power |
2. LED Notifications and Actions
Condition | State | Action |
---|---|---|
Constant Red Light | Hardware failure | Power cycle glasses, if not solved contact support |
Flashing Yellow | Ready for connecting | Connect to the app |
Flashing Blue | Device connected | N/A |
Light cycle Red/Green/Blue + short vibration | Device turning on | N/A |
Flashing Green | Glasses are calibrating for the expression recognition algorithm | Stay neutral for 1 second |
3. Button Press Notifications and Actions
- A single button press when the glasses are off will turn them on.
- A double-click on the button while the glasses are on will turn them off.
4. Auto On/Off Notifications and Actions
- Connected Mode: When the glasses are connected to the app, they will remain on and will not turn off automatically.
- Automatic Power-Off: If the Bluetooth connection is lost or no connection is detected for 5 minutes, the glasses will power off.
- Automatic Power-On: The glasses will turn on automatically whenever they are plugged into or unplugged from a USB power source.