Visionless Spatial Awareness System

Take any regular pair of glasses and upgrade them with an ESP-32 dev module and a LiDAR sensor for real time spatial awareness. Use cases in this expand to people with vision impairments, such as Blindness, and Macular degeneration.

Demo Image

Full Feature Set & Required Materials

  • LiDAR: A ToF LiDAR sensor maps out the user's surroundings.
  • Spatial Awareness: A statistical model detects many forms of obstacles, both static and moving.
  • Wireless: All components are independent of each other and are connected via a central network.
  • VL53L1X: $15 - $25
  • Microcontroller: ESP-32 S3 $10 - $20
  • Power Source: Small LiPo battery or battery pack, $10 - $20
  • Glasses: Cheap blue light or plastic glasses, $5 - $15

Getting Started

Clone the repository to build locally.

git clone https://github.com/chromemilk/spatial-awareness

Build & Programming Instructions

Pre-build: download PlatformIO and add the ESP-32 core

  1. Obtain required materials (listed above)
  2. Wire time of flight sensor to ESP32 dev module according to firmware
  3. Flash ESP-32 dev module with the provided firmware and set network parameters
  4. Attach hardware to glasses via tape or 3D-printed parts

Usage Instructions

  1. Have a local network set up for all the devices to connect to
  2. Power on the device
  3. Run the provided Python script on your computer