Brick · 03
Hear
Microphones, audio pipelines, and DSP on the chip
Why this band exists
Sound tells you more about a home than a camera does, which is exactly why it should never leave without asking. Hear is the audio half of the Janus family: rusty_esp_audio captures from PDM and I2S microphones, encodes PCM, IMA ADPCM, WAV, or FLAC, and streams to your own speakers, while rusty_esp_dsp keeps the math fast and byte-identical to a reference.
Why now
The audio path has run a ten-minute soak on a XIAO ESP32-S3 Sense with zero datagrams lost, and its ADPCM is byte-identical to ffmpeg in both directions. Speaker loopback is still unmeasured, and the plan says so.
How it fits
Flash composes the mic into the image. Connect moves the audio over the mesh. See shares the board for a porch cam with sound. Own keeps the stream subscribed only to the people you adopted.
Bricks in Hear
Each brick is a package in the Janus family under Remade-With-Rust. Read the field note, then snap it onto the rest of the house.
rusty_esp_audio · replaces ESP-ADF / esp_codec_dev
Pipeline, PDM and I2S capture, PCM, ADPCM, WAV, FLAC
rusty_esp_dsp · replaces ESP-DSP C kernels
Scalar kernel home with a PIE SIMD seam for S3 and P4
What to build first
- A baby monitor that plays on a laptop with ffplay and nowhere else
- A room-to-room intercom over the home mesh
- A FLAC recorder for a workshop or a practice room
Field notes in Hear
Our FFmpeg Alternative Stopped Reading the Whole File to Open a Recording
Our FFmpeg alternative stopped reading the whole file to open MP4, Matroska, AVI, Ogg, FLAC, WAV, and the simple boxes. A 239 MiB MKV probe fell from 516 MiB to 6.2 MiB.
October 16, 2026
When a Baby Monitor Camera Leaves the Nursery
A baby monitor camera left the nursery when TRENDnet's feeds were posted online, including cribs. A local ESP32 keeps the measured listen and picture on the LAN.
October 13, 2026
rusty_esp_audio Is a Pure Rust Alternative to ESP-ADF
rusty_esp_audio is a pure Rust alternative to ESP-ADF for an ESP32 microphone: fixed blocks, no per-element allocation, and codecs checked against ffmpeg.
October 3, 2026
rusty_esp_dsp Is a Pure Rust Alternative to esp-dsp
rusty_esp_dsp is a pure Rust alternative to esp-dsp for shared ESP32 kernels: a scalar oracle, and ESP32-S3 PIE twins that must match it byte for byte.
October 3, 2026
ESP32 Audio in Rust: A Microphone That Keeps Time on Your LAN
Field note on rusty_esp_audio: PDM microphone, PCM, ADPCM, WAV and FLAC byte-identical to ffmpeg, codec chips as register data, and PCM your laptop plays with ffplay.
September 30, 2026
ESP32 DSP in Rust: Scalar Kernels, PIE SIMD Twins, Same Bytes
Field note on rusty_esp_dsp: one scalar kernel home, ESP32-S3 PIE SIMD twins gated byte-identical, and why measuring on the chip, not the laptop, changed the plan.
September 30, 2026
The rest of the home mesh
Six technology bands, one sky. Open another star, or return to the full map.
01
Flash
MATA Makers Kit: pick a board, build, flash, provision
02
See
Cameras and video that stay on your LAN
04
Sense
Presence without cameras: CSI, mmWave, radio links
05
Connect
iroh mesh, Wi-Fi, BLE, ESP-NOW, and LoRa between devices
06
Own
Device identity you hold: adoption and signed updates
