While my guitar gently speaks — Todd Fisher, Philo Ventures
Aug 18, 2026 · 18:35
Todd Fisher demonstrates how he built a speaking and singing guitar, walking through the audio engineering and AI stack behind it. He traces it from a Halloween Stranger Things garage door display to a JUCE plugin in Logic Pro that plays text-to-speech clips when he picks notes. Slicing words proved hard: energy gap segmentation fails on continuous speech, so he combined it with a sonority peak syllabifier and still hand-edited boundaries. For singing, he uses YIN pitch detection, synthesizes the note, and routes it through a vocoder. Because pitch-shifting samples from World and VocalSet is too heavy to run live, he pre-bakes vowel samples per fret. He also adds a microphone, Whisper, and a local LLM, letting the guitar answer audience questions like 'What is reality?'
