Hacker News Reader

Comment by vitovito | Hacker News Reader

I don't see any audio controls, or audio download progress, in either Safari, Chrome, or Firefox. Looks like a syntax error, there's some HTML in a Javascript file.

Conceptually, since I can't try it, it reminds me a bit of hyperaudio. Have you seen http://hyperaud.io?

I also did a hypertranscript similar to this here: http://vitor.io/uxr101 Click on any word to scrub to it, or click in whitespace to toggle play/pause.

View on HN

How did u manage the sync between the audio and words? ... In my little demo, I've used IBM Watson's Speech to text API to analyze the audio. I used those results - it had timestamps, to the recognized words - and used some algorithms to match it with the text. Naturally, it did not catch like 20% of the words but was able to massage it enough that it looked smooth.

I had a verbatim transcript already, and I used CMU Sphinx to do the alignment between that and the recording.

With raw audio only, I'd probably use a transcription service that provides timings, or software like Trint to do machine learning first, and then clean up by hand, like you did.

The software I wrote to handle the playback is here: https://github.com/vitorio/hyperaudio-lite

whoops, thank you for that input. Just fixed it.... I tried both of those links. It's pretty cool. It is very similar to what I've created except I took UI cues from Audible's mobile app. ...Man, just goes to show how big the world is. I thought I was a bit original on that. Thank you for sharing.

Reply on news.ycombinator.com