Ask HN: Tutorial for syncing cameras with recorded audio?

5 points·ameyades··2 comments

There is a method to sync the frames of multiple cameras close together with recorded audio (albeit with a margin of error due to the relatively low speed of sound). Is there any literature on this? I know video editing software probably uses it but I'd like a deep look at the methodology so I can create an algorithm adjusted for my purposes.

View on HN

My understanding is you're looking for landmarks in the audio and then matching/aligning on those.

Shenidam is open source software which does the whole process, site offline, GitHub still up: https://web.archive.org/web/20160309034204/http://shenidam.o... and https://github.com/stendardo/shenidam

A node stream module: https://github.com/adblockradio/stream-audio-fingerprint

Python: https://github.com/dpwe/audfprint

A blog post explaining fingerprinting: https://willdrevo.com/fingerprinting-and-audio-recognition-w...

Commercial software: https://www.redgiant.com/products/shooter-pluraleyes/

ith a margin of error due to the relatively low speed of sound

The typical frequency of video (frames) is ~30Hz. Maybe 24Hz for cinematic effect. Maybe 240Hz for super slow motion (but then you're not syncing with sound). 60Hz (sixty frames per second) is probably the upper end of what you are likely to have sync.

Reply on news.ycombinator.com