Why 23.976 and not 24 FPS? (2016)
cinematography.com
cinematography.com
All high-end cameras like the ones from Arri, RED and Sony can switch easily between 23.976 and 24.0 since many years. The sound recorders can now too, like the Sound Devices, which is the most common brand used (at least here in North America). The choice of shooting in 24.0 was already available in 2016, but not every gig would be used to shoot 24.0 so they chose 23.976 just to be safe, I guess.
Also, in 2016 television was still a major deliverable, but this has changed. Video on demand, which supports any framerates, is now the main distribution channel when a movie has finished playing on the big screen.
Documentaries are more of an exception because they are still aimed at television and also, they often use old footage which was telecine'd at 23.976 so it's easier to edit when everything's 23.976.
I don't think so, majority of displays are still 60Hz without VRR.
What does that mean? I thought 44khz sampling meant 44.000 integers are recorded per second.
This timecode format is a timestamp with seconds resolution plus a frame count within each second. To properly sync, all the timecode generators must use the same framerate. In other words, the audio recorder’s timecode framerate needs to match the camera.
The funny thing with timecode, which is hh:mm:ss:ff, is that the frame count is done at 24 frames, even at 23.976. So 1 frame of 23.976 is longer in actual "real time" duration than 1 frame at 24 fps. This can get confusing when going from and to 24/23.976.
There are more sophisticated workflows where the audio is recorded at 48.048 kHz (0.1% faster sample rate) called audio pull-up (or pull-down). The technique is used when shooting, for example, a TV spot, with a film camera at 24 fps. Since the 24 fps picture will be played back at 23.976 at the edit, the audio will follow the same speed down because it will itself play at 48.000 kHz instead of 48.048 kHz. I'm not sure that many productions still shoots TV spots in film, though, contrary to fiction where film is still being used sometimes.
In all cases, the time code increments at the frame rate you are using.
But all the major VOD services, be it Disney+, Netflix, Hulu,... still mainly use 23.976 or 29.97 fps for their video distributions.
I don't know what your production company mainly works on, but these NTSC frame rates ares still the norm across the whole cinematic industry, and it's not going anywhere. It's not limited to documentaries at all.
The YouTubers etc. do use 30/60 fps more often OTOH.
https://partnerhelp.netflixstudios.com/hc/en-us/articles/360...
This is a guide about data bitrate, what it says is that for 24fps, you need at least 240Mbps (means it needs more if it has higher frame rate).
If anything, all the other language versions actually use "23.98" as example instead. E.g. this Deutsch version: https://drive.google.com/file/d/1WLz0O_dwmVWjqHafaHoLav0qvHU...
This guide https://partnerhelp.netflixstudios.com/hc/en-us/articles/441... mentions more about frame rate but it's basically just "don't convert frame rate around, and use constant frame rate for intermediate file".
So some of them might reconvert to 23.976 even when we submit 24 fps masters as per the contractual agreement. Maybe you are right. I will check.
Low budget web series shot at 23.976 even get delivered and played back at 29.97i on some local platforms here in Canada (Crave, Noovo, tout.tv), so anything's possible nowadays.
On the other end, Blurays can be encoded at both 23 and 24, and Vimeo, Youtube, etc all support 24fps. So 24 fps exists, not just on DCPs.
By the way, the loss of quality from going to/from 23.976 and 24 is not much. I've never heard any artifacts from that kind of conversion. But since cinema theatres are most likely to have a better sound system that a home system, I think it makes more sense to have the unconverted mix playing in the cinema and not vice versa.
Surely the first solution would be preferable. But it would still lead to more than one jitter per minute. I wouldn't call that "no artifacts".
1.7321 cents difference for your audio (100 cents is a half-step)
I do agree we should actively push this relic out, though. Wish Netflix etc. can do more to normalize whole number frame rate to end this. Unfortunately considering TV industry are still using 29.97i for broadcasting, I don't see it's going to happen any time soon. And it's worse in other countries like Japan.
I would think the main consideration is workflow these days.
Source: https://partnerhelp.netflixstudios.com/hc/en-us/articles/726...
I understand that the two main reasons for 23.976/24 fps are that it’s:
1) been the standard for a really long time so you know everything will more or less support it (cinemas/vod/broadcast tv).
2) is now in people minds as what film should look like (in that 60 fps somehow looks “off” because we’re trained to expect 24 fps).
Given that analogue broadcast tv is dying off and that digital OTA tv is a similar case to vod in terms of codecs (maybe not receiver support?), wouldn’t a stopgap be some multiple of 24 fps (e.g. 48fps) that would allow better motion handling without the pace seeming off?
I'm quite convincented you already notice it at 30fps (but I'd have to check again)
Watch either of Ang Lee’s HFR movies (Billy Lynn/Gemini Man) and you’ll understand what I mean. HFR breaks suspension of disbelief. I didn’t want this to be true but I’ve come to accept that it doesn’t really have a place in cinema at least for now.
(I worked in the industry at the time on the technical side, but I’m not a film buff, so the details are forgotten a long time ago. All I remember is that there was a huge amount of work involved to get all the equipment upgraded to support HFR. Cinemas had to upgrade both their playback servers and projectors for thousands of dollars. All for less than a handful of films.)
Remember also that typically a 1/2 rule is followed where the exposure of each frame is half the time of its display. So for each of the 1/24s intervals, an exposure is made for 1/48s. A shorter exposure would have less motion blur but look jittery. A longer exposure would look too buttery. People are extremely used to 1/48s exposures displayed for 1/24s (or similar).
48fps video in the Hobbit movies was very negatively perceived. It looked too much like a video game.
As someone who hates 24fps, because it looks way too jerky, and not lifelike, the sooner we lose 24FPS, the better.
I also think most jerkiness in 23.976/24 is due to incorrect display settings leading to dropped/skipped/repeated frames. If your display can match 23.976, even panning scenes look pretty smooth. It's the jitter that messes with our brains and looks bad.
It's not jitter that bothers me, it's the stop motion effect. It's especially bad with action sequences that have a lot of closeup shots.
This is basically every movie with any sort of action in the past decade or so. If you do closeup shots in on some fast action in 24fps you don't have to worry one bit about choreography, since it'll just be a choppy blurry mess and nobody can tell what's going on anyway.
I'd argue stylistically the lower frame rate works a lot better on a big screen. There's also the fact that high frame rates on a big screen seem to cause some people to get motion sick.
I personally have no issue w/ action scenes which are shot at 24fps. Yeah, there is a fair amount of blur but it all seems natural (at least on a cinema projector), and conveys the fast movement, even if it might not be precise.
Take Jackie Chan's Drunken Master epic final fight scene for example - yes it's a bit blurry but I can make sense of everything going on. If anything it enhances the feeling of action - if this was shot at 60fps, it would look much more "real" and be a lot less enjoyable.
Not sure how a camera would be built that could do this...
Hobbit's 48 fps version was not as badly received as you make it, though the unreal slow 24 fps shoot does give it more of a fairytale character.
Cinematographers have to pick particular aperture and ISO to get the depth of field and film grain they want, so they can only really adjust exposure though shutter speed. If you double the framerate, the minimum possible shutter speed halves. Therefore (unless you are shooting outside on a sunny day) it is very likely that your shot is underexposed, and the only thing you can do about it is add more lighting. This can be both logistically complicated and technically very hard to pull off without looking unnatural, especially in scenes that are supposed to be dark and moody.
Many new TVs interpolate 24/30 fps to be 60fps. This is knows as "The Soap Opera Effect", and has been written about here before. [0].
To me, 24/30fps feels "smooth", almost "buttery". 60fps feels crisp. 60fps feels almost too real. It makes it more difficult for me to suspend disbelief, whereas 30 makes it easier to suspend disbelief and get lost in the imaginary world that's being presented to me as if it were real. It's really difficult for me to explain....
“Teachable moment” I guess? I usually use that notation in my nfo blurb when encoding DVDs for a modern flatscreen target. Anecdotally, nobody has ever asked me to clarify. Small sample size though due to niche nature.
Even worse, not only is the recommended precision only 1 ms, but almost all muxers support nothing else, ffmpeg included*. A shame that despite such versatility, mkv is scuffed as an intermediate/archival format by lossy muxing, yet almost no one is aware.
* https://lists.ffmpeg.org/pipermail/ffmpeg-devel/2021-May/280... matroska precision parameter coming soon? It's been over a year, though - looks like the patch is dead. Meanwhile, the bikeshedding of rational timestamps in the matroska lists can now be expressed with a timebase of decades....
1 ms is pretty imprecise for audio seeks, however - mkvtoolnix actually increases precision to sample rate when there's audio. But why do all tracks have the same timescale? Oh right, TrackTimeStampScale was in the spec all along and could be used to solve all of this...apart from being floating-point.
Why? It shouldn't. A millisecond-resolution timestamp unambiguously identifies a specific frame, at least until you start going over 400fps. You just need to go to the closest frame rather than rounding up/down. And rounding up/down can break very easily even if you're using ultra precise numbers, especially if you don't have a fixed framerate for the entire file.
In Mpeg 4, each track header has a “time scale” integer field. For a video track of 23.976 FPS the value can be 23976, or half of that, 11988. Audio tracks typically have different time scale field, often 48000 for 48kHz audio.
In Media Foundation, MF_MT_FRAME_RATE media type attribute is a rational number with uint32_t numerator and denominator. In DXGI, the RefreshRate field of DXGI_MODE_DESC structure which contains a refresh rate of a monitor is a rational number, for instance my display actually uses 59997/1000 Hz frame rate, not exactly 60 Hz.
Here’s what MediaInfo tool shows about the video stream of some *.mp4 file on my computer. The content was first released in 1997, before modern digital stuff.
Frame rate mode: Constant
Frame rate: 23.976 (24000/1001) FPS
Specifically, the timescale value in "mdhd" box (overall information about the media, defined in section 8.4.2 of the ISO/IEC 14496-12 spec) is 24000, and "stts" box (time-to-sample, defined in section 8.6.1.2 of that spec) says all video frames have the same sampleDelta = 1001.> A flick (frame-tick) is a very small unit of time. It is 1/705600000 of a second, exactly.
> 1 flick = 1/705600000 second This unit of time is the smallest time unit which is LARGER than a nanosecond, and can in integer quantities exactly represent a single frame duration for 24 Hz, 25 Hz, 30 Hz, 48 Hz, 50 Hz, 60 Hz, 90 Hz, 100 Hz, 120 Hz, and also 1/1000 divisions of each, as well as a single sample duration for 8 kHz, 16 kHz, 22.05 kHz, 24 kHz, 32 kHz, 44.1 kHz, 48 kHz, 88.2 kHz, 96 kHz, and 192kHz, as well as the NTSC frame durations for 24 * (1000/1001) Hz, 30 * (1000/1001) Hz, 60 * (1000/1001) Hz, and 120 * (1000/1001) Hz.
Guess the project got archived. Seemed like a semi sensible high res time format that was very media friendly.
Even if you map Internet protocols to the OSI model -- which is imprecise at best -- TCP represents the transport layer, and IP the network layer. They're not a single component.
We’ve just moved it.
Hell, just look at ffmpeg commandline if you miss some complexity in your life
Every generation has its challenges, but we can be greatful that the generation before us gave us new ones. It has not always been the case.
I certainly don't miss the days of adjusting tint settings, headroom, over-scan and interlacing. Digital isn't without its issues of course, but even a lot of those trace their history back to analogue hacks - article case in point.
There is this side effect of digital lowering the bar though. Back in the analogue days, you needed to be a wizard to get anything done, which meant a lot of the people then seemed to care about the details more than they do now. Digital makes everything so easy that anyone can do it, which can go both ways.
Spinning rust drives store analog magnetics that get error corrected to digital. Same with electron potentials in ram. Same with SSDs. Signals over HDMI are converted to analog to display.
Sure, it's nice to deal with crisp neat digital signals... But to get there, you always need to deal with analog.
That's why people like Leonardo da Vinci could exist, the scope of human understanding was much smaller and so their work was much more wide-reaching and foundational. Today, you can dedicate your life's work to some hyper-specific problem in a very specific field. Tomorrow, this work might seem fundamentally primitive or foundational in the way that previous generations are perceived.
Later these were declared wrong, considered harmful, having bad smell, not passing code review and it all became a boring task of combining lego blocks. Sure these analog guys had insane tricks in their sleeves, but our “collective industry” would probably stigmatize them immediately if met today.
Edit: more specifically, if audio was being converted to NTSC for dailies, why would it be 23.976 and not 29.97?
My friend insisted I was just imagining it, but only one of us went on to have a career doing post-production in the US market. To be completely frank I've looked down on UK/EU broadcast techs a little ever since because being able to set everything to 25fps and forget about it is easy street.
My experience has been the reverse. Because they can, people in UK/EU have historically cared much more about frame accuracy. It’s only in the last 10 years or so that people in North America have started caring about frame accuracy. In the past it’s been quite hard to do because of the non integer frame rate.
NOT about converting from film to PAL. You are arguing with no-one.
I suggest you get over yourself. I am indeed a video expert with decades of IVTC experience.
The first line of your reply was:
"but rarely does anyone actually do this"
That is factually incorrect, no matter how many years of experience you may have.
Coincidentally PAL video plays back at 25fps, to convert film to PAL they just speed it up from 24 to 25fps, audio and all, which is why if you watch a Euro DVD release of the same film all the actors sound like they just ingested helium before the scene because the audio is playing back ~4% faster. This was largely fixed with Blu-Ray as films play back at their native rate[1] on progressive displays but our European friends who have only seen films on VHS/DVD or TV and not in the theatre or Blu-Ray have been done a disservice, because the video and audio is sped up on playback and not as the director intended it to be shown.
[1] A notable exception is some unscrupulous distributors abroad release shitty PAL 25fps Blu-Rays of films which are simply upscaled PAL DVD versions that they then market as Blu-Ray but are worse than DVD quality but at marked up prices. This is more common than you think. Official releases from the studios are encoded at 23.976fps on the disc. TV shows shot on PAL video (native 25fps) will always play back at 25fps.
For example, ffmpeg's pitch correction using "atempo" filter (WSOLA) is average and might present artifacts depending on source audio.
ZTX (was Dirac) is another algorithm that's commercial and pretty much artifact free.
Btw, sound studios responsible for the 24-25 pitch shift often have the possibility to process the pitch shift on separate dialogue, music and effects tracks, limiting even more the artifacts in the converted output.
Around 2009, my street flooded and I decided to record it and sell it to a local news station. I had one bite and I took my camera over to the TV station (CTV).
When I got there, I was beyond disappointed that (1) they didn’t have an HDV player and that (2) I forgot my FireWire cable. I rushed home, imported/exported it in FCP, burnt it to a DVD and rushed back.
In the rush, I forgot to ensure the right frame rate was set. When I got there, the techs were able to ingest it no problem, but my heart dropped when I noticed the import rate on a little VFD was 1080/50i. Fortunately, it worked out and when my video aired, it looked like it was from an international source because of the pulldown.
I ended up getting a cheque for $135 for 8 broadcasted seconds of video and a day’s work of rushing back and forth. I’ve extrapolated it to be my most valuable piece of work at about $60,000 per hour.
You can get pitch-shifters, but on DVD players, the only ones with this feature I can find happen to function as karaoke machines.
I'll have you know, there were CRTs that did progressive scan too. Early HDTVs were CRTs, before flat screen TVs got big.
Plenty of PAL CRTs can accept NTSC at 60Hz on a 50Hz supply too, of course. It's nice to tie the supply and video rates together to reduce interactions between the two rates.
would you explain this to me like I'm 5?
Originally NTSC was 60 fields per second, based on the 60hz frequency of the North American power grid. 60 interlaced fields per second is pretty similar to 30 frames per second, but is not the same thing. The interlaced signal refreshes twice as quickly, but with half the vertical resolution per refresh.
When colour was added to NTSC, the frequency was shifted to 59.94 fields per second.
Movies shot on film are filmed at 24 frames per second. To convert a 24fps film to 60 field per second video, something called a 2:3 pulldown is used. The wiki explanation for how this works is pretty good: https://en.wikipedia.org/wiki/Telecine#2:3_pulldown
A 2:3 pulldown on 24fps film matches the 60 fields per second of the original black and white NTSC signal, but is slightly off for colour NTSC. The original article talks about how this can lead to problems like audio desync in production workflows.
Digital cameras offer the option to capture at 23.976fps. When you apply a 3:2 pulldown to 23.976fps video, you get an interlaced 59.94 fields per second video.
The story is well chronicled in a book I read about twenty years ago:
https://www.amazon.com/Defining-Vision-Broadcasters-Governme...
The title is intriguing enough:
"Defining Vision: How Broadcasters Lured the Government into Inciting a Revolution in Television"
I can't possibly do it justice here. I'll just mention that one would not be wrong to call Donald Rumsfeld the father of high definition television. His approach to wrangling the ATSC and FCC into adopting a cornucopia of standards was, from a business perspective, nothing less than genius while, from a technical perspective, a complete mess. The fractional frame rates would have evaporated from this planet had it not been for this part of the story.
Well worth reading for anyone interested in the technology or working in associated industries. Your jaw will most definitely drop as you get deeper into the story.
Does anyone have a circuit diagram for any of this? What were they using as a timing reference in the 50s that allowed a frequency lock accurate to 7 significant figures? There must be a fairly large error allowed.
So it's really 4.5 MHz, multiplied by 35/44.
In practice, you might buy a 3.579545 MHz crystal oscillator and then use dividers and PLLs to make all the other frequencies you need. The actual error is going to be based on the oscillators you use, but for the past few decades, we've just been using ordinary crystal oscillators and that means something like 50ppm, maybe (for cheap ones).
Crystal oscillators were available prior to the invention of NTSC. Quartz oscillators achieved 0.1ppm accuracy at some point in the 1920s.
From what I can find as I write this, the only movies distributed at high-framerates on Blu-ray are Gemini Man and Billy Lynn’s Long Halftime Walk.
Although HFR is technically an improvement, not everyone's a fan of the "feel". Relevant HN thread: https://news.ycombinator.com/item?id=14616930
I will say that seeing 60fps video on youtube is very very noticeable, much more than the resolution. I personally much prefer it but I can see how others don't since it is such a difference to the normal.
The first time I saw a film at 48 fps it finally felt so natural and immersive.
48+fps makes motion both a lot smoother and less blurry, however for me, it makes their costumes look a lot more like... costumes. For example when I watched The Hobbit in 48fps, it felt more like a LOTR themed fancy dress party than a film.
I suspect, in time, most people will get used to high frame rates as it becomes more common and learn to suspend disbelief the same way they do at low frame rates. Objectively, it looks fantastic.
Ooh, I experience this too. Great way to put it.
As far as I'm concerned, everything should be shot and delivered at 120.
For a good comparison, watch the few Twilight Zone episodes (the original from the 60s) from season 2 that were shot on videotape, as opposed to film for the rest of the series. They look downright weird.
This is a drama film. Both critics and viewers hated the look of it.
Marvel comic book films should def be shot at 60/120 though. Why haven't anyone tried this with audiences?
(See also: drop frame time code.)
Actually, I'd say 50fields/sec is the most popular frame-rate in-use around the world. Theatres still use 24fps or perhaps 48fps.
Shooting at 1200fps would make everybody happy. But 24fps works pretty well.
NTSC's components, including framerates, are still widely used in various (previously NTSC) countries.
The strangeness of PAL vs. NTSC lives on
It's actually 24000/1001, or in integers: 23.976023976023976... fps.
59.94 fps vs 60 fps...
A new generation is always behind us, and explaining a nice, even 24.0 to them will just be a better situation.