I used something like this a few years ago in a project sort of similar to this one. There's a bunch of parsing and processing to do with that, and the "0.3" value is ... fiddly, but it worked pretty well:

    ffprobe -show_frames -of compact=p=0 -f lavfi "movie=THE_VIDEO_FILE,select=gt(scene\,0.3)" -pretty`