Saying Goodbye to OpenSubtitles.org API
blog.opensubtitles.com
blog.opensubtitles.com
> If you wish to offer subtitles without prompting for an opensubtitles account, please contact us and tell us about your project... For an easier development process, you can set your consumer as "Under Development", this will allow you to perform up to 100 downloads per day without user authentication temporarly. [1]
Downloading tiers are listed at [2].
It's a question I've never considered before -- should "open" mean "you can API-download everything all the time anonymously no limits", or "you're free to API-download a reasonable amount for consumer purposes with an account, and the more you upload the more you can download"?
Do they offer any kind of bulk download or mirror?
[1] https://opensubtitles.stoplight.io/docs/opensubtitles-api/e3...
Very few people, even few programmers, would be able to take on maintaining complicated software like tofu alone, for example.
If you have a benevolent dictator with deep pockets, throttling usage and retrieval is less of a concern. The Internet Archive comes to mind, as does Wikipedia. Reddit's outcome happened because they were a discussion board utility masquerading as a 10-100x VC funded business, and their actions drove away the concentration of mods and contributors who were putting in all the free work (broadly speaking).
From what I saw, there were protests which most Redit users barely noticed (the front-page just served content from the subreddits that didn't go private), and then there was nothing. The long-term impact seems to be small to nonexistent.
Maybe if the users organized better and started posting "brand unsafe" content everywhere instead of just going dark, the effects (and especially the effects on advertisers and Reddit profitability) would have been different. One can dream, though.
https://news.ycombinator.com/item?id=36289290 (Ask HN: Anyone at Reddit can confirm a traffic dip?)
(n=1, I consume Reddit now with a Lemmy mirror of the subs I'm interested in)
I would be -shocked- if Reddit had data showing that the protest was more than a fart in the wind
r/gonewild for example has nominal 4.6 million subscribers - but among the default "hot" feed on the first page there's just four posts with > 500 karma, and on the 2nd page there's tons of posts with 80-120 karma. That's insanely low, back in ye olde days a simple boobie could easily hit 2k karma in a matter of hours, and there was pages and pages of highly upvoted content.
Now, I can't say whether this is a consequence of users leaving, mods leaving, Reddit manually downranking NSFW sub engagements, or the massive increase of ragebait redirecting attention and engagement - r/europe is filled with utterly vile comments on everything regarding immigration and Islam, r/therewasanattempt even managed to get geobanned in Germany because they put up the (banned) Hamas slogan on their banner [1].
(In the German Reddit sphere, it seems that additionally Reddit has created a ton of outright clones of popular English subs like AitA, DIY, legaladvice, ... that further remove engagement from the large subs and redirect it to the small new ones - this "pushing" of new subs likely also drives NSFW subs with low engagement down the feed)
[1] https://old.reddit.com/r/Israel/comments/17vqch7/rtherewasan...
I did start to wonder if people's viewpoint on immigration has changed as the narrative that Europe is "saturated" with immigrants seems to be being pushed a lot at them moment, but I have a feeling that the audience of Reddit and r/europe seems to be changing. I wish there was some way to know for sure.
Social media of all kinds are effective tools in this. Vilification of minorities works, it always has, but those who would exploit it haven't had access to the public forums required to promote it. Now they have.
Nuclear weapons won't destroy the earth, social media will.
That said, there is also a shift to the right in real life, as seen by the rise of groups like AfD, Brothers of Italy or Sweden Democrats.
r/europe also has a bit of a weird history with this too. It started relatively left wing in the early days of reddit, drifting to the right until the mods started clamping down on the more overtly racist stuff. At this point, a lot of the posters involved moved to r/european, which sort of reset r/europe back leftward a bit again. But then r/european was banned around the same time as r/the_donald for much the same reasons, and those users drifted back into r/europe which shifted it to the right a second time.
It should also be noted that it's not a "Hamas slogan" but has a much wider use:
Germany, and Europe in general, has the cultural understanding (as a consequence of 1933-1945) that no, not all speech has to be allowed - particularly not when it calls for or supports terrorism.
And that is precisely the context in where this slogan is currently being used.
"Kill Jews" is clearly evil and should be banned, but banning this phrase ends up smearing ordinary Palestinians who use it to describe an non-violent aspiration, as did the Israelis.
As I said, an over-reaction.
I haven't actually tried to use it. So long as they offer a dump you could use I think it's entirely reasonable to require payment for the API.
I think it's reasonable to consider them morally open even if the web UI is closed source if the subtitles are open. It feels to me like a project selling a shiny hosted app around an open source project. I think in this sort of project the core "source" is the subtitles, not the web UI.
If OpenAI let you download their models but didn't provide the tooling you'd need to run them I think their name would be much more reasonable.
IDSubtitle MovieName MovieYear LanguageName ISO639 SubAddDate ImdbID SubFormat SubSumCD MovieReleaseName MovieFPS SeriesSeason SeriesEpisode SeriesIMDBParent MovieKind URL
1 Alien3 1992 English en 2004-10-31 23:54:23 103644 sub 2 Alien.3 11.000 0 0 0 movie http://www.opensubtitles.org/subtitles/1/alien3-en
2 Identity 2003 Slovenian sl 2004-10-31 23:54:23 309698 sub 1 Identity.DVDRiP.XViD 0.000 0 0 0 movie http://www.opensubtitles.org/subtitles/2/identity-sl
3 Ghost in the Shell 2: Innocence 2004 English en 2004-10-31 23:54:23 347246 srt 1 Innocence.2004.DVDRip.XviD 23.980 0 0 0 movie http://www.opensubtitles.org/subtitles/3/ghost-in-the-shell-2-innocence-enOpen Exchange Rates: the fact that you didn’t need an API key was an important part of their gaining popularity. Of course, this fell down at some point, at least partly due to stupidly-coded clients, and so they started requiring an API key, and completely hobbled the free plan for many previously-recommended uses (only hourly updates and 1,000 requests per month; a month is up to 744 hours, so they really are just saying “if you want to use this broadly, either pay us $97/month, or cache it yourself hourly, proxying it if you have multiple access points”). Not very open.
OpenAI: eh, you probably already know the story. They broke their word and premise thoroughly.
Neither, Open should mean that the resources are publicly licensed such that they can be freely rehosted or redistributed. It should mean that the resources are owned by the community rather than the website operator, and that the website should be selling coordination, not access.
Whether or not there's an API limit is irrelevant provided that:
A) the website does not claim ownership over resources it hosts
B) the website is not going to go after people hosting or distributing those resources outside of the site -- ie, users have explicit permission to distribute any and all of the subtitle content on the site
C) there is a way to get the resources off of the site, ie it's not impossible for someone to set up a rehost.
If OpenSubtitles still allows a bulk download or has a mirror, then honestly I don't see a problem with them making this change -- I'm not a fan of it, but if the subtitles are still downloadable in bulk and if OpenSubtitles isn't claiming ownership and would have no issue with someone setting up a separate service or rehosting those subtitles and if (to the degree they can be licensed openly, given that they're subtitles of copyrighted films) they are licensed openly using an OSI-compatible or comparable license in the case of the GPL, then I don't have a problem with them using the word "Open" and I think it still applies.
Having said that, I can't immediately find any information on their website about what copyrights they do or don't try to claim, and it's not clear to me how I would go about building a full dump of the content (a sibling mentions a dump but that it doesn't contain the full subtitles). But that would be my bigger beef. I'm less concerned about whether the website is Open and I'm more concerned about whether the subtitles are Open (again, as open as movie subtitles can be).
Open means "we will not take any legal action against sharing and/or modifying these files".
Open projects can have all the ratelimits and paid APIs that they want, as long as they are okay with people setting up mirrors and re-hosting content for free.
Goodreads also springs to mind (although I guess Amazon has started monetizing that now, so it might not be as great of an example). The immediate access matters less to me than Amazon looking at all those user reviews and recommendations and saying, "we own them."
For consumers with normal usage, on-demand downloading of subtitles for 5 movies in a day seems pretty good. For TV, not so much. Even rate limits would be fine. A movie can be downloaded every hour, a TV show every 15 minutes.
For a media server that wants a local cache of the subtitles, it could still run through with those rate limits in the background while you’re not watching. It could be a slight annoyance when first setting it up, but would be a one time thing and not much of an issue for one-off adds over time.
I was messing around to mass download stuff from a wallpaper site with an API about a year ago, just because I’m a data hoarder and was worried about it going away at some point. The API required auth and had a rate limit, but as a consumer, it was fine. I just added in a 2 second wait between downloads and had no issues. It took longer, but what do I care? After a week of screwing around with it I saw I downloaded about 50gb of wallpapers, which was more than I wanted. I felt kind of bad about it and stopped. I decided to be a bit more intentional on my downloads after that. The tool I made let me put it a tag and download all the results. That was a bit too greedy.
It’s a lot easier to look the other way when it’s free.
https://arstechnica.com/tech-policy/2017/04/fan-made-subtitl... (2017)
The subs wouldn’t exist without the original work.
Edit: Yes, it’s a subset of the script and not thee script itself, and being a pedant about that isn’t a useful point. It’s just pedantic.
Imagining I were to hand you a book. It's Harry Potter but missing every third sentence. You tell me "It's Harry Potter" and I'm like "nuh uh", I'd be just being a pedantic ass and not making a good point.
Similarly, I might pay for a subscription to a website which has a detailed review of that episode along with screenshots. Neither replace watching it, not even close.
I do think that subs are a little bit more legally ambiguous than a review but I think you could make a reasonable argument that they're a fair use under US copyright law.
Movie scripts contain much more than the dialogues. There's enough of an argument to be made that transcription is covered by fair use rights.
source: I worked in the music biz
Calling the subtitles "basically a script" is like saying JavaScript is basically Java.
Things like [ominous music plays] are not part of the script at all, but featured in subtitles
IANAL but I'd say the main argument for it being free use is that subtitles don't take away from movie/TV sales. There's no harm. To the contrary -- fan-made subtitles in languages the studio didn't produce might generate purchases where there were none before.
While the main argument against it is that it's part of and enables broader piracy -- if you can show that people are overwhelmingly using subtitles with content they downloaded illegally, then it is part of harming the studios.
(Also, subtitles are not scripts. They usually don't even indicate who's speaking, much less include all of the scene descriptions and instructions. Probably ~half the words in a script are not dialog.)
do you think that people who want subtitles would pay for content if there were no subtitles available for it?
subtitles either increase sales, or they do nothing. they may increase illegitimate sharing, but they won't do it at the expense of sales.
Pretty much. If you're Japanese and don't speak English, and a show you really want to watch is only available to pirate in English (no subtitles available) which means you can't understand it, but if you subscribe to Netflix you can watch it with Japanese subtitles that Netflix provides... I mean yeah?
I'm presenting both sides of the argument. The question is really, which side will a court find to be stronger? And there may very well be a distinction here between fan-made subtitle translations, versus official subtitles.
Like all things in life, YMMV. ;)
The bottom line is that most of these points haven't been challenged outside of that BREIN case, nor do they cover some of the more valuable uses of authored or revised subtitles, such as subtitling and captioning works that never had them, or in languages that weren't translated, or to correct significant translation errors.
The legal cases of subtitling are especially pertinent now that we have relatively accurate, low-cost, easy to implement realtime speech-to-text. If many devices that play video can now add subtitles, or even captions, locally in real time, how much value is there in paying lawyers to pursue cases to protect the copyright of _just_ the subtitles? Is editing a subtitle script generated by a speech-to-text engine also a copyright violation, and if so, who all is violating the copyright? The person who feeds the video to the engine? The editor, who could be a different person? The distributor of the resulting subtitle file?
Oh boy. I mean, I frequently rewind turn on subtitles for 10 seconds because a bit of dialog is totally unintelligible. (Or it turns out to be perfectly intelligible but it's something with a proper noun like "Kantauganwe it is.")
For people without accessibility needs, speech-to-text is the least help when they most need it...
On the other hand I was using VLSub, a VLC addon, which downloads subtitles automagically. But now I see it used opensubtitles :(
Submitters: "Please use the original title, unless it is misleading or linkbait; don't editorialize." - https://news.ycombinator.com/newsguidelines.html
If you want to say what you think is important about an article, that's fine, but do it by adding a comment to the thread. Then your view will be on a level playing field with everyone else's: https://hn.algolia.com/?dateRange=all&page=0&prefix=false&so...
You will still be able to visit the website and download the subtitles you want. You just won't be able to make use of the API without paying for it.
Edit: Nvm they are going to insert ads everywhere
he wasn't very happy (because my website would compete with him and take ad revenue from him)
at the same time any "extension"/media player that downloads the subs can do it freely
so was it ever open or not?
just because my website had an easier to way to monetize unlike VLC extensions or wtv
Really quite amazing
https://wiki.bazarr.media/Additional-Configuration/Whisper-P...
[1] https://wiki.bazarr.media/Additional-Configuration/Whisper-P...
It's not perfect, and it'll completely lose some dialogue, but it's let us enjoy shows that we couldn't before.
On the other hand, who is going to tell people about putting a stop to Clearway Law now?
OpenAI
Open = Closed
Up = Down
War = Peace
Freedom = Slavery
Ignorance = Strength
only from English?
and what about a translation from English to another language?
How long would it take for you download all 6.260.893 subtitles listed in the "dump" with these limits in place?
Then one day it said "oh, so sorry, now this is commercial"
The basic problem though is servers cost money and time to run. No one really wants to pay much for it. So these sorts of metadata sites come and go because they end up as the destination for popular 3rd party items to basically harvest their data. Then basically whoever runs it runs into an issue (job loss, crazy bill, anger, whatever) and says screw it this now costs money.
Especially with such cases, assuming malice is weird. The site wasn't acquired by some shady private capital or whatever entity jacking up prices for profit (like Broadcom with VMware), it's the same people(person?).
We have neither the source code nor training data.
It’s just a list of subtitles with download links.
> But I suspect your comment like many others are from users who don't even really use OpenSubtitles often/ever.
I suspect your comment is a whole load of projection.
I use OpenSubtitles a lot. You can still freely download subtitles, but their will now be limits on the new REST Api they build. You could in theory scrape the site. You can jump on and download things freely. There might be full dumps including the subtitle text itself out there, I would guess nobody cares given the community around it but thats just a guess.
The move is from I understood over the past year to 1) Deprecate the old hard to maintain API 2) Get applications that are using OpenSubtitles to either introduce a OpenSubtitles link in their app or to work with OpenSubtitles to pay for direct access. 3) Help support continued work on both the site and the API.
The new daily usage limits against the API still allow unauthenticated users from using the API, downloads are limited to 5 a day per IP. Authenticated users but non-paying get a bump up from that, and paying (VIP) users get 1k per day. Is it change from the old API? Yes but my impression is the core user base are happy to support. It costs money to maintain the entire system and you can still download subtitles without signing up. The data is still freely available but the transport, API, has new limitations.
Do you use the OpenSubtitles API or website?
To celebrate this change, OpenSubtitles.org is offering a 20% discount on a one-year subscription to VIP membership. VIP members enjoy benefits such as an ad-free experience, direct download links, higher download limits, ad-free subtitles, user profile visibility, and contribute to the platform's development. Users are encouraged to upgrade to VIP membership to take advantage of the limited-time offer and immerse themselves in a premium subtitle experience across OpenSubtitles platforms.
TLDR: Nothing changes except API prices.
Is this a change worth celebrating, then?
(original link gives 503 error to me so I'm happy with the summary here)