top | item 32895251

Google removed our website from search because it uses YouTube-dl

381 points| justswim | 3 years ago |kapwing.com

147 comments

order
[+] jsnell|3 years ago|reply
Uh, put down the pitchforks. This is not Google taking it down because of not liking the tool. According to the screenshot it's a DMCA request from "BPI", "a UK record label association".
[+] mschuster91|3 years ago|reply
Actually, we should keep up the pitchforks, but redirect them towards the legal frameworks that give private, unaccountable entities the power to unilaterally disrupt infrastructure with almost zero legal recourse.
[+] weird-eye-issue|3 years ago|reply
Google doesn't take down entire domains from DMCA requests. They will remove single pages from their index
[+] jquery|3 years ago|reply
That’s even worse isn’t it?
[+] boomboomsubban|3 years ago|reply
I still don't see how they can pretend these anti-circumvention takedown requests are legal. The DMCA clearly lays out the path to challenge an alleged circumvention, and it involves a court order barring distribution of the product. Takedown notices are only for violations of copyright.
[+] blfr|3 years ago|reply
Obviously, this tool does circumvent YouTube's mechanisms to download and edit a video. The user kinda accepts the risk (how many of them even read that privacy policy?) but there is no verification that they have any rights to the video. Which is imho as it should be.

It's neither wrong nor illegal to download someone's video and edit it. It's explicitly allowed in many jurisdictions under fair use. However, OP seems to accept complaint's framing.

Speaking of youtube-dl, there's an excellent fork, yt-dlp[1], which circumvents the newer speed limiting features YouTube implemented. (From what I gather, they use APIs for older devices.)

[1] https://github.com/yt-dlp/yt-dlp

[+] BlueTemplar|3 years ago|reply
Yeah, AFAIK in many jurisdictions, this would be thrown out of court, because you (YouTube) cannot go around and complain about people downloading your videos after you put them on direct access on the Internet ! (Your profits being reliant on separately shown ads aren't an excuse because you could splice them directly in the video and the analog hole still exists anyway.)

In practice though, this has resulted in several (replay) video broadcasters hiding their videos behind mandatory account creation - IIRC a legal battle is still ongoing because doing something like this might violate the obligations they took when they rented the public EM spectrum.

[+] Freak_NL|3 years ago|reply
Does yt-dlp circumvent the age check for videos classified as not suitable for minors as well? From what I've seen the loopholes for that type of video seem to have gotten closed this year.
[+] heinrichhartman|3 years ago|reply
The case is more nuanced than it looks from the outset. In this case YTDL is executed on the provider's premise not on the users machines. So you are not distributing a tool, you are providing a service that scrapes videos from YouTube.

I still think that a DMCA takedown should not apply (and the regulation is BS) but this looks to be a different case. E.g. I could completely understand why Google would not want such a feature in your product for Business reasons.

[+] senko|3 years ago|reply
> you are providing a service that scrapes videos from YouTube. ... > I could completely understand why Google would not want such a feature in your product

So, when Google scraped the internet to provide search engine, that was okay, but when some other site scrapes something, it is not?

If they are doing something illegal, by all means sue or report them.

But Google acting as police, judge, jury and executioner here shows why it's a problem to have a single unregulated company with so much power.

[+] boredpudding|3 years ago|reply
I agree with this, but I also feel Google should sue them for this feature, instead of removing them from Google Search. I feel like the second is an abuse of their massive power on the internet.
[+] bryanrasmussen|3 years ago|reply
> I could completely understand why Google would not want such a feature in your product for Business reasons.

yeah I can understand this too, but it looks to me like Google is using its monopoly power in industry (search) to protect its monopoly power in another industry (video streaming)

[+] masswerk|3 years ago|reply
Hum, isn't copyright about publication? The mere act of downloading doesn't necessarily imply this, and there's still legitimate cause for publication as in fair use. Also, wouldn't a DCMA complaint have to concern specific material? (To me, this doesn't make much sense.)
[+] danbulant|3 years ago|reply
But again, GIPHY has the exact same feature, and I can find Giphy just fine
[+] megous|3 years ago|reply
> The case is more nuanced than it looks from the outset. In this case YTDL is executed on the provider's premise not on the users machines. So you are not distributing a tool, you are providing a service that scrapes videos from YouTube.

So the rule is that you can't (as a user of Kapwing) use a computer you don't own (and are just renting in some capacity) to download your own videos? Or to download videos for "fair use" use cases?

I mean who cares where the software runs?

[+] tremon|3 years ago|reply
I could completely understand why Google would not want such a feature in your product for Business reasons.

But if Google would actually act on that desire, they're so far into antitrust territory they'll never find their way out on their own. We can only hope that some of those teeth might have grown back.

[+] johnebgd|3 years ago|reply
Google has become the baddies. I assume this is just them abusing their power to hurt companies that their customers (advertisers) complain about.
[+] stevage|3 years ago|reply
A long time ago.
[+] blacklight|3 years ago|reply
This is why everybody should stop using Google as their primary search engine, and either use DuckDuckGo/Startpage/Brave or (even better) self-hosted meta-search engines like SearX/SearxNG.

I personally opted for the SearxNG option and I haven't looked back at Google for a single search for months.

Google decides to remove a website from their engine because of their bullshit reasons? And who cares? Google is only one among ten different sources that contribute to my SearxNG results. Other search engines will probably keep including that website.

The best way to stop Google's arrogant monopoly is to ensure that they become just another source among many, and that nobody cares of their search results more than they care about Brave, Ecosia or DDG. Remember that the only reason why Google has so much power over users and businesses is that too many people use it as their sole source of truth.

[+] frognumber|3 years ago|reply
I feel like submitting a swarm of DMCA take-down notices for copilot, which stole my AGPL code.
[+] chrismorgan|3 years ago|reply
> my AGPL code

To repeat what I keep saying in these cases: there’s nothing special about the particular license you use, if it still has pretty much any condition. If Copilot is subject to copyright restrictions, MIT-licensed code is affected just as much as AGPL-licensed code: Copilot is still not meeting (and cannot meet) the condition of the license, attribution. Copilot depends entirely upon exemption from copyright restrictions under “fair use” exceptions.

But still, you’re quite welcome to issue takedown notices, though I don’t know if the regular process is actually appropriate (given that it’s a GitHub project rather than a project hosted on the GitHub platform). Their reaction might be interesting, though I expect they will just declare the notice invalid because of fair use exemptions and ignore it.

[+] stevewatson301|3 years ago|reply
It's interesting to see this statement. When it comes to Copilot, many HNers share the sentiment that it has copied code from open-source projects without their permission.

However, when it comes to a different group such as artists, the same people seem to believe stable diffusion/DALLE-2/midjourney et al. are "just weights in a neural network and the neural network is generating art based on its understanding of text and style".

[+] geraldwhen|3 years ago|reply
You should. What’s the point of licenses if big companies ignore them?

Personally I’ve only ever released source as MIT, knowing it could be resold or used for nefarious things, or kept source private. I don’t trust ransoms on the internet to respect posted licenses, so anything I post publicly I post with as much permission as possible.

[+] belorn|3 years ago|reply
DMCA take-down notices only works if the platform that receives them want to act on them. Unless you got power and influence, nothing will happen.
[+] Kiro|3 years ago|reply
How is your comment relevant to this?
[+] kjeetgill|3 years ago|reply
Mistakenly googling kawping even auto-corrected to kapwing so I'm guessing they've since been fully reinstated ... (Tinfoil hat) if they were ever even taken down.
[+] jenthoven|3 years ago|reply
[This is Julia, Eric’s cofounder] 317 Kapwing webpages were taken down, but we still have others (including this blog post) that show up on Google Search. As the article explains, our home page, blog, and EDU page are among those that are de-listed
[+] ALittleLight|3 years ago|reply
I still kapwing and this post on Google search. I did look at one of the blog posts the author mentioned and tried googling random strings from that blog post and found it did not show up in a google search (though was the first result on Brave search).
[+] sschueller|3 years ago|reply
Monopolies abusing their power. Until congress does something this will continue and only get worse.

I wouldn't be too sure that AT&T would be broken up today as it was back in 1982.

[+] encryptluks2|3 years ago|reply
This is like robocallers complaining that phone companies are making it more difficult for them to use the phone networks to robocall people.
[+] encryptluks2|3 years ago|reply
I'm not justifying Google here as I am a fan of youtube-dl and the variants, but if you are creating a product or business that relies on Google servers and uses software that could be considered abuse (especially for commercial purposes) then I'm not completely surprised. You could have got an API key which is probably the correct route to go once you want to commercialize something like this.
[+] hnbad|3 years ago|reply
This is what struck me as well. Giphy doesn't exist to scrape full videos from YouTube. Kapwing offers to scrape full videos from YouTube and then reupload them to other platforms. That not only likely violates YouTube's terms of service but also directly contradicts YouTube's business interests.

I'm not sure the DMCA claim is legitimate (and Google seems to have walked back on it, which seems odd) but this feels more like a ToS violation that would justify an IP ban or strongly worded legal letter than an obvious DMCA case.

[+] account42|3 years ago|reply
This stance would make sense if Youtube had decided to block them. That is not what happened.
[+] weird-eye-issue|3 years ago|reply
https://i.imgur.com/ioNjNmI.png

Okay so their top organic pages were specifically about how to download Youtube videos. I'm assuming this is against Youtube's Terms of Service and considering Youtube is owned by Google this doesn't seem like they were really trying too hard to stay on Google's good side which you need to do when you get millions of monthly organic traffic and want to keep it that way.

But anyways according to Ahrefs I'm not seeing any traffic loss (not sure what happened with that big spike but there was a Google update at that time):

https://i.imgur.com/r9naQne.png

[+] Hitton|3 years ago|reply
Where is the first screenshot from? Looks useful.
[+] behel|3 years ago|reply
And I wondered why we suddenly moved to the first page on google for some queries for our app that we posted on Show HN some time ago that competes with kapwing in a small niche (SavvyCut: https://news.ycombinator.com/item?id=28950702). It seems that someone made some room for us. I guess if you rely on googles monopoly to run your business you should not be surprised if they can remove you at will. For us, a lot traffic originates from competing search engines that show us on their first page even without creating any SEO spam.
[+] megamix|3 years ago|reply
I can still see your website listed in Google search.

You can always rely on DuckDuckGo to list :D.

What can we say about a totalitarian search engine?

[+] unconed|3 years ago|reply
It's depressing how shit the internet is now. Youtube has a virtual monopoly on video, effectively making them the public square for rich media. But you're limited in what you can post there, they can remove or deboost or quarantine whatever they want, and they actively prevent you from integrating with them. This is pretty much what every major platform turns into over time.

It's the complete opposite of what it was 20 years ago.

[+] emaro|3 years ago|reply
Although generally I totally agree and I think that with the size and relevance of YouTube Google has to allow access to the content with tools like yt-dl (even for businesses), I still wonder why they do not mention the official YT api with one word? Is it to expensive? Why wouldn't they use it?
[+] rpigab|3 years ago|reply
Well, obviously, APIs provided by Google can allow app creators to do many things, but not things that are useful. Only Google apps can do useful things, per Google policy.

See this SO answer https://stackoverflow.com/a/8081778/12405367

"Downloading Youtube videos is against their Terms of Service, so their API's will not support that."

Downloading videos for streaming services makes them cry, Not only Google, Netflix also hates people who go off the grid too. You should be online at all times and feed them data and money, and save your credit card details in-app, ready for compulsive buying. One day you'll be able to buy things while you sleep.

[+] IshKebab|3 years ago|reply
Can't you just submit a counter-notice for DMCA take-downs?
[+] grey_earthling|3 years ago|reply
> has essentially been erased from the internet

> This post is a cry for help to Google to stand up for smaller web developers

You perceive Google removing you from their Search service as being essentially erased from the internet, which means you understand they're effectively a monopoly.

And when they use that monopoly power against you, your response is to… beg them for mercy?

Not even a little questioning their monopoly status, as a treat?

It's fair enough to argue your case that you didn't break the rules. It just seems weirdly sinister to not even mention that your fundamental problem here is that the rules are capriciously enforced by what authors in the 1990s would have considered “a bit farfetched even for a hypercapitalist dystopia”.

[+] data_maan|3 years ago|reply
When I search for "Kapwing" it appears in my searches (the post says it doesn't).

Does this mean that after a mere 3 hours Google reacted already?

This would again point to the highly asymmetrical balance of power where those that succeed in making themselves heard publicly (e.g. by hitting HN front page - not so easy, see my own submissions) get their problems fixes by the internet big ones, while those that don't are left to rot in obscurity. #regulateSiliconValley

[+] maven29|3 years ago|reply
It doesn't look like Giphy actually downloads from youtube, it seems like it does a lookup in their content library using the video page metadata.