I think Reddit’s CEO is making a fool out of himself by how he’s managing this situation. I think however that the solution is very simple and straightforward.
Let’s start: I can understand that Reddit has costs to operate the platform. I also get that they don’t want big companies to abuse the API to train ML models and profit of it. Fair game!
But why not offer a generous free tier for regular users? Say, every user gets 500 free API calls per day. Regular users stay within the free tier, while big companies can’t do anything meaningful with only 500 calls per day (so they end up paying money).
Seems pretty straightforward to me. Everyone happy! Many other companies offer generous free-tiers for exactly this reason. Am I missing something?
I still believe that the ML companies “argument” is just a giant smokescreen. Reason is simple: ML companies can, and probably always have, just scrape the website. Why build an integration for every API under the sun if you can just build a web crawler once and be done? There are even existing, free implementations available so that’s an absolute no-brainer.
It’s about killing independent clients, nothing else.
Actually when I think about it you are absolutely right. The ML argument is complete bullshit. I mean to train a ML algorithm an API is nice but scraping should do just as fine. I don’t know how complicated the Reddit API is but you essentially need just GET so I guess not that much. How much time would a development team need to switch the implementation from API to scrape? A week? We’re in corporate world so let’s say a month with all the corporate bs around. That’s still nothing
I think Reddit’s CEO is making a fool out of himself by how he’s managing this situation. I think however that the solution is very simple and straightforward.
Let’s start: I can understand that Reddit has costs to operate the platform. I also get that they don’t want big companies to abuse the API to train ML models and profit of it. Fair game!
But why not offer a generous free tier for regular users? Say, every user gets 500 free API calls per day. Regular users stay within the free tier, while big companies can’t do anything meaningful with only 500 calls per day (so they end up paying money).
Seems pretty straightforward to me. Everyone happy! Many other companies offer generous free-tiers for exactly this reason. Am I missing something?
I still believe that the ML companies “argument” is just a giant smokescreen. Reason is simple: ML companies can, and probably always have, just scrape the website. Why build an integration for every API under the sun if you can just build a web crawler once and be done? There are even existing, free implementations available so that’s an absolute no-brainer.
It’s about killing independent clients, nothing else.
Actually when I think about it you are absolutely right. The ML argument is complete bullshit. I mean to train a ML algorithm an API is nice but scraping should do just as fine. I don’t know how complicated the Reddit API is but you essentially need just GET so I guess not that much. How much time would a development team need to switch the implementation from API to scrape? A week? We’re in corporate world so let’s say a month with all the corporate bs around. That’s still nothing
Maybe he’s so incompetent that he honestly doesn’t know that machine learning companies don’t need api access to do what they do