Revolut says that in less than a year it’s managed to slash its [code generation] costs by roughly 90 percent by making self-hosted models its default instead of relying primarily on commercial services like Claude.
Revolut says that in less than a year it’s managed to slash its [code generation] costs by roughly 90 percent by making self-hosted models its default instead of relying primarily on commercial services like Claude.
And ethically trained. People should be financially compensated if their data was used to train AI without their consent.
I don’t think it’s really possible to do this.
I mean speaking just logistically, how would you determine who gets how much? If it’s based on quality, how do you determine what is of high quality? Otherwise, does everyone who has every written anything that finds its way into a training dataset get like a tenth of a cent?
Alternative proposal: all AI models must be released as open weights, available to everyone.
AI, through its use of training data, has benefited from the sum total of human knowledge, therefore the results of this training should be given back for the use of all humanity.
That seems fair to me.
Not only open weight, but the dataset used should also be public.
This is also my opinion. I always advocate for putting GenAI models under UNESCO stewardship, because they are a snapshot of all digital, cultural output the world has to offer, and therefor they aren’t less important than physical cultural artifacts. Free personal use, licensed use for commercial usage, with lower prices for educational/nongovernmental organisations. Use the funding to provide grants to the arts in a large scale.
Holy shit! What an excellent idea.
As now will I.
You are right if we look at it short term, long term llm will be replaced with the next thing and who knows maybe it can be trained ethically, at least we should require research into it.
Why not? Both parties have to figure out how much they want to pay or to get payed. Similar like it works for any other license like on Netflix or Spotify. It is not the AI companies job to determine how much they will get payed but how much the data is worth to them and the data creator how much they want.
If i am at a bakery and the bread they offer does not look like its for that much to me then i have not to buy it.
How do you suggest an individual should go about this?
Do I go down to my local courthouse and file a suit against Anthropic so I can ask the judge to subpoena them to determine if my Reddit shitpost from 2012 is in their training set?
Class action lawsuits. How would something like this work for anything else? Like Netflix subscription violations?
And we are talking about meaningful data not your shitpost, like licensed code or a book you wrote and anthropic pirated.
Ah ha! You see, that’s the problem. My shitpost is meaningful data. This is something people seem to have a really hard time understanding. Scaling laws and the size of the search space in AI training means that the datum is not valuable. It’s only the data (in conglomerate) that is value for training, and my shitpost would be a part of that.
Once you understand this, you should see what I meant when I said it’s not feasible. How do you determine and then fairly distribute the payout to everyone who has ever written or recorded anything in digital format? This is not a simple supply vs demand equation, like your bakery example assumes.
Also I have no idea what Netflix has to do with this discussion.
No. Meaningful in the sense of copyright. Data you get copyright
There you got your distinction.
Copyright isn’t something you “get.” It’s something that comes with the production, no extra steps required.
You’ve accidentally come upon the other reason why your example doesn’t hold in the training data case. How do you suss out who actually holds the copyright on that data.
Take my shitpost for example. Whonis the copyright holder? Me the author? Reddit the platform I published on? What if the source was an Internet Archive snapshot?
Do you earnestly believe this could work in practice?
When i write a sentence then do i have a copyright upon it which i can defend in law? No. Yes copyright is nothing you get, that in theory is correct but in practice a sentence or few lines of code don’t let me fight for them in court.
The current models are all trained with data which at least some larger creator (book writer or whatever) does not want a model to be trained on. So the discussion is a complete other, not how ppl will be compensated on their unlawful use of their data but on how the payment works in the future and here comes my first comment back.
The current models are under the current law unsustainable. And more and more courts rule in this direction.
That soup is already cooked. And obtaining consent is prohibitive, so your data set will be tiny.
Open weight models cannot do this, they do not have any funding. If you demand this, you are just demanding that there will never be any open models, that proprietary AI models controlled by massive trillion dollar corporations will be the only models available, and frankly the cure is worse than the disease.
It’s also impractical, like closing the gate after the horses have already gone. Open-weight, unethically trained models are already out there. They are not going away. You cannot put the genie back in the bottle. They will never earn any money, so they will never be able to compensate for the training that was done to create them, unless you consider the fact that they exist, and they are open to anybody, as at least some measure of compensation.
It’s not enough compensation, but it is something. The training was certainly unethical, but so is an economic system that requires intellectual property to be transactional. Why fix one unethical thing while keeping and reinforcing another?
The only sensible and reasonable way to resolve the issue in the long term is for significant government support and patronage of the arts and content creators (and ideally all people) to be established. People who do this for a living are providing valuable service to all of humanity and that deserves to be recognized not by transactional, metered capitalism that defines each piece of art or content in terms of its raw economic value (a system easily and frequently corrupted anyway if you look at the prevalence of theft, forgery, fraud and money-laundering in the high art world), but by guaranteeing a comfortable and dignified life that allows creative people to freely create the art or other works they love and feel passionate about without worrying that they’re going to starve to death or be forced into a dead-end job if they’re not economically successful.