LadyButterfly she/her@piefed.blahaj.zoneM to WomensStuff@piefed.blahaj.zoneEnglish · 5 days agoWhat do you think of AI?message-squaremessage-square58linkfedilinkarrow-up135arrow-down10
arrow-up135arrow-down1message-squareWhat do you think of AI?LadyButterfly she/her@piefed.blahaj.zoneM to WomensStuff@piefed.blahaj.zoneEnglish · 5 days agomessage-square58linkfedilink
minus-squareZDL@lazysoci.allinkfedilinkEnglisharrow-up1·4 days agoOf course all this will collapse when the bills come due and people have to pay the actual cost of LLM “tokens”. As users of Microsoft’s Copilot found out not long ago.
minus-squaresunbrrnslapper@lemmy.worldlinkfedilinkEnglisharrow-up1·4 days agoI mean, you can put caps on token usage at the user level. Also, you can test while building so you have an estimated cost per run.
minus-squareZDL@lazysoci.allinkfedilinkEnglisharrow-up1·4 days agoWhen you look at the costs involved, putting caps on means you run out of tokens in your first morning of use per month. The sticker shock for the Copilot users was a couple orders of magnitude.
minus-squaresunbrrnslapper@lemmy.worldlinkfedilinkEnglisharrow-up1·3 days agoWe capped everyone at $50/month. You can see how many tokens you use per task my typing /cost. Then you can manage it. I’m not sure I can justify those other people’s poor/stupid behavior.
Of course all this will collapse when the bills come due and people have to pay the actual cost of LLM “tokens”. As users of Microsoft’s Copilot found out not long ago.
I mean, you can put caps on token usage at the user level. Also, you can test while building so you have an estimated cost per run.
When you look at the costs involved, putting caps on means you run out of tokens in your first morning of use per month.
The sticker shock for the Copilot users was a couple orders of magnitude.
We capped everyone at $50/month. You can see how many tokens you use per task my typing /cost. Then you can manage it.
I’m not sure I can justify those other people’s poor/stupid behavior.