Just your typical internet guy with questionable humor

  • 100 Posts
  • 4.17K Comments
Joined 2 years ago
cake
Cake day: June 22nd, 2023

help-circle



  • Anthropic made lots of intriguing discoveries using this approach, not least of which is why LLMs are so terrible at basic mathematics. “Ask Claude to add 36 and 59 and the model will go through a series of odd steps, including first adding a selection of approximate values (add 40ish and 60ish, add 57ish and 36ish). Towards the end of its process, it comes up with the value 92ish. Meanwhile, another sequence of steps focuses on the last digits, 6 and 9, and determines that the answer must end in a 5. Putting that together with 92ish gives the correct answer of 95,” the MIT article explains.

    But here’s the really funky bit. If you ask Claude how it got the correct answer of 95, it will apparently tell you, “I added the ones (6+9=15), carried the 1, then added the 10s (3+5+1=9), resulting in 95.” But that actually only reflects common answers in its training data as to how the sum might be completed, as opposed to what it actually did.

    Another very surprising outcome of the research is the discovery that these LLMs do not, as is widely assumed, operate by merely predicting the next word. By tracing how Claude generated rhyming couplets, Anthropic found that it chose the rhyming word at the end of verses first, then filled in the rest of the line.













  • Open Veins of Latin America. Finished reading it today. It’s a 1973 book that explains some of the reasons for the massive underdevelopment of Latin American colonies. The general gist can be summed up as “it is a place full of riches, and the colonizers only want to extract everything and send it back to their masters” - that still applied to the industrialization efforts funded by foreign capital.

    Although Spain and Portugal were the nominal masters, they, too, were fucking themselves over with debts to Dutch and English bankers back in 16th and 17th centuries, not to mention bad trade deals, effectively killing their own industries and those of their colonies.

    EDIT: Galeano also exposed a lot of the shady deals made mainly by USA companies with governments in order to “develop” the southern countries, like ensuring that they’d get less taxes, better exchange prices and better credit options, that their goods would only be shipped by USA owned ships, etc. Not to mention that, during 1950-1970, the price of the commodities sold by Latin American countries kept falling (probably growing below inflation) and the income from the exports kept getting lower, despite larger volumes.





  • That murder-hobo part. I never really understood the expression.

    It stems from the typical RPG dungeon-raiding parties since the times of Dungeons and Dragons. You have a group of homeless people (hobos), traveling from place to place, killing (murder) almost everything that crosses their path in order to collect treasure.