Vibe working is all about Office’s new Agent Mode.
  • InEnduringGrowStrong@sh.itjust.worksEnglish
    1031·
    2 months ago

    Microsoft says its Agent Mode in Excel has an accuracy rate of 57.2 percent in SpreadsheetBench, a benchmark for evaluating an AI model’s ability to edit real world spreadsheets.

    It generates 42.8% bullshit.

  • Fyrnyx@kbin.melroy.org
    32·
    2 months ago

    Oh it’s going to do it for Word too?

    Prompt: Termination letter telling my boss and bosses to kindly go fuck themselves and make it professional

    • calliope@retrolemmy.comEnglish
      9·
      2 months ago

      The best you can do in any job is to care as little about them as they care about you.

      They will barely read it, and they won’t care nearly as much as you do.

      I resign my position as a [position], effective [DATE].

  • supersquirrel@sopuli.xyzEnglish
    8·
    2 months ago

    So let me fast forward a bit, ->underpaid stressed out techworkers in the global south pretending to be AI for incompetent upper management in wealthy countries?

    • Fizz@lemmy.nzEnglish
      2·
      2 months ago

      Not related but does global south refer to south of the equator or just everything south of north America?

      • supersquirrel@sopuli.xyzEnglish
        2·
        2 months ago

        I don’t know if it is a perfect term, but it doesn’t literally refer to any specific “South”, rather I think it is a reference to the coincidence that many of the heavily industrialized empires of the 18th, 19th and 20th centuries have been in the northern hemisphere, and the general colonial power dynamic therein set up has lead to the term “Global South” meaning pretty much anywhere that has gotten the short end of the colonialism stick, vs the long end.

        https://en.m.wikipedia.org/wiki/Global_North_and_Global_South

    • Olap@lemmy.worldEnglish
      262·
      2 months ago

      LLMs can’t count. Can’t add. Can’t deal with actually large datasets

      How is excel a good fit for vibe-coding?

        • Olap@lemmy.worldEnglish
          21·
          2 months ago

          LLMs lose context over a short session. They all have input limits. Very small input limits usually. Best it can probably do is suggest formulas for you based on your natural language, maybe some copy/paste. Which means it can beat a 9 year old, great news everyone! Or show a help article on pivot tables (which the help function already does!)

          Excel is very simple to work with, hence its ubiquity. LLMs also get shit wrong about half the time, way more than half with difficult things ime. Meaning they cost experienced operators time, a few studies are showing this now with coding. And are expensive as fuck. And slow as fuck. And reduce capacity for learning. Meaning they actually cap what excel can achieve, as the user won’t grow at the same rate, renoving the one advantage excel actually has: the learning rate is phenomenal

          The C-Suite which insisted on this integration is basically an subservient idiot themselves at this stage who doesn’t understand their product, their market fit, or their userbase. They should replace thenselves with an LLM

        • Zos_Kia@lemmynsfw.comEnglish
          2·
          2 months ago

          The problem with being a pragmatic LLM user is that you have on one side corporate America shoe-horning the tech in mediocre products none wants, and on the other side a large portion of the internet who loathe it but don’t use it and don’t even know what it does. Those conversations never go anywhere man. You’re talking to someone who thinks accuracy of 57% on SpreadsheetBench means the model gives wrong answers 42% of the time.

          Hate to agree with Microsoft but yeah, Excel is probably a great place to introduce an LLM. It’s in that sweet spot between natural language and light programming, in an environment with math baked in so you don’t really care about the model’s accuracy or exact recall. All the data is here, and the model only has to manipulates cell numbers and writes formulas in this dumbed down language.

          I’m sure you can get away with pretty small models too. It doesn’t need super human knowledge to implement 90% of common Excel use cases, and i suspect in real world scenarios the accuracy must be pretty interesting.

    • jacksilver@lemmy.worldEnglish
      1·
      2 months ago

      It could be good to layer in standard machine learning (ML), and it already does have some features (like line of best fit).

      However, in today’s context AI means LLMs, and that is not a good fit due to its unpredictability.