• scruiser@awful.systems
    link
    fedilink
    English
    arrow-up
    2
    ·
    9 hours ago

    They’ve been talking about the recurrent layers… but my suspicion is that this “innovation” is to obfuscate “thinking” tokens/content instead of actually improving the model in any sort of useful way.

  • lurker@awful.systems
    link
    fedilink
    English
    arrow-up
    9
    ·
    18 hours ago

    Someone pointed out that on some tests, Astra is actually a regression from previous models. Totally AGI guys

    • scruiser@awful.systems
      link
      fedilink
      English
      arrow-up
      2
      ·
      9 hours ago

      Benchmaxxing for one set of benchmarks can actually degrade performance on other benchmarks. They’ve plateaued for a while, all they can do is scale inference compute up and down (at logarithmically poor rates of exchange) and trade performance in one area for performance in others

    • diz@awful.systems
      link
      fedilink
      English
      arrow-up
      5
      ·
      17 hours ago

      Yeah sloppers I know went from “see it proved new math! that totally clears us of plagiarism accusations we get when we repost that someone ai generated a frogger and a WoW clone” to “tried to use it for coding and it didn’t do a good job”.

      The math stuff is mostly using Lean proof verifier and all that, by the way, the only use of LLM that they found that is actually legit because it doesn’t matter if its slopping, and you want your attempts randomized.

  • lagoon8622@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    15
    ·
    1 day ago

    It’s so annoying, every time a new model comes out, the “thought leaders” on my team are always gushing about how they finally achieved AGI this time.

    This has been happening since GPT3. Every time. Right on schedule. They just regurgitate the ad copy.

    Of course none of them have any idea what the terms they’re using mean

  • Soyweiser@awful.systems
    link
    fedilink
    English
    arrow-up
    11
    ·
    2 days ago

    The finances must be really really bad.

    Also didn’t they define AGI as ‘it should be able to make x00 billion dollars’?