Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help.

LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help.

Scheduled Pinned Locked Moved Uncategorized
79 Posts 30 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

    LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help. It doesn’t know when it’s making stuff up, and it couldn’t change that even if you told it to. (In fact it’s always just making stuff up, and is only ever true by chance.)

    Part of why I’m so negative about them is that their advocates simply do not understand how they work and do not seem to want to.

    Link Preview Image
    Dare Obasanjo (@carnage4life@mas.to)

    Attached: 1 image Hallucinations are the bane of my existence when using Claude Code and that has significantly improved after adding the following instructions to my Claude .MD file. Sharing for anyone else who uses Claude as a daily driver for analysis and writing but has gotten frustrated by it making things up.

    favicon

    mas.to (mas.to)

    junkman@mastodon.socialJ This user is from outside of this forum
    junkman@mastodon.socialJ This user is from outside of this forum
    junkman@mastodon.social
    wrote last edited by
    #10

    @benjamineskola I don't partake on the LLM stuff but they've already proved some degree of usefulness.

    I don't think people in general would trust them with sensitive (health, well being) stuff but from what I hear, some people are very good at wielding it as a tool.

    I don't know how my car works, I'd be a terrible mechanic and racer. Still, it's very handy tool for me to move around.

    benjamineskola@hachyderm.ioB mushroom_man@infosec.exchangeM 3 Replies Last reply
    0
    • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

      LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help. It doesn’t know when it’s making stuff up, and it couldn’t change that even if you told it to. (In fact it’s always just making stuff up, and is only ever true by chance.)

      Part of why I’m so negative about them is that their advocates simply do not understand how they work and do not seem to want to.

      Link Preview Image
      Dare Obasanjo (@carnage4life@mas.to)

      Attached: 1 image Hallucinations are the bane of my existence when using Claude Code and that has significantly improved after adding the following instructions to my Claude .MD file. Sharing for anyone else who uses Claude as a daily driver for analysis and writing but has gotten frustrated by it making things up.

      favicon

      mas.to (mas.to)

      aedius@lavraievie.socialA This user is from outside of this forum
      aedius@lavraievie.socialA This user is from outside of this forum
      aedius@lavraievie.social
      wrote last edited by
      #11

      @benjamineskola

      That's funny when you explain to people how it really works, if they are not LLM advocates, they see exactly why it can't work.

      It's literally created with to make stuff up.

      benjamineskola@hachyderm.ioB sherapantsuit@mastodon.socialS 2 Replies Last reply
      0
      • junkman@mastodon.socialJ junkman@mastodon.social

        @benjamineskola I don't partake on the LLM stuff but they've already proved some degree of usefulness.

        I don't think people in general would trust them with sensitive (health, well being) stuff but from what I hear, some people are very good at wielding it as a tool.

        I don't know how my car works, I'd be a terrible mechanic and racer. Still, it's very handy tool for me to move around.

        benjamineskola@hachyderm.ioB This user is from outside of this forum
        benjamineskola@hachyderm.ioB This user is from outside of this forum
        benjamineskola@hachyderm.io
        wrote last edited by
        #12

        @junkman sorry, did I seem like I was interested in yet another defence of LLMs?

        junkman@mastodon.socialJ 1 Reply Last reply
        0
        • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

          LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help. It doesn’t know when it’s making stuff up, and it couldn’t change that even if you told it to. (In fact it’s always just making stuff up, and is only ever true by chance.)

          Part of why I’m so negative about them is that their advocates simply do not understand how they work and do not seem to want to.

          Link Preview Image
          Dare Obasanjo (@carnage4life@mas.to)

          Attached: 1 image Hallucinations are the bane of my existence when using Claude Code and that has significantly improved after adding the following instructions to my Claude .MD file. Sharing for anyone else who uses Claude as a daily driver for analysis and writing but has gotten frustrated by it making things up.

          favicon

          mas.to (mas.to)

          nelson@wetdry.worldN This user is from outside of this forum
          nelson@wetdry.worldN This user is from outside of this forum
          nelson@wetdry.world
          wrote last edited by
          #13

          @benjamineskola "hey convincing-bullshit-a-tron2000, i want you to stop making up bullshit when you answer to me"
          "ok"

          1 Reply Last reply
          0
          • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

            @junkman sorry, did I seem like I was interested in yet another defence of LLMs?

            junkman@mastodon.socialJ This user is from outside of this forum
            junkman@mastodon.socialJ This user is from outside of this forum
            junkman@mastodon.social
            wrote last edited by
            #14

            @benjamineskola nah, man. You do you, proceed with the dunking.

            1 Reply Last reply
            0
            • solonovamax@tech.lgbtS solonovamax@tech.lgbt

              @benjamineskola like, fundamentally it has no concept of truth so it cannot evaluate the truthiness of any statement

              nelson@wetdry.worldN This user is from outside of this forum
              nelson@wetdry.worldN This user is from outside of this forum
              nelson@wetdry.world
              wrote last edited by
              #15

              @solonovamax @benjamineskola i feel like it's more that it just wasn't built to give out answers, it was trained not to answer truthfully and "understand" but to just come up with something that sounds kind of convincing

              benjamineskola@hachyderm.ioB complexmath@hachyderm.ioC solonovamax@tech.lgbtS 3 Replies Last reply
              0
              • skotchygut@social.seattle.wa.usS skotchygut@social.seattle.wa.us

                @benjamineskola reminds me of meeting with the business side of my job and the marketing people keep thinking if they word the requirements juuuuust right suddenly I'll be able to do the impossible.

                aedius@lavraievie.socialA This user is from outside of this forum
                aedius@lavraievie.socialA This user is from outside of this forum
                aedius@lavraievie.social
                wrote last edited by
                #16

                @skotchygut @benjamineskola

                LLM are a Skinner Box.

                1 Reply Last reply
                0
                • aedius@lavraievie.socialA aedius@lavraievie.social

                  @benjamineskola

                  That's funny when you explain to people how it really works, if they are not LLM advocates, they see exactly why it can't work.

                  It's literally created with to make stuff up.

                  benjamineskola@hachyderm.ioB This user is from outside of this forum
                  benjamineskola@hachyderm.ioB This user is from outside of this forum
                  benjamineskola@hachyderm.io
                  wrote last edited by
                  #17

                  @Aedius yes, like... if you accept that this is just how they work, you might be able to use them productively for the limited tasks they're capable of doing at. But refusing to understand the way they work and then yelling at them about it is just embarrassing.

                  1 Reply Last reply
                  0
                  • nelson@wetdry.worldN nelson@wetdry.world

                    @solonovamax @benjamineskola i feel like it's more that it just wasn't built to give out answers, it was trained not to answer truthfully and "understand" but to just come up with something that sounds kind of convincing

                    benjamineskola@hachyderm.ioB This user is from outside of this forum
                    benjamineskola@hachyderm.ioB This user is from outside of this forum
                    benjamineskola@hachyderm.io
                    wrote last edited by
                    #18

                    @nelson @solonovamax no, it's not capable of understanding. it's not a thing that this sort of technology could do.

                    nelson@wetdry.worldN 1 Reply Last reply
                    0
                    • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

                      @nelson @solonovamax no, it's not capable of understanding. it's not a thing that this sort of technology could do.

                      nelson@wetdry.worldN This user is from outside of this forum
                      nelson@wetdry.worldN This user is from outside of this forum
                      nelson@wetdry.world
                      wrote last edited by
                      #19

                      @benjamineskola @solonovamax yeah it's just good at knowing what the next word is, so it can string something mathematically coherent

                      kind of like how "ai art" tends to be extremely generic looking because it quite literally aims to pick the most average in its dataset for a specific prompt

                      linkplay@biplus.socialL 1 Reply Last reply
                      0
                      • junkman@mastodon.socialJ junkman@mastodon.social

                        @benjamineskola I don't partake on the LLM stuff but they've already proved some degree of usefulness.

                        I don't think people in general would trust them with sensitive (health, well being) stuff but from what I hear, some people are very good at wielding it as a tool.

                        I don't know how my car works, I'd be a terrible mechanic and racer. Still, it's very handy tool for me to move around.

                        benjamineskola@hachyderm.ioB This user is from outside of this forum
                        benjamineskola@hachyderm.ioB This user is from outside of this forum
                        benjamineskola@hachyderm.io
                        wrote last edited by
                        #20

                        @junkman like in all seriousness it's fine to have some degree of missing knowledge about how your car works, but if you believe that it's capable of avoiding collisions by itself and your method of reducing collisions is just to ask it to try harder, you'd be a danger to yourself and others.

                        I'm not asking people to have deep knowledge of the mathematics behind LLMs, but I do expect people who are actively advocating their adoption not to make up outright fantasies about how they work.

                        1 Reply Last reply
                        0
                        • solonovamax@tech.lgbtS solonovamax@tech.lgbt

                          @benjamineskola like, fundamentally it has no concept of truth so it cannot evaluate the truthiness of any statement

                          michaelgemar@cosocial.caM This user is from outside of this forum
                          michaelgemar@cosocial.caM This user is from outside of this forum
                          michaelgemar@cosocial.ca
                          wrote last edited by
                          #21

                          @solonovamax @benjamineskola Exactly — IT DOESN’T THINK. It’s not a mind, but just a huge statistical matrix.

                          (And in top of that, don’t folks like this feel ashamed that their job has devolved to pleading with a mindless idiot genie, rather than writing deterministic code?)

                          benjamineskola@hachyderm.ioB mdione@en.osm.townM 2 Replies Last reply
                          0
                          • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

                            LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help. It doesn’t know when it’s making stuff up, and it couldn’t change that even if you told it to. (In fact it’s always just making stuff up, and is only ever true by chance.)

                            Part of why I’m so negative about them is that their advocates simply do not understand how they work and do not seem to want to.

                            Link Preview Image
                            Dare Obasanjo (@carnage4life@mas.to)

                            Attached: 1 image Hallucinations are the bane of my existence when using Claude Code and that has significantly improved after adding the following instructions to my Claude .MD file. Sharing for anyone else who uses Claude as a daily driver for analysis and writing but has gotten frustrated by it making things up.

                            favicon

                            mas.to (mas.to)

                            bloognoo@retro.pizzaB This user is from outside of this forum
                            bloognoo@retro.pizzaB This user is from outside of this forum
                            bloognoo@retro.pizza
                            wrote last edited by
                            #22

                            @benjamineskola
                            It's all halucinations, there's just a magical line where we don't mind the output on the one side and we do on the other. There is literally no distinction between the two

                            benjamineskola@hachyderm.ioB 1 Reply Last reply
                            0
                            • michaelgemar@cosocial.caM michaelgemar@cosocial.ca

                              @solonovamax @benjamineskola Exactly — IT DOESN’T THINK. It’s not a mind, but just a huge statistical matrix.

                              (And in top of that, don’t folks like this feel ashamed that their job has devolved to pleading with a mindless idiot genie, rather than writing deterministic code?)

                              benjamineskola@hachyderm.ioB This user is from outside of this forum
                              benjamineskola@hachyderm.ioB This user is from outside of this forum
                              benjamineskola@hachyderm.io
                              wrote last edited by
                              #23

                              @michaelgemar @solonovamax Yes precisely. An argument that a huge statistical matrix is useful for certain tasks is valid.

                              (I disagree. It seems bad at all the tasks people want to use it for, as well as wasteful and soul-destroying. But it’s at least valid.)

                              But pretending it’s doing something that it isn’t undermines any possibility of actual usefulness.

                              michaelgemar@cosocial.caM 1 Reply Last reply
                              0
                              • bloognoo@retro.pizzaB bloognoo@retro.pizza

                                @benjamineskola
                                It's all halucinations, there's just a magical line where we don't mind the output on the one side and we do on the other. There is literally no distinction between the two

                                benjamineskola@hachyderm.ioB This user is from outside of this forum
                                benjamineskola@hachyderm.ioB This user is from outside of this forum
                                benjamineskola@hachyderm.io
                                wrote last edited by
                                #24

                                @bloognoo yes, that’s exactly my point.

                                1 Reply Last reply
                                0
                                • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

                                  LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help. It doesn’t know when it’s making stuff up, and it couldn’t change that even if you told it to. (In fact it’s always just making stuff up, and is only ever true by chance.)

                                  Part of why I’m so negative about them is that their advocates simply do not understand how they work and do not seem to want to.

                                  Link Preview Image
                                  Dare Obasanjo (@carnage4life@mas.to)

                                  Attached: 1 image Hallucinations are the bane of my existence when using Claude Code and that has significantly improved after adding the following instructions to my Claude .MD file. Sharing for anyone else who uses Claude as a daily driver for analysis and writing but has gotten frustrated by it making things up.

                                  favicon

                                  mas.to (mas.to)

                                  gbargoud@masto.nycG This user is from outside of this forum
                                  gbargoud@masto.nycG This user is from outside of this forum
                                  gbargoud@masto.nyc
                                  wrote last edited by
                                  #25

                                  @benjamineskola

                                  Any LLM output that takes more than a few seconds of low mental effort to check (so anything more than a line or two of tab complete in a strongly typed coding language in an IDE with built in error underlining) makes me want to throw my computer out of the window.

                                  I don't know how some people use it to generate a whole paragraph let alone multiple.

                                  1 Reply Last reply
                                  0
                                  • michaelgemar@cosocial.caM michaelgemar@cosocial.ca

                                    @solonovamax @benjamineskola Exactly — IT DOESN’T THINK. It’s not a mind, but just a huge statistical matrix.

                                    (And in top of that, don’t folks like this feel ashamed that their job has devolved to pleading with a mindless idiot genie, rather than writing deterministic code?)

                                    mdione@en.osm.townM This user is from outside of this forum
                                    mdione@en.osm.townM This user is from outside of this forum
                                    mdione@en.osm.town
                                    wrote last edited by
                                    #26

                                    @michaelgemar @solonovamax @benjamineskola I'm trying to convert my suddenly boss obsessed with our overlords pushing AI down our throats to at least use AI not as process but to at least write crappy but deterministic code 😞

                                    1 Reply Last reply
                                    0
                                    • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

                                      @michaelgemar @solonovamax Yes precisely. An argument that a huge statistical matrix is useful for certain tasks is valid.

                                      (I disagree. It seems bad at all the tasks people want to use it for, as well as wasteful and soul-destroying. But it’s at least valid.)

                                      But pretending it’s doing something that it isn’t undermines any possibility of actual usefulness.

                                      michaelgemar@cosocial.caM This user is from outside of this forum
                                      michaelgemar@cosocial.caM This user is from outside of this forum
                                      michaelgemar@cosocial.ca
                                      wrote last edited by
                                      #27

                                      @benjamineskola @solonovamax I’m sure that there is genuine utility in LLMs and the newer approaches to AI in general. But too many people are being led astray by LLMs intentional appearance of mentality so that they interact with them as people, as having understanding. That is wrong and risks terrible errors in the final product.

                                      1 Reply Last reply
                                      0
                                      • aedius@lavraievie.socialA aedius@lavraievie.social

                                        @benjamineskola

                                        That's funny when you explain to people how it really works, if they are not LLM advocates, they see exactly why it can't work.

                                        It's literally created with to make stuff up.

                                        sherapantsuit@mastodon.socialS This user is from outside of this forum
                                        sherapantsuit@mastodon.socialS This user is from outside of this forum
                                        sherapantsuit@mastodon.social
                                        wrote last edited by
                                        #28

                                        @Aedius @benjamineskola language consists of two parts, the form and the sign

                                        the form is the "tangible" part of the language, e.g. this text, or whatever soundwave physics bullshit is happening when we talk

                                        the sign is the meaning, what you might visualize in your head when you read the word "cat"

                                        LLMs only have access to form, so when the meaning of text is important (read: always), LLMs are not very useful

                                        to this, promptfondlers always reply "but today is the worst it's ever gonna be"

                                        aedius@lavraievie.socialA 1 Reply Last reply
                                        0
                                        • benjamineskola@hachyderm.ioB benjamineskola@hachyderm.io

                                          @prietschka I do recall that a few weeks back he was complaining that LLM advocates get made to feel unwelcome on the fediverse. (OK? I don’t care. It’s nobody’s job to make people feel good about their bad opinions.)

                                          And then just a couple of days ago he was posting something critical, and like … yes this is what we’ve been saying all along.

                                          prietschka@mastodon.socialP This user is from outside of this forum
                                          prietschka@mastodon.socialP This user is from outside of this forum
                                          prietschka@mastodon.social
                                          wrote last edited by
                                          #29

                                          @benjamineskola The problem with Obasanjo is he's utterly unprincipled and just chasing engagement/self-aggrandizement. His purpose for being in social spaces like Masto/Bluesky/X is to stroke his ego, so everything he does is just an act of public masturbation.

                                          He's interested in self-aggrandizement and self-promotion, nothing more.

                                          Which is why I use the descriptor "piece of shit" with regard to him.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups