Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. So, something that's been bugging the shit out of me?

So, something that's been bugging the shit out of me?

Scheduled Pinned Locked Moved Uncategorized
74 Posts 32 Posters 2 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • munin@infosec.exchangeM This user is from outside of this forum
    munin@infosec.exchangeM This user is from outside of this forum
    munin@infosec.exchange
    wrote last edited by
    #1

    So, something that's been bugging the shit out of me?

    These fucking assholes who let LLMs run rampant and delete prod?

    They query the LLM for "why" it did that.

    This is delusional behavior.

    LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

    LLMs do not have the ability to have motivation. It is a machine.

    LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

    which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

    It cannot have a why;
    It cannot have a self to have motivations;
    And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

    Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

    Touch some grass and get a fucking therapist.

    munin@infosec.exchangeM J peter@thepit.socialP grumpusnation@mastodon.socialG beeoproblem@mastodon.gamedev.placeB 18 Replies Last reply
    3
    0
    • munin@infosec.exchangeM munin@infosec.exchange

      So, something that's been bugging the shit out of me?

      These fucking assholes who let LLMs run rampant and delete prod?

      They query the LLM for "why" it did that.

      This is delusional behavior.

      LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

      LLMs do not have the ability to have motivation. It is a machine.

      LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

      which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

      It cannot have a why;
      It cannot have a self to have motivations;
      And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

      Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

      Touch some grass and get a fucking therapist.

      munin@infosec.exchangeM This user is from outside of this forum
      munin@infosec.exchangeM This user is from outside of this forum
      munin@infosec.exchange
      wrote last edited by
      #2

      Also, putting as fine a fucking point on it as possible:

      if you do not have the fucking logs to figure out what the LLM "did"

      then you are incompetent and are not suited to build nor run the thing which you are trying to do.

      Get good, asshole. Take the time to learn the fucking skills.

      fayedrake@furry.engineerF 1 Reply Last reply
      0
      • munin@infosec.exchangeM munin@infosec.exchange

        So, something that's been bugging the shit out of me?

        These fucking assholes who let LLMs run rampant and delete prod?

        They query the LLM for "why" it did that.

        This is delusional behavior.

        LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

        LLMs do not have the ability to have motivation. It is a machine.

        LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

        which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

        It cannot have a why;
        It cannot have a self to have motivations;
        And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

        Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

        Touch some grass and get a fucking therapist.

        J This user is from outside of this forum
        J This user is from outside of this forum
        jackryder@infosec.exchange
        wrote last edited by
        #3

        @munin So many people fail to understand them at a functional level.

        They have uses, but they aren't some sentient oracle fulfilling humanities wishes.

        munin@infosec.exchangeM 1 Reply Last reply
        0
        • munin@infosec.exchangeM munin@infosec.exchange

          So, something that's been bugging the shit out of me?

          These fucking assholes who let LLMs run rampant and delete prod?

          They query the LLM for "why" it did that.

          This is delusional behavior.

          LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

          LLMs do not have the ability to have motivation. It is a machine.

          LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

          which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

          It cannot have a why;
          It cannot have a self to have motivations;
          And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

          Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

          Touch some grass and get a fucking therapist.

          peter@thepit.socialP This user is from outside of this forum
          peter@thepit.socialP This user is from outside of this forum
          peter@thepit.social
          wrote last edited by
          #4

          @munin but what if i have a hole through my head the diameter of a nickle? what am i supposed to do then??

          munin@infosec.exchangeM 1 Reply Last reply
          0
          • peter@thepit.socialP peter@thepit.social

            @munin but what if i have a hole through my head the diameter of a nickle? what am i supposed to do then??

            munin@infosec.exchangeM This user is from outside of this forum
            munin@infosec.exchangeM This user is from outside of this forum
            munin@infosec.exchange
            wrote last edited by
            #5

            @peter

            ask this dude https://en.wikipedia.org/wiki/Phineas_Gage

            1 Reply Last reply
            0
            • J jackryder@infosec.exchange

              @munin So many people fail to understand them at a functional level.

              They have uses, but they aren't some sentient oracle fulfilling humanities wishes.

              munin@infosec.exchangeM This user is from outside of this forum
              munin@infosec.exchangeM This user is from outside of this forum
              munin@infosec.exchange
              wrote last edited by
              #6

              @jackryder

              It does not help that the assholes shitting this toxin into the public sphere routinely and obviously lie about its capabilities.

              J walrus@toot.walesW 2 Replies Last reply
              0
              • munin@infosec.exchangeM munin@infosec.exchange

                So, something that's been bugging the shit out of me?

                These fucking assholes who let LLMs run rampant and delete prod?

                They query the LLM for "why" it did that.

                This is delusional behavior.

                LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

                LLMs do not have the ability to have motivation. It is a machine.

                LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

                which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

                It cannot have a why;
                It cannot have a self to have motivations;
                And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

                Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

                Touch some grass and get a fucking therapist.

                grumpusnation@mastodon.socialG This user is from outside of this forum
                grumpusnation@mastodon.socialG This user is from outside of this forum
                grumpusnation@mastodon.social
                wrote last edited by
                #7

                @munin <me staring at the cat> So, why'd you bite me, bro?
                cat: …
                me: I mean, that's really bleeding there…
                cat: …
                me: Like, I gotta get a bandage and everything…?
                cat: mrp?

                1 Reply Last reply
                0
                • munin@infosec.exchangeM munin@infosec.exchange

                  So, something that's been bugging the shit out of me?

                  These fucking assholes who let LLMs run rampant and delete prod?

                  They query the LLM for "why" it did that.

                  This is delusional behavior.

                  LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

                  LLMs do not have the ability to have motivation. It is a machine.

                  LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

                  which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

                  It cannot have a why;
                  It cannot have a self to have motivations;
                  And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

                  Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

                  Touch some grass and get a fucking therapist.

                  beeoproblem@mastodon.gamedev.placeB This user is from outside of this forum
                  beeoproblem@mastodon.gamedev.placeB This user is from outside of this forum
                  beeoproblem@mastodon.gamedev.place
                  wrote last edited by
                  #8

                  @munin I bet there are real logs to be grabbed from LLMs but they would look more like some kind of horrifically tangled node graph than anything readable by a normal human. I strongly doubt any AI company would actually allow users access to those kind of real debug logs from their models since that would be a goldmine for anyone looking to clone them.

                  munin@infosec.exchangeM 1 Reply Last reply
                  0
                  • beeoproblem@mastodon.gamedev.placeB beeoproblem@mastodon.gamedev.place

                    @munin I bet there are real logs to be grabbed from LLMs but they would look more like some kind of horrifically tangled node graph than anything readable by a normal human. I strongly doubt any AI company would actually allow users access to those kind of real debug logs from their models since that would be a goldmine for anyone looking to clone them.

                    munin@infosec.exchangeM This user is from outside of this forum
                    munin@infosec.exchangeM This user is from outside of this forum
                    munin@infosec.exchange
                    wrote last edited by
                    #9

                    @beeoproblem

                    I'm not talking about anything from the LLM provider's side.

                    I am talking about the end user here, who has failed to set up their environment properly with logging and monitoring implemented to understand what the fuck is going on in their own production environment.

                    beeoproblem@mastodon.gamedev.placeB 1 Reply Last reply
                    0
                    • munin@infosec.exchangeM munin@infosec.exchange

                      @jackryder

                      It does not help that the assholes shitting this toxin into the public sphere routinely and obviously lie about its capabilities.

                      J This user is from outside of this forum
                      J This user is from outside of this forum
                      jackryder@infosec.exchange
                      wrote last edited by
                      #10

                      @munin And absolutely are incentivized by doing it.

                      1 Reply Last reply
                      0
                      • munin@infosec.exchangeM munin@infosec.exchange

                        @beeoproblem

                        I'm not talking about anything from the LLM provider's side.

                        I am talking about the end user here, who has failed to set up their environment properly with logging and monitoring implemented to understand what the fuck is going on in their own production environment.

                        beeoproblem@mastodon.gamedev.placeB This user is from outside of this forum
                        beeoproblem@mastodon.gamedev.placeB This user is from outside of this forum
                        beeoproblem@mastodon.gamedev.place
                        wrote last edited by
                        #11

                        @munin fair. My point was somewhat tangential. The LLM providers most likely don't want to provide useful logs to the end user in the first place because of their paranoia about being reverse-engineered. End users are behind the 8 ball from the start.

                        IMO "Agentic" tools should be hurled into the sun. Not asked nicely "pweeze tell me why did you delete all the things?"

                        munin@infosec.exchangeM 1 Reply Last reply
                        0
                        • beeoproblem@mastodon.gamedev.placeB beeoproblem@mastodon.gamedev.place

                          @munin fair. My point was somewhat tangential. The LLM providers most likely don't want to provide useful logs to the end user in the first place because of their paranoia about being reverse-engineered. End users are behind the 8 ball from the start.

                          IMO "Agentic" tools should be hurled into the sun. Not asked nicely "pweeze tell me why did you delete all the things?"

                          munin@infosec.exchangeM This user is from outside of this forum
                          munin@infosec.exchangeM This user is from outside of this forum
                          munin@infosec.exchange
                          wrote last edited by
                          #12

                          @beeoproblem

                          they don't provide those because they don't have them.

                          look at the 'claude' leak: it is all vibed slop.

                          there are no logs. there is no human understanding of these systems. there is no intent or competence. it is all defective horseshit.

                          1 Reply Last reply
                          0
                          • munin@infosec.exchangeM munin@infosec.exchange

                            So, something that's been bugging the shit out of me?

                            These fucking assholes who let LLMs run rampant and delete prod?

                            They query the LLM for "why" it did that.

                            This is delusional behavior.

                            LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

                            LLMs do not have the ability to have motivation. It is a machine.

                            LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

                            which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

                            It cannot have a why;
                            It cannot have a self to have motivations;
                            And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

                            Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

                            Touch some grass and get a fucking therapist.

                            sinvega@mas.toS This user is from outside of this forum
                            sinvega@mas.toS This user is from outside of this forum
                            sinvega@mas.to
                            wrote last edited by
                            #13

                            @munin see also: "hallucinated". fucking STOP IT. It did not hallucinate anything it is not even remotely capable of thinking or imagining or understanding anything at all, ever, and never will be. It just regurgitates shit that looks statistically similar to the words you put in

                            I'm so tired of having to revise my expectations of people downwards AGAIN. I did not know a hole this deep was possible

                            theeclecticdyslexic@mstdn.socialT mkj@social.mkj.earthM 2 Replies Last reply
                            0
                            • sinvega@mas.toS sinvega@mas.to

                              @munin see also: "hallucinated". fucking STOP IT. It did not hallucinate anything it is not even remotely capable of thinking or imagining or understanding anything at all, ever, and never will be. It just regurgitates shit that looks statistically similar to the words you put in

                              I'm so tired of having to revise my expectations of people downwards AGAIN. I did not know a hole this deep was possible

                              theeclecticdyslexic@mstdn.socialT This user is from outside of this forum
                              theeclecticdyslexic@mstdn.socialT This user is from outside of this forum
                              theeclecticdyslexic@mstdn.social
                              wrote last edited by
                              #14

                              @sinvega

                              I like the term "bullshit" here. The LLM produces a series of symbols with no connection to the concept of meaning, mearely to statistical frequency. Whether the output is accurate or not provides no insight, because there was no intent. It is effectively as close to a philosophical zombie as we have come.

                              Any other interpretation is anthropomorphism all the way down.

                              It might get things correct, but this is the same way random pictures of clocks may show the right time.

                              @munin

                              rupert@mastodon.nzR sabik@rants.auS 2 Replies Last reply
                              0
                              • theeclecticdyslexic@mstdn.socialT theeclecticdyslexic@mstdn.social

                                @sinvega

                                I like the term "bullshit" here. The LLM produces a series of symbols with no connection to the concept of meaning, mearely to statistical frequency. Whether the output is accurate or not provides no insight, because there was no intent. It is effectively as close to a philosophical zombie as we have come.

                                Any other interpretation is anthropomorphism all the way down.

                                It might get things correct, but this is the same way random pictures of clocks may show the right time.

                                @munin

                                rupert@mastodon.nzR This user is from outside of this forum
                                rupert@mastodon.nzR This user is from outside of this forum
                                rupert@mastodon.nz
                                wrote last edited by
                                #15

                                @theeclecticdyslexic @sinvega @munin I like talking *about* bullshit, especially when you tell people you mean in the sense coined by Harry Frankfurt in his 1986 paper, and they look at you like this is an example, isn't it?

                                1 Reply Last reply
                                0
                                • munin@infosec.exchangeM munin@infosec.exchange

                                  So, something that's been bugging the shit out of me?

                                  These fucking assholes who let LLMs run rampant and delete prod?

                                  They query the LLM for "why" it did that.

                                  This is delusional behavior.

                                  LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

                                  LLMs do not have the ability to have motivation. It is a machine.

                                  LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

                                  which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

                                  It cannot have a why;
                                  It cannot have a self to have motivations;
                                  And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

                                  Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

                                  Touch some grass and get a fucking therapist.

                                  arclight@oldbytes.spaceA This user is from outside of this forum
                                  arclight@oldbytes.spaceA This user is from outside of this forum
                                  arclight@oldbytes.space
                                  wrote last edited by
                                  #16

                                  @munin How did we get to the point of _asking_ the computer? You don't ask a computer, you tell it. You give it a command and it either succeeds or it fails or or it is broken. It's a complicated box of sand. There's no awareness, no spark, just an odd arrangement of doped silicon and metal. Believing there's more than that is deeply deeply delusional, like believing socks are sentient because you made a sock puppet once.

                                  crowbriarhexe@tech.lgbtC pikesley@mastodon.me.ukP smartmanapps@dotnet.socialS rubinjoni@mastodon.socialR 4 Replies Last reply
                                  0
                                  • munin@infosec.exchangeM munin@infosec.exchange

                                    So, something that's been bugging the shit out of me?

                                    These fucking assholes who let LLMs run rampant and delete prod?

                                    They query the LLM for "why" it did that.

                                    This is delusional behavior.

                                    LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

                                    LLMs do not have the ability to have motivation. It is a machine.

                                    LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

                                    which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

                                    It cannot have a why;
                                    It cannot have a self to have motivations;
                                    And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

                                    Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

                                    Touch some grass and get a fucking therapist.

                                    varpie@peculiar.floristV This user is from outside of this forum
                                    varpie@peculiar.floristV This user is from outside of this forum
                                    varpie@peculiar.florist
                                    wrote last edited by
                                    #17

                                    @munin Well... As you mentioned, each generation "reads the prompt and any cache, if they exist, from prior session", and since they were trained on "explaining" their previous outputs to sound like a relevant discussion, asking why a model gave a specific output isn't as stupid as you make it out to be, as it can give some input on the "thinking" part of the previous output that is usually not directly visible. That can then be used to tweak prompts and add some guardrails (even though there is a fairly long list of examples of guardrails not being fully effective). Of course, the first problem is giving access to prod to an unreliable system...

                                    1 Reply Last reply
                                    0
                                    • arclight@oldbytes.spaceA arclight@oldbytes.space

                                      @munin How did we get to the point of _asking_ the computer? You don't ask a computer, you tell it. You give it a command and it either succeeds or it fails or or it is broken. It's a complicated box of sand. There's no awareness, no spark, just an odd arrangement of doped silicon and metal. Believing there's more than that is deeply deeply delusional, like believing socks are sentient because you made a sock puppet once.

                                      crowbriarhexe@tech.lgbtC This user is from outside of this forum
                                      crowbriarhexe@tech.lgbtC This user is from outside of this forum
                                      crowbriarhexe@tech.lgbt
                                      wrote last edited by
                                      #18

                                      @arclight @munin Don’t drag Tubey into this 😭

                                      arclight@oldbytes.spaceA 1 Reply Last reply
                                      0
                                      • munin@infosec.exchangeM munin@infosec.exchange

                                        So, something that's been bugging the shit out of me?

                                        These fucking assholes who let LLMs run rampant and delete prod?

                                        They query the LLM for "why" it did that.

                                        This is delusional behavior.

                                        LLMs do not have a concept of 'why': they assemble a response based on a statistical sampling of likely continuations of the original prompt in their database.

                                        LLMs do not have the ability to have motivation. It is a machine.

                                        LLMs, further, function by instantiating a new runtime -for each query- that reads the prompt and any cache, if they exist, from prior sessions:

                                        which means, fundamentally, "asking" the LLM to explain "why" "it" did a thing is thrice-divorced from reality:

                                        It cannot have a why;
                                        It cannot have a self to have motivations;
                                        And the LLM you ask is not the one that did it, but is a new instance reading from its predecessors notes.

                                        Treating it as tho it is an entity with continuity of existence is fucking delusional and I am fucking sick of pandering to this horseshit.

                                        Touch some grass and get a fucking therapist.

                                        clarablackink@writing.exchangeC This user is from outside of this forum
                                        clarablackink@writing.exchangeC This user is from outside of this forum
                                        clarablackink@writing.exchange
                                        wrote last edited by
                                        #19

                                        @munin It seems to tie in which the trend that started awhile back (2016-2018) where people would respond to other people online by telling them to "go google it".

                                        It came from a place of frustration with reply guys but I think there was a cultural effect of people being told to fuck off and stop asking actual people questions.

                                        Curiosity deflected is often a social wound.

                                        Communities that handled dumb questions well always felt like places of refuge. Things shifted and it opened the door.

                                        clarablackink@writing.exchangeC 1 Reply Last reply
                                        0
                                        • clarablackink@writing.exchangeC clarablackink@writing.exchange

                                          @munin It seems to tie in which the trend that started awhile back (2016-2018) where people would respond to other people online by telling them to "go google it".

                                          It came from a place of frustration with reply guys but I think there was a cultural effect of people being told to fuck off and stop asking actual people questions.

                                          Curiosity deflected is often a social wound.

                                          Communities that handled dumb questions well always felt like places of refuge. Things shifted and it opened the door.

                                          clarablackink@writing.exchangeC This user is from outside of this forum
                                          clarablackink@writing.exchangeC This user is from outside of this forum
                                          clarablackink@writing.exchange
                                          wrote last edited by
                                          #20

                                          @munin Also, not arguing against anything you've said.

                                          Its been sad seeing different online places slowly give over the human side of the community to various resources that paved the way towards LLM dependence.

                                          I've been online since the 90s and folks have always had shitty moments but the outsourcing of community knowledge to google did seem to prime folks who are more vulnerable in ways that LLMs are calibrated to cater to.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups