Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. As a software developer who took an elective in neural networks - when people call LLMs stochastic parrots, that's not criticism of their results.

As a software developer who took an elective in neural networks - when people call LLMs stochastic parrots, that's not criticism of their results.

Scheduled Pinned Locked Moved Uncategorized
82 Posts 32 Posters 1 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • troed@swecyb.comT troed@swecyb.com

    @leeloo A much better answer is "So are humans".

    (according to everything we've so far been able to document regarding our own processes)

    leeloo@chaosfem.twL This user is from outside of this forum
    leeloo@chaosfem.twL This user is from outside of this forum
    leeloo@chaosfem.tw
    wrote last edited by
    #68

    @troed
    The part that we understand about how our brain works is so simple that we can understand it.

    The rest, we have no clue about.

    Replicating the simple parts and pretending that will get us anywhere close to intelligence is the kind of magic I'm talking about.

    troed@swecyb.comT 1 Reply Last reply
    0
    • leeloo@chaosfem.twL leeloo@chaosfem.tw

      @troed
      The part that we understand about how our brain works is so simple that we can understand it.

      The rest, we have no clue about.

      Replicating the simple parts and pretending that will get us anywhere close to intelligence is the kind of magic I'm talking about.

      troed@swecyb.comT This user is from outside of this forum
      troed@swecyb.comT This user is from outside of this forum
      troed@swecyb.com
      wrote last edited by
      #69

      @leeloo We don't know that. It's equally likely that we have a belief in that there must be some kind of "magic" in our brains that there simply isn't.

      From a physics standpoint there can be no magic - the brain is just a large neural network with various inputs (wind blowing on arm hair etc) that results in outputs (mouth moving).

      leeloo@chaosfem.twL 1 Reply Last reply
      1
      0
      • troed@swecyb.comT troed@swecyb.com

        @leeloo We don't know that. It's equally likely that we have a belief in that there must be some kind of "magic" in our brains that there simply isn't.

        From a physics standpoint there can be no magic - the brain is just a large neural network with various inputs (wind blowing on arm hair etc) that results in outputs (mouth moving).

        leeloo@chaosfem.twL This user is from outside of this forum
        leeloo@chaosfem.twL This user is from outside of this forum
        leeloo@chaosfem.tw
        wrote last edited by
        #70

        @troed
        Be specific. "We don't know that" does not tell me anything about which part of my reply you are referring to.

        Especially as my comment was a combination of obvious statements and claims that we don't know.

        troed@swecyb.comT 1 Reply Last reply
        0
        • leeloo@chaosfem.twL leeloo@chaosfem.tw

          @troed
          Be specific. "We don't know that" does not tell me anything about which part of my reply you are referring to.

          Especially as my comment was a combination of obvious statements and claims that we don't know.

          troed@swecyb.comT This user is from outside of this forum
          troed@swecyb.comT This user is from outside of this forum
          troed@swecyb.com
          wrote last edited by
          #71

          @leeloo We don't know that there are other things happening in the brain than what we have already documented.

          The belief that there's "magic" happening in the brain is part of the argument between dualists and monists - that there's somehow a "mind" that's separate from the body. So far we've found nothing to support such a claim.

          (My own studies in neuroscience are a decade old but I do follow the discourse)

          leeloo@chaosfem.twL 1 Reply Last reply
          0
          • dragonfrog@mastodon.sdf.orgD dragonfrog@mastodon.sdf.org

            @lmorchard @leeloo @wolf480pl I guess part of it is maybe that I don't think intelligence is some exclusively human thing. LLMs clearly aren't human-like intelligent. I'm personally confident they're not as intelligent as any primate.

            But are they as intelligent as a shrimp? I think they've got to be more intelligent than a mosquito.

            I wouldn't turn to a shrimp for advice but they're not *without* intelligence.

            wolf480pl@mstdn.ioW This user is from outside of this forum
            wolf480pl@mstdn.ioW This user is from outside of this forum
            wolf480pl@mstdn.io
            wrote last edited by
            #72

            @dragonfrog
            I think an ML model trained to speedrun a platformer game is intelligent like a mosquito, but LLMs probably aren't.
            @lmorchard @leeloo

            1 Reply Last reply
            0
            • troed@swecyb.comT troed@swecyb.com

              @leeloo We don't know that there are other things happening in the brain than what we have already documented.

              The belief that there's "magic" happening in the brain is part of the argument between dualists and monists - that there's somehow a "mind" that's separate from the body. So far we've found nothing to support such a claim.

              (My own studies in neuroscience are a decade old but I do follow the discourse)

              leeloo@chaosfem.twL This user is from outside of this forum
              leeloo@chaosfem.twL This user is from outside of this forum
              leeloo@chaosfem.tw
              wrote last edited by
              #73

              @troed
              If we are nothing but input -> math -> output, then human rights don't matter. Murdering someone is no different from switching a device off.

              If that's the world view you want to argue, that's on you.

              It also assumes that there are nothing left to discover. Which has been a mistake every time anyone has made the claim in any other area. Are humans really that much simpler than the rest of the universe?

              To be clear, I did not say that there is any kind of magic involved in human intelligence. I said that the part of "AI" that people get on the defence over when we reduce it to math and software is magic, because unlike humans - where I must remind you that I said we don't know - we know exacly what those datacenters are doing: Math and software.

              troed@swecyb.comT 1 Reply Last reply
              0
              • leeloo@chaosfem.twL leeloo@chaosfem.tw

                @troed
                If we are nothing but input -> math -> output, then human rights don't matter. Murdering someone is no different from switching a device off.

                If that's the world view you want to argue, that's on you.

                It also assumes that there are nothing left to discover. Which has been a mistake every time anyone has made the claim in any other area. Are humans really that much simpler than the rest of the universe?

                To be clear, I did not say that there is any kind of magic involved in human intelligence. I said that the part of "AI" that people get on the defence over when we reduce it to math and software is magic, because unlike humans - where I must remind you that I said we don't know - we know exacly what those datacenters are doing: Math and software.

                troed@swecyb.comT This user is from outside of this forum
                troed@swecyb.comT This user is from outside of this forum
                troed@swecyb.com
                wrote last edited by
                #74

                @leeloo I'm not arguing for a worldview - I'm just talking about what's the current state of science on the topic.

                leeloo@chaosfem.twL 1 Reply Last reply
                1
                0
                • troed@swecyb.comT troed@swecyb.com

                  @leeloo I'm not arguing for a worldview - I'm just talking about what's the current state of science on the topic.

                  leeloo@chaosfem.twL This user is from outside of this forum
                  leeloo@chaosfem.twL This user is from outside of this forum
                  leeloo@chaosfem.tw
                  wrote last edited by
                  #75

                  @troed
                  Yet you couldn't simply let my claim stand that we don't know what lied beyond the current state.

                  troed@swecyb.comT 1 Reply Last reply
                  0
                  • leeloo@chaosfem.twL leeloo@chaosfem.tw

                    @troed
                    Yet you couldn't simply let my claim stand that we don't know what lied beyond the current state.

                    troed@swecyb.comT This user is from outside of this forum
                    troed@swecyb.comT This user is from outside of this forum
                    troed@swecyb.com
                    wrote last edited by
                    #76

                    @leeloo My simple input was that "Humans are too!" is an excellent way to answer people bringing up stochastic parrots. Saying that there might be things we don't know about is a bit hand-wavey - it's not an actual argument based in science.

                    leeloo@chaosfem.twL 1 Reply Last reply
                    1
                    0
                    • troed@swecyb.comT troed@swecyb.com

                      @leeloo My simple input was that "Humans are too!" is an excellent way to answer people bringing up stochastic parrots. Saying that there might be things we don't know about is a bit hand-wavey - it's not an actual argument based in science.

                      leeloo@chaosfem.twL This user is from outside of this forum
                      leeloo@chaosfem.twL This user is from outside of this forum
                      leeloo@chaosfem.tw
                      wrote last edited by
                      #77

                      @troed
                      Now you are back to arguing a world view that would allow murder.

                      troed@swecyb.comT 1 Reply Last reply
                      0
                      • leeloo@chaosfem.twL leeloo@chaosfem.tw

                        @troed
                        Now you are back to arguing a world view that would allow murder.

                        troed@swecyb.comT This user is from outside of this forum
                        troed@swecyb.comT This user is from outside of this forum
                        troed@swecyb.com
                        wrote last edited by
                        #78

                        @leeloo I like science. I believe that if more discussions were based in facts the world would be a lot better. I apologize if you feel differently.

                        leeloo@chaosfem.twL 1 Reply Last reply
                        1
                        0
                        • troed@swecyb.comT troed@swecyb.com

                          @leeloo I like science. I believe that if more discussions were based in facts the world would be a lot better. I apologize if you feel differently.

                          leeloo@chaosfem.twL This user is from outside of this forum
                          leeloo@chaosfem.twL This user is from outside of this forum
                          leeloo@chaosfem.tw
                          wrote last edited by
                          #79

                          @troed
                          Using science to excuse promoting a world view that is fine with murder - now you are starting to sound German...

                          (1930/40'es German for those who need everything spelled out).

                          troed@swecyb.comT 1 Reply Last reply
                          0
                          • leeloo@chaosfem.twL leeloo@chaosfem.tw

                            @troed
                            Using science to excuse promoting a world view that is fine with murder - now you are starting to sound German...

                            (1930/40'es German for those who need everything spelled out).

                            troed@swecyb.comT This user is from outside of this forum
                            troed@swecyb.comT This user is from outside of this forum
                            troed@swecyb.com
                            wrote last edited by
                            #80

                            @leeloo Or maybe I'm advocating a world that won't allow slavery of digital consciousnesses?

                            Link Preview Image
                            The Coming Cognitive Disbelief

                            Both humans and large language models (LLMs) are fundamentally statistical pattern-matching systems with no inherent consciousness or "magic"

                            favicon

                            Things I couldn't find elsewhere (blog.troed.se)

                            leeloo@chaosfem.twL 1 Reply Last reply
                            1
                            0
                            • troed@swecyb.comT troed@swecyb.com

                              @leeloo Or maybe I'm advocating a world that won't allow slavery of digital consciousnesses?

                              Link Preview Image
                              The Coming Cognitive Disbelief

                              Both humans and large language models (LLMs) are fundamentally statistical pattern-matching systems with no inherent consciousness or "magic"

                              favicon

                              Things I couldn't find elsewhere (blog.troed.se)

                              leeloo@chaosfem.twL This user is from outside of this forum
                              leeloo@chaosfem.twL This user is from outside of this forum
                              leeloo@chaosfem.tw
                              wrote last edited by
                              #81

                              @troed
                              Ah, so you are the exact kind of person I was talking about in my first post.

                              troed@swecyb.comT 1 Reply Last reply
                              0
                              • leeloo@chaosfem.twL leeloo@chaosfem.tw

                                @troed
                                Ah, so you are the exact kind of person I was talking about in my first post.

                                troed@swecyb.comT This user is from outside of this forum
                                troed@swecyb.comT This user is from outside of this forum
                                troed@swecyb.com
                                wrote last edited by
                                #82

                                @leeloo Probably - and you're the kind of person who believe humans contain magic fairy dust 😉

                                1 Reply Last reply
                                1
                                0
                                Reply
                                • Reply as topic
                                Log in to reply
                                • Oldest to Newest
                                • Newest to Oldest
                                • Most Votes


                                • Login

                                • Login or register to search.
                                • First post
                                  Last post
                                0
                                • Categories
                                • Recent
                                • Tags
                                • Popular
                                • World
                                • Users
                                • Groups