Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

Scheduled Pinned Locked Moved Uncategorized
51 Posts 35 Posters 49 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

    When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

    I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

    ox1de@cyberplace.socialO This user is from outside of this forum
    ox1de@cyberplace.socialO This user is from outside of this forum
    ox1de@cyberplace.social
    wrote last edited by
    #20

    @neurovagrant i suspect we have two weak links now, great!

    1 Reply Last reply
    0
    • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

      When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

      I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

      kitkat_blue@mastodon.socialK This user is from outside of this forum
      kitkat_blue@mastodon.socialK This user is from outside of this forum
      kitkat_blue@mastodon.social
      wrote last edited by
      #21

      @neurovagrant

      :sigh: better than humans *again*!

      the end is nigh....

      (/s)

      1 Reply Last reply
      0
      • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

        When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

        I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

        cr0w@infosec.exchangeC This user is from outside of this forum
        cr0w@infosec.exchangeC This user is from outside of this forum
        cr0w@infosec.exchange
        wrote last edited by
        #22

        @neurovagrant

        massive bong rip

        Who decided to deploy the LLMs? It wasn't a computer...

        lerxst@az.socialL huronbikes@cyberplace.socialH 2 Replies Last reply
        0
        • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

          When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

          I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

          misusecase@twit.socialM This user is from outside of this forum
          misusecase@twit.socialM This user is from outside of this forum
          misusecase@twit.social
          wrote last edited by
          #23

          @neurovagrant To err is human, but to *really* agree things up you need a computer.

          1 Reply Last reply
          0
          • cr0w@infosec.exchangeC cr0w@infosec.exchange

            @neurovagrant

            massive bong rip

            Who decided to deploy the LLMs? It wasn't a computer...

            lerxst@az.socialL This user is from outside of this forum
            lerxst@az.socialL This user is from outside of this forum
            lerxst@az.social
            wrote last edited by
            #24

            @cR0w @neurovagrant
            Or *was* it? <dramatic music>

            cr0w@infosec.exchangeC 1 Reply Last reply
            0
            • lerxst@az.socialL lerxst@az.social

              @cR0w @neurovagrant
              Or *was* it? <dramatic music>

              cr0w@infosec.exchangeC This user is from outside of this forum
              cr0w@infosec.exchangeC This user is from outside of this forum
              cr0w@infosec.exchange
              wrote last edited by
              #25

              @lerxst @neurovagrant

              Link Preview Image
              1 Reply Last reply
              0
              • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                catavz@mastodon.socialC This user is from outside of this forum
                catavz@mastodon.socialC This user is from outside of this forum
                catavz@mastodon.social
                wrote last edited by
                #26

                @neurovagrant

                Link Preview Image
                1 Reply Last reply
                0
                • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                  When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                  I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                  lmk@infosec.exchangeL This user is from outside of this forum
                  lmk@infosec.exchangeL This user is from outside of this forum
                  lmk@infosec.exchange
                  wrote last edited by
                  #27

                  @neurovagrant Well we do have humans carelessly accepting AI submits without an review: one could consider them an even weaker chain.

                  1 Reply Last reply
                  0
                  • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                    When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                    I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                    starkrg@myside-yourside.netS This user is from outside of this forum
                    starkrg@myside-yourside.netS This user is from outside of this forum
                    starkrg@myside-yourside.net
                    wrote last edited by
                    #28

                    @neurovagrant It's still kind of a human's fault for installing that weak link. The weakest link are the c-suite making terrible decisions.

                    1 Reply Last reply
                    0
                    • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                      When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                      I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                      madengineering@mastodon.cloudM This user is from outside of this forum
                      madengineering@mastodon.cloudM This user is from outside of this forum
                      madengineering@mastodon.cloud
                      wrote last edited by
                      #29

                      @neurovagrant okay, now the weakest link is the human who decided "I think I'll outsource my work to a dumbass who's wrong about everything."

                      1 Reply Last reply
                      0
                      • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                        When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                        I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                        chasalin@mastodon.chasalin.nlC This user is from outside of this forum
                        chasalin@mastodon.chasalin.nlC This user is from outside of this forum
                        chasalin@mastodon.chasalin.nl
                        wrote last edited by
                        #30

                        @neurovagrant now the weakest link is the human who decided to implement AI.
                        So what's changed?

                        1 Reply Last reply
                        0
                        • phil@fed.bajsicki.comP phil@fed.bajsicki.com

                          @EndlessMason@hachyderm.io @neurovagrant@masto.deoan.org
                          Running Qwen3.5 on my 7900xtx eats as much power as running any video game. I have zero issue with running LLMs locally to assist with my journals/ notes. Nothing compared to a data center.

                          jae@mastodon.bsd.cafeJ This user is from outside of this forum
                          jae@mastodon.bsd.cafeJ This user is from outside of this forum
                          jae@mastodon.bsd.cafe
                          wrote last edited by
                          #31

                          @phil @neurovagrant @EndlessMason similar experience. humans can drive these models if they have a decent engineering/security understanding. i've got no issue with leveraging it to offload tedious tasks and operational burden.

                          but to your point on the human factor, there's been a lot of footgunning lately. even with principal staff getting lazy.

                          running models on a ada4000-20gb works pretty nicely and way less power use than a dc or some 5090 monster i need a new circuit for

                          phil@fed.bajsicki.comP 1 Reply Last reply
                          0
                          • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                            When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                            I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                            sarah@phpc.socialS This user is from outside of this forum
                            sarah@phpc.socialS This user is from outside of this forum
                            sarah@phpc.social
                            wrote last edited by
                            #32

                            @neurovagrant it still is the human. They just changed how they break things. Instead of breaking things themselves they trust a machine that does it.

                            1 Reply Last reply
                            0
                            • jae@mastodon.bsd.cafeJ jae@mastodon.bsd.cafe

                              @phil @neurovagrant @EndlessMason similar experience. humans can drive these models if they have a decent engineering/security understanding. i've got no issue with leveraging it to offload tedious tasks and operational burden.

                              but to your point on the human factor, there's been a lot of footgunning lately. even with principal staff getting lazy.

                              running models on a ada4000-20gb works pretty nicely and way less power use than a dc or some 5090 monster i need a new circuit for

                              phil@fed.bajsicki.comP This user is from outside of this forum
                              phil@fed.bajsicki.comP This user is from outside of this forum
                              phil@fed.bajsicki.com
                              wrote last edited by
                              #33

                              @jae@mastodon.bsd.cafe @neurovagrant@masto.deoan.org @EndlessMason@hachyderm.io
                              I just give the LLM some tools to read my journals, and then type my notes into my note git repo in a separate place.

                              https://codeberg.org/bajsicki/gptel-got

                              I've a bunch of re-writes locally, but they're not ready to be out in public yet until I test more and gain confidence.

                              jae@mastodon.bsd.cafeJ 1 Reply Last reply
                              0
                              • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                                When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                                I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                                neurovagrant@masto.deoan.orgN This user is from outside of this forum
                                neurovagrant@masto.deoan.orgN This user is from outside of this forum
                                neurovagrant@masto.deoan.org
                                wrote last edited by
                                #34

                                Thank you to everyone saying "it's still the human."

                                No, it isn't. It's product deployment without any concern for security or impact. This is the equivalent of suggesting every customer catch a falling knife, for their own benefit.

                                This is nondeterministic, autonomous malicious enablement, and we cannot blame the user as much as I'd like to.

                                jztusk@mastodon.socialJ tindrasgrove@infosec.exchangeT aeoncypher@lgbtqia.spaceA renardboy@mastodon.socialR 4 Replies Last reply
                                0
                                • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                                  When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                                  I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                                  tuban_muzuru@ohai.socialT This user is from outside of this forum
                                  tuban_muzuru@ohai.socialT This user is from outside of this forum
                                  tuban_muzuru@ohai.social
                                  wrote last edited by
                                  #35

                                  @neurovagrant

                                  Turns out the weakest link was just waiting for a better prompt.

                                  1 Reply Last reply
                                  0
                                  • phil@fed.bajsicki.comP phil@fed.bajsicki.com

                                    @jae@mastodon.bsd.cafe @neurovagrant@masto.deoan.org @EndlessMason@hachyderm.io
                                    I just give the LLM some tools to read my journals, and then type my notes into my note git repo in a separate place.

                                    https://codeberg.org/bajsicki/gptel-got

                                    I've a bunch of re-writes locally, but they're not ready to be out in public yet until I test more and gain confidence.

                                    jae@mastodon.bsd.cafeJ This user is from outside of this forum
                                    jae@mastodon.bsd.cafeJ This user is from outside of this forum
                                    jae@mastodon.bsd.cafe
                                    wrote last edited by
                                    #36

                                    @phil @neurovagrant @EndlessMason that's really clever. i had a pile of links from the last 2 years. dedupe + sort + relevance tagging took ~10 minutes which would have taken me a frustrating couple of days.

                                    i like how you're clear on the disclaimer. i've seen others tout their tool as "military-grade secure" and i fall back out of my chair

                                    1 Reply Last reply
                                    0
                                    • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                                      When I started in security, one of the prevailing attitudes was "The weakest link in the chain will always be the human."

                                      I would like to thank every LLM provider and startup for changing this paradigm by introducing a much weaker link in the chain.

                                      fennix@infosec.spaceF This user is from outside of this forum
                                      fennix@infosec.spaceF This user is from outside of this forum
                                      fennix@infosec.space
                                      wrote last edited by
                                      #37

                                      @neurovagrant

                                      It's still a human, it's just shifted to the decision-making ones that mandate use of these systems.

                                      1 Reply Last reply
                                      0
                                      • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                                        Thank you to everyone saying "it's still the human."

                                        No, it isn't. It's product deployment without any concern for security or impact. This is the equivalent of suggesting every customer catch a falling knife, for their own benefit.

                                        This is nondeterministic, autonomous malicious enablement, and we cannot blame the user as much as I'd like to.

                                        jztusk@mastodon.socialJ This user is from outside of this forum
                                        jztusk@mastodon.socialJ This user is from outside of this forum
                                        jztusk@mastodon.social
                                        wrote last edited by
                                        #38

                                        @neurovagrant

                                        I'd say it's still a human. But it's not the user, it's the product deployer.

                                        In my worldview, responsibility always, and only, lands on humans

                                        1 Reply Last reply
                                        0
                                        • neurovagrant@masto.deoan.orgN neurovagrant@masto.deoan.org

                                          Thank you to everyone saying "it's still the human."

                                          No, it isn't. It's product deployment without any concern for security or impact. This is the equivalent of suggesting every customer catch a falling knife, for their own benefit.

                                          This is nondeterministic, autonomous malicious enablement, and we cannot blame the user as much as I'd like to.

                                          tindrasgrove@infosec.exchangeT This user is from outside of this forum
                                          tindrasgrove@infosec.exchangeT This user is from outside of this forum
                                          tindrasgrove@infosec.exchange
                                          wrote last edited by
                                          #39

                                          @neurovagrant one of these days I need to sit down and write a blog post about how I have a blade that is cheap as hell, but more safe than any other blade I’ve owned, and how that relates to… everything.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups