Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. So, more #genAI pain.

So, more #genAI pain.

Scheduled Pinned Locked Moved Uncategorized
genai
30 Posts 20 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • timbray@cosocial.caT timbray@cosocial.ca

    And, that's the software dev community, where (whether you like it or not) there are many people who are willing to spend, in aggregate, (a small number of) billions of dollars.

    So, the investor community looks at that, gets dollar signs in their eyes, and says “Software is hard and GenAI is doing great there, so the rest of the world will pick it up, fer sure. Take my money, Sam!”

    Except for…

    timbray@cosocial.caT This user is from outside of this forum
    timbray@cosocial.caT This user is from outside of this forum
    timbray@cosocial.ca
    wrote last edited by
    #3

    The software-dev community is many orders of magnitude too small to keep the bubble inflated.

    And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

    So…

    timbray@cosocial.caT bms48@mastodon.socialB cratermoon@zirk.usC warrengallagher@cosocial.caW 4 Replies Last reply
    0
    • timbray@cosocial.caT timbray@cosocial.ca

      The software-dev community is many orders of magnitude too small to keep the bubble inflated.

      And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

      So…

      timbray@cosocial.caT This user is from outside of this forum
      timbray@cosocial.caT This user is from outside of this forum
      timbray@cosocial.ca
      wrote last edited by
      #4

      So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

      Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

      guillaumerossolini@infosec.exchangeG virtuous_sloth@cosocial.caV brandonscript@appdot.netB worik@mastodon.socialW kurt@mastodon.nelson.funK 13 Replies Last reply
      0
      • timbray@cosocial.caT timbray@cosocial.ca

        So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

        Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

        guillaumerossolini@infosec.exchangeG This user is from outside of this forum
        guillaumerossolini@infosec.exchangeG This user is from outside of this forum
        guillaumerossolini@infosec.exchange
        wrote last edited by
        #5

        @timbray I wish the ethics of this were that easy, but you’re probably right

        1 Reply Last reply
        0
        • timbray@cosocial.caT timbray@cosocial.ca

          So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

          Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

          virtuous_sloth@cosocial.caV This user is from outside of this forum
          virtuous_sloth@cosocial.caV This user is from outside of this forum
          virtuous_sloth@cosocial.ca
          wrote last edited by
          #6

          @timbray Not to mention what happens when they finally decide to raise the token price to reflect all-in costs, including capital depreciation.

          bflipp@vmst.ioB 1 Reply Last reply
          0
          • timbray@cosocial.caT timbray@cosocial.ca

            So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

            Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

            brandonscript@appdot.netB This user is from outside of this forum
            brandonscript@appdot.netB This user is from outside of this forum
            brandonscript@appdot.net
            wrote last edited by
            #7

            @timbray weirdly I think contract law might also succeed for the same reason. Small market also.

            ibboard@hachyderm.ioI 1 Reply Last reply
            0
            • timbray@cosocial.caT timbray@cosocial.ca

              So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

              Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

              worik@mastodon.socialW This user is from outside of this forum
              worik@mastodon.socialW This user is from outside of this forum
              worik@mastodon.social
              wrote last edited by
              #8

              @timbray I'm not feeling guilty.

              My budget is US$10/month. I get a lot for that.

              1 Reply Last reply
              0
              • virtuous_sloth@cosocial.caV virtuous_sloth@cosocial.ca

                @timbray Not to mention what happens when they finally decide to raise the token price to reflect all-in costs, including capital depreciation.

                bflipp@vmst.ioB This user is from outside of this forum
                bflipp@vmst.ioB This user is from outside of this forum
                bflipp@vmst.io
                wrote last edited by
                #9

                @virtuous_sloth @timbray

                Claude Code itself works really well against local models if you have the hardware to run something in the 30b parameter range. And hey it's already been open sourced so when Anthropic ceases to exist the agent will still be around in some form.

                timbray@cosocial.caT 1 Reply Last reply
                0
                • timbray@cosocial.caT timbray@cosocial.ca

                  The software-dev community is many orders of magnitude too small to keep the bubble inflated.

                  And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

                  So…

                  bms48@mastodon.socialB This user is from outside of this forum
                  bms48@mastodon.socialB This user is from outside of this forum
                  bms48@mastodon.social
                  wrote last edited by
                  #10

                  @timbray disclaimer: not necessarily if a genuine innovation may be about to happen, or in a brand new language dialect, in which case LLMs are mostly useless anyway due to their mean reversion effects.

                  1 Reply Last reply
                  0
                  • timbray@cosocial.caT timbray@cosocial.ca

                    The software-dev community is many orders of magnitude too small to keep the bubble inflated.

                    And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

                    So…

                    cratermoon@zirk.usC This user is from outside of this forum
                    cratermoon@zirk.usC This user is from outside of this forum
                    cratermoon@zirk.us
                    wrote last edited by
                    #11

                    @timbray programming tools were barely profitable back when people paid serious money for compilers, IDEs, and related tools.

                    1 Reply Last reply
                    0
                    • timbray@cosocial.caT timbray@cosocial.ca

                      The software-dev community is many orders of magnitude too small to keep the bubble inflated.

                      And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

                      So…

                      warrengallagher@cosocial.caW This user is from outside of this forum
                      warrengallagher@cosocial.caW This user is from outside of this forum
                      warrengallagher@cosocial.ca
                      wrote last edited by
                      #12

                      @timbray I think that another major reason why this works for software is that there are tools to help determine if it is correct. Compilers, linters, static analysis and tests. Harder to apply to domains that don’t have these kind of checks.

                      1 Reply Last reply
                      0
                      • timbray@cosocial.caT timbray@cosocial.ca

                        So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                        Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                        kurt@mastodon.nelson.funK This user is from outside of this forum
                        kurt@mastodon.nelson.funK This user is from outside of this forum
                        kurt@mastodon.nelson.fun
                        wrote last edited by
                        #13

                        @timbray but what if my employer is the one spending $400 on my tokens a month?

                        1 Reply Last reply
                        0
                        • bflipp@vmst.ioB bflipp@vmst.io

                          @virtuous_sloth @timbray

                          Claude Code itself works really well against local models if you have the hardware to run something in the 30b parameter range. And hey it's already been open sourced so when Anthropic ceases to exist the agent will still be around in some form.

                          timbray@cosocial.caT This user is from outside of this forum
                          timbray@cosocial.caT This user is from outside of this forum
                          timbray@cosocial.ca
                          wrote last edited by
                          #14

                          @bflipp @virtuous_sloth I'm curious: What kind of hardware is that?

                          bflipp@vmst.ioB 1 Reply Last reply
                          0
                          • timbray@cosocial.caT timbray@cosocial.ca

                            So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                            Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                            adrianco@mastodon.socialA This user is from outside of this forum
                            adrianco@mastodon.socialA This user is from outside of this forum
                            adrianco@mastodon.social
                            wrote last edited by
                            #15

                            @timbray I do think there is a bubble that will pop, but I also think that useful AI is already escaping from the dev community via tooling like OpenClaw that is taking off and using lots of tokens automating tasks for people.

                            andrewt@mathstodon.xyzA 1 Reply Last reply
                            0
                            • timbray@cosocial.caT timbray@cosocial.ca

                              So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                              Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                              evan@cosocial.caE This user is from outside of this forum
                              evan@cosocial.caE This user is from outside of this forum
                              evan@cosocial.ca
                              wrote last edited by
                              #16

                              @timbray So, if it's real value that people are willing to pay for, is it a bubble? Or a business?

                              I guess if software developers are paying enough that investors think it's interesting, but not enough to pay the expenses, and not by a large margin, that's probably a bubble.

                              timbray@cosocial.caT 1 Reply Last reply
                              0
                              • evan@cosocial.caE evan@cosocial.ca

                                @timbray So, if it's real value that people are willing to pay for, is it a bubble? Or a business?

                                I guess if software developers are paying enough that investors think it's interesting, but not enough to pay the expenses, and not by a large margin, that's probably a bubble.

                                timbray@cosocial.caT This user is from outside of this forum
                                timbray@cosocial.caT This user is from outside of this forum
                                timbray@cosocial.ca
                                wrote last edited by
                                #17

                                @evan depends how many people are willing to pay, I guess.

                                evan@cosocial.caE 1 Reply Last reply
                                0
                                • timbray@cosocial.caT timbray@cosocial.ca

                                  @evan depends how many people are willing to pay, I guess.

                                  evan@cosocial.caE This user is from outside of this forum
                                  evan@cosocial.caE This user is from outside of this forum
                                  evan@cosocial.ca
                                  wrote last edited by
                                  #18

                                  @timbray Right. If revenue is only 0.5% of expenses, or even 5%, there's no way that unit economics can be tuned to make a profit. But if it's 50%, say, I think the traditional VC idea is to keep funding it, and then make it pay well in the future. I don't know if those percentages are anywhere near accurate, btw.

                                  virtuous_sloth@cosocial.caV 1 Reply Last reply
                                  0
                                  • timbray@cosocial.caT timbray@cosocial.ca

                                    So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                                    Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                                    jannem@fosstodon.orgJ This user is from outside of this forum
                                    jannem@fosstodon.orgJ This user is from outside of this forum
                                    jannem@fosstodon.org
                                    wrote last edited by
                                    #19

                                    @timbray
                                    I do see some other clearly useful, clearly worth paying for use cases at work. We're a multilingual environment, and translation is if anything more of a killer app than coding. A large fraction of the entire workplace already uses it, and there's a clear business case for paying for it.

                                    1 Reply Last reply
                                    0
                                    • evan@cosocial.caE evan@cosocial.ca

                                      @timbray Right. If revenue is only 0.5% of expenses, or even 5%, there's no way that unit economics can be tuned to make a profit. But if it's 50%, say, I think the traditional VC idea is to keep funding it, and then make it pay well in the future. I don't know if those percentages are anywhere near accurate, btw.

                                      virtuous_sloth@cosocial.caV This user is from outside of this forum
                                      virtuous_sloth@cosocial.caV This user is from outside of this forum
                                      virtuous_sloth@cosocial.ca
                                      wrote last edited by
                                      #20

                                      @evan @timbray AI is the rare capital-intensive but also operationally-intensive industry!

                                      1 Reply Last reply
                                      0
                                      • timbray@cosocial.caT timbray@cosocial.ca

                                        So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                                        Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                                        hugoestr@functional.cafeH This user is from outside of this forum
                                        hugoestr@functional.cafeH This user is from outside of this forum
                                        hugoestr@functional.cafe
                                        wrote last edited by
                                        #21

                                        @timbray The bubble is all business. Investors will shutdown successful companies that make a nice 3 million a year because they decided that is the market and there is no growth.

                                        Even in software the rate of adoption is deceptive since there are mandates on using it coming from business leaders, many told my the same investors to create demand sort of like return to office

                                        1 Reply Last reply
                                        0
                                        • timbray@cosocial.caT timbray@cosocial.ca

                                          So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                                          Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                                          mason@partychickens.netM This user is from outside of this forum
                                          mason@partychickens.netM This user is from outside of this forum
                                          mason@partychickens.net
                                          wrote last edited by
                                          #22

                                          @timbray Getting away from guilt will be hard given the training data and the lack of regard for copyright and licenses. Anyway, free software depends on copyright being honored for its licenses to work. Bubble or not, there are some vicious legal gotchas in there. And even small-scale use makes the climate crisis worse. It was already bad before this craze.

                                          I'm not seeing a bright future for the stuff.

                                          Happily, I love coding, so a lack of chatbot aid won't phase me. Not using it now, won't miss it tomorrow.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups