Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. So, more #genAI pain.

So, more #genAI pain.

Scheduled Pinned Locked Moved Uncategorized
genai
30 Posts 20 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • timbray@cosocial.caT This user is from outside of this forum
    timbray@cosocial.caT This user is from outside of this forum
    timbray@cosocial.ca
    wrote last edited by
    #1

    So, more #genAI pain. By and large, the bubble's a bubble because the number of people out there in the business community who like it enough to be willing to pay for zillions of tokens, in aggregate trillions of dollars, is pretty small despite frantic pushing, and thus eventually it all pops.

    There is an exception…

    timbray@cosocial.caT 1 Reply Last reply
    0
    • timbray@cosocial.caT timbray@cosocial.ca

      So, more #genAI pain. By and large, the bubble's a bubble because the number of people out there in the business community who like it enough to be willing to pay for zillions of tokens, in aggregate trillions of dollars, is pretty small despite frantic pushing, and thus eventually it all pops.

      There is an exception…

      timbray@cosocial.caT This user is from outside of this forum
      timbray@cosocial.caT This user is from outside of this forum
      timbray@cosocial.ca
      wrote last edited by
      #2

      And, that's the software dev community, where (whether you like it or not) there are many people who are willing to spend, in aggregate, (a small number of) billions of dollars.

      So, the investor community looks at that, gets dollar signs in their eyes, and says “Software is hard and GenAI is doing great there, so the rest of the world will pick it up, fer sure. Take my money, Sam!”

      Except for…

      timbray@cosocial.caT 1 Reply Last reply
      0
      • timbray@cosocial.caT timbray@cosocial.ca

        And, that's the software dev community, where (whether you like it or not) there are many people who are willing to spend, in aggregate, (a small number of) billions of dollars.

        So, the investor community looks at that, gets dollar signs in their eyes, and says “Software is hard and GenAI is doing great there, so the rest of the world will pick it up, fer sure. Take my money, Sam!”

        Except for…

        timbray@cosocial.caT This user is from outside of this forum
        timbray@cosocial.caT This user is from outside of this forum
        timbray@cosocial.ca
        wrote last edited by
        #3

        The software-dev community is many orders of magnitude too small to keep the bubble inflated.

        And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

        So…

        timbray@cosocial.caT bms48@mastodon.socialB cratermoon@zirk.usC warrengallagher@cosocial.caW 4 Replies Last reply
        0
        • timbray@cosocial.caT timbray@cosocial.ca

          The software-dev community is many orders of magnitude too small to keep the bubble inflated.

          And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

          So…

          timbray@cosocial.caT This user is from outside of this forum
          timbray@cosocial.caT This user is from outside of this forum
          timbray@cosocial.ca
          wrote last edited by
          #4

          So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

          Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

          guillaumerossolini@infosec.exchangeG virtuous_sloth@cosocial.caV brandonscript@appdot.netB worik@mastodon.socialW kurt@mastodon.nelson.funK 13 Replies Last reply
          0
          • timbray@cosocial.caT timbray@cosocial.ca

            So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

            Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

            guillaumerossolini@infosec.exchangeG This user is from outside of this forum
            guillaumerossolini@infosec.exchangeG This user is from outside of this forum
            guillaumerossolini@infosec.exchange
            wrote last edited by
            #5

            @timbray I wish the ethics of this were that easy, but you’re probably right

            1 Reply Last reply
            0
            • timbray@cosocial.caT timbray@cosocial.ca

              So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

              Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

              virtuous_sloth@cosocial.caV This user is from outside of this forum
              virtuous_sloth@cosocial.caV This user is from outside of this forum
              virtuous_sloth@cosocial.ca
              wrote last edited by
              #6

              @timbray Not to mention what happens when they finally decide to raise the token price to reflect all-in costs, including capital depreciation.

              bflipp@vmst.ioB 1 Reply Last reply
              0
              • timbray@cosocial.caT timbray@cosocial.ca

                So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                brandonscript@appdot.netB This user is from outside of this forum
                brandonscript@appdot.netB This user is from outside of this forum
                brandonscript@appdot.net
                wrote last edited by
                #7

                @timbray weirdly I think contract law might also succeed for the same reason. Small market also.

                ibboard@hachyderm.ioI 1 Reply Last reply
                0
                • timbray@cosocial.caT timbray@cosocial.ca

                  So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                  Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                  worik@mastodon.socialW This user is from outside of this forum
                  worik@mastodon.socialW This user is from outside of this forum
                  worik@mastodon.social
                  wrote last edited by
                  #8

                  @timbray I'm not feeling guilty.

                  My budget is US$10/month. I get a lot for that.

                  1 Reply Last reply
                  0
                  • virtuous_sloth@cosocial.caV virtuous_sloth@cosocial.ca

                    @timbray Not to mention what happens when they finally decide to raise the token price to reflect all-in costs, including capital depreciation.

                    bflipp@vmst.ioB This user is from outside of this forum
                    bflipp@vmst.ioB This user is from outside of this forum
                    bflipp@vmst.io
                    wrote last edited by
                    #9

                    @virtuous_sloth @timbray

                    Claude Code itself works really well against local models if you have the hardware to run something in the 30b parameter range. And hey it's already been open sourced so when Anthropic ceases to exist the agent will still be around in some form.

                    timbray@cosocial.caT 1 Reply Last reply
                    0
                    • timbray@cosocial.caT timbray@cosocial.ca

                      The software-dev community is many orders of magnitude too small to keep the bubble inflated.

                      And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

                      So…

                      bms48@mastodon.socialB This user is from outside of this forum
                      bms48@mastodon.socialB This user is from outside of this forum
                      bms48@mastodon.social
                      wrote last edited by
                      #10

                      @timbray disclaimer: not necessarily if a genuine innovation may be about to happen, or in a brand new language dialect, in which case LLMs are mostly useless anyway due to their mean reversion effects.

                      1 Reply Last reply
                      0
                      • timbray@cosocial.caT timbray@cosocial.ca

                        The software-dev community is many orders of magnitude too small to keep the bubble inflated.

                        And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

                        So…

                        cratermoon@zirk.usC This user is from outside of this forum
                        cratermoon@zirk.usC This user is from outside of this forum
                        cratermoon@zirk.us
                        wrote last edited by
                        #11

                        @timbray programming tools were barely profitable back when people paid serious money for compilers, IDEs, and related tools.

                        1 Reply Last reply
                        0
                        • timbray@cosocial.caT timbray@cosocial.ca

                          The software-dev community is many orders of magnitude too small to keep the bubble inflated.

                          And in fact #genAI works way better on code than on actual human language. Because the vocabulary is so much smaller and “doing the same as everyone else already has” is actually a good engineering practice.

                          So…

                          warrengallagher@cosocial.caW This user is from outside of this forum
                          warrengallagher@cosocial.caW This user is from outside of this forum
                          warrengallagher@cosocial.ca
                          wrote last edited by
                          #12

                          @timbray I think that another major reason why this works for software is that there are tools to help determine if it is correct. Compilers, linters, static analysis and tests. Harder to apply to domains that don’t have these kind of checks.

                          1 Reply Last reply
                          0
                          • timbray@cosocial.caT timbray@cosocial.ca

                            So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                            Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                            kurt@mastodon.nelson.funK This user is from outside of this forum
                            kurt@mastodon.nelson.funK This user is from outside of this forum
                            kurt@mastodon.nelson.fun
                            wrote last edited by
                            #13

                            @timbray but what if my employer is the one spending $400 on my tokens a month?

                            1 Reply Last reply
                            0
                            • bflipp@vmst.ioB bflipp@vmst.io

                              @virtuous_sloth @timbray

                              Claude Code itself works really well against local models if you have the hardware to run something in the 30b parameter range. And hey it's already been open sourced so when Anthropic ceases to exist the agent will still be around in some form.

                              timbray@cosocial.caT This user is from outside of this forum
                              timbray@cosocial.caT This user is from outside of this forum
                              timbray@cosocial.ca
                              wrote last edited by
                              #14

                              @bflipp @virtuous_sloth I'm curious: What kind of hardware is that?

                              bflipp@vmst.ioB 1 Reply Last reply
                              0
                              • timbray@cosocial.caT timbray@cosocial.ca

                                So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                                Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                                adrianco@mastodon.socialA This user is from outside of this forum
                                adrianco@mastodon.socialA This user is from outside of this forum
                                adrianco@mastodon.social
                                wrote last edited by
                                #15

                                @timbray I do think there is a bubble that will pop, but I also think that useful AI is already escaping from the dev community via tooling like OpenClaw that is taking off and using lots of tokens automating tasks for people.

                                andrewt@mathstodon.xyzA 1 Reply Last reply
                                0
                                • timbray@cosocial.caT timbray@cosocial.ca

                                  So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                                  Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                                  evan@cosocial.caE This user is from outside of this forum
                                  evan@cosocial.caE This user is from outside of this forum
                                  evan@cosocial.ca
                                  wrote last edited by
                                  #16

                                  @timbray So, if it's real value that people are willing to pay for, is it a bubble? Or a business?

                                  I guess if software developers are paying enough that investors think it's interesting, but not enough to pay the expenses, and not by a large margin, that's probably a bubble.

                                  timbray@cosocial.caT 1 Reply Last reply
                                  0
                                  • evan@cosocial.caE evan@cosocial.ca

                                    @timbray So, if it's real value that people are willing to pay for, is it a bubble? Or a business?

                                    I guess if software developers are paying enough that investors think it's interesting, but not enough to pay the expenses, and not by a large margin, that's probably a bubble.

                                    timbray@cosocial.caT This user is from outside of this forum
                                    timbray@cosocial.caT This user is from outside of this forum
                                    timbray@cosocial.ca
                                    wrote last edited by
                                    #17

                                    @evan depends how many people are willing to pay, I guess.

                                    evan@cosocial.caE 1 Reply Last reply
                                    0
                                    • timbray@cosocial.caT timbray@cosocial.ca

                                      @evan depends how many people are willing to pay, I guess.

                                      evan@cosocial.caE This user is from outside of this forum
                                      evan@cosocial.caE This user is from outside of this forum
                                      evan@cosocial.ca
                                      wrote last edited by
                                      #18

                                      @timbray Right. If revenue is only 0.5% of expenses, or even 5%, there's no way that unit economics can be tuned to make a profit. But if it's 50%, say, I think the traditional VC idea is to keep funding it, and then make it pay well in the future. I don't know if those percentages are anywhere near accurate, btw.

                                      virtuous_sloth@cosocial.caV 1 Reply Last reply
                                      0
                                      • timbray@cosocial.caT timbray@cosocial.ca

                                        So those of you who are burning millions of tokens on Claude Code should probably be aware that you’re one of the few remaining forces inflating the bubble.

                                        Whatever, it’ll pop anyhow, the #genAI space will become a tiny, mostly open-source, fraction of what it is today, and at that point. we devs can use it without feeling guilty.

                                        jannem@fosstodon.orgJ This user is from outside of this forum
                                        jannem@fosstodon.orgJ This user is from outside of this forum
                                        jannem@fosstodon.org
                                        wrote last edited by
                                        #19

                                        @timbray
                                        I do see some other clearly useful, clearly worth paying for use cases at work. We're a multilingual environment, and translation is if anything more of a killer app than coding. A large fraction of the entire workplace already uses it, and there's a clear business case for paying for it.

                                        1 Reply Last reply
                                        0
                                        • evan@cosocial.caE evan@cosocial.ca

                                          @timbray Right. If revenue is only 0.5% of expenses, or even 5%, there's no way that unit economics can be tuned to make a profit. But if it's 50%, say, I think the traditional VC idea is to keep funding it, and then make it pay well in the future. I don't know if those percentages are anywhere near accurate, btw.

                                          virtuous_sloth@cosocial.caV This user is from outside of this forum
                                          virtuous_sloth@cosocial.caV This user is from outside of this forum
                                          virtuous_sloth@cosocial.ca
                                          wrote last edited by
                                          #20

                                          @evan @timbray AI is the rare capital-intensive but also operationally-intensive industry!

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups