Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. My first job was building out the first mega-datacenters.

My first job was building out the first mega-datacenters.

Scheduled Pinned Locked Moved Uncategorized
37 Posts 26 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • cwebber@social.coopC cwebber@social.coop

    My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.

    And so it is with some significant expertise that I say:

    Fuck datacenters. Datacenters are an anti-pattern.

    dianea@lgbtqia.spaceD This user is from outside of this forum
    dianea@lgbtqia.spaceD This user is from outside of this forum
    dianea@lgbtqia.space
    wrote last edited by
    #10

    @cwebber

    I spent half my career maintaining plastics manufacturing plants. I learned about what effects that had on the environment, so I started maintaining food production plants. Yeah, highly processed foods. So, I'm now working with very low energy electronics. Hopefully, a few electrons might be less damaging to our future...

    1 Reply Last reply
    0
    • cwebber@social.coopC cwebber@social.coop

      Working in that environment, seeing as Google rolled out the idea of "cloud computing" meaning "you have no involvement or agency in your computing because we do it for you" radicalized me for much of the work of my career.

      It was one thing to run a datacenter to index the world's public web information. I understood that, it made sense.

      But watching as Google and Apple co-developed the idea that computers, which I cared about, got abstracted into toys and jewelry that had all your key computing done in a way you had no agency over... where I saw firsthand the kinds of churn of resources necessary to keep these things going, it made me want to fight for a different computing future.

      ctminfocom@fosstodon.orgC This user is from outside of this forum
      ctminfocom@fosstodon.orgC This user is from outside of this forum
      ctminfocom@fosstodon.org
      wrote last edited by
      #11

      @cwebber
      The core problem is not AI, cloud, or interfaces.

      The real problem is ambiguous and centrally controlled information.

      Without deterministic foundations, civilization will keep scaling dependency, manipulation, and chaos.

      CTMinfo is the first real attempt to solve this at the root.

      Link Preview Image
      CTMinfo: Ontology-Based System for 100% Verified Data

      CTMinfo is an ontology-based system designed to achieve 100% verified and reliable data across industrial, trade, and engineering domains.Unlike Big Data approaches that accumulate unverified information, CTMinfo introduces the concept of SmallData — a model built exclusively from verified and logically consistent entities. The system establishes a structural ontology ensuring the full traceability of each object, its origin, and transformation throughout the production and supply chain. This approach eliminates ambiguity, duplication, and corruption in data management. CTMinfo also introduces the principle of OpenTech, emphasizing open, structural, and transparent technological development as an alternative to opaque “deep-tech” systems. The project demonstrates how a precisely defined ontological framework can serve as a universal infrastructure for verified industrial information, creating a foundation for trustworthy AI, automation, and sustainable economic systems. Author: Dmitriy Andriyanov (CTMinfo Founder and System Architect)

      favicon

      Zenodo (zenodo.org)

      1 Reply Last reply
      0
      • cwebber@social.coopC cwebber@social.coop

        @thomasjwebb I've been meaning to write a blogpost for a long time. Sounds like it's time to write it!

        reinald@nrw.socialR This user is from outside of this forum
        reinald@nrw.socialR This user is from outside of this forum
        reinald@nrw.social
        wrote last edited by
        #12

        @cwebber @thomasjwebb I remember "datacenter" starting as "colocation hoster" - you rentet rackspace or several racks with redundant power supply, internet link, packed in some pizzaboxes and a router, and there you go. Physical safety was better than the rack with dev servers in the basement, so what else could you ask for?

        1 Reply Last reply
        0
        • thomasjwebb@mastodon.socialT thomasjwebb@mastodon.social

          @cwebber do you have a writeup expanding on “datacenters are an anti-pattern” because this is 100% how I feel. I’m not fighting over AI. I’m still fighting over the cloud. Society has badly fumbled the fact that everyone has incredible computing power in their pocket. We’ve already been wasting electricity on idle servers and inefficient high level code. I’ve been - and am - part of the problem, moving functionality to the cloud for business reasons I hate.

          leslieclarke@mastodon.socialL This user is from outside of this forum
          leslieclarke@mastodon.socialL This user is from outside of this forum
          leslieclarke@mastodon.social
          wrote last edited by
          #13

          @thomasjwebb Not to pre-empt Christine, since I don’t know what she has in mind, but you may find the essay The eternal mainframe by Rudolf Winestock interesting if you haven’t read it already: https://www.winestockwebdesign.com/Essays/Eternal_Mainframe.html (archive: https://archive.today/mz7Zk). (It’s from 2013, so admittedly a bit old.)

          1 Reply Last reply
          0
          • cwebber@social.coopC cwebber@social.coop

            My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.

            And so it is with some significant expertise that I say:

            Fuck datacenters. Datacenters are an anti-pattern.

            gert@social.coopG This user is from outside of this forum
            gert@social.coopG This user is from outside of this forum
            gert@social.coop
            wrote last edited by
            #14

            @cwebber At the moment we ended up with a phone that could do most of what we wanted, but had no agency over, at the backend there was the datacenter explosion, which we had no agency over. Now you can't even buy a laptop anymore because the datacenter explosion caused scarcity of its components. Check mate.

            1 Reply Last reply
            0
            • pixelate@tweesecake.socialP pixelate@tweesecake.social shared this topic
            • cwebber@social.coopC cwebber@social.coop

              @thomasjwebb I've been meaning to write a blogpost for a long time. Sounds like it's time to write it!

              stormygleason@hachyderm.ioS This user is from outside of this forum
              stormygleason@hachyderm.ioS This user is from outside of this forum
              stormygleason@hachyderm.io
              wrote last edited by
              #15

              @cwebber @thomasjwebb why am I starting to hear Bohemian Rhapsody in my head?

              1 Reply Last reply
              0
              • cwebber@social.coopC cwebber@social.coop

                My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.

                And so it is with some significant expertise that I say:

                Fuck datacenters. Datacenters are an anti-pattern.

                hoboshrimps@mastodon.socialH This user is from outside of this forum
                hoboshrimps@mastodon.socialH This user is from outside of this forum
                hoboshrimps@mastodon.social
                wrote last edited by
                #16

                @cwebber I agree with your premise. However, realistically, convincing businesses to return to on-prem is challenging. It's not just about management – maintaining, securing, and procuring on-prem hardware is a significant expense and effort compared to provisioning cloud resources.

                MSPs could help, but even with their assistance, the ongoing costs and complexity often favor cloud-native solutions.

                How do you think we could convince small business owners to move from Shopify for example?

                1 Reply Last reply
                0
                • cwebber@social.coopC cwebber@social.coop

                  @farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.

                  johns@social.librem.oneJ This user is from outside of this forum
                  johns@social.librem.oneJ This user is from outside of this forum
                  johns@social.librem.one
                  wrote last edited by
                  #17

                  @cwebber @farfalk I think it more corresponds to the death of personal computing as it was? People don't have desktops anymore and barely have laptops other than for work? Which is a problem for p2p? Seems like most people's decentralized/federated nodes for things are hosted in data centers? All question marks because just speculating.

                  celeduc@mastodon.socialC cwebber@social.coopC 2 Replies Last reply
                  0
                  • cwebber@social.coopC cwebber@social.coop

                    @farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.

                    ottomate@noc.socialO This user is from outside of this forum
                    ottomate@noc.socialO This user is from outside of this forum
                    ottomate@noc.social
                    wrote last edited by
                    #18

                    @cwebber @farfalk Well you see Datacankers that way and I entirely agree. When will those presently apathetic about Datacancers realize their browsing and posting options have shrunken in quantity and quality? Some may built for bit mining but most have an objective I would call brain mining.

                    1 Reply Last reply
                    0
                    • farfalk@toot.communityF farfalk@toot.community

                      @cwebber that's an interesting point of view. I mean, of course the current datacenter craze is complete madness, but it seems you consider an anti-pattern the concept of datacenter itself. Why is it so? What do you suggest as an alternate solution to the problems data centers try to solve?

                      moss@beige.partyM This user is from outside of this forum
                      moss@beige.partyM This user is from outside of this forum
                      moss@beige.party
                      wrote last edited by
                      #19

                      @farfalk @cwebber Really look at “the problems data centers try to solve”. At face value, LLMs and other “AI” are not functional or even profitable by themselves, but they are the supposed reason for the data center boom. But there’s strong evidence that the boom is driven by market manipulation for the hardware, not organic demand for its work. Further, the face value function of “AI” is to extract short term cash value while denying resources to humans. That is the secondary problem the centers try to solve (first being fraudulent investment in the centers themselves). That’s why framing it as “what’s your alternative” is a mistake.

                      jayalane@mastodon.onlineJ 1 Reply Last reply
                      0
                      • em0nm4stodon@infosec.exchangeE em0nm4stodon@infosec.exchange shared this topic
                        R relay@relay.mycrowd.ca shared this topic
                      • cwebber@social.coopC cwebber@social.coop

                        @farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.

                        thomasjwebb@mastodon.socialT This user is from outside of this forum
                        thomasjwebb@mastodon.socialT This user is from outside of this forum
                        thomasjwebb@mastodon.social
                        wrote last edited by
                        #20

                        @cwebber @farfalk like, I can appreciate some of the advantages of having them. Like you could get more computer per watt, maybe. I think valuable research is done with supercomputers and modern, more modular approaches to big data. But we could do way more with way fewer datacenters if these weren't used as a way to paywall functionality at the server side. The move to the cloud almost makes me miss when my problem was Cubase requiring a USB dongle.

                        raven667@hachyderm.ioR 1 Reply Last reply
                        0
                        • cwebber@social.coopC cwebber@social.coop

                          @farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.

                          robryk@social.wuatek.isR This user is from outside of this forum
                          robryk@social.wuatek.isR This user is from outside of this forum
                          robryk@social.wuatek.is
                          wrote last edited by
                          #21
                          @cwebber @farfalk How would you approach defining the threshold of concentration past which it's undesirable? The only obvious approach I can think of is "it's too high if there's a positive feedback loop", but that's both not really knowable and probably too low, given that we ~started from much concentration and arrived at current, clearly undesirably high, levels thereof.
                          1 Reply Last reply
                          0
                          • johns@social.librem.oneJ johns@social.librem.one

                            @cwebber @farfalk I think it more corresponds to the death of personal computing as it was? People don't have desktops anymore and barely have laptops other than for work? Which is a problem for p2p? Seems like most people's decentralized/federated nodes for things are hosted in data centers? All question marks because just speculating.

                            celeduc@mastodon.socialC This user is from outside of this forum
                            celeduc@mastodon.socialC This user is from outside of this forum
                            celeduc@mastodon.social
                            wrote last edited by
                            #22

                            @johns @cwebber @farfalk it's telling that hardware for user-controlled computing is disappearing. Memory and storage are disappearing from the market and it feels *intentional*. https://investors.micron.com/news-releases/news-release-details/micron-announces-exit-crucial-consumer-business

                            1 Reply Last reply
                            0
                            • farfalk@toot.communityF farfalk@toot.community

                              @cwebber that's an interesting point of view. I mean, of course the current datacenter craze is complete madness, but it seems you consider an anti-pattern the concept of datacenter itself. Why is it so? What do you suggest as an alternate solution to the problems data centers try to solve?

                              datenwolf@chaos.socialD This user is from outside of this forum
                              datenwolf@chaos.socialD This user is from outside of this forum
                              datenwolf@chaos.social
                              wrote last edited by
                              #23

                              @farfalk @cwebber

                              There's a very simple and actually very affordable alternative to data centers, both commercially and consumer: Self hosting.

                              Do you have a router in your home? Congratulations, you've got more computing resources than you'll ever need for your own little soapbox on the web as well as sending & receiving email.

                              For the moment it's too much of a configuration challenge for john-and-jane-doe average, but that's a software problem, that's very much solvable.

                              datenwolf@chaos.socialD 1 Reply Last reply
                              0
                              • datenwolf@chaos.socialD datenwolf@chaos.social

                                @farfalk @cwebber

                                There's a very simple and actually very affordable alternative to data centers, both commercially and consumer: Self hosting.

                                Do you have a router in your home? Congratulations, you've got more computing resources than you'll ever need for your own little soapbox on the web as well as sending & receiving email.

                                For the moment it's too much of a configuration challenge for john-and-jane-doe average, but that's a software problem, that's very much solvable.

                                datenwolf@chaos.socialD This user is from outside of this forum
                                datenwolf@chaos.socialD This user is from outside of this forum
                                datenwolf@chaos.social
                                wrote last edited by
                                #24

                                @farfalk @cwebber

                                Small and mid sized businesses used to host their very own compute infrastructure, some 30 years ago. I was there, I worked summer jobs in their IT departments

                                IBM System/36, AS/400, Novell Netware, dBase/Clipper… those were the staples of the times, you could find at least one of them, but often several in most mid-sized businesses in Europe and North America.

                                shredder7579@mastodon.socialS 1 Reply Last reply
                                0
                                • cwebber@social.coopC cwebber@social.coop

                                  My first job was building out the first mega-datacenters. 2005-2007, I was a datacenter assistant monkey working from Google working somewhere in the Chicago suburbs, swapping out hard drives and ram and writing shell scripts, as myself and my friends unknowingly laid down the prototype for the kinds of datacenters we all see today.

                                  And so it is with some significant expertise that I say:

                                  Fuck datacenters. Datacenters are an anti-pattern.

                                  corbden@defcon.socialC This user is from outside of this forum
                                  corbden@defcon.socialC This user is from outside of this forum
                                  corbden@defcon.social
                                  wrote last edited by
                                  #25

                                  @cwebber @YakyuNightOwl Looking at the replies, I'm seeing so many of us who built this who are in dismay at what it was built into.

                                  For me it was working for an enterprise CRM/CIM software company '05-10. I supported the development of knowledge bases and customer support streamlining (chat, automation) because I thought it would be used to relieve call center agents and help customers get to accurate information faster. Instead it became a dehumanization tool, distancing customers from accessing real people and real help when they actually need it, and reducing the tech skills of agents. Utterly devastating.

                                  1 Reply Last reply
                                  0
                                  • cwebber@social.coopC cwebber@social.coop

                                    @farfalk Datacenters are concentrations of power. Anytime a datacenter is involved, it's a sign of power centralization. The rise of datacenters corresponds with the death of p2p and other visions of a more decentralized internet.

                                    raven667@hachyderm.ioR This user is from outside of this forum
                                    raven667@hachyderm.ioR This user is from outside of this forum
                                    raven667@hachyderm.io
                                    wrote last edited by
                                    #26

                                    @cwebber @farfalk yeah, this is the way back to "personal computing"

                                    1 Reply Last reply
                                    0
                                    • thomasjwebb@mastodon.socialT thomasjwebb@mastodon.social

                                      @cwebber @farfalk like, I can appreciate some of the advantages of having them. Like you could get more computer per watt, maybe. I think valuable research is done with supercomputers and modern, more modular approaches to big data. But we could do way more with way fewer datacenters if these weren't used as a way to paywall functionality at the server side. The move to the cloud almost makes me miss when my problem was Cubase requiring a USB dongle.

                                      raven667@hachyderm.ioR This user is from outside of this forum
                                      raven667@hachyderm.ioR This user is from outside of this forum
                                      raven667@hachyderm.io
                                      wrote last edited by
                                      #27

                                      @thomasjwebb @cwebber @farfalk there is always a "but sometimes" so maybe we can take it as a given that for any strident statement in short form chat there isn't all the nuance about exceptions.

                                      The overall direction seems right to me though. We've got a not insignificant ipv6 deployment for residential use, where is the Cobalt Qube of personal computing? There is no good *technical* reason I shouldn't be able to host my personal email on my own domain, at home, on my own computer, along with a website or whatever. Big monopolistic platforms, which require huge datacenters and complex tech stacks, are an antipattern.

                                      thomasjwebb@mastodon.socialT 1 Reply Last reply
                                      0
                                      • johns@social.librem.oneJ johns@social.librem.one

                                        @cwebber @farfalk I think it more corresponds to the death of personal computing as it was? People don't have desktops anymore and barely have laptops other than for work? Which is a problem for p2p? Seems like most people's decentralized/federated nodes for things are hosted in data centers? All question marks because just speculating.

                                        cwebber@social.coopC This user is from outside of this forum
                                        cwebber@social.coopC This user is from outside of this forum
                                        cwebber@social.coop
                                        wrote last edited by
                                        #28

                                        @johns @farfalk Yes, all things I worried about, as they were happening, and all of which have enormously clear and worrying impacts on user agency

                                        1 Reply Last reply
                                        0
                                        • raven667@hachyderm.ioR raven667@hachyderm.io

                                          @thomasjwebb @cwebber @farfalk there is always a "but sometimes" so maybe we can take it as a given that for any strident statement in short form chat there isn't all the nuance about exceptions.

                                          The overall direction seems right to me though. We've got a not insignificant ipv6 deployment for residential use, where is the Cobalt Qube of personal computing? There is no good *technical* reason I shouldn't be able to host my personal email on my own domain, at home, on my own computer, along with a website or whatever. Big monopolistic platforms, which require huge datacenters and complex tech stacks, are an antipattern.

                                          thomasjwebb@mastodon.socialT This user is from outside of this forum
                                          thomasjwebb@mastodon.socialT This user is from outside of this forum
                                          thomasjwebb@mastodon.social
                                          wrote last edited by
                                          #29

                                          @raven667 @cwebber @farfalk sure I just don’t want to be seen as someone who hasn’t considered the obvious counterpoints. I have the “always include depth-first nuance” kind of autism and ocd. But yeah I think if we design protocols right, maybe people won’t even have to self-host in many cases. It could be some truly p2p stuff than can run on the client.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups