Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. There's a lot of stuff going around about datacenters, so I decided to do a quick tour yesterday of some of the datacenters in the Salt Lake Valley.

There's a lot of stuff going around about datacenters, so I decided to do a quick tour yesterday of some of the datacenters in the Salt Lake Valley.

Scheduled Pinned Locked Moved Uncategorized
slc
71 Posts 32 Posters 3 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • ricci@discuss.systemsR ricci@discuss.systems

    Now we're getting a bit bigger, and also more residential. This one sits on the edge of a residential neighborhood, on 200 E, in Milcreek. This is a 36k sq ft, 1.9 MW facility. What's in there? I don't know, as mentioned above, datacenters don't tend to tell you who their tenants are. There's probably some reasonable computing power in there, but it's probably not dense enough to be very GPU-heavy.

    The sounds of the HVAC systems were quite noticeable at this one. Any time you are dealing with electricity, you are also dealing with heat. In a datacenter, the power drawn by the compute and network equipment gets turned into heat, and you need to get rid of it. Of course, you want to spend as little electricity getting rid of heat as you can. Datacenters call this "Power Usage Effectiveness", commonly called PUE. A PUE of 1.5 means that for every KW that goes to computers, .5 KW goes to other stuff - mostly cooling, but also heat losses, lighting, etc. A 1.5 PUE is pretty good, supposedly some of the biggest datacenters have PUE of around 1.1 .

    This actually highlights one way in which having a fairly large-scale datacenter is efficient: putting all the computers in one place does enable you to use cooling systems that get rid of more heat for less power. Of course, how many computers you have, where your power is coming from, what mechanisms you use to cool them, etc. matters too! Again, we'll get back to that later.

    By the way, my guess would be that only the building in the front is a datacenter - the building in the back has too many truck bays and not enough cooling. It's probably a small warehouse of some sort.

    mjd@mathstodon.xyzM This user is from outside of this forum
    mjd@mathstodon.xyzM This user is from outside of this forum
    mjd@mathstodon.xyz
    wrote last edited by
    #17

    @ricci How do you find out the size and power usage of a particular data center?

    ricci@discuss.systemsR 1 Reply Last reply
    0
    • mjd@mathstodon.xyzM mjd@mathstodon.xyz

      @ricci How do you find out the size and power usage of a particular data center?

      ricci@discuss.systemsR This user is from outside of this forum
      ricci@discuss.systemsR This user is from outside of this forum
      ricci@discuss.systems
      wrote last edited by
      #18

      @mjd

      Excellent question! For the mutlt-tenant datacenters, location, size, and power draw is generally advertised, because they are trying to attract customers. I pulled it from datacentermap.com, so, for example:

      Vercel Security Checkpoint

      favicon

      (www.datacentermap.com)

      For the private ones, like the likely-AI building at this campus, you mostly have to get this information from press releases. So it's probably less reliable, as there is more incentive to overhype.

      mjd@mathstodon.xyzM 1 Reply Last reply
      0
      • ricci@discuss.systemsR ricci@discuss.systems

        @mjd

        Excellent question! For the mutlt-tenant datacenters, location, size, and power draw is generally advertised, because they are trying to attract customers. I pulled it from datacentermap.com, so, for example:

        Vercel Security Checkpoint

        favicon

        (www.datacentermap.com)

        For the private ones, like the likely-AI building at this campus, you mostly have to get this information from press releases. So it's probably less reliable, as there is more incentive to overhype.

        mjd@mathstodon.xyzM This user is from outside of this forum
        mjd@mathstodon.xyzM This user is from outside of this forum
        mjd@mathstodon.xyz
        wrote last edited by
        #19

        @ricci Thanks!

        When I saw the claim about the 9GW data center, my immediate thought was that it was simply a lie, intended as an advertisement to potential investors: Look what amazing stuff we are going to do!

        How plausible do you find the claim that they actually intend to build a 9GW data center that will take up 10% of the Salt Lake Valley?

        ricci@discuss.systemsR 1 Reply Last reply
        0
        • mjd@mathstodon.xyzM mjd@mathstodon.xyz

          @ricci Thanks!

          When I saw the claim about the 9GW data center, my immediate thought was that it was simply a lie, intended as an advertisement to potential investors: Look what amazing stuff we are going to do!

          How plausible do you find the claim that they actually intend to build a 9GW data center that will take up 10% of the Salt Lake Valley?

          ricci@discuss.systemsR This user is from outside of this forum
          ricci@discuss.systemsR This user is from outside of this forum
          ricci@discuss.systems
          wrote last edited by
          #20

          @mjd Frankly, I think it's entirely implausible that it will get built as advertised. I'm not sure that the demand is actually there for as many datacenter projects as have been announced. I think it's a very good bet that many or even most of them won't get built out to the size they've discussed. I think the game here is to make big announcements to try to grab headlines and capital before someone else does, and before demand collapses. Is this one of the ones that might actually get built? No idea.

          One likely pivot, if the datacenter doesn't get built, or gets built at a much smaller size, is that they switch to being a private power plant with a bunch of land where they don't have to follow state or county land-use regulations (this is what MIDA is for). That would likely mean bringing in other energy-intensive industries; they have more or less said this in county commission meetings. There's a chance that this is actually far worse, as datacenters (if they use low-water cooling) actually use less water and don't produce as much ground pollution as many industrial land uses.

          skybrian@mastodon.socialS 1 Reply Last reply
          0
          • ricci@discuss.systemsR ricci@discuss.systems

            The reason I went on this little tour was to put in perspective the proposed Stratos datacenter project in Box Elder County, UT.

            Stratos is supposedly designed to eventually reach a size of 9 GW. That is more than double the 4 GW that the entire state of Utah currently uses. The entire campus is supposed to be big enough that, for comparison, it would fill over 10% of the Salt Lake Valley, as shown in this image (which I didn't make).

            That last datacenter campus? At ~160 MW, those three buildings put together are designed for a load about 1/55th the size of Stratos. That 300 MW natural gas power station we saw in the background? Stratos is supposed to generate its own power on-site, so it will need 30 of those things. (Or maybe more - remember PUE?)

            In terms of carbon output, this thing is designed to be an absolute monster.

            There's not much getting around that. They have handwaved about including solar and/or wind, but without anything concrete, we should assume this is a whole lot of carbon.

            How about water?

            Well, that's harder to tell, given all the vagaries and "if"s in the public information so far.

            Remember, a datacenter has to get rid of a lot of heat. A datacenter that is generating its own energy on-site has to get rid of *far* more heat.

            In the desert West, the most *energy* efficient way of getting rid of heat in the hot summer months is evaporative cooling: you boil water. This has, historically, been a major way of cooling both natural gas plants and datacenters, as well as homes, etc.

            The same reason why this works well in the west is the same reason why it's problematic: we have very dry air, so evaporative cooling is very effective, but having dry air is connected to the fact that we don't have much water to begin with.

            There *are* ways to air-cool natural gas turbines, and there *are* ways to cool datacenters that are not evaporative cooling. They are more *water* efficient. But they are less *power* efficient, which means, in this context, burning even more natural gas.

            The backers of Stratos claim that they are trying to get some very new, high-tech gas turbines that operate without water cooling, or at least with very little. That does assuage some water concerns. But their language is very hedge-y - they're trying, they hope to jump in line for the limited supply of them, etc.

            They also claim they will use "closed loop" water systems for cooling the datacenter. There are several things this *could* mean, and we need to know more in order to actually understand it. Most cooling systems for datacenters and even large buildings have a closed loop of water (or another coolant) for moving heat around. That's because we cannot *make* cold, we can only *move* heat. In some datacenters, this cold loop comes into the room, where it's used to cool air, which is blown across the servers. In higher-power-density datacenters, the coolant loop comes all the way to the individual rack in order to cool the air right before it enters the servers. In the most high-tech datacenters (which Stratos would likely be), it comes all the way *inside* the server, directly exchanging heat with the hot bits like CPUs and GPUs.

            Coolant in these kinds of systems circulates, it's closed, you can generally consider the coolant loop to consume very little to no water after it's been filled.

            But: you still have to make the heat go away somehow. This is where Stratos *might* use evaporative cooling. Or they might opt for one of the more expensive, less energy efficient dry systems. Saying "we have a closed loop" only tells us *part* of the story!

            Here's what we know: the Stratos people have secured 13,000 acre-feet of water rights. In numbers that mean more to most of us, that's about 4 billion gallons per year.

            They *claim* that's far more water than they need, and they won't use most of it.

            But: if they don't manage to get their air-cooled gas turbines (which, in addition to being less efficient, also cost more), or decide to go with some evaporative cooling for the datacenter (because it's cheaper and uses less power), they could very easily use that much water. We are very much in a "trust me" situation, and it's not clear that we *should* trust what developers say when they are trying to get permits. We need to get independent studies and binding contracts.

            For those who aren't locals, you might not be aware, but: the Great Salt Lake is shrinking. People are trying (not hard enough, probably) to save it. Not just because hey, what would we call our city without it, but also because the lakebed is full of chemicals we'd rather not be breathing in, thanks.

            Stratos would not literally pull water out of the lake (which it is quite close to). But: the water rights they have obtained are in the watershed of the lake. So: if they use the water rights they have obtained, they might well contribute to the drying up of the lake.

            The point here is that: they are hoarding water rights that they claim they will not use - the more reasonable bet is to assume they will use them; we need a study by actual hydrologists to understand whether using the water would accelerate the lake's demise.

            And, you will notice that I have not even touched on a ton of *other* issues, such as:

            1) Is there actually demand for all of these computers?
            2) Would it be a good idea to fill this demand even if it does exist?
            3) Can we build enough computers to fill this thing in a reasonable time anyway?
            4) How far will this project get before the AI bubble pops, and will it leave anyone other than the investors holding the bag?
            5) If it does get fully built, what other resources (like more water rights) might they go after?
            6) Is it a wise idea to provide huge tax breaks to companies that expect to be highly profitable?
            7) This is being done though the Military Installation Development Authority - what's the actual military connection here?
            😎 Regardless of whether it's wet or dry, is dumping this much heat into one valley a good idea?
            9) There's no way that burning that much natural gas doesn't raise gas and electricity prices.
            10) Can we trust the developers' numbers for how many jobs this will create locally?

            Just to name a few.

            darwinwoodka@mastodon.socialD This user is from outside of this forum
            darwinwoodka@mastodon.socialD This user is from outside of this forum
            darwinwoodka@mastodon.social
            wrote last edited by
            #21

            @ricci

            Why are we building housing for computers and not for people?

            ricci@discuss.systemsR jonhendry@iosdev.spaceJ 2 Replies Last reply
            0
            • darwinwoodka@mastodon.socialD darwinwoodka@mastodon.social

              @ricci

              Why are we building housing for computers and not for people?

              ricci@discuss.systemsR This user is from outside of this forum
              ricci@discuss.systemsR This user is from outside of this forum
              ricci@discuss.systems
              wrote last edited by
              #22

              @darwinwoodka just imagine what we could do if we put these kinds of resources to other uses

              1 Reply Last reply
              0
              • ricci@discuss.systemsR ricci@discuss.systems

                The reason I went on this little tour was to put in perspective the proposed Stratos datacenter project in Box Elder County, UT.

                Stratos is supposedly designed to eventually reach a size of 9 GW. That is more than double the 4 GW that the entire state of Utah currently uses. The entire campus is supposed to be big enough that, for comparison, it would fill over 10% of the Salt Lake Valley, as shown in this image (which I didn't make).

                That last datacenter campus? At ~160 MW, those three buildings put together are designed for a load about 1/55th the size of Stratos. That 300 MW natural gas power station we saw in the background? Stratos is supposed to generate its own power on-site, so it will need 30 of those things. (Or maybe more - remember PUE?)

                In terms of carbon output, this thing is designed to be an absolute monster.

                There's not much getting around that. They have handwaved about including solar and/or wind, but without anything concrete, we should assume this is a whole lot of carbon.

                How about water?

                Well, that's harder to tell, given all the vagaries and "if"s in the public information so far.

                Remember, a datacenter has to get rid of a lot of heat. A datacenter that is generating its own energy on-site has to get rid of *far* more heat.

                In the desert West, the most *energy* efficient way of getting rid of heat in the hot summer months is evaporative cooling: you boil water. This has, historically, been a major way of cooling both natural gas plants and datacenters, as well as homes, etc.

                The same reason why this works well in the west is the same reason why it's problematic: we have very dry air, so evaporative cooling is very effective, but having dry air is connected to the fact that we don't have much water to begin with.

                There *are* ways to air-cool natural gas turbines, and there *are* ways to cool datacenters that are not evaporative cooling. They are more *water* efficient. But they are less *power* efficient, which means, in this context, burning even more natural gas.

                The backers of Stratos claim that they are trying to get some very new, high-tech gas turbines that operate without water cooling, or at least with very little. That does assuage some water concerns. But their language is very hedge-y - they're trying, they hope to jump in line for the limited supply of them, etc.

                They also claim they will use "closed loop" water systems for cooling the datacenter. There are several things this *could* mean, and we need to know more in order to actually understand it. Most cooling systems for datacenters and even large buildings have a closed loop of water (or another coolant) for moving heat around. That's because we cannot *make* cold, we can only *move* heat. In some datacenters, this cold loop comes into the room, where it's used to cool air, which is blown across the servers. In higher-power-density datacenters, the coolant loop comes all the way to the individual rack in order to cool the air right before it enters the servers. In the most high-tech datacenters (which Stratos would likely be), it comes all the way *inside* the server, directly exchanging heat with the hot bits like CPUs and GPUs.

                Coolant in these kinds of systems circulates, it's closed, you can generally consider the coolant loop to consume very little to no water after it's been filled.

                But: you still have to make the heat go away somehow. This is where Stratos *might* use evaporative cooling. Or they might opt for one of the more expensive, less energy efficient dry systems. Saying "we have a closed loop" only tells us *part* of the story!

                Here's what we know: the Stratos people have secured 13,000 acre-feet of water rights. In numbers that mean more to most of us, that's about 4 billion gallons per year.

                They *claim* that's far more water than they need, and they won't use most of it.

                But: if they don't manage to get their air-cooled gas turbines (which, in addition to being less efficient, also cost more), or decide to go with some evaporative cooling for the datacenter (because it's cheaper and uses less power), they could very easily use that much water. We are very much in a "trust me" situation, and it's not clear that we *should* trust what developers say when they are trying to get permits. We need to get independent studies and binding contracts.

                For those who aren't locals, you might not be aware, but: the Great Salt Lake is shrinking. People are trying (not hard enough, probably) to save it. Not just because hey, what would we call our city without it, but also because the lakebed is full of chemicals we'd rather not be breathing in, thanks.

                Stratos would not literally pull water out of the lake (which it is quite close to). But: the water rights they have obtained are in the watershed of the lake. So: if they use the water rights they have obtained, they might well contribute to the drying up of the lake.

                The point here is that: they are hoarding water rights that they claim they will not use - the more reasonable bet is to assume they will use them; we need a study by actual hydrologists to understand whether using the water would accelerate the lake's demise.

                And, you will notice that I have not even touched on a ton of *other* issues, such as:

                1) Is there actually demand for all of these computers?
                2) Would it be a good idea to fill this demand even if it does exist?
                3) Can we build enough computers to fill this thing in a reasonable time anyway?
                4) How far will this project get before the AI bubble pops, and will it leave anyone other than the investors holding the bag?
                5) If it does get fully built, what other resources (like more water rights) might they go after?
                6) Is it a wise idea to provide huge tax breaks to companies that expect to be highly profitable?
                7) This is being done though the Military Installation Development Authority - what's the actual military connection here?
                😎 Regardless of whether it's wet or dry, is dumping this much heat into one valley a good idea?
                9) There's no way that burning that much natural gas doesn't raise gas and electricity prices.
                10) Can we trust the developers' numbers for how many jobs this will create locally?

                Just to name a few.

                dougfir@m.ai6yr.orgD This user is from outside of this forum
                dougfir@m.ai6yr.orgD This user is from outside of this forum
                dougfir@m.ai6yr.org
                wrote last edited by
                #23

                @ricci
                Currently this area is remote ranching country, served by one two-lane road and no businesses like gas stations or stores. In addition to building the data center, they will have to build ALL the infrastructure needed to support it. Where are the workers going to live?

                ricci@discuss.systemsR jonhendry@iosdev.spaceJ 2 Replies Last reply
                0
                • ricci@discuss.systemsR ricci@discuss.systems

                  The reason I went on this little tour was to put in perspective the proposed Stratos datacenter project in Box Elder County, UT.

                  Stratos is supposedly designed to eventually reach a size of 9 GW. That is more than double the 4 GW that the entire state of Utah currently uses. The entire campus is supposed to be big enough that, for comparison, it would fill over 10% of the Salt Lake Valley, as shown in this image (which I didn't make).

                  That last datacenter campus? At ~160 MW, those three buildings put together are designed for a load about 1/55th the size of Stratos. That 300 MW natural gas power station we saw in the background? Stratos is supposed to generate its own power on-site, so it will need 30 of those things. (Or maybe more - remember PUE?)

                  In terms of carbon output, this thing is designed to be an absolute monster.

                  There's not much getting around that. They have handwaved about including solar and/or wind, but without anything concrete, we should assume this is a whole lot of carbon.

                  How about water?

                  Well, that's harder to tell, given all the vagaries and "if"s in the public information so far.

                  Remember, a datacenter has to get rid of a lot of heat. A datacenter that is generating its own energy on-site has to get rid of *far* more heat.

                  In the desert West, the most *energy* efficient way of getting rid of heat in the hot summer months is evaporative cooling: you boil water. This has, historically, been a major way of cooling both natural gas plants and datacenters, as well as homes, etc.

                  The same reason why this works well in the west is the same reason why it's problematic: we have very dry air, so evaporative cooling is very effective, but having dry air is connected to the fact that we don't have much water to begin with.

                  There *are* ways to air-cool natural gas turbines, and there *are* ways to cool datacenters that are not evaporative cooling. They are more *water* efficient. But they are less *power* efficient, which means, in this context, burning even more natural gas.

                  The backers of Stratos claim that they are trying to get some very new, high-tech gas turbines that operate without water cooling, or at least with very little. That does assuage some water concerns. But their language is very hedge-y - they're trying, they hope to jump in line for the limited supply of them, etc.

                  They also claim they will use "closed loop" water systems for cooling the datacenter. There are several things this *could* mean, and we need to know more in order to actually understand it. Most cooling systems for datacenters and even large buildings have a closed loop of water (or another coolant) for moving heat around. That's because we cannot *make* cold, we can only *move* heat. In some datacenters, this cold loop comes into the room, where it's used to cool air, which is blown across the servers. In higher-power-density datacenters, the coolant loop comes all the way to the individual rack in order to cool the air right before it enters the servers. In the most high-tech datacenters (which Stratos would likely be), it comes all the way *inside* the server, directly exchanging heat with the hot bits like CPUs and GPUs.

                  Coolant in these kinds of systems circulates, it's closed, you can generally consider the coolant loop to consume very little to no water after it's been filled.

                  But: you still have to make the heat go away somehow. This is where Stratos *might* use evaporative cooling. Or they might opt for one of the more expensive, less energy efficient dry systems. Saying "we have a closed loop" only tells us *part* of the story!

                  Here's what we know: the Stratos people have secured 13,000 acre-feet of water rights. In numbers that mean more to most of us, that's about 4 billion gallons per year.

                  They *claim* that's far more water than they need, and they won't use most of it.

                  But: if they don't manage to get their air-cooled gas turbines (which, in addition to being less efficient, also cost more), or decide to go with some evaporative cooling for the datacenter (because it's cheaper and uses less power), they could very easily use that much water. We are very much in a "trust me" situation, and it's not clear that we *should* trust what developers say when they are trying to get permits. We need to get independent studies and binding contracts.

                  For those who aren't locals, you might not be aware, but: the Great Salt Lake is shrinking. People are trying (not hard enough, probably) to save it. Not just because hey, what would we call our city without it, but also because the lakebed is full of chemicals we'd rather not be breathing in, thanks.

                  Stratos would not literally pull water out of the lake (which it is quite close to). But: the water rights they have obtained are in the watershed of the lake. So: if they use the water rights they have obtained, they might well contribute to the drying up of the lake.

                  The point here is that: they are hoarding water rights that they claim they will not use - the more reasonable bet is to assume they will use them; we need a study by actual hydrologists to understand whether using the water would accelerate the lake's demise.

                  And, you will notice that I have not even touched on a ton of *other* issues, such as:

                  1) Is there actually demand for all of these computers?
                  2) Would it be a good idea to fill this demand even if it does exist?
                  3) Can we build enough computers to fill this thing in a reasonable time anyway?
                  4) How far will this project get before the AI bubble pops, and will it leave anyone other than the investors holding the bag?
                  5) If it does get fully built, what other resources (like more water rights) might they go after?
                  6) Is it a wise idea to provide huge tax breaks to companies that expect to be highly profitable?
                  7) This is being done though the Military Installation Development Authority - what's the actual military connection here?
                  😎 Regardless of whether it's wet or dry, is dumping this much heat into one valley a good idea?
                  9) There's no way that burning that much natural gas doesn't raise gas and electricity prices.
                  10) Can we trust the developers' numbers for how many jobs this will create locally?

                  Just to name a few.

                  lpryszcz@genomic.socialL This user is from outside of this forum
                  lpryszcz@genomic.socialL This user is from outside of this forum
                  lpryszcz@genomic.social
                  wrote last edited by
                  #24

                  @ricci @tunubesecamirio have a look

                  1 Reply Last reply
                  0
                  • ricci@discuss.systemsR ricci@discuss.systems

                    The reason I went on this little tour was to put in perspective the proposed Stratos datacenter project in Box Elder County, UT.

                    Stratos is supposedly designed to eventually reach a size of 9 GW. That is more than double the 4 GW that the entire state of Utah currently uses. The entire campus is supposed to be big enough that, for comparison, it would fill over 10% of the Salt Lake Valley, as shown in this image (which I didn't make).

                    That last datacenter campus? At ~160 MW, those three buildings put together are designed for a load about 1/55th the size of Stratos. That 300 MW natural gas power station we saw in the background? Stratos is supposed to generate its own power on-site, so it will need 30 of those things. (Or maybe more - remember PUE?)

                    In terms of carbon output, this thing is designed to be an absolute monster.

                    There's not much getting around that. They have handwaved about including solar and/or wind, but without anything concrete, we should assume this is a whole lot of carbon.

                    How about water?

                    Well, that's harder to tell, given all the vagaries and "if"s in the public information so far.

                    Remember, a datacenter has to get rid of a lot of heat. A datacenter that is generating its own energy on-site has to get rid of *far* more heat.

                    In the desert West, the most *energy* efficient way of getting rid of heat in the hot summer months is evaporative cooling: you boil water. This has, historically, been a major way of cooling both natural gas plants and datacenters, as well as homes, etc.

                    The same reason why this works well in the west is the same reason why it's problematic: we have very dry air, so evaporative cooling is very effective, but having dry air is connected to the fact that we don't have much water to begin with.

                    There *are* ways to air-cool natural gas turbines, and there *are* ways to cool datacenters that are not evaporative cooling. They are more *water* efficient. But they are less *power* efficient, which means, in this context, burning even more natural gas.

                    The backers of Stratos claim that they are trying to get some very new, high-tech gas turbines that operate without water cooling, or at least with very little. That does assuage some water concerns. But their language is very hedge-y - they're trying, they hope to jump in line for the limited supply of them, etc.

                    They also claim they will use "closed loop" water systems for cooling the datacenter. There are several things this *could* mean, and we need to know more in order to actually understand it. Most cooling systems for datacenters and even large buildings have a closed loop of water (or another coolant) for moving heat around. That's because we cannot *make* cold, we can only *move* heat. In some datacenters, this cold loop comes into the room, where it's used to cool air, which is blown across the servers. In higher-power-density datacenters, the coolant loop comes all the way to the individual rack in order to cool the air right before it enters the servers. In the most high-tech datacenters (which Stratos would likely be), it comes all the way *inside* the server, directly exchanging heat with the hot bits like CPUs and GPUs.

                    Coolant in these kinds of systems circulates, it's closed, you can generally consider the coolant loop to consume very little to no water after it's been filled.

                    But: you still have to make the heat go away somehow. This is where Stratos *might* use evaporative cooling. Or they might opt for one of the more expensive, less energy efficient dry systems. Saying "we have a closed loop" only tells us *part* of the story!

                    Here's what we know: the Stratos people have secured 13,000 acre-feet of water rights. In numbers that mean more to most of us, that's about 4 billion gallons per year.

                    They *claim* that's far more water than they need, and they won't use most of it.

                    But: if they don't manage to get their air-cooled gas turbines (which, in addition to being less efficient, also cost more), or decide to go with some evaporative cooling for the datacenter (because it's cheaper and uses less power), they could very easily use that much water. We are very much in a "trust me" situation, and it's not clear that we *should* trust what developers say when they are trying to get permits. We need to get independent studies and binding contracts.

                    For those who aren't locals, you might not be aware, but: the Great Salt Lake is shrinking. People are trying (not hard enough, probably) to save it. Not just because hey, what would we call our city without it, but also because the lakebed is full of chemicals we'd rather not be breathing in, thanks.

                    Stratos would not literally pull water out of the lake (which it is quite close to). But: the water rights they have obtained are in the watershed of the lake. So: if they use the water rights they have obtained, they might well contribute to the drying up of the lake.

                    The point here is that: they are hoarding water rights that they claim they will not use - the more reasonable bet is to assume they will use them; we need a study by actual hydrologists to understand whether using the water would accelerate the lake's demise.

                    And, you will notice that I have not even touched on a ton of *other* issues, such as:

                    1) Is there actually demand for all of these computers?
                    2) Would it be a good idea to fill this demand even if it does exist?
                    3) Can we build enough computers to fill this thing in a reasonable time anyway?
                    4) How far will this project get before the AI bubble pops, and will it leave anyone other than the investors holding the bag?
                    5) If it does get fully built, what other resources (like more water rights) might they go after?
                    6) Is it a wise idea to provide huge tax breaks to companies that expect to be highly profitable?
                    7) This is being done though the Military Installation Development Authority - what's the actual military connection here?
                    😎 Regardless of whether it's wet or dry, is dumping this much heat into one valley a good idea?
                    9) There's no way that burning that much natural gas doesn't raise gas and electricity prices.
                    10) Can we trust the developers' numbers for how many jobs this will create locally?

                    Just to name a few.

                    nnn@bettercities.topN This user is from outside of this forum
                    nnn@bettercities.topN This user is from outside of this forum
                    nnn@bettercities.top
                    wrote last edited by
                    #25

                    @ricci
                    We need to ban new evap-cooled DCs.
                    Air-side economy is more efficient and doesn't use water (except for humidity). Though you wouldn't put such a DC in Utah, but rather in places with consistent wind, and few high-heat events.

                    There may someday be a point where we can just use our renewable energy abundance to use CO2-refrigerant DX to cool large datacenters: inefficient, but no water use, and works anywhere.

                    1 Reply Last reply
                    0
                    • dougfir@m.ai6yr.orgD dougfir@m.ai6yr.org

                      @ricci
                      Currently this area is remote ranching country, served by one two-lane road and no businesses like gas stations or stores. In addition to building the data center, they will have to build ALL the infrastructure needed to support it. Where are the workers going to live?

                      ricci@discuss.systemsR This user is from outside of this forum
                      ricci@discuss.systemsR This user is from outside of this forum
                      ricci@discuss.systems
                      wrote last edited by
                      #26

                      @Dougfir In county council meetings, they've claimed they are going to build some hotels for contractors and restaurants, etc. Probably on the parcel of land they got right off I-84. But they seem to expect that on-site staff (which I think they are likely overestimating to make it look more attractive) will live in Brigham City, Snowville, etc.

                      The area already has a similar problem with the rocket plant at Promontory point. Both my brothers did internships there, and they had to get up super early to take a company bus out there from Brigham City.

                      dougfir@m.ai6yr.orgD 1 Reply Last reply
                      0
                      • ricci@discuss.systemsR ricci@discuss.systems

                        The reason I went on this little tour was to put in perspective the proposed Stratos datacenter project in Box Elder County, UT.

                        Stratos is supposedly designed to eventually reach a size of 9 GW. That is more than double the 4 GW that the entire state of Utah currently uses. The entire campus is supposed to be big enough that, for comparison, it would fill over 10% of the Salt Lake Valley, as shown in this image (which I didn't make).

                        That last datacenter campus? At ~160 MW, those three buildings put together are designed for a load about 1/55th the size of Stratos. That 300 MW natural gas power station we saw in the background? Stratos is supposed to generate its own power on-site, so it will need 30 of those things. (Or maybe more - remember PUE?)

                        In terms of carbon output, this thing is designed to be an absolute monster.

                        There's not much getting around that. They have handwaved about including solar and/or wind, but without anything concrete, we should assume this is a whole lot of carbon.

                        How about water?

                        Well, that's harder to tell, given all the vagaries and "if"s in the public information so far.

                        Remember, a datacenter has to get rid of a lot of heat. A datacenter that is generating its own energy on-site has to get rid of *far* more heat.

                        In the desert West, the most *energy* efficient way of getting rid of heat in the hot summer months is evaporative cooling: you boil water. This has, historically, been a major way of cooling both natural gas plants and datacenters, as well as homes, etc.

                        The same reason why this works well in the west is the same reason why it's problematic: we have very dry air, so evaporative cooling is very effective, but having dry air is connected to the fact that we don't have much water to begin with.

                        There *are* ways to air-cool natural gas turbines, and there *are* ways to cool datacenters that are not evaporative cooling. They are more *water* efficient. But they are less *power* efficient, which means, in this context, burning even more natural gas.

                        The backers of Stratos claim that they are trying to get some very new, high-tech gas turbines that operate without water cooling, or at least with very little. That does assuage some water concerns. But their language is very hedge-y - they're trying, they hope to jump in line for the limited supply of them, etc.

                        They also claim they will use "closed loop" water systems for cooling the datacenter. There are several things this *could* mean, and we need to know more in order to actually understand it. Most cooling systems for datacenters and even large buildings have a closed loop of water (or another coolant) for moving heat around. That's because we cannot *make* cold, we can only *move* heat. In some datacenters, this cold loop comes into the room, where it's used to cool air, which is blown across the servers. In higher-power-density datacenters, the coolant loop comes all the way to the individual rack in order to cool the air right before it enters the servers. In the most high-tech datacenters (which Stratos would likely be), it comes all the way *inside* the server, directly exchanging heat with the hot bits like CPUs and GPUs.

                        Coolant in these kinds of systems circulates, it's closed, you can generally consider the coolant loop to consume very little to no water after it's been filled.

                        But: you still have to make the heat go away somehow. This is where Stratos *might* use evaporative cooling. Or they might opt for one of the more expensive, less energy efficient dry systems. Saying "we have a closed loop" only tells us *part* of the story!

                        Here's what we know: the Stratos people have secured 13,000 acre-feet of water rights. In numbers that mean more to most of us, that's about 4 billion gallons per year.

                        They *claim* that's far more water than they need, and they won't use most of it.

                        But: if they don't manage to get their air-cooled gas turbines (which, in addition to being less efficient, also cost more), or decide to go with some evaporative cooling for the datacenter (because it's cheaper and uses less power), they could very easily use that much water. We are very much in a "trust me" situation, and it's not clear that we *should* trust what developers say when they are trying to get permits. We need to get independent studies and binding contracts.

                        For those who aren't locals, you might not be aware, but: the Great Salt Lake is shrinking. People are trying (not hard enough, probably) to save it. Not just because hey, what would we call our city without it, but also because the lakebed is full of chemicals we'd rather not be breathing in, thanks.

                        Stratos would not literally pull water out of the lake (which it is quite close to). But: the water rights they have obtained are in the watershed of the lake. So: if they use the water rights they have obtained, they might well contribute to the drying up of the lake.

                        The point here is that: they are hoarding water rights that they claim they will not use - the more reasonable bet is to assume they will use them; we need a study by actual hydrologists to understand whether using the water would accelerate the lake's demise.

                        And, you will notice that I have not even touched on a ton of *other* issues, such as:

                        1) Is there actually demand for all of these computers?
                        2) Would it be a good idea to fill this demand even if it does exist?
                        3) Can we build enough computers to fill this thing in a reasonable time anyway?
                        4) How far will this project get before the AI bubble pops, and will it leave anyone other than the investors holding the bag?
                        5) If it does get fully built, what other resources (like more water rights) might they go after?
                        6) Is it a wise idea to provide huge tax breaks to companies that expect to be highly profitable?
                        7) This is being done though the Military Installation Development Authority - what's the actual military connection here?
                        😎 Regardless of whether it's wet or dry, is dumping this much heat into one valley a good idea?
                        9) There's no way that burning that much natural gas doesn't raise gas and electricity prices.
                        10) Can we trust the developers' numbers for how many jobs this will create locally?

                        Just to name a few.

                        lpryszcz@genomic.socialL This user is from outside of this forum
                        lpryszcz@genomic.socialL This user is from outside of this forum
                        lpryszcz@genomic.social
                        wrote last edited by
                        #27

                        @ricci beside using electricity and water, data centers contribute to heating up the local environment . Curious to know how much effect the large ones will have...
                        https://arxiv.org/abs/2603.20897

                        ricci@discuss.systemsR 1 Reply Last reply
                        0
                        • ricci@discuss.systemsR ricci@discuss.systems

                          @Dougfir In county council meetings, they've claimed they are going to build some hotels for contractors and restaurants, etc. Probably on the parcel of land they got right off I-84. But they seem to expect that on-site staff (which I think they are likely overestimating to make it look more attractive) will live in Brigham City, Snowville, etc.

                          The area already has a similar problem with the rocket plant at Promontory point. Both my brothers did internships there, and they had to get up super early to take a company bus out there from Brigham City.

                          dougfir@m.ai6yr.orgD This user is from outside of this forum
                          dougfir@m.ai6yr.orgD This user is from outside of this forum
                          dougfir@m.ai6yr.org
                          wrote last edited by
                          #28

                          @ricci
                          A lot of the goldmines in Nevada are remote so there are busses running crews back and forth from towns all the time.
                          I still don't believe their handwaving about being able to source that much power generation capacity that quickly.

                          ricci@discuss.systemsR 1 Reply Last reply
                          0
                          • lpryszcz@genomic.socialL lpryszcz@genomic.social

                            @ricci beside using electricity and water, data centers contribute to heating up the local environment . Curious to know how much effect the large ones will have...
                            https://arxiv.org/abs/2603.20897

                            ricci@discuss.systemsR This user is from outside of this forum
                            ricci@discuss.systemsR This user is from outside of this forum
                            ricci@discuss.systems
                            wrote last edited by
                            #29

                            @lpryszcz Yep, even if you are energy-efficient at shedding heat, you are still shedding heat!

                            Link Preview Image
                            ‘So much worse than I even thought’: Utah’s ‘hyperscale’ data center could create massive heat island near Great Salt Lake

                            Skeptics of the proposed hyperscale data center in Box Elder County are sweating about a lot more than its energy demands and potential toll on water supplies.

                            favicon

                            The Salt Lake Tribune (www.sltrib.com)

                            I think one of the things going on here is that the assumption is that 10x as big is "only" 10x as bad, but scales that large certainly have the possibility of qualitative changes that we might not have a good understanding of (and which we should not just take the developers' word on)

                            1 Reply Last reply
                            0
                            • dougfir@m.ai6yr.orgD dougfir@m.ai6yr.org

                              @ricci
                              A lot of the goldmines in Nevada are remote so there are busses running crews back and forth from towns all the time.
                              I still don't believe their handwaving about being able to source that much power generation capacity that quickly.

                              ricci@discuss.systemsR This user is from outside of this forum
                              ricci@discuss.systemsR This user is from outside of this forum
                              ricci@discuss.systems
                              wrote last edited by
                              #30

                              @Dougfir yep, it seems extremely unlikely, and I'm not inclined to take the word of another guy who plays a businessman on TV

                              1 Reply Last reply
                              0
                              • ricci@discuss.systemsR ricci@discuss.systems

                                Here's what I hope your takeaway from this thread will be: datacenters come in many sizes, have many uses, and are not necessarily where you'd expect. The impact they have locally depends on how they're powered, how they're cooled, what they're used for, who owns them, and how big they are. It's worth looking at all of these things when considering whether a datacenter project is a good idea or not.

                                msbellows@c.imM This user is from outside of this forum
                                msbellows@c.imM This user is from outside of this forum
                                msbellows@c.im
                                wrote last edited by
                                #31

                                @ricci This is REALLY thoughtful and informative; thank you. (And it's worth saving/sharing even outside Mastodon, so: hey, @mastoreaderio ! Unroll!)

                                mastoreaderio@mastodon.socialM 1 Reply Last reply
                                0
                                • msbellows@c.imM msbellows@c.im

                                  @ricci This is REALLY thoughtful and informative; thank you. (And it's worth saving/sharing even outside Mastodon, so: hey, @mastoreaderio ! Unroll!)

                                  mastoreaderio@mastodon.socialM This user is from outside of this forum
                                  mastoreaderio@mastodon.socialM This user is from outside of this forum
                                  mastoreaderio@mastodon.social
                                  wrote last edited by
                                  #32

                                  @msbellows here's the unrolled thread: https://mastoreader.io?url=https%3A%2F%2Fc.im%2F%40msbellows%2F116557139885627239

                                  Next time, kindly set the visibility to 'Mentioned people only' and mention only me (@mastoreaderio). This ensures we avoid spamming others' timelines and threads unless you intend for others to see the unrolled thread link as well.

                                  Thank you!

                                  jherazob@mastodon.ieJ 1 Reply Last reply
                                  0
                                  • mastoreaderio@mastodon.socialM mastoreaderio@mastodon.social

                                    @msbellows here's the unrolled thread: https://mastoreader.io?url=https%3A%2F%2Fc.im%2F%40msbellows%2F116557139885627239

                                    Next time, kindly set the visibility to 'Mentioned people only' and mention only me (@mastoreaderio). This ensures we avoid spamming others' timelines and threads unless you intend for others to see the unrolled thread link as well.

                                    Thank you!

                                    jherazob@mastodon.ieJ This user is from outside of this forum
                                    jherazob@mastodon.ieJ This user is from outside of this forum
                                    jherazob@mastodon.ie
                                    wrote last edited by
                                    #33

                                    @mastoreaderio
                                    Well, this is handy
                                    @msbellows

                                    1 Reply Last reply
                                    0
                                    • ricci@discuss.systemsR ricci@discuss.systems

                                      Next, an even smaller datacenter, that just about anyone in #SLC has seen! This is XMission, a local Internet Service Provider that's been running since 1993, so one of The Ancients in Internet time. It's on a very busy part of 4th South, and if you've been by at night, you've seen the big LED display on the front of the building that they put various animations on.

                                      One of the things that I *think* is probably in this building is SLIX: https://slix.net/traffic/ - this is an Internet Exchange Point (IXP), where various carriers meet up to exchange traffic without it having to travel long distances. These are often run as a sort of community infrastructure - it's in the best interests of all networks involved to connect to each other so that they can do their jobs more efficiently.

                                      SLIX is fairly small (according to their own data they carry ~200Gbps, with some spikes up to 1Tbps). There are about 40 networks that meet there: https://slix.net/participants/ . Funny story, when I first got Google Fiber at my house, I was getting routed through California to get to the University of Utah campus just a few miles away. I pinged a guy I know who pinged a guy he knows who ... learned that some of the participants in SLIX didn't have their routes set up right. A config change later, and not only me, but basically everyone on any commercial ISP in the Salt Lake Valley had much more direct routes to campus!

                                      ciscojunkie@techhub.socialC This user is from outside of this forum
                                      ciscojunkie@techhub.socialC This user is from outside of this forum
                                      ciscojunkie@techhub.social
                                      wrote last edited by
                                      #34

                                      @ricci SLIX lists their organizational address publicly on PeeringDB, so you are indeed correct.
                                      https://www.peeringdb.com/org/8808

                                      (I guess it's possible that this is just the org's "business address," but I *highly* doubt it.)

                                      ricci@discuss.systemsR 1 Reply Last reply
                                      0
                                      • ciscojunkie@techhub.socialC ciscojunkie@techhub.social

                                        @ricci SLIX lists their organizational address publicly on PeeringDB, so you are indeed correct.
                                        https://www.peeringdb.com/org/8808

                                        (I guess it's possible that this is just the org's "business address," but I *highly* doubt it.)

                                        ricci@discuss.systemsR This user is from outside of this forum
                                        ricci@discuss.systemsR This user is from outside of this forum
                                        ricci@discuss.systems
                                        wrote last edited by
                                        #35

                                        @CiscoJunkie In this case their business address is adjacent to their datacenter. But yeah I don't see why they'd have it anywhere else, they have a datacenter 🙂 and it's in a fairly fiber-rich area

                                        1 Reply Last reply
                                        0
                                        • ricci@discuss.systemsR ricci@discuss.systems

                                          There's a lot of stuff going around about datacenters, so I decided to do a quick tour yesterday of some of the datacenters in the Salt Lake Valley. Some are indeed quite large, but there are a bunch of smaller ones too - and they are not always where you think!

                                          All of these are publicly known, and you can find them (and ones in your own area) at https://www.datacentermap.com/ .

                                          Let's start with a datacenter that I go by all the time! It's across the street from my grocery store in downtown #SLC. It's listed as a colocation facility; datacenters are famously secretive about who their tenants are, but we can guess that it probably hosts servers belonging to nearby businesses, especially ones that want their storage, etc. nearby, but don't want to have to maintain a secure, cooled room. Given the number of banks that have headquarters nearby, I'd bet at least some of them are customers.

                                          This is a fairly little guy, with apparently 16k square feet of floorspace and 1.6MW of power.

                                          fivetonsflax@tilde.zoneF This user is from outside of this forum
                                          fivetonsflax@tilde.zoneF This user is from outside of this forum
                                          fivetonsflax@tilde.zone
                                          wrote last edited by
                                          #36

                                          @ricci Great thread, Rob! I've been working in datacenters for decades but I still found it educational. Thank you!

                                          ricci@discuss.systemsR 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups