AI data centers now obsolete

[BeyondKnowledge]

All existing AI data centers are now obsolete. Nvidia is developing a processor that will require 80 to 90% less power. This will also make them cooler needing less water and run faster. 

While you hear a lot about processor speed, they are limited by having to transfer data from and to memory for each instruction executed. This is why fast memory has been eaten up by data centers. Nvidia has found a way to eliminate this transfer by computing directly in memory.




And the technical explanation.




At least two times as many processors can be put in existing buildings with less than half the power and cooling needs. This cuts down four data center problems, footprint, power, water, and noise.

Now we suddenly have tones of fresh e waist that will have to be delt with. Sometimes building things that are cutting edge in technology means you have invested time and money in a dead end. This time it is effency that put the dead end sign up on existing infrastructure.

Or perhaps they can put them in individual cases for cheap super high end PCs. Oh but that would still take more power.


The future of AI has just got more frightening now that it has even more processer capacity available.

Yet again, we are doing something because we can without asking if we should.

[BeyondKnowledge]

Ok, did I cover it too well or is it just a subject not needing discussing? 

Both sides are still fighting about the data centers but I don't think many know this solution is available. 

If you can't stop them, at least make them as efficient as possible.

[guyfriday]

The main issues with Data Centers is a fabricated issue. DCs can be built with their own power supply and the water used can also be recycled within their own systems limiting how much new water is needed for continuous run times. 

I think these new directions that Nvidia is trying to head will bring a type of AI to new personal computer builds. While I doubt these PC-AIs will be much more than limit use assistants, the use of them could be expanded with net connections.

[BeyondKnowledge]

The main issues with Data Centers is a fabricated issue. DCs can be built with their own power supply and the water used can also be recycled within their own systems limiting how much new water is needed for continuous run times. 

I think these new directions that Nvidia is trying to head will bring a type of AI to new personal computer builds. While I doubt these PC-AIs will be much more than limit use assistants, the use of them could be expanded with net connections.

I see the noise and water usage as building too cheap. Yes the water can easily be reused but that would cost more up front to build. Oversize the water cooling systems instead of just big enough and that would reduce the need for so many noisy fans. 

This new chip approach would reduce the power needed which they also try to do on the cheap. They try to tell the power companies they need less power than they actually do so the power company won't charge as much for the installation. 

Some get around the power issue by running their own generators but that is back to more greenhouse gasses from burning fuel. The global warming people don't seem to notice this though.

[andy06shake]

All existing AI data centers are now obsolete. Nvidia is developing a processor that will require 80 to 90% less power. This will also make them cooler needing less water and run faster. 

While you hear a lot about processor speed, they are limited by having to transfer data from and to memory for each instruction executed. This is why fast memory has been eaten up by data centers. Nvidia has found a way to eliminate this transfer by computing directly in memory.

[Video: https://youtube.com/6ivkPrqxnCY]

And the technical explanation.

[Video: https://youtu.be/5tmGKTNW8DQ]

At least two times as many processors can be put in existing buildings with less than half the power and cooling needs. This cuts down four data center problems, footprint, power, water, and noise.

Now we suddenly have tones of fresh e waist that will have to be delt with. Sometimes building things that are cutting edge in technology means you have invested time and money in a dead end. This time it is effency that put the dead end sign up on existing infrastructure.

Or perhaps they can put them in individual cases for cheap super high end PCs. Oh but that would still take more power.


The future of AI has just got more frightening now that it has even more processer capacity available.

Yet again, we are doing something because we can without asking if we should.

Good news i suppose, for the planet.

Hope this translates to me being able to buy a half-decent graphics card for less than £1500!

[quintessentone]

Google & SpaceX reportely in talks for rocket-launch (2027 prototype?) deal - Could AI data centres move to space?




Isn't it too crowded up there yet?

What it could look like.

[BeyondKnowledge]

Google & SpaceX reportely in talks for rocket-launch (2027 prototype?) deal - Could AI data centres move to space?

[Video: https://www.youtube.com/watch?v=C75jIJJnW98]

Isn't it too crowded up there yet?

What it could look like.

[Video: https://www.youtube.com/watch?v=ichlfqHF6XM]

Nice videos.


This video has the satalites enlarged just enough to be seen and this is not including junk form breakups.




Remember, the lower ones are going about 18,000 miles per hour. At that speed, a speck of paint can do a lot of damage. It is getting quite crowded up there. 

My question is how are they cooled with no air or water? Cooling is one of the biggest problems for a spacesuit, and now they are cooling racks of servers.

[quintessentone]

Nice videos.


This video has the satalites enlarged just enough to be seen and this is not including junk form breakups.

[Video: https://youtu.be/yiMbm9XBCK4]

Remember, the lower ones are going about 18,000 miles per hour. At that speed, a speck of paint can do a lot of damage. It is getting quite crowded up there. 

My question is how are they cooled with no air or water? Cooling is one of the biggest problems for a spacesuit, and now they are cooling racks of servers.

"Khan Noonien Singh in Star Trek II: The Wrath of Khan, who states: "It is very cold in space.""

[David64]

I see the noise and water usage as building too cheap. Yes the water can easily be reused but that would cost more up front to build. Oversize the water cooling systems instead of just big enough and that would reduce the need for so many noisy fans. 

This new chip approach would reduce the power needed which they also try to do on the cheap. They try to tell the power companies they need less power than they actually do so the power company won't charge as much for the installation. 

Some get around the power issue by running their own generators but that is back to more greenhouse gasses from burning fuel. The global warming people don't seem to notice this though.

I have a question that may sound dumb, but I know enough about computers to know I know nothing about computers.

Why does it have to be water ? Can't it be an eclosed system like a home A/C just on a much longer scale ?

Or is it a matter of cost designing a cooling system that big ?

[BeyondKnowledge]

I have a question that may sound dumb, but I know enough about computers to know I know nothing about computers.

Why does it have to be water ? Can't it be an eclosed system like a home A/C just on a much longer scale ?

Or is it a matter of cost designing a cooling system that big ?

Data centers use water for cooling because that is more efficient for coolimg at a distance than central AC units for large areas.

Most large cooling needs are not conveniantly located near where the heat needs to be dumped into the atmosphere. I worked for years in plastic recycling and the equipment had several parts need  cooling a distance way from a single cooling tower. The water was piped in, passed through heat exchangers where it took on the heat. Then returned to the cooling tower to have air passed through the water to remove the heat. Yes, the water was pumped around in a loop so it did not take much water per day to operate. Just what evaporated in the actual cooling.

This type of system is easy to maintain, cheaper, amd easy to transfer heat over long distances than say a central AC unit using a gas refrigerant. As the racks of servers are stacked together as would be in a warehouse but running, they need the heat moved a distance before they can get rid of it. Think of any AC cooled computer room you might have seen and cram hundreds of them side by side in a single building. Just moving the heat to somewhere to get rid of it is a big problem for air because it is less dense than water.

For the same reason large hospitals, hotels, office buildings, etc.. often used water circulation systems for both heating and cooling. One central heating and cooling plant can handle a large building by simply providing hot or cold water to radiators quite a distance away. 

Some of the data centers use so much water because they are so big to cool so much equipment.  The more heat removed, the more water evaporated. 

There are also air-cooled data centers. Those don't use water but many fans to pull air through small sections of server racks. This is very loud in operation though. I live around a mile from some of those and I can hear them. You almost need earplugs driving past them, they are so loud. They are in an industrial park so how they get away with the noise.