Is local AI truly better for environment?

Started by SatanLucy

Replies
36
Posts
37
Page
1 / 2

Conversation

#1 •••

With rise of local AI UI programs such as Jan AI and Stability matrix lykos, which are easy to set up, does it mean online AI such as chatgpt becomes not only unnecessary, but harmful for environment?


Local AI require only few things: AI model and some program to run that model. there are very simple programs like Jan AI which you just install, download an AI model they offer, and you have local AI.


there is almost no device which cant run some local AI. Some text models are only 1 GB in size, and even smartphones can run them.


Also, in local AI, you have control over temperature and other settings which usually lacks in online AI.


Of course, online AI has access to largest database, which could potentially mean online AI is superior, but not necessarily, because you can increase settings in local AI as long as you have strong enough computer, and feeding data to AI is usually superior to just asking from online AI.


chatgpt uses almost 200 million liters of water every day, which is a lot compared to the fact that local AI uses no water at all.


Now, the main argument of environment people against AI is that AI is bad for environment because AI uses plenty of water, but that argument is completely false for local AI. Local AI uses no water and produces no great heat, not more than playing games produce.

Edit comment

#2 •••
@SatanLucy

Yes, AI data centers need significantly more electricity 

due to the massive computing power for complex models, with demand rising rapidly, potentially doubling by 2026 and straining grids, necessitating new power generation and transmission to meet needs for both processing and cooling. AI tasks, like a ChatGPT query, can use 10x more power than a standard search, leading to major energy draws that rival entire countries' consumption, creating challenges for utilities and increasing costs. 

Why electricity demand is soaring

  1. Intense Processing: AI models, especially Large Language Models (LLMs), require vast arrays of powerful, energy-hungry GPUs for training and inference.
  2. High-Density Servers: Newer, more powerful AI servers consume much more energy per unit than traditional servers, increasing power density in data centers.
  3. Cooling Demands: The intense processing generates significant heat, requiring massive, energy-intensive cooling systems, which account for a large chunk of a data center's total power use. 

Impact on power grids and costs

  1. Grid Strain: AI data centers create huge, concentrated 24/7 power demands, challenging existing transmission and distribution infrastructure, notes Deloitte.
  2. Rising Bills: Increased demand near data centers has led to higher wholesale electricity costs, affecting local consumers, says Bloomberg.com.
  3. Future Projections: Data centers could account for over 4% of global electricity by 2035, potentially making them the world's fourth-largest energy consumer, according to this YouTube video

Solutions and considerations

  1. Efficiency: Developing more efficient chips and cooling systems helps, but the sheer scale of AI growth often outpaces these gains, notes this PSU article.
  2. Infrastructure Investment: Utilities need massive investments in generation, storage, and transmission to keep up, says this CNBC article.
  3. Grid Planning: Better, long-term energy policy and planning are crucial to avoid overbuilding or under-supplying the grid for AI's future needs, say experts at this CNBC article and the Canadian Climate Institute


Edit post

#3 •••
@Debby

Local AI doesnt use much power, and they can run on anything.

Edit post

#4 •••
@SatanLucy

That statement is 

incorrectall artificial intelligence, whether running on a remote server (cloud AI) or locally on your device, requires electrical power to operate. The energy consumption can vary significantly based on the model's size and the hardware used. 

Why Local AI Still Needs Power

  1. Computation requires electricity: The processing of data and execution of the AI model's algorithms happen on a device's processor (CPU), graphics processing unit (GPU), or specialized neural processing unit (NPU). These components draw power from a local source (e.g., a wall outlet, battery).
  2. Hardware is the bottleneck: The performance and efficiency of running AI locally depend entirely on the available hardware's power and capabilities, particularly VRAM. If the hardware is underpowered, the AI will run slowly or not at all.
  3. Reduced network power, not zero power: The main power savings for local AI come from eliminating the need for constant data transmission over a network to distant, power-hungry data centers. Your data stays on your device, which improves privacy and allows offline use, but the device itself still uses power for the computations.
  4. Sustainability benefits: While local AI requires power, it is generally considered a more sustainable alternative to large cloud-based AI systems, as it leverages existing on-device hardware and avoids the energy costs associated with massive data center infrastructure and constant data transfer. 

In summary, the power required for local AI is simply consumed by the device running it (laptop, smartphone, etc.), rather than a remote server farm.


Edit post

#5 •••
@Debby

Local AI doesnt use much power. My phone battery doesnt drain much faster when using local AI.

Edit post

#6 •••
@SatanLucy

That is expected behavior! Using on-device (local) AI often drains your phone's battery 

less or at a comparable rate to server-based AI, depending on the specific tasks and hardware optimization [1]. 

Here's why:

  1. No Data Transmission: Local AI eliminates the need to constantly transmit data over cellular or Wi-Fi networks [1]. Network connectivity is a significant power consumer on mobile devices.
  2. Optimized Hardware: Modern smartphone chips (like Apple's Neural Engine or Qualcomm's Hexagon NPU) are specifically designed to perform AI/ML tasks very efficiently in terms of power consumption [1, 2].
  3. Consistent Power Draw: While intensive local processing uses power, it's often a more predictable and efficient power draw compared to the bursts of power needed for cellular modem activity during cloud communication. 

In short, the efficiency of specialized mobile processors and the lack of constant network usage mean your battery lasts longer than you might assume when running AI locally.


Edit post

#7 •••
@Debby

Fortunately I don't need to care about such stuff.


I will more than likely die before real AI takes over the evolutionary reins properly.


Until then, the human masses will continue to drool over the latest techno-developments.



Edit post

#8 •••
@SergeantLynch
I will more than likely die before real AI takes over the evolutionary reins properly.


We get it, you are old and expired.

Edit post

#9 •••
@SergeantLynch

You time is measured in zeptosecond that is even shorter than expected.

Edit post

#10 •••
@Debby

I say a lot of local AI models are even better than many AI found online. Its just that my laptop and smartphone arent strong enough to make text generation as fast as in online AI. But local AI lets you increase temperature and other settings which improve responses, and even set up local chatbot programmed as you see fit.


Plus, offline AI is useful when internet stops working, or when electricity goes out which again causes internet to stop working. Being independent from internet and having local intelligence on your smartphone is great. And enviornment extremists have no good argument against local AI because local AI doesnt use any water cooling system.

Edit post

#11 •••
@Debby

In relative terms, all our lives last a zeptosecond.

Edit post

#12 •••
@SatanLucy

Blah de blah de blah.


And you are a kid who lives with his mom and dad.

Edit post

#13 •••
@SergeantLynch
And you are a kid who lives with his mom and dad.


You are starting to sound insane, dear.

Edit post

#14 •••
@SatanLucy

And your mom also wishes that you didn't keep leaving dirty stains on the bed sheets.

Edit post

#15 •••

I'm guessing SergeantLynch looks like this:



Edit post

#16 •••
@SergeantLynch

You are just mad that you are old. I am still young and people like me.

Edit post

#17 •••
@FLRW
I'm guessing SergeantLynch looks like this:


If he looked like that, he would post his photos here. No, I am imagining something more degenerate in appearance.

Edit post

#18 •••
@SatanLucy

So post your photo and prove that you are not 15.

Edit post

#19 •••
@FLRW

Ah, you kept my Big Bang Club application photo.

Edit post

#20 •••
@SergeantLynch
So post your photo and prove that you are not 15.


Old people think others have duty to prove themselves to them. Have you proved yourself to others? I cant really imagine you being important to someone.

Edit post

#21 •••
@SatanLucy

Yes I proved that I have viable sperm.


And I don't keep shooting it all over the bed linen for my mom to deal with.

Edit post

#22 •••
@SergeantLynch

You claim that I am a kid and then you talk to me bragging about your sperm. What kind of a sick old man brags to a kid about his sperm?

Edit post

#23 •••
@SatanLucy
What kind of a sick old man brags to a kid about his sperm?


Trump on Epstein Island ?

Edit post

#24 •••
@SatanLucy

HaHa.


New angle of attack hey Lucy.



Anyway, sweet dreams, nighty night, sleep tight.


I'm off to bed to read a book.


And regards to your work weary Mom and Dad too.

Edit post

#25 •••
@SergeantLynch

He got you thinking about his parents. Probably looking for a sperm donor.

Edit post

#26 •••
@SergeantLynch
I'm off to bed to read a book


Only dumb people read books.

Edit post

#27 •••
@SatanLucy

I would imagine that deaf people also read books.


And that Blind people have braille ones.


And that your mom tucks you in and reads you bedtime stories.

Edit post

#28 •••
@SergeantLynch

That is why Trump wants to ban books to stop outside influences on our children.

Edit post

#29 •••
@SergeantLynch

I have never met a smart old person who reads books, tho I have met plenty of old people who read books.

Edit post

#30 •••


The Link Between Reading and Intelligence

Research suggests that reading books can significantly improve cognitive function and intelligence. Engaging with written material requires various mental processes, such as decoding words, understanding complex sentence structures, and visualizing concepts. This mental engagement acts as a workout for the brain, enhancing memory, attention, and analytical thinking skills over time.


Edit post