Generative AI’s Energy Problem Today is Foundational

Daily Feed: Quite a debatable topic. While we have seen infrastructure grow and adapt by itself as the technology advances, it seems to turn out in a different trajectory this time https://spectrum.ieee.org/ai-energy-consumption
IEEE Spectrum
Generative AI’s Energy Problem Today is Foundational
Before AI can take over, it will need to find a new approach to energy
4 Replies
Navadeep
Navadeep6mo ago
Relatable to what might happen if all the vehicles on road go electric suddenly! The power generation and grid will cease to support the massive load demand... Maybe the technology is moving at a faster than ever pace?
techielew
techielew6mo ago
That's a super interesting read. There's also not a clear (to me) way you can recoup the expended energy outside of some sort of tax. What we need to consider is something like what's being worked on with EVs - EV discharge. Basically the grid would ask that all EVs plugged into the infrastructure allow the grid to draw power from their batteries when not in use in the event of a demand surge: https://embeddedcomputing.com/application/automotive/electric-vehicles-powertrain/success-story-how-electric-vehicles-can-give-back-to-the-grid
Embedded Computing Design
Success Story: How Electric Vehicles Can Give Back to the Grid - Em...
I used to think electric vehicles (EVs) were invented recently in response to the global outcry to reduce carbon emissions. So, you can imagine my surprise when I learned EVs have been in and out of popularity since the late 19th century but didn’t stick until the 21st century mostly because fossil fuels were just so available.
techielew
techielew6mo ago
For LLMs, I'm not sure there's an analog. Can you think of one?
Navadeep
Navadeep6mo ago
Probably powering them from the cars 😉 EVs giving back to the grid can be of use in managing the load demand throughout the day more so in a decentralized power network. Like, someone else charging their car from the energy given back is only an efficiency drop in the transmission.
Want results from more Discord servers?
Add your server
More Posts
Nvidia Trains LLM on Chip DesignDaily Feed: Fingers crossed - the investment on human workforce for chip design is immense now and iBringing Tiny Chiplets To Embedded SoCsDaily Feed: Someone is envisioning chip design taking inspiration from lego-block type building httpA glimpse on Python for embedded programming.Daily Feed: A glimpse on Python for embedded programming. Came across a magazine article collectionTHE AMAZING $1 MICROCONTROLLERDaily Feed: An extensive collection of resources about popular available microcontrollers. The amounRevolutionizing Energy Conversion and Sustainability at ECCE 2023Daily Feed: Continuing from the earlier discussions on energy and infra, here's a summary of what giHow Deepfakes Fuel Conspiracy TheoriesDaily Feed: Open for thoughts - is deepfake concerning to you personally? https://spectrum.ieee.org/What’s next in BMS? Safer, more affordable electric vehiclesDaily Feed: Probably one of the most talked-about circuitry ever - the Battery Management System httRISC-V adaption and it's emergence into the mass markets is a very happening thingDaily Feed: RISC-V adaption and it's emergence into the mass markets is a very happening thing httpsBlockchain Technology Explained: How do Bitcoin & Cryptocurrencies Work?Daily Feed: A book after long time. Recently I have heard about blockchain being applied in farming How Will AI Affect the Semiconductor Industry?Daily Feed: "Given high level specifications, AI tools can potentially assist in all parts of chip d