AI News: Nobody Wants a Data Centre Next Door. Is AI Being Pushed Too Far?
Welcome to another episode of Cloud
Unplugged.
We've got news for you in this episode.
We're
the midterms who isn't,
but also primarily around the revolt
against the data centers.
No one wants those data centers in their
area.
The impact that's had on AI with the
Democrats get it in and what that's kind
of done to the stock market.
And LLM jacking, if you're not doing it,
you need to do it.
Steal those keys,
use other people's money,
and do some prompting.
But first things first,
let's get into it with the midterms and
what the data was saying around people
just not wanting to have data centers near
them.
What do you reckon?
What do you reckon is going on in
the states there where people,
I think it was forty four or forty
five local votes basically said to
restrict the data centers.
They don't want them.
What do you think, Salman?
I think it's one of those that people
are saying we don't want the data centers,
but at the same time,
people are using LLMs day to day for
their jobs.
Not us.
Do the tasks.
Not us.
We don't.
So I don't know what the numbers are
saying.
John, tell us about the numbers.
What happened in the US midterms?
Well, basically, the Democrats smashed it,
didn't they?
They won the Senate,
won the House as well, obviously,
underneath.
And I think their whole strategy
throughout the midterms was being quite
anti-capitalist.
So there is obviously quite a lot of
synergies between...
how people are making the money, you know,
the top richest people in twenty twenty
six today and the corruption that's going
on, you know,
where all the money is moving to and
then what what types of companies are
underneath those people.
It's very AI and data center heavy,
you know, from Meta through to Google,
Alphabet through to Amazon, et cetera,
et cetera, Elon.
so i suppose people you know if i'm
thinking it just from from a sentiment
perspective you have these billionaires
either claiming space shoving a load of
things in space uh that they claim for
with with obviously their satellites or
they're either claiming the land to build
data centers uh there you know and i
think there's probably a pushback on the
fact that it's kind of getting out of
control for people that
people are being done to.
They don't get a choice.
The government's just backing the rich and
letting them do what they want and
stomping all over everyone else to get
where they want to get to irrespective of
other people.
That's my sentiment aspect and I think
everyone's
basically pushed back on that.
And I think everyone's saying,
I think something like.
Of the votes,
people opposed any data center near them.
Um,
and I think only something like said it
was kind of critical and we'll kind of
get onto the stock market, but, um,
all the expansions.
So I think there was like,
obviously data center expansions going on.
Um,
of them have been paused or temporarily
paused, I think.
Um,
And a lot of it was, you know,
a lot of the winning aspect of the
Democrats was to talk about those things
and to talk about, obviously,
the cost of living was kind of like
the big things.
But yeah, what do you think?
Are you pro that?
Are you pro those people claiming back
their land and kicking their capitalist
companies in the nuts and being like,
back off?
What do you think?
I wouldn't call it like kicking companies
in the nuts.
It's because I think it's always hard
every time there's like an election.
It's always hard to figure out that one
party won because of specific thing like
not building AI data centers.
Did they win because of some of the
candidates say not building air data
centers?
I don't know.
But the important thing here is that any
time an infrastructure is to be built,
no matter where it is,
there's always opposition wherever it's
built.
Remember, though,
in our previous episodes,
you were talking about the booze every
time AI got mentioned, the crowd booed.
Yeah.
are booing it right they're not like they
they love using it to book holidays but
um you know because we're all hypocrites
obviously at the end of the day
We're all for that,
but just don't take our jobs.
But also the important thing about data
centers,
unlike maybe you can think about people
installing wind turbines.
When people want wind energy,
they're like, yeah,
we don't want the turbines in our
backyard, but we love wind energy.
So I think the reason why people are
against also is because the areas,
the data centers,
do require a lot of power,
a lot of water.
And I think reservation is where all this
stuff is going to come from,
as much as it requires the chips and
the wiring and the jobs and everything.
I think, though,
there's a push and a pull,
isn't the model going on here?
People are not
screaming out for AI,
not like it's a bit like saying, um,
you know, you like to,
this is such a bad, I apologize.
I'm apologizing now because this metaphor
is so horrifically bad,
but I'm going to say it anyway,
it's a shit metaphor, but I've committed.
It'd be like, people like cookies,
but you wouldn't have a twenty four foot
cookie and be like, well,
you like cookies.
And you're like,
it's an impracticality of like, well,
I can't like, obviously I like them,
but I don't want the twenty four foot
one like outside my house or in my
garden just because I like a cookie.
You know,
there's obviously like reality checks and
people aren't asking for that.
You know,
people are asking specifically for that.
They're also not saying, yeah,
I like to book a holiday,
but I also do like plants.
It's like I want to deforest the world
just so I could book a holiday like
this.
There's.
a contrast to it right so and i
think that's what people are saying and
they're also not demanding it they're not
like i need more ai in my life
can you just build more data centers i
can't get enough of this ai please there's
not enough ai for me today i need
more data centers immediately there's
things i just i just can't get enough
tokens um you know no one's saying that
people are pushing it so i don't think
the pull is there
but the businesses are doing the push.
And I think that's what people are saying.
Stop pushing it like a drug almost.
I mean, drug dealers or something.
Why do you think businesses are doing the
push?
Why that is the case?
Because there was a load of money not
spent during Covid.
So all of the VC money,
all of the private equity money that's all
sat there,
all that capital hasn't been put to work.
And all through the Covid period,
it kind of rained back and it was
quite disruptive.
And then all the money has basically gone
pushed full blown AI.
AI has happened and everyone's like being
like, that's it.
This is the thing we need to invest
in.
And so all the investments happening.
And so people are borrowing money.
They get an investment to do these things.
And then they're seeing obviously the
market increase.
And then obviously the cloud providers are
then reacting to where money's moving and
the investment and be like,
we need to get more chip,
we need more GPUs,
we need more data centers.
You know,
that's because they're future-proofing
like multi-year growth plans.
And so obviously they're projecting out
multi-year on those things for those
investments.
But, you know,
that's where I'm saying people aren't,
There's a lot of people that are not
those people in the world.
And as people are pushing it and other
people are making a load of money off
the stock market with all their
investments,
there's a lot of people that make nothing
out of it.
They don't get anything.
The only thing they're going to get is
the risk of maybe losing their job from
it,
not necessarily a positive where that
shared value across the world.
It's basically going to other people's
pockets.
And people aren't dumb.
They know that.
And I think that's why the US being
like this is mental.
And then pushing back.
That's what I think.
I don't know if that's fully true.
But I say it obviously being a hypocrite
too,
because I am pushing AI as a business.
So everything I say is absolute total
hypocrisy.
But I do understand it at the same
time.
Who do you think is the Willy Wonka
of AI at the moment, John?
Who's the Willy Wonka of AI?
I would say, I don't know.
I feel like they're all big wonkers,
aren't they?
A lot of them.
I don't know.
I'm not really sure who the biggest wonker
of them all is.
Who do you think the big wonker is?
Out of all the wonkers,
which one's the biggest one,
do you reckon?
All I'm going to say is you are
right because yesterday, November fifth,
we think, well,
that's what the sentiment is,
that the build-up of those data centers is
going to be a little bit slower.
That's reflected on what happened in the
stock market yesterday.
And NASDAQ fell about six percent.
yesterday which is the worst it's been
since the ai boom started like middle of
last year and you know like nvidia dropped
by like almost ten percent which is about
i think half a trillion worth five or
five hundred billion or four fifty two
point five trillion two point five
trillion was wiped off the nasdaq
of which of which four fifty billion was
just Nvidia right something like nine
percent yeah exactly yeah and then Amazon
and then Microsoft and then Meta as well
they all fell between two to five percent
right because because people are not
people
Now we're talking about VC.
You spoke about VCs, investors,
and they're worried about the AI build out
will slow down after what's happened in
the election results, right?
Because voters, as you're saying,
are opposing on face value build out of
local data center.
And the timing is a little bit
like, unfortunate, I guess,
because Anthropic filed for IPO, right,
to go to public on just the end
of last month, October.
And yeah, so I think they,
they reported a loss of hundred and twenty
billion for compute commitments, right?
For compute commitments,
because they committed to using that much
compute to SpaceX.
So that's good.
I mean, you know,
it's a weird thing to say,
because obviously I'm in this space,
but
a lot of people don't you know we
were talking about these things you know
you know me saying oh two point five
trillion was wiped off the nasdaq and
obviously you know i understand economics
it does it does have impact um but
it has you know the us stock market
has been very heavily reliant on ai for
it for its market right so it's it's
disproportionately relying on it,
which is never a healthy thing.
And it's propping it up.
And so you're only a few bad things
like this to happen because it's obviously
superficial anyway.
You can't put all your eggs in one
basket for your country.
the stock market but most people in that
two point five trillion wouldn't have
taken anything from it anyway like that
meant nothing to most of the people in
the world they're not like oh my god
that two point five trillion that's really
impacted me today like you know i can't
get my pret a manger sandwich that i
really like you know so
it's so in a certain sphere of sets
of individuals that are making the money
from all of this that is not reflective
of a lot of other people in the
world so um you know i think that's
kind of the challenge that everybody has
at the moment is it's pushed sometimes you
can push things too far and i feel
like
as we even spoke about,
you can't not hear about AI, right?
Even with like every bit of news of
every single thing of every single day is
all about it.
A hundred percent of the time,
every hour of every minute.
And you get to the point where like,
it's a push,
you're pushing it and it's pushing it and
you're pushing it.
And actually maybe people just need a bit
of a break.
And it's like,
can we just slow it down?
And,
you know, doomsday and, you know,
we're all going to die and it's going
to take over us and we've got ten
years or however long before the end of
the world and blah, blah, blah.
I mean,
all those things are not great things,
you know.
So I don't think it's a bad thing
to counterbalance and regulate it a bit.
Do you know what I mean?
And I think it's, in the end,
probably a good thing rather than a bad
thing.
But I think if we think about let's
just think about this for a second, right,
John,
let's say the data centers are not allowed
to be built, right?
They're not allowed to be built in the
United States of America.
But what does that mean for the end
user?
Does that mean that now the supply is
less?
So the models are going to be a
bit more expensive.
So is everybody competing for the same
resources?
What does it mean for the end user?
And will we see where companies then
perhaps can use data center?
Of course,
you don't have data center in the USA.
but you have data centers all around the
world,
perhaps maybe people branch out building
data centers elsewhere.
I know latency is a thing and and
also data centers in the space.
John, what is actually going to happen?
Or is this all just like a like
a fad where people are saying, well,
you know,
we're going to slow down the data center
build, but in reality,
nothing's actually going to happen.
I don't know.
I guess.
Yeah.
Who really knows?
But slowing down doesn't mean stopping
and.
You know,
do we all need another model that's better
than the other one i mean are we
all saying oh my god this model is
just so like i need a better one
like hurry up and give me a better
model asap i want one where i want
one that reads my mind i don't want
to talk or type anymore guys i want
one that's got the power to look into
my eyes and through model training it
knows what i'm thinking and what i want
and that's the next model i need so
if you can use
as much water and power as you possibly
can to build a model that reads my
mind, that would be great.
Take whatever land you need,
take all the trees,
plummet them down because that's kind of
what I need.
I don't think anybody needs it to that
degree.
So, yeah,
the vendors are going to have to slow
it down.
Slow it down.
Don't use so much compute.
Be happy with the model you've got.
Yeah, but I disagree, right?
Why...
Why do we keep getting new phone models
every year?
I don't.
Why do we keep getting new car models?
Not us, but they keep getting released,
right?
You don't have to pick the new model
if you don't want to,
but I just don't understand how that is
any different to phone models getting
released every year or car models getting
released every year.
It isn't.
It's a lot more work.
But I think even if you look at
the statistics, the latest phones,
people aren't buying new phones as much as
they used to be.
So even that's slowing down.
And also,
just as human beings from a consumption,
just getting, I guess, more moral,
I suppose, rather than technical.
No,
but if you didn't have a way to
dispose of your stuff,
and there wasn't such a thing as a
tip, and you couldn't go with it,
and it had to live in your garden,
you would definitely buy less, right?
Because your garden would be full of shit,
right?
And you'd be like,
I can't live like this.
We can't buy another thing.
So obviously when it's all hidden,
you'll just keep consuming and that's,
you know, but it isn't,
it doesn't make it a good thing.
It doesn't make it a positive or a
healthy thing.
And actually, you know,
want a need you know you might want
something but you don't need it and so
i think and that's the same here i
feel like we might aspire for things but
we don't need them and some of this
is like actually we've gone astronomically
fast
compared to where we were.
Just think about how much has evolved over
the last three years.
We're all wearing masks.
There was no AI.
We're getting on tubes.
Not that long ago, right?
Twenty twenty, whatever,
twenty twenty one.
uh and now all of a sudden that's
all forgotten about and we're like
chatting to things as deep fake images of
things as ai videos that look so realistic
you can't even just do just in that
short period of time and i think that's
enough for now we don't need to keep
going faster and further that's
good progress how do you so i think
the way you control you can you can
control that if you make things more
expensive if it was expensive for you to
like create an image like the true value
because i don't think at the moment i
don't think all the all the all the
subscriptions that we buy are they're a
hundred percent subsidized not yeah all of
it no hundred percent yeah
But they are subsidized because the
companies want to make sure they get the
market share.
So if there was true value attached to
the subscription that you buy,
you would be a bit more careful.
Like the free model of ChatGPT is really
good, right?
And ChatGPT doesn't have any ads.
So where are they making money from?
Google ads, for example, that makes sense,
right?
You can search ads.
There is ChatGPT ads.
Do you not know?
Now there is, yes.
There is ChatGPT ads, yeah.
I don't think they're very good,
but there is.
yeah there's gpt ads but i yeah i
don't know john what the end game for
this is but i don't really think it's
my opinion that anything's going to slow
down they still as you said there's a
lot of money that's been put in there's
a lot of backing it doesn't like one
day i know yesterday there was a bit
of a crash of the stock market one
day doesn't really prove it's a bubble i
know we keep saying we're living in a
bubble but i think it's just going to
keep going
But the important thing...
Do you know what?
I think everything's like elastic.
That's how the world always works.
You push to the point that it's stretched
and it bounces back.
You know what I mean?
And we've just seen it before.
We, we, we like elastic,
we swang too far to the left and
it was a ricochet back all the way
to the right, right?
Swing all the way back over here.
We're pushing too far to the right and
it swings all the way back again.
That's just kind of how it works.
So I feel, I feel it will.
I think,
I think we're about to bit elasticated
back.
We're all going to swing back a little
bit and we'll be probably a really good
middle phase.
Um,
and then we'll probably swing back to the
side after that middle phase.
Um,
But yeah,
that seems to be how the world works
nowadays, isn't it?
Yeah.
And I think the important thing to an
end user using these services is just to
make sure
be cognizant of the fact that supply at
some point, perhaps for a little while,
might not be as readily available.
So think about how you are using your
models and how much you're using them and
how much it consumes in terms of credence
and whatnot.
But the good thing about all of this
john is that yes the data centers need
to be built and perhaps they'd be slowed
down but nobody can stop the jackers the
llm jackers yeah you can spend your own
money why anyway if if you're worried
about token usage you don't need to work
just jack someone else's tokens go and get
the go and get the api key
And get going.
You shouldn't need to use your own tokens.
It's twenty twenty six.
It's insane.
Go and jack some.
Disclaimer, John is joking.
Don't do this.
Yeah.
Just so anybody reads it and like I
said, well, don't do that.
So LLM jacking, John, this thing,
of course,
wherever there is an opportunity,
people will find loopholes and try and do
this.
So Google.
They released, you know,
they did some threat intelligence.
They released a news article this week.
They're saying that criminals are stealing
cloud credentials and API keys,
then using the victim's accounts to run
expensive models.
This is the thing that we've also seen
before in the past, John,
where people were, you know, when crypto,
when people were mining for coins,
people would steal cloud credentials,
run VMs with their mining equipment on
there,
with the mining software just to mine it.
So basically we're seeing a repeat of the
same thing,
that fraudulent charges as much as like a
hundred thousand dollars for some person,
and basically they stole their
credentials,
And they started running expensive models.
These are very sophisticated ones, right?
Because, and I think that the reason why,
and I think like for some people,
you know,
they're seeing about one million dollars
for some organization that basically
credentials got stolen and people started
running expensive models only because the
stolen credentials
access was being resold through what they
call LLM Mixer,
which is just basically a gateway.
Did you write a product called Jet Night
or something?
I'm sure.
Did you write something for that where you
were selling them on to some web service
you wrote?
What was it called?
Jet Day?
What did you call it again?
It's called Jet Night.
I didn't write it.
That's what you created.
I'm not right.
I didn't write it.
I'm not behind.
Basically, this says... Guess what, John?
It says sixty dollars and you get
unlimited tokens for a month.
Sixty dollars.
Forget about the pro max subscription that
you get from Claude.
Just go jet night and do not go
jet night because it's fraudulent.
It's completely wrong.
And they're selling for sixty dollars a
month.
And somebody used about five hundred
thousand API calls in like eight hours,
which is basically one million dollars
worth of tokens that were spent.
what are you doing with those tokens i
don't know well that's because you know
it's being reused by many people whatever
but this is it's this is happening so
the credential theft is nothing new this
is yeah but people need to be aware
of it i guess is the thing isn't
it so you people should be probably
cautious about that and make sure you
haven't had your uh your api keys stolen
and that people are running absolutely so
it is worth paying attention to yeah
As always is the case, right?
Don't want any exposed keys.
Make sure you have multi-factor
authentication.
Keep rotating your credentials.
Make sure your keys and your access keys
are locked down to specific accounts,
specific areas.
They're scoped.
by what models you can run,
what things you can run,
maybe start setting up caps in your cloud
budget as well.
All the good things that we learned with
FinOps and DevOps and security practices,
they still apply.
But John, you're right.
People need to be aware because people are
taking advantage of this,
which is a bit sad.
But these things will happen.
They still happen nowadays.
with cyber, what is it called, tokens.
So yeah, LLM jacking is a thing.
It's a new thing.
Well,
that has been the wrap-up of the news.
Got a bit philosophical, got a bit moral,
got a bit criminal.
at the very end and also if you
if you are passionate about who you think
the biggest wonker is uh let us know
as well because we're keen to know i
didn't find out salmons um you didn't find
out ours because i'm not sure either but
uh let us know what you think but
until the next time we'll be back as
always uh digging into these topics speak
to you soon
Creators and Guests
