AI News: Nobody Wants a Data Centre Next Door. Is AI Being Pushed Too Far?

Welcome to another episode of Cloud

Unplugged.

We've got news for you in this episode.

We're

the midterms who isn't,

but also primarily around the revolt

against the data centers.

No one wants those data centers in their

area.

The impact that's had on AI with the

Democrats get it in and what that's kind

of done to the stock market.

And LLM jacking, if you're not doing it,

you need to do it.

Steal those keys,

use other people's money,

and do some prompting.

But first things first,

let's get into it with the midterms and

what the data was saying around people

just not wanting to have data centers near

them.

What do you reckon?

What do you reckon is going on in

the states there where people,

I think it was forty four or forty

five local votes basically said to

restrict the data centers.

They don't want them.

What do you think, Salman?

I think it's one of those that people

are saying we don't want the data centers,

but at the same time,

people are using LLMs day to day for

their jobs.

Not us.

Do the tasks.

Not us.

We don't.

So I don't know what the numbers are

saying.

John, tell us about the numbers.

What happened in the US midterms?

Well, basically, the Democrats smashed it,

didn't they?

They won the Senate,

won the House as well, obviously,

underneath.

And I think their whole strategy

throughout the midterms was being quite

anti-capitalist.

So there is obviously quite a lot of

synergies between...

how people are making the money, you know,

the top richest people in twenty twenty

six today and the corruption that's going

on, you know,

where all the money is moving to and

then what what types of companies are

underneath those people.

It's very AI and data center heavy,

you know, from Meta through to Google,

Alphabet through to Amazon, et cetera,

et cetera, Elon.

so i suppose people you know if i'm

thinking it just from from a sentiment

perspective you have these billionaires

either claiming space shoving a load of

things in space uh that they claim for

with with obviously their satellites or

they're either claiming the land to build

data centers uh there you know and i

think there's probably a pushback on the

fact that it's kind of getting out of

control for people that

people are being done to.

They don't get a choice.

The government's just backing the rich and

letting them do what they want and

stomping all over everyone else to get

where they want to get to irrespective of

other people.

That's my sentiment aspect and I think

everyone's

basically pushed back on that.

And I think everyone's saying,

I think something like.

Of the votes,

people opposed any data center near them.

Um,

and I think only something like said it

was kind of critical and we'll kind of

get onto the stock market, but, um,

all the expansions.

So I think there was like,

obviously data center expansions going on.

Um,

of them have been paused or temporarily

paused, I think.

Um,

And a lot of it was, you know,

a lot of the winning aspect of the

Democrats was to talk about those things

and to talk about, obviously,

the cost of living was kind of like

the big things.

But yeah, what do you think?

Are you pro that?

Are you pro those people claiming back

their land and kicking their capitalist

companies in the nuts and being like,

back off?

What do you think?

I wouldn't call it like kicking companies

in the nuts.

It's because I think it's always hard

every time there's like an election.

It's always hard to figure out that one

party won because of specific thing like

not building AI data centers.

Did they win because of some of the

candidates say not building air data

centers?

I don't know.

But the important thing here is that any

time an infrastructure is to be built,

no matter where it is,

there's always opposition wherever it's

built.

Remember, though,

in our previous episodes,

you were talking about the booze every

time AI got mentioned, the crowd booed.

Yeah.

are booing it right they're not like they

they love using it to book holidays but

um you know because we're all hypocrites

obviously at the end of the day

We're all for that,

but just don't take our jobs.

But also the important thing about data

centers,

unlike maybe you can think about people

installing wind turbines.

When people want wind energy,

they're like, yeah,

we don't want the turbines in our

backyard, but we love wind energy.

So I think the reason why people are

against also is because the areas,

the data centers,

do require a lot of power,

a lot of water.

And I think reservation is where all this

stuff is going to come from,

as much as it requires the chips and

the wiring and the jobs and everything.

I think, though,

there's a push and a pull,

isn't the model going on here?

People are not

screaming out for AI,

not like it's a bit like saying, um,

you know, you like to,

this is such a bad, I apologize.

I'm apologizing now because this metaphor

is so horrifically bad,

but I'm going to say it anyway,

it's a shit metaphor, but I've committed.

It'd be like, people like cookies,

but you wouldn't have a twenty four foot

cookie and be like, well,

you like cookies.

And you're like,

it's an impracticality of like, well,

I can't like, obviously I like them,

but I don't want the twenty four foot

one like outside my house or in my

garden just because I like a cookie.

You know,

there's obviously like reality checks and

people aren't asking for that.

You know,

people are asking specifically for that.

They're also not saying, yeah,

I like to book a holiday,

but I also do like plants.

It's like I want to deforest the world

just so I could book a holiday like

this.

There's.

a contrast to it right so and i

think that's what people are saying and

they're also not demanding it they're not

like i need more ai in my life

can you just build more data centers i

can't get enough of this ai please there's

not enough ai for me today i need

more data centers immediately there's

things i just i just can't get enough

tokens um you know no one's saying that

people are pushing it so i don't think

the pull is there

but the businesses are doing the push.

And I think that's what people are saying.

Stop pushing it like a drug almost.

I mean, drug dealers or something.

Why do you think businesses are doing the

push?

Why that is the case?

Because there was a load of money not

spent during Covid.

So all of the VC money,

all of the private equity money that's all

sat there,

all that capital hasn't been put to work.

And all through the Covid period,

it kind of rained back and it was

quite disruptive.

And then all the money has basically gone

pushed full blown AI.

AI has happened and everyone's like being

like, that's it.

This is the thing we need to invest

in.

And so all the investments happening.

And so people are borrowing money.

They get an investment to do these things.

And then they're seeing obviously the

market increase.

And then obviously the cloud providers are

then reacting to where money's moving and

the investment and be like,

we need to get more chip,

we need more GPUs,

we need more data centers.

You know,

that's because they're future-proofing

like multi-year growth plans.

And so obviously they're projecting out

multi-year on those things for those

investments.

But, you know,

that's where I'm saying people aren't,

There's a lot of people that are not

those people in the world.

And as people are pushing it and other

people are making a load of money off

the stock market with all their

investments,

there's a lot of people that make nothing

out of it.

They don't get anything.

The only thing they're going to get is

the risk of maybe losing their job from

it,

not necessarily a positive where that

shared value across the world.

It's basically going to other people's

pockets.

And people aren't dumb.

They know that.

And I think that's why the US being

like this is mental.

And then pushing back.

That's what I think.

I don't know if that's fully true.

But I say it obviously being a hypocrite

too,

because I am pushing AI as a business.

So everything I say is absolute total

hypocrisy.

But I do understand it at the same

time.

Who do you think is the Willy Wonka

of AI at the moment, John?

Who's the Willy Wonka of AI?

I would say, I don't know.

I feel like they're all big wonkers,

aren't they?

A lot of them.

I don't know.

I'm not really sure who the biggest wonker

of them all is.

Who do you think the big wonker is?

Out of all the wonkers,

which one's the biggest one,

do you reckon?

All I'm going to say is you are

right because yesterday, November fifth,

we think, well,

that's what the sentiment is,

that the build-up of those data centers is

going to be a little bit slower.

That's reflected on what happened in the

stock market yesterday.

And NASDAQ fell about six percent.

yesterday which is the worst it's been

since the ai boom started like middle of

last year and you know like nvidia dropped

by like almost ten percent which is about

i think half a trillion worth five or

five hundred billion or four fifty two

point five trillion two point five

trillion was wiped off the nasdaq

of which of which four fifty billion was

just Nvidia right something like nine

percent yeah exactly yeah and then Amazon

and then Microsoft and then Meta as well

they all fell between two to five percent

right because because people are not

people

Now we're talking about VC.

You spoke about VCs, investors,

and they're worried about the AI build out

will slow down after what's happened in

the election results, right?

Because voters, as you're saying,

are opposing on face value build out of

local data center.

And the timing is a little bit

like, unfortunate, I guess,

because Anthropic filed for IPO, right,

to go to public on just the end

of last month, October.

And yeah, so I think they,

they reported a loss of hundred and twenty

billion for compute commitments, right?

For compute commitments,

because they committed to using that much

compute to SpaceX.

So that's good.

I mean, you know,

it's a weird thing to say,

because obviously I'm in this space,

but

a lot of people don't you know we

were talking about these things you know

you know me saying oh two point five

trillion was wiped off the nasdaq and

obviously you know i understand economics

it does it does have impact um but

it has you know the us stock market

has been very heavily reliant on ai for

it for its market right so it's it's

disproportionately relying on it,

which is never a healthy thing.

And it's propping it up.

And so you're only a few bad things

like this to happen because it's obviously

superficial anyway.

You can't put all your eggs in one

basket for your country.

the stock market but most people in that

two point five trillion wouldn't have

taken anything from it anyway like that

meant nothing to most of the people in

the world they're not like oh my god

that two point five trillion that's really

impacted me today like you know i can't

get my pret a manger sandwich that i

really like you know so

it's so in a certain sphere of sets

of individuals that are making the money

from all of this that is not reflective

of a lot of other people in the

world so um you know i think that's

kind of the challenge that everybody has

at the moment is it's pushed sometimes you

can push things too far and i feel

like

as we even spoke about,

you can't not hear about AI, right?

Even with like every bit of news of

every single thing of every single day is

all about it.

A hundred percent of the time,

every hour of every minute.

And you get to the point where like,

it's a push,

you're pushing it and it's pushing it and

you're pushing it.

And actually maybe people just need a bit

of a break.

And it's like,

can we just slow it down?

And,

you know, doomsday and, you know,

we're all going to die and it's going

to take over us and we've got ten

years or however long before the end of

the world and blah, blah, blah.

I mean,

all those things are not great things,

you know.

So I don't think it's a bad thing

to counterbalance and regulate it a bit.

Do you know what I mean?

And I think it's, in the end,

probably a good thing rather than a bad

thing.

But I think if we think about let's

just think about this for a second, right,

John,

let's say the data centers are not allowed

to be built, right?

They're not allowed to be built in the

United States of America.

But what does that mean for the end

user?

Does that mean that now the supply is

less?

So the models are going to be a

bit more expensive.

So is everybody competing for the same

resources?

What does it mean for the end user?

And will we see where companies then

perhaps can use data center?

Of course,

you don't have data center in the USA.

but you have data centers all around the

world,

perhaps maybe people branch out building

data centers elsewhere.

I know latency is a thing and and

also data centers in the space.

John, what is actually going to happen?

Or is this all just like a like

a fad where people are saying, well,

you know,

we're going to slow down the data center

build, but in reality,

nothing's actually going to happen.

I don't know.

I guess.

Yeah.

Who really knows?

But slowing down doesn't mean stopping

and.

You know,

do we all need another model that's better

than the other one i mean are we

all saying oh my god this model is

just so like i need a better one

like hurry up and give me a better

model asap i want one where i want

one that reads my mind i don't want

to talk or type anymore guys i want

one that's got the power to look into

my eyes and through model training it

knows what i'm thinking and what i want

and that's the next model i need so

if you can use

as much water and power as you possibly

can to build a model that reads my

mind, that would be great.

Take whatever land you need,

take all the trees,

plummet them down because that's kind of

what I need.

I don't think anybody needs it to that

degree.

So, yeah,

the vendors are going to have to slow

it down.

Slow it down.

Don't use so much compute.

Be happy with the model you've got.

Yeah, but I disagree, right?

Why...

Why do we keep getting new phone models

every year?

I don't.

Why do we keep getting new car models?

Not us, but they keep getting released,

right?

You don't have to pick the new model

if you don't want to,

but I just don't understand how that is

any different to phone models getting

released every year or car models getting

released every year.

It isn't.

It's a lot more work.

But I think even if you look at

the statistics, the latest phones,

people aren't buying new phones as much as

they used to be.

So even that's slowing down.

And also,

just as human beings from a consumption,

just getting, I guess, more moral,

I suppose, rather than technical.

No,

but if you didn't have a way to

dispose of your stuff,

and there wasn't such a thing as a

tip, and you couldn't go with it,

and it had to live in your garden,

you would definitely buy less, right?

Because your garden would be full of shit,

right?

And you'd be like,

I can't live like this.

We can't buy another thing.

So obviously when it's all hidden,

you'll just keep consuming and that's,

you know, but it isn't,

it doesn't make it a good thing.

It doesn't make it a positive or a

healthy thing.

And actually, you know,

want a need you know you might want

something but you don't need it and so

i think and that's the same here i

feel like we might aspire for things but

we don't need them and some of this

is like actually we've gone astronomically

fast

compared to where we were.

Just think about how much has evolved over

the last three years.

We're all wearing masks.

There was no AI.

We're getting on tubes.

Not that long ago, right?

Twenty twenty, whatever,

twenty twenty one.

uh and now all of a sudden that's

all forgotten about and we're like

chatting to things as deep fake images of

things as ai videos that look so realistic

you can't even just do just in that

short period of time and i think that's

enough for now we don't need to keep

going faster and further that's

good progress how do you so i think

the way you control you can you can

control that if you make things more

expensive if it was expensive for you to

like create an image like the true value

because i don't think at the moment i

don't think all the all the all the

subscriptions that we buy are they're a

hundred percent subsidized not yeah all of

it no hundred percent yeah

But they are subsidized because the

companies want to make sure they get the

market share.

So if there was true value attached to

the subscription that you buy,

you would be a bit more careful.

Like the free model of ChatGPT is really

good, right?

And ChatGPT doesn't have any ads.

So where are they making money from?

Google ads, for example, that makes sense,

right?

You can search ads.

There is ChatGPT ads.

Do you not know?

Now there is, yes.

There is ChatGPT ads, yeah.

I don't think they're very good,

but there is.

yeah there's gpt ads but i yeah i

don't know john what the end game for

this is but i don't really think it's

my opinion that anything's going to slow

down they still as you said there's a

lot of money that's been put in there's

a lot of backing it doesn't like one

day i know yesterday there was a bit

of a crash of the stock market one

day doesn't really prove it's a bubble i

know we keep saying we're living in a

bubble but i think it's just going to

keep going

But the important thing...

Do you know what?

I think everything's like elastic.

That's how the world always works.

You push to the point that it's stretched

and it bounces back.

You know what I mean?

And we've just seen it before.

We, we, we like elastic,

we swang too far to the left and

it was a ricochet back all the way

to the right, right?

Swing all the way back over here.

We're pushing too far to the right and

it swings all the way back again.

That's just kind of how it works.

So I feel, I feel it will.

I think,

I think we're about to bit elasticated

back.

We're all going to swing back a little

bit and we'll be probably a really good

middle phase.

Um,

and then we'll probably swing back to the

side after that middle phase.

Um,

But yeah,

that seems to be how the world works

nowadays, isn't it?

Yeah.

And I think the important thing to an

end user using these services is just to

make sure

be cognizant of the fact that supply at

some point, perhaps for a little while,

might not be as readily available.

So think about how you are using your

models and how much you're using them and

how much it consumes in terms of credence

and whatnot.

But the good thing about all of this

john is that yes the data centers need

to be built and perhaps they'd be slowed

down but nobody can stop the jackers the

llm jackers yeah you can spend your own

money why anyway if if you're worried

about token usage you don't need to work

just jack someone else's tokens go and get

the go and get the api key

And get going.

You shouldn't need to use your own tokens.

It's twenty twenty six.

It's insane.

Go and jack some.

Disclaimer, John is joking.

Don't do this.

Yeah.

Just so anybody reads it and like I

said, well, don't do that.

So LLM jacking, John, this thing,

of course,

wherever there is an opportunity,

people will find loopholes and try and do

this.

So Google.

They released, you know,

they did some threat intelligence.

They released a news article this week.

They're saying that criminals are stealing

cloud credentials and API keys,

then using the victim's accounts to run

expensive models.

This is the thing that we've also seen

before in the past, John,

where people were, you know, when crypto,

when people were mining for coins,

people would steal cloud credentials,

run VMs with their mining equipment on

there,

with the mining software just to mine it.

So basically we're seeing a repeat of the

same thing,

that fraudulent charges as much as like a

hundred thousand dollars for some person,

and basically they stole their

credentials,

And they started running expensive models.

These are very sophisticated ones, right?

Because, and I think that the reason why,

and I think like for some people,

you know,

they're seeing about one million dollars

for some organization that basically

credentials got stolen and people started

running expensive models only because the

stolen credentials

access was being resold through what they

call LLM Mixer,

which is just basically a gateway.

Did you write a product called Jet Night

or something?

I'm sure.

Did you write something for that where you

were selling them on to some web service

you wrote?

What was it called?

Jet Day?

What did you call it again?

It's called Jet Night.

I didn't write it.

That's what you created.

I'm not right.

I didn't write it.

I'm not behind.

Basically, this says... Guess what, John?

It says sixty dollars and you get

unlimited tokens for a month.

Sixty dollars.

Forget about the pro max subscription that

you get from Claude.

Just go jet night and do not go

jet night because it's fraudulent.

It's completely wrong.

And they're selling for sixty dollars a

month.

And somebody used about five hundred

thousand API calls in like eight hours,

which is basically one million dollars

worth of tokens that were spent.

what are you doing with those tokens i

don't know well that's because you know

it's being reused by many people whatever

but this is it's this is happening so

the credential theft is nothing new this

is yeah but people need to be aware

of it i guess is the thing isn't

it so you people should be probably

cautious about that and make sure you

haven't had your uh your api keys stolen

and that people are running absolutely so

it is worth paying attention to yeah

As always is the case, right?

Don't want any exposed keys.

Make sure you have multi-factor

authentication.

Keep rotating your credentials.

Make sure your keys and your access keys

are locked down to specific accounts,

specific areas.

They're scoped.

by what models you can run,

what things you can run,

maybe start setting up caps in your cloud

budget as well.

All the good things that we learned with

FinOps and DevOps and security practices,

they still apply.

But John, you're right.

People need to be aware because people are

taking advantage of this,

which is a bit sad.

But these things will happen.

They still happen nowadays.

with cyber, what is it called, tokens.

So yeah, LLM jacking is a thing.

It's a new thing.

Well,

that has been the wrap-up of the news.

Got a bit philosophical, got a bit moral,

got a bit criminal.

at the very end and also if you

if you are passionate about who you think

the biggest wonker is uh let us know

as well because we're keen to know i

didn't find out salmons um you didn't find

out ours because i'm not sure either but

uh let us know what you think but

until the next time we'll be back as

always uh digging into these topics speak

to you soon

Creators and Guests

Salman Iqbal
Host
Salman Iqbal
Salman is an experienced Cloud, Data and AI leader, lover of all things AI, Cloud, Platform Engineering and Development tooling.
AI News: Nobody Wants a Data Centre Next Door. Is AI Being Pushed Too Far?
Broadcast by