Universal Blue•2y ago

yo does anyone know why duperemove takes up a solid 500% of my cpu usage

HHikariKnight try, it wont make it any worse

Kid•4/1/24, 11:36 PM

It worked!
nvm

Rryan yo does anyone know why duperemove takes up a solid 500% of my cpu usage

ryanOP•4/1/24, 11:39 PM

unsure what it does for bazzite but i suppose ill disable it?

Rryan unsure what it does for bazzite but i suppose ill disable it?

termdisc•4/1/24, 11:40 PM

It’s a helper function for btrfs’s deduplication

tryhardsoccermomswag•4/1/24, 11:41 PM

guh! we removed rmlint for being problematic on some hardware

now another btrfs feature

Rryan unsure what it does for bazzite but i suppose ill disable it?

tryhardsoccermomswag•4/1/24, 11:41 PM

is it causing performance isuses?

ryanOP•4/1/24, 11:42 PM

pretty stuttery, i have a few things open but sitting at 50% cpu usage no games no browsers

ryanOP•4/1/24, 11:43 PM

on an r5 3600 so its not like a normal occurance

ryanOP•4/1/24, 11:44 PM

is it something that should be running all the time? seems like judging by top its just running and running

Rryan is it something that should be running all the time? seems like judging by top i...

tryhardsoccermomswag•4/1/24, 11:45 PM

no but that means it's taking a long time to complete

Rryan pretty stuttery, i have a few things open but sitting at 50% cpu usage no games ...

tryhardsoccermomswag•4/1/24, 11:55 PM

question: do you have a secondary drive formatted to btrfs?

tryhardsoccermomswag•4/1/24, 11:55 PM

even if that drive is a microSD

Rryan yo does anyone know why duperemove takes up a solid 500% of my cpu usage

Kyle Gospo•4/2/24, 12:01 AM

duperemove is cpu intensive when it does run

Kyle Gospo•4/2/24, 12:01 AM

it also runs with the lowest possible nice value, meaning literally anything else will execute before it

Kyle Gospo•4/2/24, 12:01 AM

you can turn the service off if you don't want it, note that your drive usage will go up with time

tryhardsoccermomswag•4/2/24, 12:02 AM

i dont understand how this happens with some users tbh

tryhardsoccermomswag•4/2/24, 12:02 AM

how does it take up so much CPU usage for them lol

Daph•4/2/24, 12:03 AM

I tried researching it and couldn't understand why it did that for me and also slowed my games down significantly while running. All while taking over an hour

Daph•4/2/24, 12:03 AM

On my 7800x3d and fast ssd

Daph•4/2/24, 12:03 AM

Doesn't make any sense

Ttryhardsoccermomswag question: do you have a secondary drive formatted to btrfs?

ryanOP•4/2/24, 12:04 AM

yes kind of 3, I have two nvmes combined for my 4tb home drive and a 4tb hard drive all btrfs

DDaph On my 7800x3d and fast ssd

tryhardsoccermomswag•4/2/24, 12:05 AM

multiple storage too?

tryhardsoccermomswag•4/2/24, 12:05 AM

and how much storage?

tryhardsoccermomswag•4/2/24, 12:05 AM

taking a guess that the more storage you have on btrfs drives, the longer it will take

KKyle Gospo duperemove is cpu intensive when it does run

ryanOP•4/2/24, 12:05 AM

okay gotcha, just been concerned since it's been like this for a few hours

Ttryhardsoccermomswag multiple storage too?

Daph•4/2/24, 12:06 AM

I might have had an external hard drive plugged in at the last time it ran but I only have one ssd right now. It's 2tb rated at 7000mbps

Ttryhardsoccermomswag taking a guess that the more storage you have on btrfs drives, the longer it wil...

Kyle Gospo•4/2/24, 12:06 AM

yep, same as any other drive operation

ryanOP•4/2/24, 12:06 AM

would it be the HDD that's bogging it down most likely

ryanOP•4/2/24, 12:06 AM

or is it moreso a cpu task

Rryan would it be the HDD that's bogging it down most likely

tryhardsoccermomswag•4/2/24, 12:07 AM

that could be yea

tryhardsoccermomswag•4/2/24, 12:07 AM

im not sure though

tryhardsoccermomswag•4/2/24, 12:07 AM

i also have a secondary 1TB HDD, but i have it formatted to ext4

Kyle Gospo•4/2/24, 12:07 AM

on my desktop I have a 2TB NVME, a 1TB NVME, a 4TB SSD, and a 2TB SSD

Kyle Gospo•4/2/24, 12:07 AM

duperemove completes in <15 minutes, using 500% CPU (Which is 5 cores of 48)

Kyle Gospo•4/2/24, 12:07 AM

no stutter

ryanOP•4/2/24, 12:07 AM

yea id be curious whether it's just a hard drive issue across the board

Kyle Gospo•4/2/24, 12:08 AM

additionally ,this same service is used on a steam deck via steamos-btrfs

ryanOP•4/2/24, 12:08 AM

48 cpu cores is wild

Kyle Gospo•4/2/24, 12:08 AM

and does not cause performance issues there

Kyle Gospo•4/2/24, 12:08 AM

so it's likely something specific to you two

Rryan 48 cpu cores is wild

tryhardsoccermomswag•4/2/24, 12:08 AM

he has a threadripper lol

ryanOP•4/2/24, 12:09 AM

I didn't know the sd card on steam deck used btrfs

ryanOP•4/2/24, 12:09 AM

that's confusing then yea, ig ill keep diagnosing

Rryan I didn't know the sd card on steam deck used btrfs

Kyle Gospo•4/2/24, 12:09 AM

it does if you use steamos-btrfs

Kyle Gospo•4/2/24, 12:09 AM

which we ship

ryanOP•4/2/24, 12:09 AM

by default?

Kyle Gospo•4/2/24, 12:09 AM

yes

ryanOP•4/2/24, 12:09 AM

gotcha

Kyle Gospo•4/2/24, 12:10 AM

Fedora itself defaults to btrfs, so we do too

Kyle Gospo•4/2/24, 12:10 AM

no EXT4

DDaph I might have had an external hard drive plugged in at the last time it ran but I...

tryhardsoccermomswag•4/2/24, 12:14 AM

what device are you using bazzite on?

yo does anyone know why duperemove takes up a solid 500% of my cpu usage

Similar Threads

Similar Threads

Similar Threads