Game lags on one end while playing multiplayer

I've been playing on a hosted server with a friend and on my end it has been lagging all the time even though we have the exact same modpack, and it happens even when my friend is hosting, i've tried deleting all config files and it still doesn't help at all