Multiplayer world acting strange, bosses despawning, time changing not working.

Had issues earlier on with sleeping in a bed the time getting moved back, using fargo's difficulty changer resetting, imksushi's npc potions not keeping the npc around and it's time changers getting rolled back, generally the world doesn't seem to like having things work unnaturally, which has become an actual problem with a secrets of the shadows boss, due to how it spawns.