Spatie\MediaLibrary\MediaCollections\Filesystem class method removeAllFiles() gets called. As you would expect this call will remove all files in the directory where the uploaded file is stored. In this case the media path generator had placed all the profile images for a user in the same directory so all files got zapped when only a single delete was needed. So this was an implementation bug not an issue with Fil or SML plugin.