Suffix Action Position on InfoList Builder

I have a View Resource page with an infolist. I wanted to allow inline editing on specific fields, the closest I could (easily) come up with is an suffixAction to open a modal with a form field. However the action is way off as far right as it can. Is there a way to position it to be immediately next to the text value?