Modify attributes of field wrappers wrapper div

I'm sorry if I described the element I want to modify confusingly in the title, but basically I want my TextInput field to not only be hidden but also have a columnSpan of 0. I tried using this ->extraFieldWrapperAttributes(['class' => ' hidden opacity-0 col-span-0']) on the TextInput, which worked fine at hiding it, but sadly the div that is outside of the data-field-wrapper still has the width of one column span, which make the layout shift in an undesired way. In the attached screenshot you can see what I mean, any help would be really apprechiated :D