Sorter gets stuck on columns with number value

Sorting works fine for string values but when I want to have a column with numbers it goes desc, asc, asc, asc, asc, asc......idk what is the difference. It shouldn't be doing anything with the number value, but the whole column... Its not that big of a deal with number values cause i can just do .toString() but I have some custom columns that cannot be "fixed" this way. Any ideas why this is happening?