fray
frazzle
wear away by rubbing
The friction frayed the sleeve