What do you expect? Your boyfriend is insensitive and doesn't know that giving hus sweater is so important and a sign of affection! he often even says rudely to you, but actually it really loves you too, it's just he is very rude and dominant. Well people say it's really special when a boy lets a girl use thier clothes, especially sweaters! So try to convince him to let you use his sweater!