I heard tell, that you can put super glue on the glove than add a little sand to it but do not think I would try it. the sandpaper probably would work, you might try scraping the glove with a sharp knife. I would suggest buying a new glove but there is nothing like a good fitting glove and a new one you have to break in and they never seem as good as the old one.
Hope you get it figured out.