In my experience, the horn will be yellowish and really ugly. Depending on how close he was to rubbing it off, the shape should be pretty similar to a normal hard horn. The color will not be right though, maybe someone has recolored a velvet buck but I would say don't take off the velvet until you have a tried and true way to get it right. Check the taxidermy forum of MM too.