You don't have to do anything if you don't want to but my first thoughts were that eventually the oils from your skin would impregnate and start looking grubby and you say its already happened, sanding it may not even remove all if it either, better to seal and wipe clean I'd of thought