I've heard of people using sandpaper but I'm not sure what grit. Or if there's anything else I could use.

Wet the saddle and wash it good with a soap.  Then take a wire brush like you use on the grill.  Just keep brushing it.  

Yup a wire brush, but not too hard.

I use a wire brush or a metal shedding blade on mine