Instead of sanding and potentially messing up your saber parts, try this: Put your hilt in the fridge for one day and your sleeve in the oven at 150°C for 10 minutes. That should give you enough play...