Wall thickness of blade holders: How thin is too thin?

[ARKM]

I have a question for the more experienced saber builders that have done their own machining...

I have a blade holder that will insert into a hilt body, about 5/8" (no threads, it will be held in with four 6-32 (or 8-32) screws). The I.D. of this particular hilt is roughly 1.055 so the part of the blade holder that inserts into it will be a hair smaller in diameter.

If I want the main LED optics to fit inside the part of the blade holder that inserts into the hilt (which is not a must but would be nice), the wall thickness of that part of the blade holder would be around 1/16" (.0625), perhaps a hair over). I'm concerned that this may be too thin to stand up to medium dueling. I can of course have the optics below the blade holder and have the wall thickness of that part of the blade holder be much thicker thus negating my problem. However having the optics in the blade holder gives me a little more room in the hilt for uneccessary extras, lol. Your thoughts on the matter would be greatly appreciated. Thanks.