Dude, honestly, the way you work out you do not need a calorie deficit so much as you need to change the quality of your calories. Now - don't let me lose you, stay with me, but I suggest you look at meat only - stay with me now. You just might find this interesting.
Of course, do you own due diligence, but in doing so beware of propaganda from vegan youtube doctors.
Here is why I suggest meat only:
I'm type 2 diabetic. I get 90% of my calories from fatty meet. Yes, occasionally I "cheat" a bit, e.g. five guys fries (I still eat the burger no bun).
The best thing that happened to me was when I was diagnosed, my doctor and my endocrininologist were both of the mind that sugars and starches were the problem, not animal fats. They also believe that most illnesses: diabetes, heart disease, rheumatoid arthitus, etc are cause by hyperinulinemia or the over production of insulin. Many of us are walking around with normal blood sugars but we are hyperinsulinemic. We do not get the high blood sugars until our cells have been so beat up by too much circulating insulin, they resist insulin's attempt to get the sugar into the cells.
Now, you probably do not have that problem because of your workouts and your athleticism. But you might (I'll post a video at the end that and try to book mark the relevant spot for you, though the whole video is worth while, imo).
Here is my blood glucose - I just took it a few minutes ago and took the pic to show you (sorry it is sideways - I flipped it, saved it, and it still uploads like that:
That is a completely normal, completely healthy blood glucose level two hours after a lunch of a large chicken leg quarter roasted with butter and bacon fat and a bit of green beans and rabbit food, er ... salad leaves I eat to make my wife happy. Before I changed my diet, I ate what most would have considered a fairly healthy diet - lots of fresh veg, brown rice, sweet potatoes, etc. Lots of lean fish and chicken breast. But somehow I still got fat and diabetic. My blood glucose readings where in the 200 mg/dl to 300 mg/dl range.
Here is my ketone reading from the same time showing 2.1 MM:
Nutritional ketosis is .5 to 3.0 MM (that is where your body is efficiently burning fat as its predominant fuel source).
There is a several week period of adaptation where you may not feel the same level of energy you do now.
But cut out the sugars and starches - no rice, potatoes, flours, etc. for one month. Eat mostly fatty meat. I have lost over 50 pounds, and I did not exercise at all except for I am a walking golfer. But I was a walking golfer when I was a fat f*ck too. And I never once counted calories. However, beware of all the keto crazies out there (I started eating this way before keto had become any kind of buzz word). The keto lunatics will have you drinking butter and eating coconut oil like its pudding.
Again, don't do it on my say so. Do your own due diligence. Look up Dr. Jeff Volek and Stephen Phinney. They have done extensive research on low and zero carb diets for high performance athletes. But please research this with real scientists and not the lunatics who are just jumping on a band wagon.
There is a reason Vince Geronda did steak and eggs only when cutting for a competition.
Here is that video cued up to a brief discussion of some world class athletes who were found to be extremely insulin resistant. They had very little subcutaneous fat (like you) but that had an abundance of visceral fat (which may very well be your problem).
