Several issues:
1. Kelly is for optimized return for a fix win/loss and expectancy/probability, with infinite budget and large number of bets. For most of us, we make finite number of bets with a limited budget and so the outcome has large spreads. If during a bad streak with our limited budget we could get wipe out.
2. For trading, our win/loss and expectancy/probability are not a constants (in gambling it is) so our input to Kelly is at best a guess and is a moving target. If we are wrong on our estimates, we could be on the wrong side of Kelly before we know it and wipe out.
3.Even in gambling like blackjack, without a large number of bets and without a large budget, the empirical bet size is 1/4 to 1/3 Kelly:
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2324852
I don't know if I make sense so experts please comment and help us out.