All you would need is a real edge, as in a significant advantage over other market participants that has the potential to yield far, far out sized returns. This is hard, but not impossible.
There are two kinds of edge. Explicit - information, technology, infrastructure, industry knowledge...