Research project · Experiment in progress
Jev versus traditional classifiers
Can a hosted text classifier pick what to hold better than trees, trend rules or simply holding everything?
Jev is TypeSafe's hosted model that answers multiple-choice questions about a piece of text. I gave it the same 27 price and volume readings as three classifiers and two trend rules, with no ticker, date or price level, then traded every model's BUY, HOLD and SELL calls by one rule across 15 assets.
Buy and holdUses JevTraditional models and rulesNo skill
- Jev alone did not rank assets. Its picks earned a net Sharpe of 0.11, under the 0.21 of a random pick and reliably below buy and hold (−0.41, 95% interval −0.72 to −0.14).
- Adding Jev to a classifier changed nothing. Gradient-boosted trees scored 0.25 on the 27 readings and 0.26 with Jev's outputs added (difference 0.00, interval −0.17 to +0.16). In most other views the change is slightly negative, and never reliably different from zero.
- Nothing beat holding everything. The best strategy, a random forest, reached 0.40 against 0.52. This run would usually miss a true difference smaller than about 0.43.
Not a verdict yet: these are the first ten yearly folds with zero-shot Jev, and the final two years stay locked for the verdict run. The asset list was chosen with hindsight. Every table is in the run report. Research, not investment advice.
