Show HN: Jevgpt – reinventing the wheel with another wheel

Category: ai-ml

Tags: token-classification, speculative-decoding, text-generation, experimental, python

Score: 5.5/10 (Innovation: 7, Technical: 6, Documentation: 7, Utility: 2)

JevGPT is an experimental chatbot that generates text one token at a time by using a classifier (TypeSafe AI's Jev) to select from a limited set of token candidates, rather than a generative model. It cleverly adapts speculative decoding by running four parallel classifier drafts to expand the candidate vocabulary, but remains a fascinating toy with limited practical utility.

Target audience: AI researchers and hobbyists interested in unconventional text generation methods

Repository: https://github.com/giga-james/jevgpt · Python · 4 stars

View on Hacker News