Show HN: Jeva.cpp – a llama.cpp fork with JEV-compatible API for all LLMs

Category: ai-ml

Tags: llm-inference, llama-cpp-fork, decision-api, c-plus-plus, logits-processing

Score: 5.8/10 (Innovation: 6, Technical: 8, Documentation: 4, Utility: 5)

jeva.cpp is a fork of llama.cpp that adds a JEV-compatible decision API to llama-server, enabling direct Choice, Score, and Noul evaluations from model logits while preserving standard autoregressive generation. It leverages llama.cpp's extensive model and backend support, making it a niche but technically interesting extension for structured decision-making in LLM inference.

Target audience: AI/ML engineers and researchers working with local LLM inference, particularly those needing structured decision APIs

Repository: https://github.com/PragmaTwice/jeva.cpp · C++ · MIT · 4 stars

View on Hacker News