jev_local: TypeSafe-compatible adapter over LFM2.5

A TypeSafe-compatible adapter running LFM2.5-1.2B through llama.cpp (about 1.25 GB download) with CUDA, ROCm and Metal builds.

Notes

Local demo.

author demo — Result shown by its author. About this label

Destinations

Filed under

• #replica
• #llama-cpp
• #github

In collections

• Local & replica models →