Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

llama.cpp


To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: