Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

For chat, I suggest trying the OpenOrca finetune, the performance is amazing and it responds very well to system prompt: https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca

It runs very well on my laptop's RTX 3070 which only has 8gb ram, felt like I'm running early versions of chatgpt locally.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: