My first quantization, this is a q4_0 GGML(ggjtv3) and GGUFv2 quantization of the model acrastt/OmegLLaMA-3B · Hugging Face I hope it’s working fine. 
Prompt format:
Interests: {interests}
Conversation:
You: {prompt}
Stranger:
1 Like