Holy shit the new #Phi3 #LLM from microsoft is 3.8B params but performs better than a bunch of 7B models I've tried. Now I just need to find a way to get it to do function calling.
https://www.theverge.com/2024/4/23/24137534/microsoft-phi-3-launch-small-ai-language-model
The Verge · Microsoft launches Phi-3, its smallest AI model yet
@mauve did you see the install instructions?
@jazzbox35 Install instructions for what? I usually run models from my own harnesses these days.