You can run Mistral AI‘s open-source LLM, Phi-2, on your laptop without an internet connection. This way, your data remains private and you can avoid censorship from other models.
Step-by-step:
- Download LM Studio – a free platform to build local AI models.
- In LM Studio, look for “phi-2” and choose “TheBloke/phi-2-GGUF”. Then, get the Q6_K or Q4_K_S version by downloading it.
- Go to the Chat tab, make sure Phi-2 is chosen, and begin prompting right away!
What do you think?
+1
+1
+1
+1
+1
