And no i do not have the privilege of running a local model. I have heard of a AI called Maple and tried it out, it was pretty limited to the point that it was a deal breaker (25 messages per week cap). I would like to know more services
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
much thanks to @gary_host_laptop for the logo design :)
I use Jan. It’s really good. A minimal install needs around 10GB of space and you can use it offline. The ‘jan nano’ model works faster than I can read in most cases.
The Qwen models that you can run with llama.cpp (Jan’s main backend) are quite brilliant for their size
There are a few AI models that are in this category, and I really liked Jan when I tested it out.
Cool, which ones do you recommend? Yeah, I found it really straightforward and pleasant to get started.