• 0 Posts
  • 6 Comments
Joined 2Y ago
cake
Cake day: Nov 05, 2023

help-circle
rss

https://ollama.ai/, this is what I’ve been using for over a year now, new models come out regularly and you just “ollama pull <model ID>” and then it’s available to run locally. Then you can use docker to run https://www.openwebui.com/ locally, giving it a ChatGPT-style interface (but even better and more configurable and you can run prompts against any number of models you select at once.)

All free and available to everyone.


In my experience it depends on the math. Every model seems to have different strengths based on a wide berth of prompts and information.


+1 for Mistral, they were the first (or one of the first) Apache open source licensed models. I run Mistral-7B and variant fine tunes locally, and they’ve always been really high quality overall. Mistral-Medium packed a punch (mid-size obviously) but it definitely competes with the big ones at least.


Holy shit this is incredible. I have wanted a way to permanently hide shorts forever, thanks for sharing. Also it’s actually recommended by Mozilla which means it has active security audits on it, impressive.


Someone on here linked to odysee.com which appears to be a better version of YouTube so far, even Louis Rossman is there talking about YT’s new adblock situation as one example: https://odysee.com/@rossmanngroup:a/youtube’s-adblock-war-is-backfiring-in:c


One of my parent’s dozen+ facebook bots that steal their pictures/identity, because they are too dumb to know how to configure FB privacy settings. It’s disturbing how many of them just scour profiles, replicate, and impersonate to scam.