They are expensive to run. Why would someone pay the cost and offer it for you to use for free? When it appears free it’s most likely not free.

The word privacy based in your post probably explains it.

use ollama to run dolphin-mixtral locally on linux

removed by mod

@THE_MASTERMIND@lemmy.sdf.org
creator
link
fedilink
1
edit-2
3M

deleted by creator

@LWD@lemm.ee
link
fedilink
2
edit-2
3M

removed by mod

Katlah
link
fedilink
11
edit-2
3M

https://stablehorde.net

Registering an account is just a username, no password or email. (Generated API key is your password)

one would think someone that calls himself THE MASTERMIND would know all… also LM Studio and no i’m not going to give you a link, your browser can do that for you

@THE_MASTERMIND@lemmy.sdf.org
creator
link
fedilink
-4
edit-2
3M

deleted by creator

not enough obv.

@THE_MASTERMIND@lemmy.sdf.org
creator
link
fedilink
-4
edit-2
3M

deleted by creator

I use https://ollama.com which gives you a huge choice of models to run locally!

@mrshy@lemmy.ml
link
fedilink
3
edit-2
3M

There is Lelapa, llamafile, GPT-NeoX-20B, BLOOM, Mixtrai8x7B come to mind which are not included at gpt4all.io.

@THE_MASTERMIND@lemmy.sdf.org
creator
link
fedilink
-15
edit-2
3M

deleted by creator

@LWD@lemm.ee
link
fedilink
33M

removed by mod

@THE_MASTERMIND@lemmy.sdf.org
creator
link
fedilink
0
edit-2
3M

deleted by creator

All kinds. You should look at GPT4ALL at gpt4all.io. Its a gui for downloading and running LLM models locally. Its a great project. Of course, everything is local and private.

Nextcloud can do it

Create a post

A place to discuss privacy and freedom in the digital world.

Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.

In this community everyone is welcome to post links and discuss topics related to privacy.

Some Rules

  • Posting a link to a website containing tracking isn’t great, if contents of the website are behind a paywall maybe copy them into the post
  • Don’t promote proprietary software
  • Try to keep things on topic
  • If you have a question, please try searching for previous discussions, maybe it has already been answered
  • Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
  • Be nice :)

Related communities

Chat rooms

much thanks to @gary_host_laptop for the logo design :)

  • 0 users online
  • 84 users / day
  • 537 users / week
  • 1.5K users / month
  • 6.58K users / 6 months
  • 1 subscriber
  • 2.31K Posts
  • 53.6K Comments
  • Modlog