Imagine a standardized API where you provide either your own LLM running locally, your own LLM running in your server (for enthusiasts or companies), or a 3rd party LLM service over the Internet, for your optional AI assistant that you can easily disable.
Regardless of your DE, you could choose if you want an AI assistant and where you want the model to run.
“AI assistant” just seems like a euphemism for “increased tracking”.
Open source locally run LLM that runs on GPU or dedicated PCIe open hardware that doesn’t touch the cloud…
deleted by creator
Yeah. I’m really annoyed by this trend of having programs that could function offline require connecting to a server.
deleted by creator
Imagine a standardized API where you provide either your own LLM running locally, your own LLM running in your server (for enthusiasts or companies), or a 3rd party LLM service over the Internet, for your optional AI assistant that you can easily disable.
Regardless of your DE, you could choose if you want an AI assistant and where you want the model to run.
deleted by creator