did they comment (maybe I missed it) on why they’re ending development?
did they comment (maybe I missed it) on why they’re ending development?
Happens more than we’d like to believe. The mans dad wasn’t actually even dead in the case linked below. The policy will continue to make these mistakes until the consequences of their failures comes directly out of their pay.
I was also not sure what this meant, so I asked Google’s Gemini, and I think this clears it up for me:
This means that the creators of Llama 3.3 have chosen to release only the version of the model that has been fine-tuned for following instructions. They are not making the original, “pretrained” version available.
Here’s a breakdown of why this is significant:
- Pretrained models: These are large language models (LLMs) trained on a massive dataset of text and code. They have learned to predict the next word in a sequence, and in doing so, have developed a broad understanding of language and a wide range of general knowledge. However, they may not be very good at following instructions or performing specific tasks.
- Instruction-tuned models: These models are further trained on a dataset of instructions and desired outputs. This fine-tuning process teaches them to follow instructions more effectively, generate more relevant and helpful responses, and perform specific tasks with greater accuracy.
In the case of Llama 3.3 70B, you only have access to the model that has already been optimized for following instructions and engaging in dialogue. You cannot access the initial pretrained model that was used as the foundation for this instruction-tuned version.
Possible reasons why Meta (the creators of Llama) might have made this decision:
- Focus on specific use cases: By releasing only the instruction-tuned model, Meta might be encouraging developers to use Llama 3.3 for assistant-like chat applications and other tasks where following instructions is crucial.
- Competitive advantage: The pretrained model might be considered more valuable intellectual property, and Meta may want to keep it private to maintain a competitive advantage.
- Safety and responsibility: Releasing the pretrained model could potentially lead to its misuse for generating harmful or misleading content. By releasing only the instruction-tuned version, Meta might be trying to mitigate these risks.
Ultimately, the decision to release only the instruction-tuned model reflects Meta’s strategic goals for Llama 3.3 and their approach to responsible AI development.
Apex Legends. Its a difficult game to master, but every once in a while I get “in the zone” and pull moves/plays that impress myself. It’s not often, but feels nice when it happens. I still enjoy it even though I “suck” most of the time. I basically play it as a survival game >90% of the time.
you can follow hashtags. I follow #opensource and a few other interests and I’ve found some interesting stuff you don’t generally see in other places. but yes, the format is completely different and I find lemmy allows for better discussion than Mastodon.