Just released: Shining Valiant 2 for Llama 3.1 8b! 2024
- the first SV at 8b size, using the best 8b model
- newest version of the SV dataset improves specialist knowledge and response consistency
3.1 70b will be coming but our next releases will focus on expanding the Build Tools lineup. Get ready for some open-source synthetic datasets made with 3.1 405, coming VERY soon :)
Prompting Guide
Shining Valiant 2 uses the Llama 3.1 Instruct prompt format. The example script below can be used as a starting point for general chat:
import transformers import torch
model_id = "ValiantLabs/Llama3.1-8B-ShiningValiant2"
pipeline = transformers.pipeline( "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto", )
messages = [ {"role": "system", "content": "You are Shining Valiant, a highly capable chat AI."}, {"role": "user", "content": "Describe the role of transformation matrices in 3D graphics."} ]
https://huggingface.co/ValiantLabs/Llama3.1-8B-ShiningValiant2
outputs = pipeline( messages, max_new_tokens=1024, )
print(outputs[0]["generated_text"][-1])
- the first SV at 8b size, using the best 8b model
- newest version of the SV dataset improves specialist knowledge and response consistency
3.1 70b will be coming but our next releases will focus on expanding the Build Tools lineup. Get ready for some open-source synthetic datasets made with 3.1 405, coming VERY soon :)
Prompting Guide
Shining Valiant 2 uses the Llama 3.1 Instruct prompt format. The example script below can be used as a starting point for general chat:
import transformers import torch
model_id = "ValiantLabs/Llama3.1-8B-ShiningValiant2"
pipeline = transformers.pipeline( "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto", )
messages = [ {"role": "system", "content": "You are Shining Valiant, a highly capable chat AI."}, {"role": "user", "content": "Describe the role of transformation matrices in 3D graphics."} ]
https://huggingface.co/ValiantLabs/Llama3.1-8B-ShiningValiant2
outputs = pipeline( messages, max_new_tokens=1024, )
print(outputs[0]["generated_text"][-1])
huggingface.co
ValiantLabs/Llama3.1-8B-ShiningValiant2 · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.