Thireus/WizardLM-70B-V1.0-BF16

WizardLM 70B V1.0 – bfloat16 (BF16)

• Model creator: WizardLM
• Original model: WizardLM 70B V1.0

Conversion process:

Use the following script to convert your local pytorch_model bin files to bfloat16 + safetensors all in one go:

• https://github.com/oobabooga/text-generation-webui/blob/main/convert-to-safetensors.py (best for sharding and float16/FP16 or bfloat16/BF16 conversion)

Example to convert WizardLM 70B V1.0 directly to bfloat16 safetensors in 10GB shards:

python convert-to-safetensors.py --bf16 ~/original/WizardLM-70B-V1.0 --output ~/float16_safetensored/WizardLM-70B-V1.0-BF16 --max-shard-size 10GB