How to convert huggingface to megatron?

by cdj0311 - opened Oct 25, 2023

Oct 25, 2023

hi,
how to convert the huggingface mode to megatron for continue training? Or, do you have the megatron model?

Oct 31, 2023

done!

cdj0311 changed discussion status to closed Oct 31, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment