0-hero
/

OLMo-50M-Mixture-of-Depths-Bitnet

Model card Files Files and versions Community

0-hero commited on Apr 10

Commit

9054ac1

•

1 Parent(s): 7620dc5

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -15,3 +15,4 @@ datasets:
 - OLMo-50M-mod-bitlinear - 50M parameter mixture-of-depths bitnet model
 Repo has zip files which include training states and other files for each model. I am not the author of the mixture-of-depths implementation, it can be found [here](https://github.com/thepowerfuldeez/OLMo)

 - OLMo-50M-mod-bitlinear - 50M parameter mixture-of-depths bitnet model
 Repo has zip files which include training states and other files for each model. I am not the author of the mixture-of-depths implementation, it can be found [here](https://github.com/thepowerfuldeez/OLMo)
+This is the first run. A few things might be broken, still a work in progress