Will release training code

[lucasjinreal]

Hi, the result looks impressive, would release training code?

[longzw1997]

The training code has already been released. You can refer to the README.

[lucasjinreal]

hi，how about the training dataset? especially for pretrain and sft

[TjoyLiu]

Same question, I wish to reproduce the text2token model and the pretraining process, but the training is not satisfied