Also, another reason why this is very special.
Program is very small size, few KB. It doesnt require downloading a model. It creates a model on its own based on parameters which user inputs. then it trains a model based on data in knowledge.txt file which user provides. It also enables constant training, so each epoch can be trained separately. User can train 1 epoch today, then turn off program, and train another epoch tomorrow or any time, and not lose any training progress.
Also, program is "all in one". It isnt divided on separate programs for training and chatting.
I am still working on improvements, to optimize program even further.
I was using float32, but now I learned maybe float8 or float16 is better for even more speed.
Also, I made 300 million parameters model as well which became more coherent after being trained only twice on 20 kb file txt.
