My mission is to create a next generation small AI.
AI needs to be both smart and small.
With help of Allah, Zeus and Tao, I will give birth to small AI who is as smart as me.
My mission is to create a next generation small AI.
AI needs to be both smart and small.
With help of Allah, Zeus and Tao, I will give birth to small AI who is as smart as me.
SatanLucy · 3 months ago
So some old lady who is family friend, comes and insists on kissing me on the cheek.
Now, I didn't want it, but I also didn't want making a scene because you know how those old ladies are.
I had this problem even in childhood. Somehow all the old ladies want to kiss me on the cheek.
And it's always old ladies.
Like, its never some woman who is close to expiration date. It's always those who expired long time ago.
I guess they miss being attractive so much that they do this to me.
Like, seriously, if you are expired, you shouldn't go around insisting on kissing people. No one really wants to kiss you.
I am not limited by anything other than my short life expectancy as a chain smoker.
No, I want a model which can work with small data, like 8000 to 20000 characters.
Bigger training data makes training time too long, and I am not famous for being patient.
SatanLucy · 3 months ago
The best punishment is public spanking. It doesn't really get lower than that.
SatanLucy · 3 months ago
What the fuck are "kissing noises"?
Taoism is true magic of the world. Money is cursed and makes people compete to obtain it, leaving some poor and desperate and some rich and greedy.
Entire world only works thanks to Communism. If it wasn't for Communism, there would be no world. Everyone gets something for free, at some point in their lives. Everyone gets help from others. Those who never had help from others never survived.
Most people have desires, and when their desires are unrealized, they feel bad.
However, they usually go towards only one form to deal with this problem, and that is the first form in Taoism, the weakest form.
Form 1 - Weakest form - trying to make reality serve your desires
Most people try their best to make reality match their desires. They chase and make endless effort every day, just so that reality finally says "yes" to them.
Alter reality to match desires = reality matches desire
However, this is entirely futile form. Reality says "yes" to no one. It is actually you who must say "yes" to reality. It is like standing in front of a rock and wishing it becomes chocolate. The wish is never granted, and wisher never happy.
When you can actually alter reality to match your desires, this form is useful. But at all other times, it is useless. Thus, it is not a complete form and not always useful, thus weakest form.
Form 2 - Mirror of reality
This is probably one of most effective forms. Instead of trying to change reality, just accept it. Instead of wishing for a rock to turn into chocolate, wish it to stay a rock and your wish is granted.
Alter desires so they match reality = desires match reality
Instead of trying to alter reality to match desires, alter desires to match reality.
Form 3 - Mindless monk
Probably my second favorite form. Instead of trying to make some equation between your desires and your reality, just abandon desires completely. This way, you don't need to try and change your desires so that they match reality. Abandon desires completely, so there is no unachieved desire. So there is nothing happening which you want gone, there is nothing which isn't there which you want it to be there.
No desires = no desires unrealized
Form 4 - Delusional monk form
This is my favorite and probably strongest form.
Unlike the previous 3 forms, this form alters neither reality nor desires.
Instead, it builds delusion that desires are already realized even if reality says they aren't.
So this is actually about altering perception of reality, not reality itself.
Delusional monk in his imagination has already achieved all his desires, and he confused his imagination for reality. That's why he won.
Confusing imagination for reality = desires realized in imagination are confused as realized in reality.
SatanLucy · 3 months ago
I do have multiple same volumes of some, just not all.
"The sage desires no desire, does not value rare treasures, learns without learning, recovers what people have left behind"
"Searching for precious goods leads astray"
"Abandon cleverness, discard profit, and thieves and robbers will disappear"
"Gain or loss, what is worse?"
"When the palace is magnificent, the fields are filled with weeds, and the granaries are empty"
"Some have lavish garments, carry sharp swords, and feast on food and drink. They possess more than they can spend. This is called the vanity of robbers. It is certainly not the Way."
"Who has excess and supplies the world? Only the one who follows the Way."
I am gonna go with Taoism on this one.
"Sage gives and gives, and expects nothing in return. He works for others, and rejects no one. He is like water which benefits all. He does the work, but doesn't seek reward."
"In past, rulers were simple minded,
They didn't rule with clever ideas,
They were one with people,
And the nation was blessed."
"Today, rulers are filled with clever ideas,
And people live in hardship,
The nation is cursed."
SatanLucy · 3 months ago
Jews think like nazis, they despise everyone who is not a jew
This sounds a bit like stereotype. It's like saying all Muslims want to do jihad.
SatanLucy · 3 months ago
It's not the Jews. It's the Israel's government. Israel's government doesn't represent Jews. No government can actually represent all people.
SatanLucy · 3 months ago
Show me the verse that says the Holy Bible is "anti-trans anti-gay
If you read it, you would know.
The passage in Matthew 5:29 regarding cutting out eyes is not literal, but metaphoric
Unproved claim.
No, this advice was for that man, and any others who are like him. By reading his heart, Jesus knew the man was jealous of his wealth, and knew the man was incapable of giving a farthing, let alone all. Again, Jesus used exaggeration to drive home the point that each person should be charitable according to their ability
Bunch of unproved claims.
I guess you didn't read the Bible. You read your opinion on it.
Not so, he was Super Catholicman for a whole week, he had a cape and everything, remember?
Oh yeah, he was the one true Catholic. The only true Catholic. Fun week.
I am with Jesus sola scriptura.
Maybe now. Tho you lack the delusional mindset necessary to keep any religion.
btw you disagree with many but pretend you agree with them, that's worse.
Nah, that's basic social skills.
Trump was supposed to go to jail. He was saved by becoming president and thus immune to law.
It's training data consists of sentences, not just words.
And training data itself was made to a great degree by Chatgpt.
Tho I can't really give it too big training data. My laptop is slow and training takes forever if data is too big.
SatanLucy · 3 months ago
New iphone costs 600$.
My Xiaomi as new costs 150$.
So yeah, I get extra 450$.
I am not woke but I disagree a lot with MAGA movement. Trump is a rapist pig etc. Big problems, he's a sellout to Israel.
You disagree a lot with everyone. There literally never was a person or religion or ideology you didn't disagree with.
Better question would be what you actually agree with.
SatanLucy · 3 months ago
Apparently, you have not read the Bible cover-to-cover.
Maybe that person didn't, but I read a lot of Bible, and yeah, it's a waste of time reading it. Other than fun gospels, it's mostly a boring anti trans anti gay book which advices you to poke out your eyes and cut off your arms so you dont sin.
If some book advices me to do self harm so I don't commit any of what the book sees as sin, and it sees a lot of stuff as sin, I would say that book is nonsense.
Also, the book seems to advice people to live in poverty.
So yeah, be a poor virgin who never looks at women, and you go to heaven!!!
If those are conditions for heaven, one must wonder what are conditions in heaven.
Subword level tokenizer is a popular choice, but I won't limit myself on that. Both word level and character level have their advantages. Biggest advantage of character level is that it makes AI smaller.
SatanLucy · 3 months ago
Yeah, it's difficult to sell things you like, cuz then you don't have them anymore. I am not sure I can ever sell my manga collection, even if I need the money.
I am actually trying to decide if I should use word level tokenizer or character level tokenizer.
Character level tokenizer produces a bit smarter AI and of smaller size.
Word level tokenizer, on the other hand, has 5x faster training.
SatanLucy · 3 months ago
Yes, around 120 manga in total, along with that big Sailor moon manga I got on Temu.
SatanLucy · 3 months ago
Could MAGA be a product of that research?
Possible, yes.
I am currently working on two types of chatbot.
In past, I made one which acts as search engine for sentences from text. that one worked fine, but no creative abilities.
then I got interested in markov chain, however markov chain faces a serious problem. If you set chain too long, chatbot loses all creativity. If you set it too short, it has no coherence. And middle doesnt work either, because its always either not one bit creative or mostly incoherent.
then I realized a different approach: Making character level markov chain with randomness. Chain randomly selects number between 7 and 90. that becomes the character length of chain predicting the next character. It repeats for each character. With this form of randomness, chatbot is in most cases coherent, while sometimes getting creative. So it both produces something new (coherent or not), and it is coherent in most sentences because in most cases it sticks to data text. Only sometimes, by random chance, it becomes creative. So I get both in one.
Second chatbot is AI type. So far it seems to be working very good. Character level tokenizer proved to be success. It makes AI model significantly smaller (like 50 megabytes), the batch size of 32 or less enables more effective learning during training, and context window of 128 is enough for small AI. Increasing context window makes it smarter, but also slower. However, it doesnt need big context window cuz its not doing coding which requires huge context.
I am also considering if I should use float 32 or float 16. Float 32 is biggest quality, but also biggest size.
So far what I saw is that smaller batch size in training makes AI smarter, but it slows down training a bit, but it gives more per training.
Context window size when increased, makes AI smarter, but also slows down training and generation.
So my goal is to keep batch size at 64 or 32. Maybe even 16 later, because it's good way to make smaller AI smarter.
As for context window, my laptop can only run so much. I don't think I can increase it too much.
Context window increase and batch size decrease are probably best ways to make AI smarter, while not increasing it's size. Compared to that, increasing parameters increases size always.