SatanLucy

these are first results of 1 megabyte AI trained on 8000 characters data.

It seems to be coherent.

So far, 1 megabyte size with training data of 8000 characters was somewhat enough to make it mostly coherent.

Tho I am now trying 80k character training data to further reduce loss function.

Ok, model seems to be showing signs of increasing coherence. Tomorrow I will train it on bigger data. I assume 8000 characters isn't enough to make it write longer responses.

I started training it on 80k characters text. That should give it more intelligence. Tho for a 1 megabyte model it's doing better than I expected.

I really didnt think it could go below 20 megabytes for a model, but apparently, it is possible.

The only disadvantage with a 1 million parameters model is that it's training data can't really exceed 5 million characters.

It's an AI which works better as specialized AI than general AI.

Maybe 100 million parameters AI can work as a general AI.

1 million parameters one cannot because 5 million characters simply isn't enough space to fit everything out there.

This is why 1 megabyte AI is meant to be a specialist. It can learn about debating specifically instead of trying to be a know it all, or it can learn all there is on one specific topic.

It is actually a big advantage to have multiple specialist AI than to have one general AI.

General AI knows a little bit about everything, but it is always outmatched by specialized AI in their field.

Eisenhower had a similar debt ratio when he took office. He paid it by increasing the tax rate for the rich to 90 percent.

Really? Nope. He didn't pay off any debt. He just cut spending to prevent debt from increasing. So economy grew while debt stayed same.

The gap in budget is 1.8 trillion.

Healthcare costs 1.9 trillion.

It's a very simple math.

The problem is that there are only 3 major expenses in US budget: Military, healthcare and social security.

Now, reducing military spending seems like a good idea until you realize US must actually stay ahead of it's enemies, and reducing military spending is like playing chess without queen.

So it's reducing social security or reducing healthcare. There are no other good options, and all the mini cuts in the budget ain't gonna do shit.

The simplest solution is to just print money, like USA was doing so far.

Money machine go brrrrrr!!!

Of course the academics and smart people say the best way to approach this is spending cuts and tax increases

No, smart people would know difference between external and internal debt.

The idea that you should raise taxes pretty much didn't work for any country ever, because raising taxes raises prices which increases budget expenses.

Cutting budget works better, but problem with that is that no one wants to actually do it.

Obama screwed you with healthcare spending, and the screwing continues till this day.

In fact, healthcare alone is literally the budget gap.

If i manage to use int4 or int2, I can actually make model have less than 0,5 megabytes.

We will see in a few hours. Small AI usually trains faster per epoch, but needs more epoch to learn than AI which is somewhat bigger.

If it becomes coherent, thats gonna be great cuz it will be probably smallest coherent AI in the world. there are really not a lot of AI models out there with size of 1 megabyte.

Kisses by old ladies is how I got oral herpes as a kid. there is nothing affectionate about giving someone herpes.

the trick lies in using character level tokenizer to achieve smaller size of AI model. All the popular AI are using subword level.

Alright, I am currently training 2 AI models.

One is only 10 megabytes in size and has about 10 million parameters.

Other is around 1 million parameters and around 1 megabyte size.

They are so far the smallest AI models I managed to poop out.

I want to see if the 1 megabyte one can become coherent. If it can, that's gonna be great cuz it means I have an AI which is so tiny, probably tiniest AI in the world.

If it becomes coherent thanks to character level tokenizer, its gonna be proof that character level tokenizer works better for small AI.

So far tiniest coherent AI was 37 megabytes.

But now I am using int8 to further reduce size of AI.

My mission is to create a next generation small AI.

AI needs to be both smart and small.

With help of Allah, Zeus and Tao, I will give birth to small AI who is as smart as me.

So some old lady who is family friend, comes and insists on kissing me on the cheek.

Now, I didn't want it, but I also didn't want making a scene because you know how those old ladies are.

I had this problem even in childhood. Somehow all the old ladies want to kiss me on the cheek.

And it's always old ladies.

Like, its never some woman who is close to expiration date. It's always those who expired long time ago.

I guess they miss being attractive so much that they do this to me.

Like, seriously, if you are expired, you shouldn't go around insisting on kissing people. No one really wants to kiss you.

I am not limited by anything other than my short life expectancy as a chain smoker.

No, I want a model which can work with small data, like 8000 to 20000 characters.

Bigger training data makes training time too long, and I am not famous for being patient.

The best punishment is public spanking. It doesn't really get lower than that.

What the fuck are "kissing noises"?

Taoism is true magic of the world. Money is cursed and makes people compete to obtain it, leaving some poor and desperate and some rich and greedy.

Entire world only works thanks to Communism. If it wasn't for Communism, there would be no world. Everyone gets something for free, at some point in their lives. Everyone gets help from others. Those who never had help from others never survived.

Most people have desires, and when their desires are unrealized, they feel bad.

However, they usually go towards only one form to deal with this problem, and that is the first form in Taoism, the weakest form.

Form 1 - Weakest form - trying to make reality serve your desires

Most people try their best to make reality match their desires. They chase and make endless effort every day, just so that reality finally says "yes" to them.

Alter reality to match desires = reality matches desire

However, this is entirely futile form. Reality says "yes" to no one. It is actually you who must say "yes" to reality. It is like standing in front of a rock and wishing it becomes chocolate. The wish is never granted, and wisher never happy.

When you can actually alter reality to match your desires, this form is useful. But at all other times, it is useless. Thus, it is not a complete form and not always useful, thus weakest form.

Form 2 - Mirror of reality

This is probably one of most effective forms. Instead of trying to change reality, just accept it. Instead of wishing for a rock to turn into chocolate, wish it to stay a rock and your wish is granted.

Alter desires so they match reality = desires match reality

Instead of trying to alter reality to match desires, alter desires to match reality.

Form 3 - Mindless monk

Probably my second favorite form. Instead of trying to make some equation between your desires and your reality, just abandon desires completely. This way, you don't need to try and change your desires so that they match reality. Abandon desires completely, so there is no unachieved desire. So there is nothing happening which you want gone, there is nothing which isn't there which you want it to be there.

No desires = no desires unrealized

Form 4 - Delusional monk form

This is my favorite and probably strongest form.

Unlike the previous 3 forms, this form alters neither reality nor desires.

Instead, it builds delusion that desires are already realized even if reality says they aren't.

So this is actually about altering perception of reality, not reality itself.

Delusional monk in his imagination has already achieved all his desires, and he confused his imagination for reality. That's why he won.

Confusing imagination for reality = desires realized in imagination are confused as realized in reality.

I do have multiple same volumes of some, just not all.

"The sage desires no desire, does not value rare treasures, learns without learning, recovers what people have left behind"

"Searching for precious goods leads astray"

"Abandon cleverness, discard profit, and thieves and robbers will disappear"

"Gain or loss, what is worse?"

"When the palace is magnificent, the fields are filled with weeds, and the granaries are empty"

"Some have lavish garments, carry sharp swords, and feast on food and drink. They possess more than they can spend. This is called the vanity of robbers. It is certainly not the Way."

"Who has excess and supplies the world? Only the one who follows the Way."

I am gonna go with Taoism on this one.

"Sage gives and gives, and expects nothing in return. He works for others, and rejects no one. He is like water which benefits all. He does the work, but doesn't seek reward."

"In past, rulers were simple minded,

They didn't rule with clever ideas,

They were one with people,

And the nation was blessed."

"Today, rulers are filled with clever ideas,

And people live in hardship,

The nation is cursed."

Jews think like nazis, they despise everyone who is not a jew

This sounds a bit like stereotype. It's like saying all Muslims want to do jihad.

It's not the Jews. It's the Israel's government. Israel's government doesn't represent Jews. No government can actually represent all people.

Show me the verse that says the Holy Bible is "anti-trans anti-gay

If you read it, you would know.

The passage in Matthew 5:29 regarding cutting out eyes is not literal, but metaphoric

Unproved claim.

No, this advice was for that man, and any others who are like him. By reading his heart, Jesus knew the man was jealous of his wealth, and knew the man was incapable of giving a farthing, let alone all. Again, Jesus used exaggeration to drive home the point that each person should be charitable according to their ability

Bunch of unproved claims.

I guess you didn't read the Bible. You read your opinion on it.

Not so, he was Super Catholicman for a whole week, he had a cape and everything, remember?

Oh yeah, he was the one true Catholic. The only true Catholic. Fun week.

I am with Jesus sola scriptura.

Maybe now. Tho you lack the delusional mindset necessary to keep any religion.

btw you disagree with many but pretend you agree with them, that's worse.

Nah, that's basic social skills.

Trump was supposed to go to jail. He was saved by becoming president and thus immune to law.