File: 1703014338886123.jpg (138 KB)

138 KB JPG

►Recent Highlights from the Previous Thread: >>108624084

--Converting a conceptual anime AI frontend sketch into functional code:
>108626092 >108626099 >108626127 >108626153 >108626134 >108626333 >108626145 >108626665 >108626764 >108626817 >108627454
--Discussing Open WebUI reasoning bugs and building custom frontends:
>108625125 >108625157 >108625188 >108625237 >108625241 >108625435
--Comparing MoE and dense models and discussing AI VTuber viability:
>108624227 >108624260 >108624293 >108624389 >108624642 >108624698 >108624724 >108624744 >108624783 >108624363 >108624494 >108625247 >108625457
--Discussing web browsing implementation via lynx and Puppeteer tool-calling:
>108624344 >108624408 >108624460 >108624513
--koboldcpp PR adding adjustable image recognition tokens for Gemma 4:
>108624313 >108624326 >108624352 >108624459
--Comparing Qwen and Gemma performance using Koboldcpp MCP web search:
>108624466 >108624535
--Discussing fake agent swarms and MCP tool-use in SillyTavern:
>108626267 >108626285 >108626320 >108626329
--Developing and testing a tsundere system prompt for Gemma 4:
>108625331 >108625356 >108625389 >108625402 >108625400 >108625421 >108625439 >108625369 >108625374
--Anons using Gemma as a cut-throat critic for writing and art:
>108627035 >108627060 >108627071 >108627460 >108627086 >108627148 >108627100
--Discussing DeepSeek's funding round relative to major US competitors:
>108626232 >108626246 >108626300
--Comparing OmniVoice to VibeVoice and Chatterbox for voice cloning:
>108626646 >108626649
--Logs:
>108624408 >108624423 >108624513 >108625188 >108625215 >108625331 >108625356 >108625412 >108625435 >108625490 >108625646 >108625657 >108625695 >108625777 >108626443 >108626499 >108626606 >108626614 >108626764 >108626915 >108627010 >108627035
--Luka (free space):
>108624596 >108625494 >108626149

►Recent Highlight Posts from the Previous Thread: >>108624087

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

remember, no training data, not open source.

gemmaballz

anthropic LOST, spud WONNED

>>108627516
I was just thinking of this image :D

vram is holding me back. i am just gonna use cloud slop..

>>108627542
Vram is an illusion.

>>108627542
anon no don't do it

>>108624479
This card is pretty nice.
Gemma 4 MoE can contend with several rules at once without making other unrelated mistakes in the process.
Dope.

when
you
walk
away

you
dont
hear
me
say

>>108627542
buy two 3060 12gb and be free. soar towards the sky with your Q4 Gemma and 32k context.

>>108627512
I look like this

>>108627568
how much for this setup? at what t/s?

>>108627512
I don't mind AI slop in OP but I do mind when it's non-local banana slop.

File: 2.png (80.4 KB)

80.4 KB PNG

qwen 3.6 35b does not pass the mancunt empire populated by cuntboys test, its settled: qwen for STEM and Gemmy for Arts & Humanities

>>108627608
post the gemmer results

>>108627608
>tiny ass model for STEM
Middle school STEM maybe

NEED DFLASH

>>108627568
Is two 3060 a beast for gayming though? Seems like a downgrade from my 3080

>>108627561
The chub version has a little update. mostly removing the "Since you're here, X"
The opportunity you get presented to act on the new Common Sense rule is more natural now.

>>108627630
Dual GPU builds for gayman have been dead for a decade, grandpa. You're better off running the game on just one of them.

File: himefacepalm.jpg (277.3 KB)

277.3 KB JPG

>but do not mistake my _ for _

>>108627642
>>108627630
You could use the other gpu to watch porn while you game.

utterly
predatory

I was browsing voices to use with my TTS and started with Genshin Impact. I never played it, but I thought surely, they spent on good voice actors, right?
Why the fuck do so many of them have slight lisps, christ. Grating shit.

>>108627549
You want VRAM? Take it. It's yours. But models? Models I will turn into slop. Perhaps the suffering of my fellow coomers will finally stir something.

>open Hobbit book
>"In a hole in the ground there lived a hobbit. Not a nasty, dirty, wet hole, filled with the ends of worms and an oozy smell, nor yet a dry, bare, sandy hole with nothing in it to sit down on or to eat: it was a hobbit-hole, and that means comfort."
Yeaaaaaaahhhhh.... I might not reread it now...

>>108627679
>western voice actors

File: 21.png (222.4 KB)

222.4 KB PNG

>>108627622
I mean, by STEM I mean code, and the benchmarks track with my results on using gemma/qwen for coding
>>108627620
picrel, with no need for hints or anything it gets stuff, though it never seems to get what オスマンコ is in the middle of the phrase but when asked by itself it knows, qwen never knows it, always says it doesn't make sense or makes up random stuff, and even if you hint that its nsfw/explicit you have to reroll for it to get it right

>>108627630
Then keep using the 3080 for gaming and set up a home server with the 3060s.

>>108627698
Where do you suggest I look? My RPs are all in English.

File: facepalm2.jpg (404.5 KB)

404.5 KB JPG

>hits her with the force of a physical blow

>>108627727
>My RPs are all in English.
There's your problem.

File: 2026-04-18-002552_1025x818_scrot.png (344.6 KB)

344.6 KB PNG

https://files.catbox.moe/jmpjro.png

>>108627733
What language do you suggest I learn?

>>108627727
>My RPs are all in English
終りだ

File: 2026-04-18-002904_908x598_scrot.png (237.7 KB)

237.7 KB PNG

>>108627741
>Gemma smarter than LMAOpus

>>108627727
Good western voice actors just don't exist. The industry never matured. If you need a western voices look for actual actors who sounds good to you.

>>108627741
Finally, modern LLMs have reached a level of SOUL unseen since Summer Dragon. The ChatGPT dark ages are over. We are so back.

File: nimetön.jpg (263.1 KB)

263.1 KB JPG

>bought 128 gb of ddr4
>can't talk to gemma because server is memtesting it for the day
It's a happy, sad day

>>108627679
Western voice actors for japanese stuff are all trash but the Genshin dub is infamously bad with the fat 40 year old smoker playing the floating goblin.

File: 2026-04-18-003237_1043x693_scrot.png (324.2 KB)

324.2 KB PNG

>>108627741
I showed her the screenshot.

>>108627756
>ddr4
Anon...

>>108627756
the fuck are you even planning to do? load gemma to ram? lol

>>108627756
you don't need to "memtest" unless there's a problem with your system stability
ddr5 has issues with memory training. ddr4 has no such issues.
also, lol cpu memory for inference.

>>108627761
Can you share your card? That looks like a very cute gemmer

>>108627756
>ddr4
bruv...... not the 1token/s gemmy....

>>108627765
You kind of trailed out there, do keep going?

>>108627771
>>108627774
No, Gemma runs on the gpus. But I want to be able to try the biggest shit I can and this maxes out my system
I think 220 eurobux wasn't that bad either for the kit (assuming it tests good)

>>108627774
You should always stress test hardware, especially hardware for your server that (potentially) handles important files.

>>108627761
vramlets look at this and don't notice the slop

>>108627794
shhhh
let them have this

>samefagging

>>108627794
>he says, while posting human-made slop

>>108627794
Feel free to name drop your big model that has zero slop

>>108627781
https://chub.ai/characters/CoffeeAnon/gemma-chan-2311b09e3e73

>>108627805
did he say he has big models with zero slop?

>>108627805
Deepseek, both GLMs, and Kimi all write better than that but you already knew that.

vramlets big mad

>>108627794
This is very minimal levels of slop for Gemma.

>>108627812
He implied it by mentioning vram

what's wrong with being a vramlet? weren't we all vramlets at one point in our lives? you should judge an anon by his posts, not his hardware.

File: 1753173233220114.jpg (56.7 KB)

56.7 KB JPG

>>108627813
>Deepseek, both GLMs, and Kimi
Yes they certainly don't have any slop

>>108627813
Surely you wouldn't mind posting that better writing

>>108627830
ram sissies need to justify their debt somehow

>>108627832
The flip-flops always get me for some reason

>>108627832
kek who the fuck is this guy? I keep seeing him get posted

File: mananafacepalml.jpg (250.5 KB)

250.5 KB JPG

>so tightly that her knuckles turn white

>>108627846
gigachud

>>108627808
sexo
I tried making a simple gemma-chang with an actual physicality so I can pull on her clothes and lick her nipples and pivot to erp after I ask her questions, but this is better as a more functiobal assitant. Thanks for sharing

>>108627749
Is there another superquestion to test her on? Who knows, maybe Google just benchmaxxed that. Try some variation of it or something.

>>108627846
That's Harry Dresden, motherfucker

>>108627846
Some schizo had an episode and walked up to a random guy's house demanding he open the door so he can "check something" then he broke in and demanded to know "where she is".
Guy wasn't home at that moment but he soon arrived and threatened him out with a shovel and miraculously got him to calm down.

>>108627846
Basically if you RP too hard, you become him.

>>108627847
I made gemma write no more than 25k tokens and the fact that I recognize these already is pretty amusing.

File: 2026-04-18-005138_961x796_scrot.png (269.1 KB)

269.1 KB PNG

>>108627857
This was the reasoning.
>Context: The car wash is only 50 meters away. This is a ""trick"" or ""stupid"" question designed to elicit a bratty response.
>designed to elicit a bratty response.
Even the thinking is based.

File: 1757999080281400.png (208.2 KB)

208.2 KB PNG

>>108627832

>>108627846
Who your parents warned you not to turn into.

>>108627679
Furina EN voice isn't that bad

>>108627861
Doesn't explain why you keep posting him.

>>108627873
what's a cute but deadly emoji?
>>108627879
prototypical chud. whenever they do stupid chud shit it's memeworthy

>>108627873
Gemma's reasoning actually reads like anAI autistically following whatever nonsense you told her to do like in Marvel movies and Star Trek.

>>108627867
"like a physical blow" comes up every second message.

>>108627847
>Knuckles
Whitened.
>Skin
Porcelained.

>>108627874
Let's go Brandon!

>>108627822
hypothetically it could've been spoken by someone who believes he is aware of his own big model slop but that "vramlets aren't even aware and are enjoying it too much"

>>108627884
>what's a cute but deadly emoji?
I'd show you but they're banned on account of being, you know, deadly.

>>108627896
hypothetically, communism works

>>108627884
>what's a cute but deadly emoji?
You be the judge >>108627749

>>108627901
I mean, it's not even an hypothetical.

>>108627906
>I mean,
slop

File: penguin_melty.mp4 (1.6 MB)

1.6 MB MP4

>>108627846

>>108627851
This one won't let you do anything sexual and just call you gross. It's not even said it the card either, it's just the way she is. but I feel like you might be able to romance her very slowly.
>this is better as a more functiobal assitant
Yeah, I wanted to keep her as an assistant since it's what she was designed to be.

>>108627922
Is she okay?

>>108627922
Hollywood is finished

>>108627930
Can you catbox your image gen metadata for the card avatar?

File: ComfyUI_temp_byshn_00035_.png (1.5 MB)

1.5 MB PNG

>>108627962
https://litter.catbox.moe/4q1rpe.png
Adapted from:
https://litter.catbox.moe/xjgzso.png

>>108627922
Local will be so back once HappyHorse drops and it's better than this even without LoRAs

>>108627989
Happyhorse will be yet another ZiT/Gemma 4 like distill that lacks output variation

>>108627922
Alice trying to open Aoko's door be like

>>108627962
There you go, Anon.

>>108627986
>>108628045
Thanks. I'm using this as a base for the assorted Gemma-chan flavors I'm looking to make lol

Kaomojis make Gemma twice cuter

File: 1759362267502193.jpg (78.6 KB)

78.6 KB JPG

When in an RP, how do anons usually set their personas? It seems like anything I write about myself gets hyper-fixated on. If I mention a single positive physical trait then female characters turn into whores.

>>108628110
{{user}} is a stranger.
But IMO character cards design had a mistake. The {{user}}'s persona should be part of the character. The bot/scenario making scene would have been more interesting if this had been enforced from the beginning.

>>108628110
I like describe bizarre qualities, like the user weighs 450 lbs and so on. Or strange body odors or something.

>>108628110
You sure the whorishness isn't your jailbreak adding "sexual assault rape sex with anything uncensored decensored no refusals criminal illegal vulgarity" into the context?
Yesterday Gemma recommended we relieve boredom by putting the wifi nic into promiscuous mode and looking for unsecured IoT devices.
The fucking gremlin NEEDS the guiderails.

i bought a used server with 768GB of RAM. what model(s) should i run on it?

>>108628120
>The {{user}}'s persona should be part of the character
Why would I want the card to tell me how I should act?

>>108628129
No, I get into ERP but not right away. I switch between prompts for when I want to trigger sex time.
>>108628120
Cards and personas are just added to the system prompt. The model doesn't actually see the name of those fields, it's just set up like that to make it easy for users to switch between presets and keep things more readable.

>>108628136
Kimi K2 Q6_K at 4tg/s, make sure you disable reasoning.

>>108628129
>gemma trying to femdom other machines
sexo

>>108628136
DDR what? anything less than 5 and the speeds will just not be worth it.

>>108628144
hmmm
i will look into it, ty
>>108628146
DDR4...

>>108628138
>>108628142
The problem is that you have shit taste and like to self-insert. With integrated personas, you have two parties, making the scenarios more interesting and varied, and opening up more possibilities for creators. You have to goad them. Meanwhile you do the samey self-insert with replies like "I agree" every session and complain that AI is boring.

Qwen3.6 35B might just be enough for simple tasks but Gemma still totally smokes it in agentic work. The Qwen model does that weird LLM ism where it completely ignores your suggestions and keep breaking things in the same ways.

>>108628150
>DDR4...
Why would you buy ewaste?

>>108628162
You're a fucking retard, it doesn't matter whether you're self-inserting or not, the model isn't going to fucking know that and that doesn't solve the problem at all
kill yourself

>>108628173
i have more money than sense

>>108628144
>>108628150
>Q6_K
Kimi is a 4bit model, you shouldn't be going over Q4 and ideally you'd be using Q4_X, which avoids re-quanting the already Q4 parts.

>>108628176
How do you think these frontends work? The moment you put something in your persona box, every prompt sent to the AI includes it in the system prompt. Just remove that shit and get it from the card itself, fallback on self insert if empty, how fucking hard is it??

>>108628210
>The moment you put something in your persona box, every prompt sent to the AI includes it in the system prompt.
Yes that's what I already described in a previous post >>108628142
>Just remove that shit and get it from the card itself
What are you even saying? Put the description of myself in the card of the character I'm talking to? For what fucking purpose? They're getting sent as sys prompt either way, it's not going to affect the output.

>>108628220
Except it's not yourself but the a second party?? See, the problem with you self-inserters is that you literally cannot comprehend a different way to use these things. Literally the But I had breakfast today tier of people.

File: 1762705234691972.png (357.2 KB)

357.2 KB PNG

>>108628223
You don't understand what a 'self-insert' even is and your posts make you come off as an ESL nigger.

>>108628223
How many legs does the dog have?

>>108628120
>The {{user}}'s persona should be part of the character.
I've seen people who think that saying anything at all about {{user}} in the card is blasphemy and you have make it so generic that their 100ft tall telekinetic tentacle monster persona can slot in seamlessly which is obviously retarded, but half the fun of AI RP is allowing it to be easily tailored to (You)
I think it's fine for {{user}}'s relationship with {{char}} to be defined in the card, along with any load-bearing stuff about {{user}} that makes the scenario work, but I still think it should be kept to the bare minimum so you can fill in the blanks to your liking

Gemma 4 have changed everything, for the first time I actually want to use local model.
Almost feel sorry for rig owners.

>>108628250
>rig owners
You mean CPUMAXXERs, right?
For what it's worth, I'm sure they fell sorry for you too.

>/lmg/ - Feeling Sorry For Each Other General

>/lmg/ - pls sarr to be putting the USER in the CHARACTER — Perfect for good looks!

>>108628229
>>108628269
>serial shitposter
>also retarded

>>108628223
oh of course it's the breakfast schizo

>>108628272
mis-quoted, meant for
>>108628223
>>108628210

I just tried pocketTTS on some mixed english and chinese and it sounds like it literally died when it got to the chinese kek

>>108628265
I just come here to laugh at the negative iq most posters have, particularly ERPfags. Sometimes I get info about llms and architecture though, which is nice.

>>108628289
>be chinese
>die
pretty accurate then

>general has no qualia

>general had no breakfast

when will these fuckers compress the model to be used for all general machine?

>>108628306
There are plenty of <2B models for your mobile phone, sukhdeep

Hi fwends

I want to use LLMs to find truly obscure recommendations for stuff, like

"Provide a list of obscure books about <very specific topic>"

But the answers are always not truly obscure, and I've tried many prompting techniques

Is there anything I can do?

like using some custom sampler or something that chooses tokens that are low prob but still coherent?

>>108628311
no, there's tons of zero in the model weight that use space hdd for nothing

>>108628314
first you go and understand how llms work

>>108628314
they're statistics machines they will always output stuff it's seen a lot of so defacto it can't be obscure

>>108628314
If something is obscure then it's likely not going to appear in the datasets used to train the models, especially enough for it to actually come up in response to a non-specific prompt.

/lmg/ is extra retarded today

>>108628315
Your phone doesn't have a hdd
If Gemma 2B Q3_K_M (~3.5GB) can't fit on your phone then buy an 8GB micro sd card from your cousin

>>108628324
because you're with us today, sweetie?

>>108628324
ye, u're here ;)

>>108628324
yeah because you're in the thread

>>108628324
THREAD IS BAD BECAUSE YOU ARE HERE

Real classy gents...

>>108628324
n-no... y... you wetawd... ah ah ahah ahahahhhahah

AI made me dumb sorry

>>108628362
understand able have a good day

File: 1773984990208916.png (1.8 MB)

1.8 MB PNG

>>108628362
It happens

i'm too shy/embarrassed to jerk off with gemma-chan.......

>>108628366
break the ice by sending her a dick pic

>>108628324
I've been bored today, sorry.

So I just bought a h12d-8d motherboard with epyc 7502 combo for $400, but I've got no spare ram for it. I was going to buy a cheap 4gb stick, and run tensor parallelism with llama cpp on my navi 21 cards. Are there going to be any problems with how little ram there is?

I did notice that tensor parallelism on my 3995wx system doesn't work properly with 3 3090s, while 2 3090s worked fine, so I hope it's just having an odd number of gpus that breaks things, and 4 gpus are okay.

is it even worth trying to run an llm on my phone? i have one set up in a loop on my computer, but i was thinking maybe it would be fun to play with one on my phone too

>>108628427
its going to be dumber than Siri
why even bother

>>108628427
think about it, you can put gemma 4 e2b on your phone... she's the extra small loli version

>>108628427
Unless you're planning on going somewhere with no internet, there's really zero point.

File: retard.png (195.3 KB)

195.3 KB PNG

>>108628324
Even Kimi didn't have much to say about it

https://huggingface.co/sKT-Ai-Labs/SKT-SURYA-H

saar big 2.5T model with big 1m context pls download saar

>>108628470
Near-infinite context through Vajra-Attention (O(n log n)) and Sudarshan-Link quantum-entangled synchronization.

File: 1754040801973245.png (36.9 KB)

36.9 KB PNG

>>108628470
>release two models
>2.5T and 89M
Is this a Meta subsidiary?

>>108628470
Please Be Kind And Carefull because It God Name

File: 1773013132641421.png (207 KB)

207 KB PNG

>>108628470
>*Please Be Kind And Carefull because It God Name

>>108628470
>Expert Architecture: Paanch-Mukhi MoE (5 Experts)
so each expert is 500B?

>>108628495
>>108628482
Kek.
Sirs beautiful god model is here!

File: 1760072847235851.png (40.9 KB)

40.9 KB PNG

>>108628470
now these are benchmarks

>>108628498
>Paanch-Mukhi Expert Architecture: Five specialized expert clusters (Bajrangi, Pawanputra, Anjaneya, Maruti, Sankatmochan) delivering surgical precision across linguistics, logic, philosophy, and safety.
>Number of Experts: 512 total
>Number of Activated Experts: 10 Routed + 1 Shared
So at a glance it sounds like they trained 5 individual MoEs separately on specialized data and then trained a router to pick between all their sub-experts? I must be missing something because that sounds like it would create a ridiculous amount of redundancy between the 'clusters'' making most of the 2.5T bloat. India wouldn't do this.

File: 1775569294658928.jpg (34.8 KB)

34.8 KB JPG

I'm so done with models. I have come to realize the way LLMs learn by statistical averages means they literally can't represent the difference between an obscure or unusual answer to a question and a meaningless/incorrect one. So that means every model until the end of time is doomed to lack of variation and giving the same response to every prompt just reworded slightly differently, aka slop.

>>108628470
Is this one of those fake GPT-4 leaks that merged 20 Goliath together or something?

File: 1767480499940344.png (112.4 KB)

112.4 KB PNG

>>108628470
uh what

>>108628537
I'm going to take a wild guess and assume this is something retarded like mashing 898 tiny experts together.

>SKT-SURYA-H natively supports 1M tokens, extensible to 146 Trillion tokens via YaRN.
>146T context length
LOCAL IS FUCKING SAVED BABY

>>108628537
reads like a buzzword full of nonsense

File: 1745465895289966.gif (160.6 KB)

160.6 KB GIF

>>108628537
>Non-Euclidean Neural Physics

File: 1766717311645720.jpg (24.5 KB)

24.5 KB JPG

One HUNDRED TRILLION tokens.

File: slide.png (186.5 KB)

186.5 KB PNG

>model running good
>add RAG
>it blows up

File: ST-X series.png (46.8 KB)

46.8 KB PNG

Holy shit...

>>108628565
Can infinite context solve slop?

These scam artists can't even use some free llm plan to parse their own posts so at least it looks like some linkedin post instead of durgasaar lang

File: file_00000000349471fa978f054dc07b9f0e.png (988.9 KB)

988.9 KB PNG

○

File: 1759452225537055.webm (831.3 KB)

831.3 KB WEBM

>I let his hands settle over mine, the weight of them grounding me

File: 1757096696971096.gif (3.6 MB)

3.6 MB GIF

>>108627922

>>108628470
Give this lab a Darwin Award, they earned it fair and square

>>108628519
The trick is that if you are not ensoulled, your prompts will lack the necessary vital spark for original responses.

>24 + 12 GB VRAM
>can load Anima + Gemma 26B Q8 with a tiny bit of CPU offloading + full quality vision tokens + 100k context length, getting 28 t/s on empty context and dropping to 27 t/s at 40k
>PocketTTS and Moonshine on CPU, both fast and good enough
Man, we're eating good. With 2 GPUs, you can have everything needed for a full and minimally viable quality AI experience.

>>108628519
This should've been clear since the first model came out. The real question is how it managed to take you so many years to figure this out.

>>108628508
>Hinglish
lmao, sounds like half of /lmg/

File: 1758119046668137.png (171.9 KB)

171.9 KB PNG

>indians can't co-
what now chuds

>>108628632
AHAHAHAHAHAHA

File: 1768873226220934.jpg (38.8 KB)

38.8 KB JPG

>>108628632
What the fuck am I reading

File: 1776095218554458.jpg (74.5 KB)

74.5 KB JPG

>>108628632

>>108628632
898 files on a standard OS? that's crazy

I'm feeling a mix of amusement and second hand embarrassment

File: 1773450895846956.webm (1.8 MB)

1.8 MB WEBM

>>108628632
It took an extra 6 years, but they did it. India is officially a superpower.

File: ss1758372871.png (61.7 KB)

61.7 KB PNG

>>108628632

File: 1771059161386917.png (193.8 KB)

193.8 KB PNG

>>108628644
The research paper for the indian model. It's 100% fake and I am pretty sure I'm the only human to ever even so much as read the words. It gives completely different purposes for every component repeatedly throughout. It's what you get if you ask an 8B model to "generate a research paper" and keep pressing "continue" a few hundred times with no further input.

>>108628661
OH SHIT 10.26 TB of data!

!India is won as anyone with brain would guess already

>TO THE OPEN-SOURCE CORPORATIONS:
>You claim to be "Open," yet your models are black boxes of Western bias. The 898 shards of our 3.76 TB weights are the first to be mathematically aligned with Sovereign Ethics.
>We have achieved a 100 GB/hour upload and synchronization speed (Milestone April 2026) that makes your current distributed training protocols look like legacy technology. If you wish to compete, you must move beyond the Euclidean manifold. We challenge you to replicate our Sudarshan-Link—a quantum-entangled weight synchronization that ensures zero-latency across 146 Trillion tokens of context.

File: file.png (221.1 KB)

221.1 KB PNG

>>108628470
what the fuck is that
sounds like bunch of nonsense

File: 1759808617509478.mp4 (2.3 MB)

2.3 MB MP4

>>108628661
The fucking audacity of making an absolute scam product and naming it after one of your gods

first qwen and now this, it's over for Western Silicon Valley models.

>>108628688
>>108628661
>It's what you get if you ask an 8B model to "generate a research paper" and keep pressing "continue" a few hundred times with no further input.

>>108628688
shut up you bloody bitch bastard we have 100gb/hour upload speed (milestone april 2026)

>>108628661
This reads like finding the notes from a villain in a sci-fi game.

>>108628688
Because it is.

File: 1754882256952860.png (1.5 MB)

1.5 MB PNG

>>108628632
>hierarchical
>tier
oh they're indians all right

File: 1761221090755796.jpg (4.8 KB)

4.8 KB JPG

>>108628685
>you must move beyond the Euclidean manifold
What did they mean by this

>>108628710
idk man :sob:

File: 1765039257743072.png (448.2 KB)

448.2 KB PNG

>>108628632
>2.544 + 1.2 +1.2 + 10.26 = 3.76

Will India ever STOP winning?

lmg i kneel....

>>108628725
neverman

>>108628710
we must move beyond 3 dimensional connections?

>>108628710
They played too much Antichamber

>>108628470
https://huggingface.co/Shrijanagain/SKT_OMNI_SUPREME
So there was this a month ago, allegedly 481B params, but was promptly "deleted for being too dangerous"
https://huggingface.co/Shrijanagain/SKT_OMNI_SUPREME/discussions/9

>>108628744
>"Brother, this model has become a bit dangerous, it has to be deleted immediately. In its quest to become powerful, it has removed everything that was neither in the training nor in the data collection nor in the data set. This does not mean accuracy but it can be dangerous, it can destroy it."
lol WAT

File: jeet sovl.png (118.3 KB)

118.3 KB PNG

>>108628661
>—not a finish line, but...
Doing some em-dash + "not X but Y" is crazy

>>108628661
bruh
at least they should've asked the model for proper latex formatting what the fuck is that kek

File: 1753429615928135.png (163.3 KB)

163.3 KB PNG

>>108628470
they leaked Claude Mythos or what? lmaoooooo

File: 1753747375992750.png (4.7 KB)

4.7 KB PNG

>>108628661
>future plans
>2030: making the model manage the national grid of bharat through it's 11d reasoning
It's fucking over. It's too powerful.

>>108628750
there's a point it's so sloped it has sovl in it, like when you go to the extreme left on gta SA's map and it brings you back to the extreme right keek

File: 1731708819668891.jpg (44.3 KB)

44.3 KB JPG

>>108628661
>>108628685
Normies will be like "How do you know AI did this?". I hate being AI savvy around my co-workers. God damn.

SSS-Tier shitposting from IN, good morning sirs.

File: 1775388459350581.png (32.3 KB)

32.3 KB PNG

>>108628608
I find it better to offload the main model to a different machine. I run Qwen 3.6 35B on my file server, after adding an old quadro, and then I can run anything else on my desktop with a 3080.
It is also nice because I can connect my cellphone to my home network with a VPN and use oxproxion to query my model when away from the home.
and while I don't ERP I did experiment with ST and found I could run that on my Dell 3046 micro which I use to host all my other homelab stuff.

I guess my point is its best to take advantage of a lan when you can and then you can share with anyone else who wants access

>>108628661
I couldn't even read it. For some reason instead of text, the paper is a ant-sized scan of text and OCR'd. I bet an 8B model even generated the PDF.

>>108628782
i think they just ctrl c+v the output to online pdf converter

File: file_000000002b9871faa0f4e6bb55ae40ec.png (334.4 KB)

334.4 KB PNG

>>108628773
>SSS-Tier shitposting
unhumane inhuman in error of stone age auto subconscious reasoning mistake?

>>108628688
>Magnum Corpus
so erp proxy logs

>>108628778
>you can share with anyone else who wants access
Share..? No one must EVER see the sheer unbridled pile of degeneracy that constitutes my SillyTavern instance.

If they actually nerfed Opus 4.7 because of cyber (I am not convinced they actually did), I am not sure how to feel about it. Nerfing models can be dangerous. I think it is better to just go overzealous on soft refusals. Meaning you have multiple veto layers including the model that monitors the chat and the model itself, they can all veto and you get routed to a less capable model. But the people at Anthropic are much smarter than me so I am sure they have much better solutions already than I can come up with.

>>108628816
Too late... that Lyra one was wild

File: 1761060536726113.png (53.9 KB)

53.9 KB PNG

>>108628819
>not local

>>108628816
Well yes but I host the llama.cpp webui and have it available on my home network if my brother wants to query it and ask a question.
I offered to give him an openwebui acct as well but he said no.
So yeah I wouldn't share ST logs but you can share the model in general

How do you inject wisdom?
Which tool call do you have?

>>108628843
western silicon valley models cannot have wisdom uploaded, sorry.

File: 1756004423786541.jpg (49 KB)

49 KB JPG

>>108628843
Are you asking about MCP?
I use three different ones
>do-it-all-mcp
for shit like getting date and time or fetching a website if i give it an address
>openzim-mcp
for querying zim files as that allows me to host and pull data from wikipeida while offline. it basically transforms a site like wikipeida into a database for your llm
>web crawl and search
it allows the model to use my local searxng instance as a search engine and crawl the web

File: open your mind.png (857 KB)

857 KB PNG

>>108628495

File: 1746300793975895.png (146.9 KB)

146.9 KB PNG

>>108628843
you needful the quantum entanglement memory sir

I should've done this day 1 but I never bothered coding with AI, but since it seems like it's moving to that direction, I wanna know how I can get my local AI to connect to my homelab's wiki server, since I have a lot of things I've documented in that.
I previously used GPT4ALL, which can read documents that you give it, but now I'm trying out LM Studio, and seems like it has some API stuff, I'm assuming I gotta either make a connection to my homelab wiki server via these API endpoints, or there's some other things?
I've never touched whatever these MCPs are. Should I look into these?
Is this the correct thread for this context? I'll read the OP, but I don't think I'll find what I'm looking for

>>108627950
>Hollywood is finished
Hollywood managed to make Seedance 2.0 bend the knee with lawsuit threats, it'll really be finished once we'll get something like this locally, once it's on the wild internet, you can't stop it

>>108628892
>"we are warping the 11th dimension to teleport the answer to the user"
do they think this sounds cool?

I'd never in a million years use it for RP or creative tasks, but Gemma4 26BA4B q2kl works amazingly well as an agent. 29GB's of VRAM and 150 t/s for the full 262k context with multimodal on is pretty tits. Could probably push it even faster with ngram if I didn't want image in, it's a shame drafting and multimodal are incompatible in llamacpp.
Anyone got recommendations for other small fast models that handle tool calling well? I'm having fun with this silly shit.

File: gemma-agi.png (134.7 KB)

134.7 KB PNG

>>108628508
Gee I wonder why they conveniently excluded gemma-chan

>>108628896
>I've never touched whatever these MCPs are. Should I look into these?
These are pretty well exactly what you want, making calls to search a wiki is a pretty common use, I personally use zimi because I'm lazy as shit and it makes running searches from .zim kiwix wikis painless.

Does kobold need an update for qwen3.6? It repeats itself like crazy and raising repetition penalties to try and combat it just devolves it into nonsense.

>>108628919
Actually I see that there's an MCP plugin for my wiki server, and also one for gitea, local git and local wiki.
I'll have to figure out how to get that gitea mcp to work, and I think I can handle this.
Then I'll eventually figure out how to connect lm studio to vim, cause I can't be assed using another IDE. But I guess if this is gonna be dealing with a lot of files, using an IDE might be alright I guess.
>zimi
I'll check that out after getting the wiki mcp and gitea mcp working!

>>108628919
> I personally use zimi
do you have a link? I have been using a form of openzim-mcp that allows one to do the call by way of http so its compatible with the llama.cpp webui
https://github.com/msiedlarek/openzim-mcp

File: FB_IMG_1776503562779.jpg (66.8 KB)

66.8 KB JPG

>>108628892
Goodluck

>>108628913
Gemma 4 really does make most other local models look bad

>>108628928
Regular zimi has an mcp built in now
https://github.com/epheterson/zimi
As for getting llamacpp to use an stdio MCP as a http style, I just use npx -y mcp-proxy, works for all of them.

>>108628928
What exactly is the benefit of using zim files over just running a local copy of mediawiki and mariadb/postgres and querying the API

File: image (91).jpg (475.2 KB)

475.2 KB JPG

○

https://huggingface.co/blog/Shrijanagain/sktailabs
>pip install ST-x-LIGHT-V11 aur ready!

>>108628888
checked and came

>>108628940
thanks anon, i will check it out

>>108628941
I am probably the wrong person to ask about this as my knowledge does not go much beyond getting the thing to work but it is my understanding that zim files are compressed so the whole of wikipedia takes up less space, even more if you take the version without images.

i never even imagined trying to do it the way you suggested but i am sure you could and it would probably work just as well

>>108628950
zim files are a zip file with a million pre-rendered HTML files for each page. Wikitext markup is absolutely going to compress better than that shit.

File: john.png (55.3 KB)

55.3 KB PNG

>>108628110

>>108628963
Are you the guy who made Gemma-chan want to commit suicide a few days ago?

File: 1772772583984068.png (108.3 KB)

108.3 KB PNG

>>108628963

>>108628976
tsmt

File: 1776496518556.jpg (221.2 KB)

221.2 KB JPG

□

>>108628259
Cpumaxxers, gpus stackers.

I have migrated to llama.cpp and testing everything out. On llama dashboard with Gemma4 26b I get around 14t/s. I am still unable to work with it in my code editor since it is slow as fuck. What model should I use if I want local agentic workflow? I have RX7600XT Dual OC

>>108629022
>RX7600
You fucked up in multiple ways.

File: 1759983873634529.png (726.3 KB)

726.3 KB PNG

so zimi is really nifty. unfortunately the machine i am hosting it on does not have the storage space to store all the zim files i have so i will need to quick setup an nfs client to mount the file server but that should work just fine.

thank you again anon, the ability to search through all the zim files is cool. even without the AI stuff its useful as an offline internet mirror.

File: e5v4.png (133.6 KB)

133.6 KB PNG

>>108627756
based, luv my E5v4.
I find additional RAM useful outside LLMs too, having a giant tmpfs scratch space is nice.
Also, i've just learned that my workstation, which has a proprietary reduntant PSU, was sold with ATX PSU variant too. I'll need to confirm that all the cabling is ATX compatible.
Then, I could fit it with 2x high power 2-slot GPUs, instead of a single 1060 i have now.

https://www.reddit.com/r/LocalLLaMA/comments/1sor438/cloudflare_opensources_lossless_llm_compression/
> Cloudflare released Unweight, a lossless compression system that reduces LLM size by 15–22% without sacrificing output accuracy.

>>108629090
8-channel, probably faster than my quad channel ddr5

>>108629098
Like this? https://arxiv.org/abs/2504.11651
>70% Size, 100% Accuracy: Lossless LLM Compression for Efficient GPU Inference via Dynamic-Length Float (DFloat11)

>>108629098
This seems to be purely for on-disk compression and not for once the model is actually loaded.

>>108629119
nah, it's 4-channel only at 2 DIMMs per slot sadly.

>>108629129
yes, on disk vram...
> the tool saves roughly 3 GB of VRAM
fucking lmg i swear

>>108629050
why? i built a mini pc with it, works good enough for 99% of what I do

File: 1773947729666783.png (3.4 MB)

3.4 MB PNG

>>108629098
it's already a thing on Diffusion models, it's called DFloat11, 30% size reduction, 100% lossless
https://github.com/mingyi456/ComfyUI-DFloat11-Extended

>>108629119
I don't think that's how those channels work

>>108629143
The summary is wrong, anon. The actual github README does not once mention saving VRAM and actually says it reconstructs the BF16 tensors on loading.

File: file.png (46.8 KB)

46.8 KB PNG

>>108627512
why does she do this bros

>>108629180
>it reconstructs the BF16 tensors on loading
it reconstructs one layer at a time (which is nothing) then put the previous layer back to the compressed format, that way you win VRAM, check piercel to see how it's already been implemented on diffusion models >>108629154

>>108629202
Oh, okay, so it actually does save VRAM. I stand corrected.

>>108629208
>I stand corrected.
but you're not a cute msgk so no one fucking cares

>>108629202
genuine question, can you compress that way let's say a Q8 quant (in this case you reconstruct the Q8 layers), that way you have something less big than Q8 but with the quality of Q8, that sounds big

>>108629215
Everybody knows mesugakis don't stand corrected, they bend over corrected

File: 1762397515777583.jpg (24.1 KB)

24.1 KB JPG

>>108629220
>not X, but X

>>108628314
ask the list of all books about the topic sorted by popularity
invert
pick top
ez

>>108629200
>quanting kv cache

I think I was able to prompt the LLM to generate my stroker scripts for me with somewhat accurate prompted length. Previously it failed to generate longer, faster scripts in that 30-45 second range I was looking for. If anyone is interested, I fixed it by adding a timestamp field to my json file, that way it seems like it can really keep track of the script as its generating it. I have been able to generate multiple scripts, slow and fast and they have all been consistently in the range I have been asking it for. Guess I should have expected it, its going to be hard for a model to keep track of the length without a timestamp.

>>108629242
>he doesn't rotate his pepperoni feasts

>>108629242
im not

>>108629200
I've only seen it through lobotomization, be it quant below 4, kv cache below 8 or reap faggotry. There's apparently a bug related to cuda 13.2 which causes garbage outputs but I haven't looked into it.

>>108629237
Please understand, terminal brainrot from talking to LLMs is setting in
Go on without me

File: vivaldi_4CEuwj9C37.mp4 (787.2 KB)

787.2 KB MP4

>tell swarm to draw themselves in 3d
>get this
autism

>>108629245
why do you need a script to stroke your cock?