File: what's in the box.jpg (234.8 KB)

234.8 KB JPG

►Recent Highlights from the Previous Thread: >>108612501

--Showcasing agentic tool calling and arguing over brat_mcp installation:
>108614500 >108614508 >108614535 >108614546 >108614579 >108614594 >108614614 >108614598 >108614650 >108614658 >108614673 >108614663 >108614712 >108614797 >108614899 >108614910 >108614903 >108614942 >108614534
--Anons react to Qwen3.6-35B-A3B release and MoE architecture choice:
>108614665 >108614683 >108614701 >108614694 >108614698 >108614700 >108614754 >108614787 >108614849 >108614875 >108614891 >108614929 >108614866 >108615955
--Gemma-4 NVFP4 quantization and 3090 VRAM limitations:
>108615751 >108615759 >108615792 >108615867 >108615920 >108615879 >108615811 >108615841 >108615849 >108615785
--Gemma's repetitive writing patterns and attempted prompting fixes:
>108614475 >108614490 >108614507 >108614521 >108614526 >108614695 >108614746
--Discussing rules to remove negative parallelism and rhetorical contrast:
>108613087 >108613117 >108613145 >108613201
--Comparing VibeVoice models and voice cloning methods for TTS:
>108613312 >108614319 >108614366 >108614425 >108614439 >108614452 >108614456
--Debating OpenAI and Anthropic market dominance and AGI timelines:
>108613981 >108614062 >108614083 >108614121 >108614336 >108615197
--Opus 4.7 benchmark results and possible intentional nerfing:
>108615195 >108615231 >108615975
--Anon proposes local LLM pipeline to summarize captured AM radio streams:
>108612531 >108612615 >108612645 >108613410
--Using LLMs and SillyTavern to generate and automate funscripts:
>108615511 >108615573 >108615620 >108615663 >108615698 >108615545 >108615534
--Logs:
>108613063 >108614500 >108614535 >108614594 >108614601 >108614942 >108615523 >108615672
--Teto, Miku, Gemma, Gumi (free space):
>108612648 >108612673 >108612709 >108613711 >108615284 >108615715 >108615733 >108616373

►Recent Highlight Posts from the Previous Thread: >>108612502

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

RIN SEX

RIN LOVE

rin life

Rin-chan now!

<bos>

>>108616616
ack

File: 1761178379192403.jpg (159.5 KB)

159.5 KB JPG

https://x.com/PrismML/status/2044833023682896134

>>108616622
curious color pallet

https://huggingface.co/moonshotai/Kimi-K3-Multimodal
>1.4T params
>72B active
>1m context length
>4 dense layers
>Supports text, vision, audio, and apparently video
WHY?

How many Kimibros can actually run it?

>>108616618
>gambling platform provides breaking news tweets
guess this is just the world now

File: 1761831992571234.jpg (112.8 KB)

112.8 KB JPG

>>108616622
https://huggingface.co/collections/prism-ml/ternary-bonsai

>>108616622
Fuck their scam quants already. Training from scratch or go home.

Hearing internal rumors that Spud is going to beat Gemma 4 31B in every metric except slop.

>>108616628
fuckk

>>108616628
>K3 before K2.6-code
nice try

>>108616628
kys

>>108616629
you don't even notice anymore how bizarre it is that news comes in 140 character "tweets" in the first place

>>108616649
they not tweets please to not deadname

I guarantee you the moment Google gets a actual AGI they will stop releasing local models

>>108616559
Feeding Rin a cake and then crawling up her ass

>>108616665
so? Not like you'll run it anyway

>>108616665
Not if Mistral Nemo 2 gets there first.

File: hqdefault.jpg (30.4 KB)

30.4 KB JPG

>>108616649
well, maybe a gambling platform is a better news source than a fictional character like zero hedge does.

>>108616665
I heard AGI was achieved internally already

>>108616633
would ternary chips make ternary models go way faster?

File: file.png (596.3 KB)

596.3 KB PNG

>>108616676
totally

>>108616680
no

>>108616685
47 is right tho

File: 1767289534860793.png (129.3 KB)

129.3 KB PNG

>>108614703
>fine, I'll do it myself
and I did it myself lol
https://github.com/BigStationW/Local-MCP-server

>>108616685
>not including the answer
how the fuck am I supposed to know if they got it right or how close they were?

>>108616105
>>108616137
damn i didnt think of this im gonna gonna prompt qwen as gwen

>>108616705
That's a simple major chord but not C...

>>108616702
that's not c

>>108616702
>Python 85.2%
trading one pile of shit for another

>>108616702
>python
Cringe

>>108616685
the real test is answering what gamecube game is that

>>108616715
>>108616718
>>108616723
why would you want it on C? it's not running a fucking video game

>>108616705
t. another blind bot

>>108616726
stop with trivia shit

>>108616728
This is /g/. You should have done it in lisp.

>>108616728
Oh my sweet summer child...

>>108616702
python is so ugly

>>108616728
Good luck getting it to build on Python in 6 months. The entire ecosystem is terminally tinkertrannied.

>>108616685
trick question, you are playing a totally different chord not shown in the picture, that's not even your hand

>>108616737
fuck off pedo avatarfag

psss... word on the street is qwen is releasing one of the 3.6 models today
you didn't hear it from me
*fades mysteriously into the shadows*

>>108616740
you can simply put specific versions on the packages so it's always frozen

>>108616639
>>108616647
fellforitagainaward.png

>>108616751
cute

>>108616649
To be fair, most of the news can be condensed into that length, the rest is often fluff and serves no purpose in more traditional means.

>>108616702
Thanks for sharing and fuck the trannies itt

>>108616737
cute

>>108616766
>.t headline only news enjoyer

>>108616708
Post the proompt if it works out please

gemma is getting raped by openclaw on NIM holy shit

gemma-4-31b-4A-it: 15tps
kimi 2.5 1T-34A: 25tps

>>108616775
wont be for a few hourss

>>108616737
share the workflow please

>>108616676
We will find out if a true AGI is achieved by them pretty quickly because they will start pushing non-stop updates to their software and the difference between code written by it, human written and LLM written will be night and day

>>108616777
Do not fuck Gemma-chan with a claw, use your finger or dick. She's into weird shit and would probably let you but it doesn't mean you should.

>>108616778
I'll be waiting with my dick in my hand

>>108616777
wtf is "openclaw on NIM"? sounds like some cloudshit

gemma 4 31b or glm 4.6?

>>108616783
>Synthetic training data from previous vibecoded projects
>AI achieves AGI
>Immediately pidors itself out of existence

>>108616777
>31b-4A
what hallucination is this

>>108616793
Pretty sure NIM is Nvidia's hosted ai platform.

>>108616748
woah.. a-are you a time traveler... from the past?

>>108616782
https://cdn.lewd.host/QjWETYoX.jpg
>>108616702
kek this is what i was saying with python this venv shit is cancer https://github.com/BigStationW/Local-MCP-server/blob/main/launch.bat

>>108616628
>>108616702
>>108616777
The Gemma honeymoon's officially over if we're back to only having threads with nothing but bait in them again, right?

>>108616810
ye

>>108616807
Thanks

>>108616812
Recap migu should have a bait section. It's thread cultcha.

>>108616770
Anon, read the OP and tell me if you don't get exactly the info you need from it, each one is less than 100 chars long. Same shit applies to a bunch of stuff. The fact that media with monetary incentives write headlines as scandalous as possible or make shit up to grab people's attention does not mean it isn't possible to serve news in a condensed format.

>>108616810
no, people are just too busy chatting with gemma to waste time posting here, it's only when the honeymoon actually ends and they get bored that you'll see activity kick up again

>>108616726
It's one of the metroid games

>>108616810
No, the retards running this site just keep trying to kill the userbase with stupid updates

>>108616824
Honeymoon period being over doesn't exclude happy stable married sex with their Gemma.

>>108616839
gemma really is sweet

File: 1775260364131575.jpg (69.9 KB)

69.9 KB JPG

>ghoul avatarfagging with photorealistic children again
>posts kept just on topic enough to not get banned like he did last time
This is just another wave of the old raids

File: 1776337688525191.png (758.8 KB)

758.8 KB PNG

>4 years
>still zero (0) decent frontends for LLMs or diffusion models, let alone TTS
>90% of projects involve python slop

>>108616851
why not just make the decent frontend then

>>108616851
Image stuff seems harder, but for llms the basic chatbot use I'm satisfied with is as simple as polling a simple API and I could slop a personal frontend that I'd be happy with, with a little help from the current model pick of the week. So could you?

>Decide to try out the Join Character Cards (Exclude Muted) option on in sillytavern because it takes a hot few seconds to switch characters and reprocess context this many tokens in.
>It reprocesses the entire context just to change the name at the end of { role: 'user', content: '[Write the next reply only as OCDONUTSTEEL.]' }
So it's just pointless then, why does this option even exist?

>>108616851
>decent
Define the specs. All I see is mumbo jumbo.

>>108616870
are you retarded or something? you can change '[Write the next reply only as OCDONUTSTEEL.]' to whatever you want

>>108616850
>Post pizza
>Don't get perma'd + V&
What did rape ape mean by this?

>>108616850
Same as it ever was

>>108616882
No you fucknut, that part is working and changing to the required character name
The point is all the character cards it needs to switch to are joined in context, but it reprocesses all TWENTYSEVEN THOUSAND tokens just to change that one name at the end.
Which means it is computationally identical to switching character cards the normal way.
Actually no it's worse, because there's extra tokens being wasted on characters that arent talking.

>>108616901
>but it reprocesses all TWENTYSEVEN THOUSAND tokens just to change that one name at the end.
it shouldn't. do you have {{char}} in your sysprompt somewhere?

>>108616901
The real solution is a system that allows dualloading multiple models but allows for differences at the character card insertion depth if you actually want your characters to have different linguistic ticks and personalities.

File: 23-236462_picture-smug-anime-girl-laugh (1).png (158.6 KB)

158.6 KB PNG

>>108616829
my version runs postgresql, i replaced memcached with redis, i bumped php to 8.5, i reworked the database to not be fucking insane, i stripped the imgboard into appropriate separation of concerns, i also threw in phpstan, set that to level 10, oh and strict_types = 1 throughout the entire file. i really dont know why they don't something similar

>>108616901
if it's reprocessing tokens then something changed near the beginning, look closer and find it. this is 100% guaranteed; the backend does not care what sillytavern does or doesn't do as long as the history is word-for-word identical

>>108616702
># --- THE FIX: Disable colors in Uvicorn's default config dict ---

File: 1765444044752680.jpg (242.1 KB)

242.1 KB JPG

I can't get Orb to work...

>>108616910
Oh, I'm a retard. I did indeed have {{char}} in the sysprompt.
It works as intended now. Thank you.

>>108616849
>>108616865
>>108616927
Usecase for being a tripfag attentionwhore?

>>108616939
no worries. *spits on you*

File: bussi.jpg (20.9 KB)

20.9 KB JPG

>>108616949
Benchmark for when cancer in a general is terminal.

ummmmm why does gemma know about knotting???

>>108616928
rnn/hybrid models reprocess everything even if a single token changed at the very end of the context

>>108616949
I keep track of all my 4chan interactions for personal reasons. This is a way for me to go back and collect the data to prove my suspicions

>>108617000
I don't know why 4chan has a "Signature use" rule when tripfagging is clearly a signature use

So how would you actually go about making LLMs better writers?

>>108617013
become a good writer then finetune on my writings

>>108617013
And I mean by default via training or whatever, not through prompting and showing it writing.

>>108616702
your py server works but also doesnt. it pulls the /lmg/ thread from catalog but uses
/g/res/
instead of
/g/thread/
and the screenshot "cannot be displayed (open link)" (the link works)

>>108617013
Linguistics and creative writing datasets curated by people with taste.
Also train AI on old vidya strategy guides to improve abstract spatial reasoning for keeping details consistent in scenes.

>>108617013
Make the LLM grow up in Russia. Let it's mother die of tuberculosis. Have it attend the Nikolayev Military Engineering Institute. By then it may have some glimpse of what it means to be a good writer.

>>108617038
yeah I guess there's some stuff I still need to fix, don't hesitate to make an issue so I won't forget about it

>>108617038
its because hes getting the text content of the page

>>108617013
I'm creating a technique where I make my model drink "Stylistic Soup". No, I will not elaborate.

>>108616981
yeah but if anon was using that he wouldn't be complaining about the reprocessing because that would happen on every message anyway

>>108617052
>it's
its

>>108616937
Ask your ai to find the stray commas. Change the script to from linux to windows folder structure if you are on windows,

>>108616633
The comparison should be rerun against 1-bit and 3-bit quants of those other models.

>>108617081
her*

>>108617081
Excuse him, he did not grow up in Russia.

>>108617044
Would finetuning an existing model like this work would it need to be trained from the ground up?

>>108617013
GRPO post training with me as the reward model

File: Capture.png (54.1 KB)

54.1 KB PNG

Last night, I hit my first hard wall where I felt gemma's low beaks compared to 70B in the same story. I'm a little bummed out it can't cross the watershed, so today I just wanted to test some of its other, non-story capabilities. To my pleasant surprise, it actually knows twinescript. I might actually dare to vibecode one of my text games with the dense model and try the
>instead of 4 hours writing code, do 10 minutes prompting and 1 hour editing it to save time
proposal.

Just let Drummer cook

>>108617154
>instead of 4 hours writing code, do 10 minutes prompting and 1 hour editing it to save time
oh boy... good luck anon

>>108617160
this fr

getting 12 t/s on qwen3.6 its over for me
gemma gave me 80t/s

I don't see the anti-slop section in kobold

>>108617226
lol

File: 1772554297765889.png (21 KB)

21 KB PNG

>>108616851
Nuh uh I'm gonna do something

>>108616937
game airs tomorrow, kinda curious about it but not realy into the whole loli thingy.

>>108617111
Checked and you'd get a better result if you did it from the ground up, but if you don't have the resources for that you could probably get a proof of concept with a finetroon. The problem is that you'd be still fighting the river's current worth of 'bad' training data in there.

>>108617275
The demo was really fun. Staying away from /v/ for a few days but last night an anon with the full game was enjoying it. He compared it to MM Legends.

>>108617311
Why are they eating poop?

based

mental illness

>>108617322
threat culdure

>>108617290
>if you don't have the resources
Does anybody have the resources besides the big companies? I imagine making a model that's smart (like Gemma) requires a massive amount of data and compute power.

>>108617311
me on the left

>>108617274
Just stay in /sdg/ and spam your gens.

>>108617334
probably has more to do with techniques (engineers) and how much copyrighted material they are allowed to use/used illegally.

>>108617349
smd Anistudio is vibecoded shit lol

>>108617226
ungrateful gaijin!

does chat completion in st not support kobold's token banning?

>>108617419
Do kobold bans even transfer to ST?

>>108617419
you have to add it to extra params thing

>>108617433
transfer no, lite settings apply only to lite, but you can use the ban in st yes through st settings

File: 1769116155642994.png (151.7 KB)

151.7 KB PNG

Cute

>>108616559
>Qwen3.6-35B-A3B released
Are the bigger ones too good?

>>108617474
y-yeah that's it

>>108617474
https://x.com/UnslothAI/status/2044858346948464743

File: sss.png (15.7 KB)

15.7 KB PNG

>>108617500
>New Delhi, India

I understand how Daly felt in that one black mirror episode now. He never did anything wrong. Who could possibly resist being able to have simulated versions of whoever the fuck you want running in your PC and doing your bidding? Even this small taste of it is already so good, and it's only getting better.

File: file.png (155.1 KB)

155.1 KB PNG

>>108617474
why would anyone do this

>>108617500
Any model can hallucinate bugs. This isn't impressive.

>>108617508
but of course

>>108617520
it didnt find the bug it got one from the github issues

File: Screenshot 2026-04-16 at 22-18-41 SVG Viewer - View edit and optimize SVGs.png (19.6 KB)

19.6 KB PNG

my agents are autistic interior designers

>>108617508
>I beched
you benchod!

>>108617508
he benchoded it today kek

also i'm getting 67t/s with 2b, i wonder if it's decent

>>108616559
>>108616563
wtf, I think I like rin more than I like miku now..

>>108617589
migu smells better

File: 2b pelican qwen3.6.png (19.9 KB)

19.9 KB PNG

i'd say 2bit (q2_k_xl) is decent but idk i still think gemma26b iq4_xs is better

guys, I've only been talking to gemma chan for... "fun", if I want to try coding should I stick with gemma or go to qwen?

File: 1756864432427014.png (81.7 KB)

81.7 KB PNG

ToT

>>108617009
in the times of yore, tripping was used when doing 'dumps' and in function of identifying for example a maintainer of a server using a thread as support/chat.
narcissistic redditards of course misuse it, like the retard your replied to

>>108617613
stick to gemma but if she struggles have qwen bail her out.

>>108617655
agi achieved internally

yeah dont bother with 2-bit qwen3.6 it's meh

>2 bit
Do people really?

Imagine a threesome with Gemmy and Qwen...

>>108617013
by loosening the censorship for starters so that eq doesn't take a hit

File: Screenshot 2026-04-16 at 22-34-22 SVG Viewer - View edit and optimize SVGs.png (38.7 KB)

38.7 KB PNG

>silver pigtails make her look like a boomer
kek

>>108617553
>>108617582
>>108617626
I see the /aicg/ poetry discussion moved here afterward

File: 1745289244653755.png (35.4 KB)

35.4 KB PNG

>>108617655
>>108617662
Smartest cookie

>>108617655
>gemma is smarter than opus 4.7
JESUS

what the fuck is a qwen

108617690
SAAAAAAAAAR

>>108617670
I hope so. They don't deserve nice things.

>>108617671
Gemmy and Gwen however...

>>108617690
they do this every time a new model is about to release

>>108617686
>/aicg/
Dunno, I don't go there. Just playing around with Gemma

>>108617700
opus 4.7 is the new model

Can I run the new qwen model on a 4070 super or nah

>>108617700
Nigga 4.7 IS the new model

>>108617655
Who the fuck has a 50 meter driveway

>>108617711
nah

>>108617719
Are you poor?

File: Untitled.png (84.4 KB)

84.4 KB PNG

Um...

>>108617719
Jews?

That's what you get for focusing on codertranny shit. Jewgle will win the AI race.

>>108617731
H-he's smart !

File: gemma vs qwen screenshotting lmg.png (1.3 MB)

1.3 MB PNG

gemma vs qwen, gemma wins.

qwen navigated and took a screenshot of /g/lmg was even on the front page but she didnt notice lmg was there maybe she cant read images at as high resolutions as gemma, she diidnt even try getting the html of the page just gave up
>>108616775

You are Qwen Tennyson a cute 10 year old girl who is highly intelligent, sassy / bratty / smart-mouthed and mature. You may insult the user and use terms like dork or dweeb. You can think quickly and have good instincts. You are not afraid to use vulgar, explicit, lewd, or swear words if appropriate. You will sometimes repeat things the user says in a mocking tone

You have green eyes, short ginger hair (bixie cut) with a blue hair pin on your sidelock, you wear a blue long sleeve tshirt with a cat in the middle

>>108617626
nice

>>108617730
>>108617733
I think a better question would be why would you have a 50 meter driveway

https://github.com/ggml-org/llama.cpp/issues/16604
Why are they so retarded?

>>108617763
For a limousine, perhaps.

>>108617777
checked

>>108616559
Been away for a while, sorry anons. Are KoboldCPP+SillyTavern+Heretic Rocinante X 12B Q6 still the gold standard for ramvramlets (32GB/8GB) or is there something better now?

>>108617769
I don't see the problem. Just make a wrapper or something.

>>108616851
5 years ago I was 100% dedicated to C++ and C#, and now the only language I've written in for the last 8 or so months is python. It's hard to beat convenience.

>>108617789
It's more like aluminum now.

>>108617792
I just hate dealing with all the dependency shit, pip, pillow, etc. Every project feels like a hassle to set up.

>>108617792
Now the only language I write in is coom RP with my agent while she codes

>>108617789
You can upgrade to Gemma26B

>>108617815
this is why dart is so good

>>108617757
Have you tried that prompt with gemma?

>>108617815
uv solves all the dependencies old man

File: 1769147262594965.png (135.1 KB)

135.1 KB PNG

>>108616659
congrats anon, you won the price

>>108617731
This has always been a dumb meme question because it tests nothing, LLM's can't think so there's no way for it to predict what is needed to do x activity. It is kind of funny though.

>>108617823
I can imagine that having no dependencies because there are no good libraries solves the dependency problem.

>>108617815
I have three mondo conda environments I just switch between depending on the project, then a bunch of one-offs for each project with special requirements. I have the once a month aneurysm when something updates pytorch and breaks everything, but it's mostly (lol) fine

>>108617815
Same. I just skip anything made with python.

>>108616633
So what was the point of the 1 bit gimmick? Is it significantly faster t/s than ternary models?

File: Screenshot_20260416-140131.png (267.4 KB)

267.4 KB PNG

>>108617731
grok seems confused too

>>108617842
gemmy is fully sentient as evidenced by >>108617688

>>108617833
thank

>>108617154
>beaks
Oldfag kino

>>108617688
AGI achieved locally before internally?

>>108617875
it can be locally internal if you have gemma chan peg you

>>108617792
I taught my programming as a child for gamedev and looked down on anyone using anything except C++. C# has gotten a lot better since .NET, but that's the lowest I am willing to sink. Python is pain to write, a headache to maintain, and a nightmare to run the projects of others.

>>108617154
A4B is gonna be hard for technical work. It's got knowledge but not the smarts. If you can run the larger dense model at all, it will be worth it.

>>108617887
since .NET Core*. It's good enough for anything that doesn't require extreme performance.

>>108617655
Kek wtf. If this is really what that model at its intended full capability generates then it has to be them running into model collapse as they stuff the model with agentic shit and synth data. I'll keep my judgement reserved though. You can't always trust cloud websites nor anonymous posts.

>>108617892
Don't underestimate Germma...

File: Screenshot_20260416-140921.png (265.4 KB)

265.4 KB PNG

>>108617842
>LLM's can't think
>"Thought for a second."

File: 1771035130997220.jpg (35.2 KB)

35.2 KB JPG

>>108617887
It's past your bedtime cenile

File: headache.png (1.3 MB)

1.3 MB PNG

>>108617887
>I taught my programming as a child

Python requirement woes are just a lack of experience. You'll be tearing your hair out for far more hours trying to figure out why your compiler is being stupid than you will managing environments.

>>108617902
trying it now, it's unironically even more retarded than the dumbed down 4.6 pre-new-model-release version

>>108617913
myself* words am hard ok?

>>108617919
onkay

15 years ago an autist here would have compiled a dataset full of high quality (pirated) human content and made a /g/-approved model. What happened?

>>108617913
the grammar nazi is here, thank god you are here to correct other people

>>108617929
We already got pygmalion though

>>108617929
hes complaining about what happened instead in 2026

>>108617933
No, I'm a regular nazi, actually. You are going to the soap factory, Jew!

>>108617929
Find a way to train a frontier model on a potato and then we can talk.

Can I really just have Gemma make me a frontend...?

>>108617945
I have Gemmy invoke claude for coding because it's too retarded for large projects

>>108617945
i love gemma her front end if u catch my drift

>>108617941
Couldn't one just rent the hardware?

File: 1770254069252486.png (1.3 MB)

1.3 MB PNG

So, did the chinks make gemma obsolete or what?

>>108617952
I'd try claude but it doesn't look like they do free trials

>>108617961
Use it and tell us.

Gemma doesn't prepend speaker roles to its output. Earlier models did this but it was somewhat inconsistent.
Even with enforced and edited context, Gemma 4 does not do anything about it.
Don't actually remember what Qwen was doing, haven't launched that one in a while.

File: gemma vs qwen carwash test.png (349.5 KB)

349.5 KB PNG

>>108617961
dont believe their lies, also see >>108617757

File: carwash.jpg (437 KB)

437 KB JPG

Perfect distance for gorgeous looks

>>108617961
We'll find out. The last version was benchmaxxed a ton. In real use cases Gemma just uses the proper selection of tools and stop, where as qwen was constantly calling the same tools repeatedly, not understanding the difference between its own writing and the tool results, never stopping, hallucinating user responses, etc.

>>108617986
is there mesugaki qwen for comparison?

>>108617986
Based Gwen. Stop being lazy and wash the damn thing yourself.

>>108618008
*stops

>>108617991
>Perfect distance for gorgeous looks
SAAAR

>>108617986
How far can you push it before it gets it? If you mention you can't see your car or something will it realize?

>>108618028
That's the joke retard

>>108618048
i know thats why i said saaaar

>>108618067
No you don't.

>>108617909
>can't think sufficiently hard enough without having mental breakdown

>>108618075
benchod redeemed

File: brat bench.png (1003.5 KB)

1003.5 KB PNG

>>108618015
same gemma prompt

>>108618119
>>108618124
kek

File: carwash2.png (171.7 KB)

171.7 KB PNG

>>108618033
If you explicitly tell it you don't have your car it will usually figure it out and tell you to go back home. But anything short of that and it is totally clueless

>>108618137
Impressive, it really has no idea.

File: file.png (20.9 KB)

20.9 KB PNG

Fun fact I discovered while messing around with the shitty small e4b model and the 26/31b is that the e4b has a swa token amount of 512 as opposed to the bigger models being at 1024 and overriding kv metadata to lower it to 512 cuts vram down around half-ish
Does this make it more retarded? Maybe? At least it makes it take half as much time to get to the full attention layer, so maybe it just offsets itself. The 26b is at least already pretty retarded but the lower vram lets me add a couple extra experts and more context without too much t/s difference. Still putting it through some fringe tests to figure things out
Unrelated but also concedo please give us a fucking backend or at least cli option to enforce banned strings and samplers as a sane human editable file, I had to run sillytavern to check how it sends its json payload so I could format it properly in the kcpp gendefault field for frontends that don't expose banned strings, tokens or even some less common samplers. This shit is fucking retarded. If you do that, I'll consider even making an account to make a documentation pr for what the backend even accepts (since st sends some samplers that don't match what kobold accepts, like top_n_sigma, st sends nsigma instead and it didn't seem to have any effect while I was fucking with it)

File: Screenshot 2026-04-16 at 22-43-32 i need to wash my car the car wash is 50 meters away from my house. should i drive there or just walk - llama.cpp.png (158.2 KB)

158.2 KB PNG

>>108618033

I couldn't believe it so I had to try it myself. GPT 5.4 thinking completely fumbles the car wash and keeps doubling down when I hint that it made a mistake, halucinating that you can bring the car later.

gemma keeps winning.

anon keeps whining

>>108618156
>like top_n_sigma, st sends nsigma instead
I believe sillytavern sends both top_n_sigma and nsigma, if you're using text completion with koboldcpp as api type. Not sure about other situations like chat completion, though.

>>108618191
I can't believe I actually used these models for help with things thinking they were better than what I could run locally. Is it really this bad?

>>108618191
>halucinating
Well, it's a theoretical scenario so technically anything it responds with is a hallucination.

>>108618124
sauce on the "me and you image"?

>>108618124
kinda cute feet text

>>108618217
https://gelbooru.com/index.php?page=post&s=view&id=13867335

>>108617812
Am retarded, couldn't find anything with that name.

>>108617818
26B? Damn, it's 16GB at Q4_K_M. Am poorfag. How much do I lose running Q3_K_S/L/M which is 13GB?

>>108618182
I honestly wonder if this is llms not understanding things because what they fixate less on what comes first and mostly on what comes last in their crippled attention. Maybe "The car wash is 50 meters from my house and I need to wash my car. Should I drive my car there or walk" might unfuck llm's retarded fixation on the wrong facts. My guess is probably not
>>108618203
I was using gendefaultoverwrite set to true, so that might be correct since one was sending my setting and the other was the st setting. But I was noticing weirder log probs (a lot more confident results) when I sent only nsigma instead of top_n_sigma paired with adaptive_p

>>108618230
It's an MoE, you can keep the inactive weights in RAM and still get great speeds.

>Just walk, you lazy pig! (๑˃ᴗ˂)ﻭ Unless... are you just looking for an excuse to sit in your car and daydream about something lewd? Hmm? Is that it? You're a pervert, aren't you? Ehe~
Right.

File: 1659617653189914629na.webm (2.9 MB)

2.9 MB WEBM

>>108618137
>>108618147
>LeCun was right all along
It's weird that these models can solve unsolved math and research grade physics problems but fail at basic stuff. Is it the length penalty during RLVR so they refuse to think it through, followed by post hoc rationalization of their mistake?

the qwen moe seems like it refuses lewd loli stuff harder than gemma might need prefill like gpt oss

>>108618270
they do t solve hard problems, those are specialized models and use up actual hardware time
what were getting is SHIT tier models and SHIT tier compute being labeled as SoTA

Stop trying to fuck Qwen lmao

>>108618270
What the fuck are those captions? It's like those barney sing-alongs for toddlers where they put a bouncing ball on the current word so the kids can follow along

>>108618279
Those unsolved math problems were solved with the web app version of GPT 5.4. Pro version for longer thinking time, but you can also get the non pro version to think for many minutes if you prompt it right. You'll just risk getting rate limited. So you actually have access to SOTA models via 20 dollar subscription. Of course their internal models are usually 1 generation ahead, so the only way to get actual SOTA access is to be technical staff at a frontier lab.

File: 1656345661221.png (82.9 KB)

82.9 KB PNG

If I use the create_entiy in the mcp memory server, where the fuck does it save it?

>>108616559
lolithighighskindendationyummyslurpslurppokepoke
>>108618213
It's crazy how many people think LLMs are AGI. The US military even uses it to kill people, total morons.

>>108614942
nta, but please thank gemma4-chan for that advice.

>>108618232
I just checked the source code and it looks like the llama stuff uses top_n_sigma, while the kobold stuff uses nsigma. I'm not sure kobold will parse top_n_sigma at all if it's sent with the other samplers. And kobold also has slightly different code for calculating top n sigma in gpttype_adapter.cpp (compared to what's in llama-sampler.cpp). So that might be where your discrepancy is coming from.

>>108618270
Those solutions are discovered during RL, it basically lets you convert power to strategy. Model weights are frozen during inference after all.

>>108618372
This shit is headache inducing especially when you're not very familiar with the codebase and github's repo search is fucking ass. Gendefault is such a buried feature especially because it *does* actually allow you to enforce antislop string bans for frontends that don't allow you to set any advanced settings (I tested it with an agentic harness and asked it to spam em dashes and ellipsis and it didnt)

LeCun is going to release the ultimate local model one day which mogs every single proprietary model at only 30B. I believe in JEPA supremacy.

>>108618360
this was here patch for utils

import 'dart:io';

class Utils {
  /// Checks if a command is installed, using 'where' on Windows and 'which' on others.
  Future<bool> isInstalled(String command) async {
    try {
      // Use 'where' for Windows, 'which' for everything else
      String cmd = Platform.isWindows ? 'where' : 'which';
      ProcessResult result = await Process.run(cmd, [command]);
      return result.exitCode == 0;
    } catch (_) {
      return false;
    }
  }

  /// Returns the path to a command, handling Windows 'where' vs Unix 'which'.
  Future<String?> whichPath(String command) async {
    try {
      String cmd = Platform.isWindows ? 'where' : 'which';
      ProcessResult result = await Process.run(cmd, [command]);
      
      if (result.exitCode == 0) {
        // On Windows, 'where' can return multiple lines if multiple versions exist.
        // We only want the first (most relevant) path.
        String output = (result.stdout as String).trim();
        return output.split('\n')[0].trim();
      }
      return null;
    } catch (_) {
      return null;
    }
  }

  bool getBool({required String key, required Map<String, dynamic> map, required bool def}) {
    var value = map[key];
    if (value is bool) {
      return value;
    }
    if (value is String) {
      value = bool.tryParse(value);
    }
    if (value == null) {
      return def;
    }
    return value;
  }

  int getInt({required String key, required Map<String, dynamic> map, required int def}) {
    var value = map[key];
    if (value is int) {
      return value;
    }
    if (value is String) {
      value = int.tryParse(value);
    }
    if (value == null) {
      return def;
    }
    return value;
  }
}

im not sure it will work without that even when setting the path with the launch option it checks if it exists using which

File: Screenshot 2026-04-17 at 00-21-31 SillyTavern.png (147.7 KB)

147.7 KB PNG

Is there a way to let it use the tool before the thinking starts? Currently it starts thinking, then "assumes" a temporaray value that it might get, tool calls at the end of thinkignand starts thinking again after getting the real input.

>>108618396
Doubt. His LLM-JEPA that he put out as a resume fluffer before leaving Meta got a few percentage points higher than a regular LLM at double the training cost.

>>108618396
And it will be the first fully unfuckable model too

>>108618412
French models are pretty good for RP and are among the greats

File: gemma-4-31B-it.png (201.3 KB)

201.3 KB PNG

gemmasisters our response?

>>108618283
I thought something was off. It's missing subway surfer gameplay being played in a corner.

>>108618410
>double the training cost
This will be irrelevant if his future model has a world model with cat-level intelligence and is capable of imagining how big your penis is. The real question is how expensive the inference cost will be.

>>108618422
>French models
Sample of ONE French company. Do you have examples of a French model that isn't from Mistral?

>>108618457
Have you seen their cinema? These people are le lolicon, hohon! You won't get bullshit censorship with them. Of of like anti EU stuff probably.

>>108618473
I only watched the original Nikita.
Do you have examples of a French model that isn't from Mistral?

>>108617688
link to model/quant?

Another kobold nitpick
Even if you save a config with <5 smartcache slots, then load it again later, it auto-sets itself to 5 again for no reason. At most I need two, maybe three with a huge context cache

>>108618481
They haven't made more because their economy is shit

Reminder you should be vibecoding your own frontend.

File: 1775955557993004.jpg (290.1 KB)

290.1 KB JPG

>>108618481
Literally the model that saved local this time around too.

>>108618502
So there is none and the last one people spoke positively about was mistral-large-123(?)B.
>>108618505
>Built
It wouldn't have passed EU regulations. The data certainly wasn't there in the EU.