Qwen3.6 27B vs 35B A3B on RTX 3090s | Local AI Head-to-Head

本站添加: 2026-05-19

[00:00:00]Damn, that looks nice. Go. Okay, start menu is I've seen better.

[00:00:10]Ladies and gentlemen, Quinn 3.6 is out here making absolute waves in the LLM community. And today we're going to test head-to-head, side by side at the same time, uh, the 27B model and the 35B A3B model. Um, Quinn 3.6. Here we're running the thinking mode for precise coding tasks.

[00:00:35]Highly recommend it. If you are coding with these models, definitely slap that in the config. We're running it on Llama CPP with Llama Swap to get us going here.

[00:00:47]Uh, we'll be um firing off these prompts in Open Web UI. Just makes it easier to look at and do both at the same time.

[00:00:54]here. Right above my head, you'll be able to see we're running it on a 3090 Ti and a 3090 locally. Uh, one model on each.

[00:01:05]Uh, let's go ahead and get these models spun up here.

[00:01:11]All right, we've got them running. You can see um 21.8 GB in the TI and 21.2 GB in the 3090. Um, we're using Quint 27 Quant 5 for the 27B model and quant 4 for the 35B model. It was really just whatever we could fit on that specific card with some decent context.

[00:01:36]Uh, so let's go ahead and throw this first prompt in here. Create a single file HTML CSS JavaScript Windows style desktop with six apps, two of which are a task manager and a game. Nice and simple.

[00:01:50]We'll see how they do head-to-head, how long they take and the outcome.

[00:02:10]35B model is done.

[00:02:13]27B model is just trucking along.

[00:02:17]Finished at 1,300 lines.

[00:02:39]All right, finally taking four or five times as long and less lines. We got 1181 coming out of that one. So tokens per second we're running around 33 for 27B model and around 137 on the 35B model. That is quite a difference. All right, let's get the 27B code opened up here.

[00:03:09]See what we got first.

[00:03:14]All right.

[00:03:18]No rightclick menu. Interesting.

[00:03:22]Didn't ask for it, but All right. Task manager looking pretty good. Let's see if Okay, applications do load in there.

[00:03:37]And all closes everything. Very good.

[00:03:42]No right clicking anywhere. Okay.

[00:03:48]Quite a settings menu we got going on here.

[00:03:59]All right.

[00:04:02]Okay. Okay.

[00:04:05]Lot going on.

[00:04:09]Brightness works.

[00:04:15]Okay, foul explorer.

[00:04:21]Very good.

[00:04:26]No right clicks anywhere.

[00:04:30]Calculator works.

[00:04:33]Notepad saved in there. All right. New Minimize.

[00:04:42]Pull it back up. Good.

[00:04:45]Cool. Works.

[00:04:49]Snake.

[00:04:52]Good looking snake.

[00:04:57]Game over. It works.

[00:05:00]Very good.

[00:05:05]I like this task manager.

[00:05:10]All right. Very good.

[00:05:13]Let's check out the 35B model. Here we go. Okay. Start menu is I've seen better for sure.

[00:05:27]Interesting.

[00:05:29]Search doesn't work. There is a right click menu in this one though.

[00:05:36]Task manager. Oh, interesting looking.

[00:05:44]Cannot resize the windows.

[00:05:52]Wow.

[00:05:53]Okay, let's see.

[00:06:02]I don't see the app actually popping up.

[00:06:05]All right.

[00:06:07]Check the calculator. I'm sure it works.

[00:06:11]Cool.

[00:06:13]Snake.

[00:06:16]Not as good of a snake for sure, but it works.

[00:06:31]Interesting.

[00:06:33]There's no game over overlay.

[00:06:36]It just stops. Waits for you to reset.

[00:06:40]Okay.

[00:06:42]File Explorer. Wow. Okay. This is actually the closest file explorer I've seen to a Windows one as far as the looks go.

[00:06:53]But nothing works.

[00:06:57]Can't click anything.

[00:07:02]All right. Well, huh.

[00:07:17]That works. Very good. Nice little terminal.

[00:07:22]They went off with these the settings windows. Ah, well, of course, none of this stuff works.

[00:07:35]That's fine. No brightness.

[00:07:39]Nothing actually useful in here. No.

[00:07:44]Change wallpaper doesn't work.

[00:07:48]Refresh. Okay. Let me see. Minimize.

[00:07:55]All right.

[00:07:57]Okay, none of the buttons work.

[00:08:04]The window itself looks very similar to Windows. That's pretty good. All right, cool.

[00:08:13]Well, you can see the difference in the two. Coin 27 definitely has a better one, but took four times as long for a very two sentence simple prompt. Not much instruction. Just leaving it to figure it out.

[00:08:30]All right, next prompt we're going to go with here.

[00:08:34]Create a single file HTML CSS JavaScript cyber punk dashboard with neon panels, animated system stats, a live log terminal, network graph, yada yada. You can read it. Very straightforward, simple. We'll see the comparison. Let's go.

[00:09:14]All right, 27B is finally done.

[00:09:19]How many tokens a second did we come in at?

[00:09:23]So, 140 for the 35B, 33ish for the 27B. All right, let's take a look at the 27V model first.

[00:09:37]Damn.

[00:09:38]That looks nice.

[00:09:41]That's impressive.

[00:09:45]That's got a lot of cyber punk going on.

[00:09:47]All right, what do we got here?

[00:09:56]CPU usage, memory, network, storage, GPU.

[00:10:04]Interesting.

[00:10:06]We've got a active stream of logs.

[00:10:16]You can type. Does nothing, but all right. We've not really got any anything clickable, any popups, any active notifications.

[00:10:29]Okay. Other than the fact it looks sick, this is something I'd love to build out into a useful dashboard of some kind. As far as the aesthetics go, that's that looks nice.

[00:10:46]Nexus. Can't really read the Nexus up there, but All right. Very good. Very good.

[00:10:55]Let's check out the 35B models code here.

[00:11:02]Okay. 35B, what are you doing? What's going on with your banner situation there? Is that on purpose? Can't be.

[00:11:10]Can't read. What?

[00:11:14]I doubt it is on purpose. Is it?

[00:11:17]Anyways, yeah, we've got some text behind it as well.

[00:11:22]Behind. What the hell's going on here?

[00:11:25]All right. I mean, it looks good besides that one little error.

[00:11:34]Looks pretty nice. No worktopology.

[00:11:39]Lots going on there.

[00:11:43]We've got no popups, no nothing actually clickable.

[00:11:48]We didn't tell it to do any of that. Um, gave it a lot of room to do whatever it wanted for the most part.

[00:11:58]Looks very good though.

[00:12:01]Very clean besides the banner.

[00:12:07]Got the hover effects on everything.

[00:12:11]Got the live system logs.

[00:12:14]Can't type anything in this one. Looks good though. Looks very well. Very well done. Clean.

[00:12:24]Fix the freaking banner. Come on. All right. Well, I'd say 27B one again. Now, the 27B model is running the Quant 5, which is going to be better than the Quant 4 a little. Uh, we were just fitting the biggest model we could on each GPU per model.

[00:12:54]You know, if you're going quality, definitely 27B. If you don't mind this the taking four times as long, 27B is definitely the way to go. 35B still gets the job done. If you can run Q5, we get a little better quality, but the speed is unbelievable for what it's actually able to produce.

[00:13:18]So, head-to-head coin 27B and 35B.

[00:13:24]Both fantastic models. Both very well capable for coding tasks. But head-to-head, there we go. We'll see you in the next one.