What reasonable comparable model can be run locally on say 16GB of video memory compared to Opus 4.6? As far as I know Kimi (while good) needs serious GPUs GTX 6000 Ada minimum. More likely H100 or H200.
Devstral¹ has very good models that can be run locally.
They are in the top of open models, and surpass some closed models.
I've been using devstral, codestral and Le Chat exclusively for three months now. All from misteals hosted versions. Agentic, as completion and for day-to-day stuff. It's not perfect, but neither is any other model or product, so good enough for me. Less anecdotal are the various benchmarks that put them surprisingly high in the rankings
Nothing will come close to Opus 4.6 here. You will be able to fit a destilled 20B to 30B model on your GPU.
Gpt-oss-20B is quite good in my testing locally on a Macbook Pro M2 Pro 32GB.
The bigger downside, when you compare it to Opus or any other hosted model, is the limited context. You might be able to achieve around 30k.
Hosted models often have 128k or more. Opus 4.6 has 200k as its standard and 1M in api beta mode.
There are local models with larger context, but the memory requirements explode pretty quickly so you need to lower parameter count or resort to heavy quantization. Some local inference platforms allow you to place the KV cache in system memory (while still otherwise using GPU). Then you can just use swap to allow for even very long contexts, but this slows inference down quite a bit. (The write load on KV cache is just appending a KV vector per inferred token, so it's quite compatible with swap. You won't be wearing out the underlying storage all that much.)
I made something similar to this project, and tested it against a few 3B and 8B models (Qwen and Ministral, both the instruction and the reasoning variants). I was pleasantly surprised by how fast and accurate these small models have become. I can ask it things like "check out this repo and build it", and with a Ralph strategy eventually it will succeed, despite the small context size.
I also don't like having to think about it, and if it were free, I would not bother even though keeping up a decent local alternative is a good defensive move regardless.
But let's face it. For most people Opus comes at a significant financial cost per token if used more than very casual, so using it for rather trivial or iterative tasks that nevertheless consume a lot of those is something to avoid.
Looks pretty cool. Lately I've been using ChatGPT to generate SQLite schema migrations and it works shockingly well. I give it the original schema and new schema and it generates the statements including caveats and gotchas to watch out for.
I’ve been working on a hobby project to send a Raspberry Pi into the stratosphere (nothing really novel) but with all custom software. The entire process, hardware, and stack is documented on the GitHub [1]. Essentially all the software and major components are purchased. I’m just waiting for the spring and then start some tests with balloons, helium mixtures, and iron out any regulatory issues. If this interest you or you have any experience would love help or contributions. The launch will happen in Tennessee.
I saw you were looking for help sourcing things like balloons and gas. https://groups.io/g/GPSL/ worried be a great place to go and ask for help with that, if you haven't already.
I figured this was Jeff’s CTO Laboratory. I enjoy your channel. Are you kicking yourself for pulling the trigger on MS-01s now that MS-02 Ultras released?
I use TrueNAS as a Time Machine destination for multiple Macs running Tahoe. Seems to work fine with no local configuration changes. Just make sure in SMB global configuration you:
- Enable Apple SMB2/3 Protocol Extensions
And when creating the SMB share select Time Machine for purpose.
I know HN always has its fair share of doomers, and generally the HN communities track record anecdotally regarding finance and the market is frankly terrible. Tesla (stock price wrong), Bitcoin (wrong), AI a huge dot com like bubble (wrong in my opinion - TBD though).
I’m optimistic on the US. We could realistically print a 5 handle GDP, oil at rock bottom prices, lower federal income taxes this year. As far as Gold and Silver I just see it being propped up by speculators. Silver spot is down 15% this mornings and gold down 8%.
I predict double digit gains in the S&P by end of year and strong financial conditions with mag 7 continuing their lead. Tesla also will be a big winner.
> We could realistically print a 5 handle GDP, oil at rock bottom prices, lower federal income taxes this year.
Ignoring everything else in terms of oredictions: the US simply doesn't have that spending buffer anymore to really outspend yet another crash. Its at what, 37 trillion right now? And it's only rising more and more by the month.
The only thing worse than a crash would be the US defaulting on that. And then we'd be screwed in ways that we don't recover from in any of our lifetimes. Nearly a century of trust and soft power completely down the drain.
Even if they don't default. How long there is willing investors? Even if FED drops rates. It is an auction. So rates should be set there. But maybe printing will happen via bigger and bigger market operations. Leading higher and higher rates. With probably inflation... So I suppose valuations could go even higher...
I do not understand economics and from engineer perspective whole thing doesn't make much sense.
Yep, there are lubricants listed in the ingredients, but the stuff it actually leaves behind when the volatiles are gone is mostly good at displacing water (as the article points out.) Very little in the way of friction reduction.
It also makes a superb bug killer, especially in combination with a barbecue lighter.
Interesting use case. lol. I use it to remove sticker residue from the insufferable companies that use stickers on their products attached with super-glue like adhesive.
Using the sticker itself, along with some patience, usually does the trick. But yes, every time I bump into the worst offenders I always feel tempted to just keep sending their product back as damaged until I get a sticker that comes off clean.
I hate that. In particular, there is a special place in hell reserved for businesses which put those stickers on books. It's almost impossible to get some of those stickers off without leaving residue or harming the paper.
Can't even do a bit of light treason without being executed these days! It's political correctness gone mad.
I'm not in favour of the death penalty. I live in a country which hasn't executed anyone since 1954, and the death penalty has been unconstitutional since 2001. However, South Korea has the death penalty. If you're not going to use it for this, what _are_ you going to use it for?
>If you're not going to use it for this, what _are_ you going to use it for?
I don't know, ask my fellow Americans. Our President committed light treason and we not only re-elected him, our Supreme Court gave him absolute immunity from all future crimes while in office as a treat. He's a pedophile and a tyrant, blatantly ignoring Congress and the courts, colonizing and threatening foreign countries, sending masked thugs into the streets, targeted universities and protestors for political oppression and censorship, destroying America's regulatory and scientific infrastructure in the name of purging it of wrongthink (etc etc etc) and neither our government nor 300 million Americans armed to the teeth and ready to water the tree of liberty with the blood of tyrants seem capable of doing anything about it.
I'm vehemently against the death penalty because I don't believe the state's monopoly on violence should extend that far (assuming for the sake of argument that it must exist at all) but I have to credit South Korea for having a system that can stand up to pressure. Wish I could say the same for us. We coasted until the civil war then collapsed then stumbled still half-wounded until 9/11 then folded like a paper cup.
The US president is _allowed_ a bit of light treason, as a treat. Or so it seems. I don't think _any_ of them have ever been prosecuted for stuff done while in office?
>I don't think _any_ of them have ever been prosecuted for stuff done while in office?
I don't think so. Indicted and investigated, certainly, but never prosecuted.
It is weird that this was always a possibility with other presidents but with Trump it became such an existential crisis that we decided to make it illegal to even try, rather than establish that even sitting presidents aren't above the law.
Which to me seems like a no-brainer but judging from how many people claimed that either presidents had to be above the law or else the US would descend into a hell spiral of recrimination with every sitting president being arrested on fake charges by the opposition party, I must just be naive. I guess it's good that Nixon was right and nothing a president does is illegal. I guess that's what the founding fathers intended.
But again, it's still weird that it was always possible for a sitting president to be prosecuting in office until the supreme court stepped in, yet the absolutely certain slippery slope and worst case scenario never happened. I guess we were just lucky.
> I guess that's what the founding fathers intended.
This... seems unlikely. It had already been established that _kings_ could be removed for doing crimes (see Charles I, who, ah, lost his head) by the time the US was founded; it seems unlikely that they'd have intended the US president be less accountable than a king.
He attempted to overthrow the government and install himself as dictator to escape criminal charges. How in the world do you find the death penalty extreme for someone who attempted to subjugate 52 million people through military force and destroy the foundations of a nation?
If this happened in Sweden, we'd have been shooting at the participating soldiers while it went on with machine guns, seeking out people associated with the coup and killing them in their homes etc.
If someone is committing a coup, you go 100%, because if they succeed you don't have a country any more.
This guy invited this in a democratic, orderly country. What crime is worse? If it were me I'd have wanted the death penalty for any participating soldiers too.
> If this happened in Sweden, we'd have been shooting at the participating soldiers while it went on with machine guns, seeking out people associated with the coup and killing them in their homes etc.
Yeah, that's exactly the kind of resolve one associates with a nation that rolled over, even to the point of active collaboration, when the Soviets invaded one democratic neighbor and annexed chunks of their territory, and when the Nazis subsequently invaded and occupied the other. The "Captain Sweden" meme exists for a reason.
Norwegians who fled to Sweden were organized into military forces intended to eventually retake Norway. My own grandfather fled to Sweden after the Nazi occupation of Norway, but was for some reason not part of this (he was sent to university instead). We even warned the Soviet Union of Operation Barbarossa after breaking the Geheimschreiber code.
Lol what world do you live in? In Sweden killing political adversaries? I've lived in Sweden winter (Stockholm 2 months) and summer (1 month) and made many friends. None, have talked about killing political coupes like you say. I'm actually pro US gaining controller of Greenland (it would open up enormous economic tailwinds)... Business.. Actual property rights, instead of government owned land with leases. US owning Greenland would be a crazy boom to their economy. I for one, would buy land.
Killing coup-plotters and their associates would happen immediately as soon as anyone began to execute a coup.
Lots of people have access to weapons (mostly for hunting, but still) and lots of people have done their mandatory military service and know that coups are illegal. They would certainly fight.
My point is that inviting that-- i.e. creating the situation where people have to fight and kill the coup plotters and anyone who sides with them, is a very extreme thing where killing only the plotters themselves is the mildest outcome.
This would happen as soon as a government said 'we're blocking the riksdag from meeting'. No one in Sweden from any political party in the Riksdag would ever do that though, it's of course unthinkable.
I don't fully get what you're saying... But if you think a few thousand farmers in Greenland will fend off Delta force soldiers, I suggested you rethink your strategy. 20 Delta force took down hundreds of soldiers in Venezuela (with 0 loss of US soldier life), you think farmers have any chance?
I don't see what any of this has to do with Greenland.
But his posts describing his fellow countrymen as if some "berserker" spirit lies dormant within, are so credulity-straining that I initially assumed they were ironic, but then I remembered what site I was on (orange reddit), and how irony unqualified by "/s" is swiftly met with downvotes or flags, so he must be serious.
Well, South Korea hasn't executed anyone for 20+ years, so death penalty is more or less symbolic here.
Also, Yoon is very unpopular, and he's a moron, so he has zero use for America even if he somehow magically teleported there. Besides, Trump somehow seems rather infatuated with SK's current president Lee, after he was gifted a golden crown, so I don't think Trump would want to piss off Lee for some useless dude - he probably doesn't even remember who is Yoon.
reply