Hacker News
points by buckleyourshoe 4 days ago | 0 comments
Competition drives prices down. We tried Kimi and GLM models after hitting 'cybersecurity' blocks on OpenAI and Anthropic. We found them to be much cheaper to access and helped us complete our work without 'cybersecurity' refusals blocking us.
[–] CalChris 4 days ago
They just started competing against each other? No.

Anthropic is going public soon. Until September, OpenAI was going public. Neither are remotely profitable.

[–] kenhwang 4 days ago
They're not competing against each other, they're competing against free/local/open weight models that they're also lobbying very hard to regulate/ban.
[–] asa123 4 days ago
As much as I hear this sentiment, and as much as all the smart software people around me echo the desire for this sentiment to be true; it feels like people say these things, but then at the same time say - well, Claude/Chatgpt is still marginally better for me now. But clearly they are catching up so maybe one day!!!

In that sense, I'm really not sure if Kimi/chinese models are really competing against Anthropic/OAI? Not to mention that for individuals, the subscription model is extremely different, and Kimi subs are (I think) worse value, and chinese API's maybe marginally end up cheaper than using american subscriptions.

[–] qlte 4 days ago
The profit comes from the enterprise customers who have to pay for usage at API rates. Not the subsidized subscriptions, which both OpenAI have designed to be unavailable for large enterprises by withholding IAM and auditing features they need except on the usage based entperise plans.

As an individual I'm still paying for a ChatGPT Plus plan since $20/mo gives me a lot of value and I use many multiples of $20 at API rates per month. But in terms of capabilities, I am entirely satisfied when using my Opencode Go plan with open models like Deepseek Flash/Pro, Kimi and MiMo.

At this point keeping my ChatGPT subscription isn't because of a significant capability gap compared to open models. It's 90% about the value of the subscription priced well below API rates (10% the fun of trying latest models).

If OpenAI/Anthropic dropped their cheap subscriptions or drastically undermined the value proposition I'd be happy using open models exclusively and currently barely notice a difference switching back and forth for the vast majority of tasks.

I'm expecting the subs to increasingly provide less value as the US labs IPO and follow the SV pattern of moving from marketshare capture mode to profit extraction mode. Thankfully I'm already comfortable using OpenCode with open models and avoid lock-in to any specific harness so would be a very soft landing.

[–] ngruhn 4 days ago
I guess I don't understand "enterprise psychology" but why are auditing features worth a 50x premium? I think we're currently blasting through $1000 worth of tokens a month per dev.
[–] ehnto 4 days ago
Because enterprises have compliance and certification requirements, meaning the enterprise is essentially held hostage by providers on price.

You could argue it's worth that much because of the value that compliance brings the enterprise, but it's just another gouging excercise. Certainly nothing unique to AI companies.

[–] mike_hearn 4 days ago
They aren't but both firms tell bigger/richer clients that the subs just aren't available to them no matter what. It's not a policy, it's an email that says "we're moving you onto API rates". They have no obligation to follow a systematic policy!
[–] CodesInChaos 4 days ago
Claude "team" plans are limited to 150 seats per company. So big companies have no choice.
[–] mschuster91 4 days ago
> I guess I don't understand "enterprise psychology" but why are auditing features worth a 50x premium?

Alternatively, one can say that the enterprise customers plus a metric shitload of VC and shareholder/investor money heavily subsidizes cheap personal plans.

It's the same playbook that Adobe used, provide cheap plans for academia and turn a blind eye towards piracy from non-commercial actors, get the young people hooked hard on Adobe's software and workflows, and they will demand that their employers purchase the nice, high profit commercial/enterprise plans.

[–] ywvcbk 4 days ago
> heavily subsidizes cheap personal plans.

They are of course are the ones paying for R&D of new models but its not exactly clear if gross margins on subscriptions are negative. It might be just normal market segmentation just like SaaS companies charging enterprise users many times more than private individuals.

[–] SR2Z 3 days ago
DeepSeek announced that each GPU they have makes about $38 an hour in revenue during off-peak times. That's $331k a year, and DeepSeek is cheap.

I think that it's not only possible but likely that the frontier labs are profitable on an ongoing basis, and it's mainly the research and capex which make them look like impending disasters.

Realistically, OpenAI and Anthropic are each probably worth ~$1T each. Anthropic can already easily justify that based on revenue alone. OpenAI isn't far off. Consider how quickly these companies are growing and the fact that they maintain a small but significant edge, I don't think the bubble is going to pop. Just deflate a little.

[–] baq 4 days ago
Let’s not forget that Luna max is actually extremely capable for the price, you can get a lot done on the $20 sub.

Haven’t tried haiku 5.5, I expect it to simply run out too fast, but they did change the price below 100k tokens recently; perhaps I should check it out.

[–] Schlagbohrer 3 days ago
Keeping a workflow under 100k tokens limits it to very tiny tasks
[–] smodo 4 days ago
Openrouter stats seem to indicate that there is a lot of demand for ‘good enough at a good price.’ After all, not everyone is decompiling PS5 games. In fact, most people are just speedrunning notetaking apps in JavaScript frameworks.
[–] mbreese 4 days ago
But, Openrouter stats can only measure the usage they see. I'm not sure it is really all that representative of total LLM usage across the market.

I think that's the difference here -- OpenAI and Anthropic are competing more with each other (and Google Gemini) than they are with open weight models. While people on HN are familiar with Kimi and GLM models, I'm not sure how many casual users of LLMs know about them. I think the competitive risk open weight models pose to OpenAI and Anthropic is much further in the future.

There is a lot of usage that's only known by Anthropic or OpenAI that's not visible to the rest of the world.

[–] InsidiousWombat 3 days ago
And the share of the tasks where cheap open model is enough only grows in time.

Frontier models just fight over smaller and smaller piece of the pie and I suspect them pushing for security work is way to open potentially infinite token sink as attackers pay for tokens so defenders need to spend even more tokens to defens

[–] peddling-brink 4 days ago
> most people are just speedrunning notetaking apps in JavaScript frameworks.

I feel seen. But seriously, my app, with my preferences, written by a semi-trustworthy entity that isn’t trying to shove ads down my throat. That’s really great.

[–] sbarre 3 days ago
Yep, this. I've seen it coined as "the age of personal software" and I totally agree.

I've built easily a dozen personal apps in the last few months that I have no plans on releasing or sharing, run locally, and solve very specific productivity (or one-off) issues for me.

I would never have spent the time building these apps in the pre-LLM days because the effort wouldn't have been worth the gains.

But now? Sure Claude, build me a MacOS app in Swift that does this exact thing I need. Less than an hour later, it's done.

[–] nekooooo 3 days ago
i mean, i made myself a dvd player for my steam machine. i don't see how that makes anthropic money at real token costs.

when lyft line was heavily subsidized in SF by VC money, i used it almost daily to commute to work because it cost $2.50 each way. Now that it's $20, I don't use it.

[–] specialist 3 days ago
Yup.

Methinks (hopes) we're entering the era of mass customization.

[–] PeterStuer 22 hours ago
All the money is in enterprise. Contrary to your experience in software development and other frontier knowledge tasks, 90% of enterprise ai tasks are pretty mundane so much so that GPT 4o was already plenty enough.
[–] hobofan 4 days ago
> well, Claude/Chatgpt is still marginally better for me now

Enterprise doesn't care about marginally better. They care about cost.

Most organizations that run our self-hostable chat platform with cloud models are for most stretches running 6 months-1 year old models, and are strongly eyeing (or have already switched) to more commodity models for most of their workforce. Frontier models are mainly relevant for engineering tasks.

[–] fultonn 3 days ago
I'm pretty much weaned off closed-weight models at this point.

It's a very "The Year of Linux on Desktop" situation, in the sense that in any particular year it seems like Linux is close, but the OSS stuff requires a lot of configuration to get to feature parity, and the barrier keeps rising because the prop solutions are running as fast as they can to justify the cost premium.

Unlike Linux, the world is pretty literate about tech business models, so I think there's a way for the open weight world to avoid the situation Linux got into, where it only really caught up once the market was pretty much commoditization any-ways.

If anyone interested in PL theory (including adjacent fields) and/or inference engines is reading this wants to help make open weight models and associated ecosystems feature-competitive, we're hiring, drop me a line: nathan at nfulton org.

[–] SkiFire13 4 days ago
For enterprise customers the value proposition of self-hosting one of the open models is enormous. We're talking 10x cheaper (remember that enterprises pay API rates), plus more control on where the data goes (especially given that some frontier models do not support ZDR). And all those savings are lost revenue for the US AI Labs.
[–] lousken 3 days ago
My issue with anthropic and openai is that if I use a model like e.g. Sonnet 5 I don't always get full Sonnet 5, sometimes it's dumber, sometimes it is smarter (mostly dumber though), while GLM, Kimi and others stay the same. So if I rely on AI for things I better make sure the platform is stable and does not introduce hidden changes.

Why is opus 5.5 suddenly a lot dumber? Who knows.

[–] NewJazz 4 days ago
Have you considered you are reading comments from different people?
[–] dimaggiosghost 3 days ago
Is Starbucks competing against Pete's Coffee, or are they competing against your home brew? Is it McDonald's vs Burger King, or all fast food against home cooking?
[–] phoghed 4 days ago
If prices were not being significantly lowered by Anthropic and OpenAI then you’d probably see more people using the Chinese models
[–] smallmancontrov 3 days ago
The frontier labs think the switching threats are credible or they would not have cut prices.
[–] rienbdj 4 days ago
Of course they compete with each other. Codex and Claude Code have direct feature overlap.

But they do have a common enemy in open weight models.

[–] HWR_14 3 days ago
Competition in a duopoly looks very different from competition with a large number of suppliers.
[–] InsidiousWombat 3 days ago
nah if not for open models they'd just raise the price in unison as any self respecting oligopoly would.

They'd compete on model quality, sure, but without competition from open models there is no reason to compete on price

[–] snek_case 3 days ago
Neither OpenAI or anthropic can afford to lose subscribers to the other or anybody else right before IPO. I tried both CC and codex recently, and I would say they are practically on par. Some things CC does better, some things codex does better. I've also seen them increase usage limits. The cheapest plan now feels very generous imo.
[–] WarmWash 4 days ago
free/local/open weight don't have the compute available to serve on a level to compete with the big labs
[–] Gareth321 4 days ago
Price per task has been dropping exponentially for years. This isn’t a sudden new phenomenon. They’ve been competing with each other continuously. There is even more competition now than ever before.
[–] koe123 4 days ago
The brutal free market for job seekers like me but regulations and safety nets for thee
[–] specialist 3 days ago
Yes and: the rules make the market. refs, adjudication, norms. markets free of rules is a tricky way to say might makes right.
[–] _heimdall 4 days ago
If this is mostly competition enduced, I have to assume either their usage has plummeted or they will implode financially in short order.

The frontier labs were already burning money on more expensive price models, and competition wouldn't have reduced their capex proportionately.

[–] p0nce 4 days ago
How could they do anything but implode financially? Genuinely curious. The numbers are not right.
[–] smallmancontrov 4 days ago
Did the frontier labs take out debt or did they make flimsy unenforceable agreements to neoclouds who took out debt?
[–] bunderbunder 4 days ago
Borrowing money is not the only way to go into debt. They reportedly made binding and non-cancelable commitments. Once those commitments come due then they will be indebted to their counterparties until they pay up or the courts sort it out.

This is comparable to how, if I sign a 12 month non-cancelable lease and then don’t pay the rent, I will be in debt to my landlord.

[–] freakynit 4 days ago
People heavily underestimate the number of tricks available to corporates for taking on "debt": https://latentstate.net/the-hidden-ledger/
[–] _heimdall 4 days ago
That's effectively borrowing money with a different name though. The only way to go into debt is to sign an agreement to pay someone money in the future, regardless of the terms used to describe it.
[–] smallmancontrov 4 days ago
No, it's really not. Do you have a war chest to drag out a legal battle and the ability to bankrupt your landlord by withholding payment? The rules are different at this scale, and "you can't enforce a contract if the attempt will bankrupt you" is only one of the possible games.

Here's another one: pay a supplier to cripple their deployment. Suddenly it's the neocloud's fault for failing to deliver, not your fault for failing to pay.

Did we all forget how Sam Altman turned a non-profit into a for-profit? Do we think he'll bring less sociopathy to this battle?

[–] haldujai 4 days ago
> Do you have a war chest to drag out a legal battle and the ability to bankrupt your landlord

Their war chest is not sufficiently larger than the hyperscalers, Broadcom or PE financiers like BlackRock.

> The rules are different at this scale, and "you can't enforce a contract if the attempt will bankrupt you" is only one of the possible games.

Rather, the inverse of what you said and far less Machiavellian.

It is legally well established that take-or-pay contracts are unenforceable if it would bankrupt the buyer which is the more likely resolution in this case. However, this does not mean frontier labs just get to walk away. They would settle in court for a penalty that is less than the full contract price.

See: AMD/global foundries and pretty much every oil and gas or commodity deal that goes bust when market pricing makes extraction unfeasible.

[–] smallmancontrov 3 days ago
> Their war chest is not sufficiently larger

That's not the metric. The legal system is pay-for-delay, not pay-to-win. Once you have enough money to delay, it becomes a contest of who has the longer runway, and that probably goes to the frontier labs rather than the neoclouds who have little alternative revenue and comparatively airtight debt obligations.

> take-or-pay contracts are unenforceable if it would bankrupt the buyer which is the more likely resolution in this case. However, this does not mean frontier labs just get to walk away. They would settle in court for a penalty

Regardless, the terms come down to positioning and bargaining power. Runway vs obligations. This seems to dramatically favor the labs.

[–] InsidiousWombat 3 days ago
Does it matter if they "win" or "lose" legally ? They still don't have money to pay, so someone (probably people that gave them their debt in the first place, and their investors) will end holding the bag.
[–] _heimdall 4 days ago
The government could bail them out, that's the most likely scenario if they don't implode IMO.

They could also continue to grow at the rates they had last year. I don't know where those customers would come from, but if they did pull that off OpenAI and Anthropic could sustain propping up the circular financing going around the AI industry.

[–] xlayn 4 days ago
Goverment bailing they out will be using people tax to rescue the companies that absorbed most of the 801k money so they can get people out of work... it's the ultimate slap to the face... I would strongly resist this, I would vote if they implode to give to whoever owned shares via 801k their money, to people and let them (openai, anthropic, et al) eat shit... I would love to buy one of those gpus to run an open model at discount price...
[–] _heimdall 4 days ago
Completely agree it will be a huge slap in the face to the public, unfortunately that's a common solution.

When everyone is afraid the market will collapse, or more likely distracted because the market collapsed just enough to hurt the average person, the government will bail them out and either people won't notice or will welcome it as a solution to huge levels of fear.

Voting isn't usually much of a solution after the fact, the political machine doesn't allow for candidates that would fix anything to have a chance at any office that matters. There's a reason our politicians today all seem to have roughly the same goals and all seem to become extremely wealthy while in office.

[–] psd1 4 days ago
Government trying to manage financial markets is like trying to steer a rampaging rhino; finance is stronger than government, and can wreck it. But some politicians want to increase regulation and some want to reduce it. Some cynicism is fair, but you've overstated the case. Elections do not offer infinite choice, but the choices are distinct.
[–] InsidiousWombat 3 days ago
But why would they bail them out ? Stock value will drop regardless of what govt does and having the borrowers (the private companies that already made billions on selling the shovel) get stuck with the unclaimable debt is far better option, and those are not hiring average blue collar workers in hundreds of thousands so any job loss would be minuscule too
[–] _heimdall 3 days ago
For the same reason the government bailed out the banks, they're too big to fail.

Two companies account for most of the frontier R&D, and something like 7 companies account for a huge portion of growth in the stock market. The government, especially under Trump, is very focused on continuing to see those numbers go up.

I also expect the government is pretty bought in on AI being the future and on us being in a race with China. They'd have to bail out the labs for those reasons alone.

Lastly in my opinion, Trump has a pretty socialist bent to him and regularly talks about a sovereign wealth fund owning portions of companies. He'd love to have take a partial stake in AI companies, and a bail out is a great way to do that.

[–] velcrovan 4 days ago
A bailout would be a slap in the face when the correct solution is to nationalize them. If they are too big to fail then the government gets a controlling share of equity and we finally start the sovereign wealth fund we should have started decades ago.
[–] _heimdall 3 days ago
Nationalization is fundamentally different from a bailout. It tends to go poorly when a government begins taking over the means of production.

Though I agree with you a bailout is a slap in the face. In my opinion bailouts shouldn't be legal, governments should pro actively be making sure individual corporations don't become so large that a failure would wreck the economy or national security.

[–] _heimdall 3 days ago
Why is it you see a sovereign wealth fund as the right answer? Why should the sovereign own the means of production, and why should the people creating and enforcing laws be the same as those in charge of our economic future?
[–] wtch98 4 days ago
How does that work when the official strategy is "Socialise the losses, privatise the profits"
[–] fourthark 4 days ago
Maybe you should try voting harder.
[–] _heimdall 4 days ago
Meaning what? Cast more than one ballot?

I live in a state that votes heavily in one direction, most states are the same. Its fine for me to vote, but the winner of a majority of states is pretty well decided before a ballot is cast (by strong majority, I'm not claiming fraud).

[–] easyThrowaway 4 days ago
Becoming "too big to fail" has become a viable market strategy.

See also how AI companies re trying to sneak in basically every level of infrastructure and public administration.

[–] rayiner 4 days ago
Apple is worth more than all the AI companies combined. You think LLMs are less valuable in the global market than slightly updated iPhone models every year?
[–] failbuffer 4 days ago
LLMs? No. LLM companies? Yes. It's just math, data centers, and mass copyright infringement. The only scarcity is Nvidia, who just passed Apple in market cap, somewhat proving your point but not in the way you meant it.
[–] _heimdall 4 days ago
If you consider Nvidia an LLM company, and I do at this point given how heavily they've invested in frontier labs and where much of their revenue comes from, they alone are worth slightly more than Apple.
[–] hvb2 4 days ago
But nvidia can sell to anyone, right?

They'll take a heavy hit stock wise, and might be an LLM company through all their shady financial constructions to keep the music going by propping up demand. But in the end, nvidia as a company has a place even when the frontier labs go bankrupt. Some other company will take their place. Worst case it'll be like the cable companies in the end 90s who found themselves out of work because they overbuilt for dotcom

[–] phoghed 4 days ago
> It's just math, data centers, and mass copyright infringement.

Ok then iPhones are just metal, plastic, glass, and a delivery truck. You are just electric meat. This has to be one of the dumber comments I’ve read on here.

[–] jasomill 4 days ago
Maybe not, but it is probably less likely that Apple will face stiff competition from freely available alternatives, given that AOSP has been a thing for the iPhone’s entire lifespan and nonproprietary Android phones have failed to capture significant market share.
[–] daveguy 4 days ago
I don't think we have seen an Apple of AI yet. I wouldn't describe the frontier that way, would you?
[–] jasomill 4 days ago
No, and moreover it’s not entirely inconceivable that the Apple of AI may turn out to be Apple itself.
[–] Danox 3 days ago
For that to happen Apple Silicon needs to continue to move forward and memory needs to move in-house along with local on-device AI agents.
[–] surajrmal 4 days ago
Are you avoiding Google and SpaceX in that math?
[–] InsidiousWombat 3 days ago
Neither's only business is LLM

And SpaceX LLM business is "we failed to build competition so we just rent what we bought in hardware to other companies"

[–] jasomill 4 days ago
Their costs could drop, competition could dry up, or they may only be unprofitable in the first place because they’re choosing to invest more money in growing their business than they’re currently making, a practice which need not and will not continue indefinitely.

It’s not at all unusual for companies to run at a loss for several years before turning a profit.

[–] SlightlyLeftPad 4 days ago
Stuff like this that defies all logic happens all the time. Amazon operated at a massive loss first it’s first decade and still IPO’d years before they posted a profit.
[–] disgruntledphd2 4 days ago
Amazon were investing in goods that lasted longer. It's an open question how long the GPUs will be worth anything, and training costs are the real killer.

Z.ai, who make GLM are public and their books are really, really, really bad.

[–] dnautics 3 days ago
Did you read the anthropic S1 or are you just saying this?
[–] kshacker 4 days ago
That's why Anthropic are rushing the IPO. You can explain a single quarter slowdown, you can not explain a multi quarter one.
[–] stingraycharles 4 days ago
What makes you say that Anthropic has multi quarter slowdowns?
[–] kshacker 4 days ago
I am technically not saying that. I am taking off from the parent comment and speculating.

Their data from September is leaked via IPO preview, and October is not yet complete, so how can someone even project that?

// I am a techie, not a finance guy, so apart from public chatter, no inside knowledge.

And I do feel their IPO is being rushed before anyone has enough information to make up their mind. The VCs or private equity have given them a lot of money and want to cash out. When the revenue does slow down, any investor should pause to take a look at whether they can right the ship, or has the landscape itself changed.

[–] eeedda 4 days ago
Have more confidence - you are correct.

Their revenue taps, product releases and marketing campaigns were all strategic: to be able to show nice numbers in the financials.

Once they stop playing games with quality of output of these models and revenue's shrink - they will be in deep deep trouble. They are hoping they will conjure up a break through with the IPO proceeds.

Let's see.

[–] flowerthoughts 4 days ago
My reason is their revenue chart is flattening.

https://techstartups.com/2026/10/15/anthropics-q3-revenue-hi...

[–] Gareth321 4 days ago
The flattening part is not reported, but based on estimates from a company called TickerTrends. If they were correct it would imply a sudden and unusual departure from some incredibly impressive growth. Even more unusual given the release of their industry leading Opus/Sonnet/Haiku. Something to watch but I would not consider that authoritative, and would not invest based on that either.
[–] InsidiousWombat 3 days ago
Opem models catching up in capabilities to do more and more tasks would easily explain it, there is a reason OpenRouter got sold for 7.5 bil, the money is in selling shovels and price per token, not chasing the frontier
[–] psd1 4 days ago
The impressive growth is plausible, but it also rhymes with "bubble". There is obviously a value proposition in there, but I'm skeptical it's a trillion-dollar one. It's a machine for turning electricity and silicon into powerpoint and spotify slop
[–] Gareth321 4 days ago
I partly agree. In support of your scepticism, I also think the frontier labs are overvalued. The expensive part which is not currently priced into the subscriptions is the training. Inference is usually profitable now - at least from what we can tell from industry reports.

Where this bubble differs from the dot-com bubble is that valuations have very strong, organic user demand behind them. In 1999, prototype websites with few customers were getting IPOs worth hundreds of millions. This time, demand is insatiable. Frontier mdoels also has very low global penetration, relatively speaking, so the TAM permits exponentially more sales, in theory.

However the risks are numerous for these labs. Foremost is that Chinese labs are able to easily distill frontier models. A tiny fraction of the cost of training, and they have a close approximation. Second, models are getting much more efficient per task. Companies are already discovering what "good enough" looks like, and it often ends up being much cheaper than what Anthropic and OpenAI are selling. This will only accelerate.

My investment thesis is bullish on the entire AI stack except the frontier labs. I think power generation is going to see huge demand. Ditto for infrastructure and data centers. Ditto for the products and services created by these models.

[–] _heimdall 4 days ago
I don't have the numbers in front of me but could have sworn I had seen quarterly revenue growth rates dropping drastically over the last year or so. Still a strong growth rate, but much lower than prior growth rates.

Edit: Data because silent down votes are useless, Anthropic Q2 2026 grew 147% while Q3 grew 45%

[–] eeedda 4 days ago
Yes but its growth rates with respect to expenditures, and in particular capital expenditures (R&D etc), which we have no idea about.

Gross margins here are irrelevant: if they can't charge a high enough price to cover all expenditures and rely on cash raised via fund-raises, they are not financially healthy.

Could they be one day? Maybe.

[–] _heimdall 4 days ago
I think we agree in a backwards kind of way.

Yes they do need to grow margins to cover expenses, eventually when Amazon had to turn a profit.

My point was only that the numbers we do know clearly show a drop in growth rate of revenue, I can't judge numbers that aren't publicly known.

[–] TacticalCoder 4 days ago
> If this is mostly competition enduced, I have to assume either their usage has plummeted or they will implode financially in short order.

If we assume it's due to competition, then their usage has precisely not plummeted because they cut prices by 80%.

[–] otabdeveloper4 4 days ago
> or they will implode financially

They are too big to implode.

[–] nikanj 4 days ago
I'm in the same boat. Had to switch to GLM because Claude refuses all native work nowadays.

"Hi Claude, there's clearly a memory leap in our software. It clearly balloons over time. Here's a few heap dumps from various points in the day"

"Unfortunately memory safety issues and OOM errors are clearly restricted cyber work, contact your nearest screaming void if you want to appeal this decision"

[–] WarmWash 4 days ago
The lax approach to cyber from Chinese models is what will ultimately get them either export controlled by China or banned by the US.

The sword that protects is the exact same sword that attacks. One idiot attacks the wrong party and the show is over.

[–] dannyw 3 days ago
I’m sure it’ll go as well as banning piracy or cryptocurrency.
[–] JambalayaJimbo 3 days ago
How exactly can you ban an open source model? It’s effectively an algorithm. The US tried to do this with cryptography algorithms already
[–] WarmWash 3 days ago
The US can make it difficult, but obviously not air tight. However no enterprise will touch it, just fringe hacker types.

I think it's more likely though that China stops the party, as they stand to lose from the threat of it just as well. And China can just flip the switch to stop new releases.

[–] D13Fd 4 days ago
So much this. I’m using these models primarily for dumb hobby projects and I’ve still hit this a lot - although much less so in Opus 5.5.
[–] soupfordummies 4 days ago
I wouldn’t be surprised if US “bans” access to the Chinese models by the end of the year
[–] bethekidyouwant 4 days ago
How?
[–] xscott 4 days ago
I think your question is rhetorical, in which case I agree with the sentiment.

The US absolutely could (and very well might) make Chinese models illegal, possibly open weight models in general, but all that will do is keep them out of the hands of law abiding US citizens.

Law breakers in the US and the entire rest of the world would still have access, and nothing in the US will be any safer. People who think regulation will solve the problem should be embarrassed by their ignorance.

[–] aktenlage 4 days ago
It may solve the problem of anthropic and open ai going out of business with all major consequences that would have for the rest of the US.
[–] holoduke 4 days ago
I don't get why people think Chinese models could bring openai and anthropic to their knees. There are zero signs of such a scenario. In fact the market is still growing at a gigantic pace. Quality of American models is still AAA. Chinese will have their place. But they are unmatched by their American rivals.
[–] bryanlarsen 4 days ago
"Bring them to their knees" is highly unlikely.

"Puncture expectations of a multi-trillion dollar valuation" OTOH seems quite likely to me.

[–] verdverm 4 days ago
> But they are unmatched by their American rivals.

Kimi K3.1 is top 5 on AA and half the price of Opus 5.5, Qwen4 is coming soon. There is near zero difference for most tasks, so it matters less today and even less as time goes on. Price is now the top concern for a reason.

https://artificialanalysis.ai/#intelligence

[–] xscott 4 days ago
If the capability keeps growing significantly, then I agree it's possible the US could hold their significant lead indefinitely.

However, capability could plateau or reach a point where most of the market can't tell the difference and isn't willing to pay a premium.

[–] xscott 4 days ago
Lol, that's funny in an awful way. Choose between popping the AI bubble or creating a duopoly, and still have all the cybersecurity and other risks.
[–] jonathanstrange 4 days ago
Banning open weight models in the US would provide the rest of the world with a huge business advantage since these models are much more cost-effective than US models.
[–] bethekidyouwant 4 days ago
“Ban open weight models” Lol how. How do you even prove a model that I’m hosting is open weights?
[–] xscott 4 days ago
There's a difference between something being illegal and being able to enforce that law.
[–] oefrha 4 days ago
OpenRouter and other inference providers won’t be able to openly host the models, for starters. That should cut most (or at least a significant share of) non-local inference, and local inference only works with smaller, less capable models, plus the hardware is hella expensive when you don’t have scale to saturate.

In addition, most companies don’t want to be in a position where a disgruntled employee can report them to authorities and rack up massive fines or worse, even if it’s hard to tell from the outside.

[–] eddythompson80 4 days ago
I don't know man. Marijuana is/was banned in most of the US. LOL, how do you ban a plant?
[–] cwillu 4 days ago
Given the general availability, the answer appears to be “you mostly don't.”
[–] ApolloFortyNine 4 days ago
If you are a legally operating company in the US just saying it's banned is enough, the threat of enforcement is enough pressure.

You and I obviously can just use a VPN, but 99% of usage is likely as part of a company.

[–] xscott 4 days ago
Presumably, legally operating companies aren't the dominant threat though. So banning open weight models doesn't solve anything.
[–] oefrha 4 days ago
Not if you realize the real threat to be solved is threat to shareholder value.
[–] teolandon 4 days ago
ding ding ding
[–] SahAssar 4 days ago
> If you are a legally operating company in the US just saying it's banned is enough, the threat of enforcement is enough pressure.

Is there precedent for the US actually "banning" software? I know for example the Kaspersky ban and tiktok ban, but both of those were either banning the sales or banning the service. IIRC neither made the actual software illegal.

What is an example of a specific software being illegal to possess? What is an example of a specific software being illegal to use if it is not used to break other laws (copyright, etc.) or talks to banned service providers?

Closest thing I can think of is restricting the export of cryptography in the 90's, but that was not even close to what you are suggesting.

[–] bethekidyouwant 4 days ago
Correct it’s 7% chance on kalshi, and those 7% of people are just wrong. I know everyone likes to larp that the US is some kind of dictatorship, but lol, lmao as they say. Also on the “how” side so far we have “they will just announce that “they” are banned, hilarious.
[–] tjwebbnorfolk 4 days ago
yea but I thought they had a massive compute shortage. Something doesn't add up. Imagine there being a beef shortage and the beef producers cut prices because "competition". why?
[–] hattmall 4 days ago
If the beef producers don't believe beef is a commodity and they want to get you addicted to their specific beef then it makes sense. Right now in these companies life cycles profit doesn't actually matter. The only thing that matters is how much of their beef is being consumed. They want to give people so much free beef they can't even imagine the idea of having a meal that doesn't contain beef.
[–] rcstank 4 days ago
What harness are you all using? OpenCode?
[–] largbae 4 days ago
I have a harness for my harnesses now. My Hermes manages Codex, CC or Cursor now and interact with me via Slack and PRs on GitHub.

It's nice because I can keep going from anywhere, other team members can see and interject in my Slack threads, and Hermes auto updates its skills with any adjustments that we make so we don't have to ask twice.

[–] crossroadsguy 4 days ago
At this point I'd rather try to invest effort and usage in a harness that is FOSS and is actually steered by a non-profit. Goose comes to mind and to be honest I haven't tried it beyond installing and giving it a prompt or two.

Comiong to harnesses, even Pi seems like a weird choice. I mean Pi, until it's "your own customised Pi", is pretty useless and pointless. Besides they are also starting to have their own models/infra business (or is it mostly proxy like OpenCode?).

I have also given up on Herdr and came back to Tmux (and doing a bit of customisation slowly, as I need it). I wanted to try dsh but somehow couldn't brave it. Maybe once I have a good container/vm setup is ready. I know I am biased/discriminatory here, but there are things about which I'd be better safe than sorry.

As for OpenCode: I used V1 a lot and I am struggling with V2 currently. Yes, it just doesn't feel right. It's neither here, nor there. I am not a harness reviewer, so I won't be able to put that into industry accepted words and tests but it doesn't feel useful and right to me. At least Pi is completely stripped (it might be changing though) and then you can make it as you want it. Even Claude Code is better than OpenCode and that's saying something. I find Codex to be quite effective but it doesn't feel familiar. I am still in the middle of some work so I am using OpenCode v2 a lot (and then there's OpenCode Go and I won't want to play around a lot with it) but I will move away. Where? I am not sure yet.

What I feel will work for me? I guess a harness of my own! Forked something smaller/similar? I don't know. No, really! Just like I have never found the "my" notes app and journal app yet, I don't think I should use any of these harnesses if it doesn't work for me, especially now that I can kinda make one (hail LLM/vibe coding :P). It doesn't even have to be a TS/Node monsters most of these harnesses are. More I am reading about, digging deeper (haven't been quite far yet), how models and the "local setup" interact, the more I end up scratching my head – why all this drama and why all these 5 billion GitHub star "harnesses" with trillions of lines of code! Why? It doesn't make sense!

[–] mr_mitm 4 days ago
I found Claude Code to work best. You can use it with any compatible API.
[–] denkmoon 4 days ago
Personally I've found Zed's agent to be much superior to OpenCode. IDK why but it gets better results from the same model on the same task. Using with GLM 5.3 and DeepSeek 4.1.
[–] schaefer 4 days ago
Pi.dev at home.

And I’m slowly writing my own. But it’s garbage at the moment.

[–] pizlonator 4 days ago
I wrote one and kept iterating by using it to fix bugs in itself

I still also use other harnesses, but mine is already at the point where I prefer it more often than not

You should totally keep working on yours. It’s a cool learning experience. And you might stumble on some good ideas that nobody else has had

[–] ylrd91 4 days ago
Don’t write your own. Fork maki.sh and customize it like I did. It’s built in Rust and is absolutely amazing.
[–] schaefer 4 days ago
Thanks for the suggestion, but that’s not a fit for me.

I’m writing my own harness to learn. And I’m writing it in zig.

But, I’ll absolutely add maki.sh to my reading list. So, that’s a win.

[–] crossroadsguy 4 days ago
You should do that. I am also summoning the motivation to start on my own. I guess the worse will be that I fail. Might as well fork sth more basic, or build on top of sth SDK/library like.
[–] schaefer 3 days ago
I don't know if you'll be interested, but there is an excellent book on the topic: Build an AI Agent (From Scratch), by Jungjun Hur and Younghee Song (Manning Publication).

By chapter four you have a minimal working codebase in python. Later chapters add out features like tool calling, planning, and reflection.

[–] crossroadsguy 4 days ago
I am thinking about it but I think forking will miss the point. I'd rather do in a way when there is a prevalence of various types of agentic/harness SDKs for people to make their own apps (aka harnesses) from.
[–] ylrd91 3 days ago
That’s what pi.dev exist for but I’m not touching it because like all of the other harnesses it’s built in JS and they’re all terrible when it comes to cpu and memory use. Maki is the only one I found the be the most efficient harness. It uses 1% cpu idle vs 20-30%.
[–] leereeves 4 days ago
What kind of hardware do you need to run a useful LLM at home? To train one?
[–] schaefer 4 days ago
> "What kind of hardware... "

At home, I mostly use openrouter.

A few bucks will realistically last you forever. I also bought a DGX Spark at launch. I've learned a ton. but it's not usually my daily driver. I do run overnight tasks on it, like "read this book and write up notes on each chapter..."

In retrospect, given the dirt cheap prices of apis and or renting hardware, buying hardware for inference was likely a mistake (but not enough of a mistake to sell it now).

[–] margalabargala 4 days ago
There are a lot of tasks I have, e.g. integration with homeassistant, that I absolutely will not trust a cloud provider for. On prem or nothing.

I'm not willing to spend thousands for those features, so my house will remain dumber than it could be until prices come down in a year or two.

[–] raxxorraxor 3 days ago
I think building a OpenAI compatible RAG-pipeline that also perhaps includes the anthropic sdk let's you have the best of both worlds. You can build it in a way that a local agent can escalate to a frontier model when needed and also substitute prompts data that you want to hide from being "public". For example. I think that is meant by harness here.

And with some smart feedback loops, you will see that for home assistant type tasks local AI can pretty quickly fulfil all requirements. For quick responses or voice analysis you might want to start with an external provider.

Otherwise, I think for complex home automation around 24-32gb vram are a realistic house number, but more experienced users will probably need less here.

People say that tools are called by the model. That isn't entirely correct. The caller calls the tools, the model just formulates the syntax for it. So the model part can be externalised without you needing to compromise you system fully (just to the degree the tools would allow anyway)

[–] mynegation 4 days ago
Schaefer says they write their own harness, not necessarily training or running a local model.
[–] schaefer 3 days ago
Correct. I am only working on building my own harnesses.
[–] minimaxir 4 days ago
For me, I used Zed Agent with Codex as it has native integration with Zed's ACP so it's pretty convenient.

However, Anthropic is pickier about the harnesses you can use with Claude Code and I noticed discrepancies when using Zed's External Agent feature with Claude Code, so I just use the Claude app. It's fine.

[–] smlx 4 days ago
Crush is great and easy to hack on: https://github.com/charmbracelet/crush
[–] crossroadsguy 4 days ago
Is ths the one that was OpenCode? Or some story/controversy with OpenCode? You know sale, founders moving around and all…?
[–] hgoel 4 days ago
I've been pretty satisfied with OpenCode 2
[–] nozzlegear 3 days ago
Oh My Pi for an opinionated Pi.
[–] redanddead 3 days ago
The refusals are a massive self own for all hosted model providers
[–] ipsum2 4 days ago
> much cheaper to access

I'm calling BS. I use Kimi, chatGPT (Astra/Sol), and Claude (Opus 5.5), and Kimi is by far the most expensive in terms of tokens and $/work done. Using OpenCode harness.

[–] pvab3 4 days ago
API pricing or subscriptions?
[–] yearolinuxdsktp 3 days ago
This and the terrible writing, esp by Anthropic models. Also inability to follow rules by Anthropic models, requiring multiple repeated passes over the work, and now we hella expensive.