They also have a reward system that punishes people for ignoring the llm review (by pushing their submission lower in the queue).
[–] cromka 3 days ago
[–] unrented7977 2 days ago
[–] bradknowles 2 days ago
It’s the LLM equivalent of “an eye for an eye just makes everyone blind”.
[–] Cthulhu_ 2 days ago
Either some consensus emerges or it just deadlocks in place. My money is on the latter. I wish my money was in the companies profiting on it three years ago because that's the only way this will financially benefit people.
[–] kyorochan 2 days ago
[–] pluc 3 days ago
[–] phoghed 3 days ago
[–] lifeisloving 3 days ago
[–] bombcar 2 days ago
Once you're drinking from the firehose you realize just how many idiots (well meaning or not) are out there, and how empowered they are now.
[–] close04 3 days ago
Lazy or incompetent colleagues always forced people around them to overcompensate and correct. AI increased their firepower and blast radius.
[–] bombcar 2 days ago
The end-game for Anthropic is each PR to be 100k+ tokens but nobody cares because they burn 100k+ tokens reviewing and responding.
[–] Cthulhu_ 2 days ago
We'll see the tools get adjusted over time to use more and more tokens, or at the very least they get optimized to use every paying customer's tokens for whatever period so that they are on the one side thinking they're getting their money's worth, or on the other that they should upgrade to a higher tier plan. Because the companies are investing trillions into thousands of datacenters and if they sit unused it'd have been a waste of money.
(the datacenters won't go unused I'm sure; any unused capacity will end up on a spot market, with cryptocurrency generation as a constant baseline. I'm pretty confident that crypto will make another small resurgence after the AI / datacenter investment bubble pops. This is a random internet comment, not financial advice)
[–] gspr 3 days ago
This is what I fear will push its way into every part of society soon, too.
"We're not forcing you to do your banking through our AI interface instead of a normal one, you're free to opt out, but multiple functions will be missing and we'll charge you a monthly fee."
"You don't have to have an LLM grade your exam, but beware that the human grader will be overworked and grumpy for the extra task."
[–] drdexebtjl 3 days ago
If you’ve applied to jobs recently, you must have seen the companies that transcribe and summarize interviews using AI (and probably share data across their clients in an indirect, technically legal way).
You can opt out, of course, but do you really want to be the one candidate for which the interviewer needs to take notes manually? And they just spent a lot of money on this hiring AI tool, will they hire the one candidate for which they couldn’t use it?
[–] gspr 3 days ago
This is gonna get so much worse. It's like the smartphone revolution on steroids – and we've seemingly learned nothing! We're in dire straits.
[–] wccrawford 3 days ago
I'm surprised that your doctors weren't asking, and instead were just assuming.
[–] jasomill 2 days ago
[–] gspr 3 days ago
[–] solyin 3 days ago
That's cute. Yo, people be having full on AI-led interviews! That is to say, there's the human interviewee, and an AI, testing the human. Asking them questions and having a conversation that is definitely recorded.
[–] drdexebtjl 2 days ago
[–] monsieurbanana 3 days ago
But to upload to debian new's queue you already need to have pre-approval, it's a different situation from e.g. a public git repository that anyone can push to.
[–] g-b-r 3 days ago
Why would you use an LLM instead of a fixed message?
[–] monsieurbanana 3 days ago
Another situation where I would use llms to generate messages is if we've mutually agreed to do that. For example automated review messages at work, if we've agreed that it would be a part of our workflow.
A good rule of thumb might be unsolicited vs solicited llm messages.
[–] g-b-r 3 days ago
If you mutually agreed of course it's fine
[–] tetha 3 days ago
For example, mine is a technical writing skill based on the old book "The Art of Scientific Writing": Front load information as much as possible - the first paragraph of a document should be a summary, the first sentence of a paragraph should summarize. Short sentences building on each other. Always show evidence.
Someone else spent quite a while optimizing a standardized PR description template, with a section for intent, expected changes, risk, rollout coordination and such.
That made the slop a lot more tolerable.
[–] InsidiousWombat 3 days ago
[–] SOLAR_FIELDS 3 days ago
[–] account42 3 days ago
[–] agwa 3 days ago
[–] thesuitonym 3 days ago
[–] solyin 3 days ago
[–] thesuitonym 1 day ago
[–] bayindirh 3 days ago
While I'm perfectly on the same page with the critics of the LLM generated summaries, I'm a bit torn on the issue.
For anyone not familiar with Debian ecosystem, there's a helper tool called Lintian. Lintian does all kinds of checks from package formatting, licenses to dependency management (which can detect both unnecessary yet included and necessary but missing dependencies via static analysis of your tool if necessary).
It's expected that your package to be "Lintian clean" to be able to included in Debian with minimum friction and wait. Even though it's Lintian clean, your package also checked by teams which are severely understaffed, and composed solely of voluntary people.
NEW queue also receives tremendous influx of packages (which can be considered a torrent, even). Since noon, there are 10 more ITP (intention to package) bugs open in my inbox.
As a result, at one hand, these people need every help they can get because getting new trainees and getting them to learn the intricacies is hard, on the other hand LLM generated text rightfully generate negative reactions from people. However, giving developers an automated check of what looks right and what looks wrong is helpful, in my perspective.
I wonder what people would have said it was a deterministic tool generating these reports and sending people these summaries as a "hey consider this feedback until a human has time to see your package".
This is a hard question and we need to think before impulsive reactions. I even don't have all or any of the answers, but at least I have some insight why this is there.
[–] monegator 3 days ago
[–] bayindirh 3 days ago
Debian has an extensive toolchain to check things. Having a set of deterministic tools which feed LLM with data can be beneficial, though.
Again, I'm not defending the LLM here, just want to show how hard the problem is to begin with.
[–] khaelenmore 2 days ago
If there are deterministic tools involved - just return their output as is. It's usually quite readable if needs a bit of adjusting
[–] pantalaimon 2 days ago
[–] vitorsr 3 days ago
[–] throwawayffffas 3 days ago
Sure LLMs are not nearly as rigorous about their output but that doesn't mean it's entirely not useful.
At a minimum you can have your LLM summarize the other LLMs output and go from there.
[–] johannes1234321 3 days ago
LLM output may or may not be relevant, may or may not tell me something new and by the way it is structure is often hard to quickly oarse for the relevant piece in a wall of text.
[–] pantalaimon 2 days ago
It does not have to be a wall of slop, maybe you only used LLMs 2 years ago where this would have been all you'd get.
This here might hit the nail on the head exactly in terms of what the biggest FOSSes gripe with LLMs with might be: not the fact people use it but rather how it hinders the communication.
If you use it to help the write code, but you explain things in your own words or, at very least, redact and trim LLMs output, it's fine.
If you, however, just drop a wall of text at someone and expect they act on its b/s, this is lazy to the point it borders with microagression.
You wouldn't expect a distinguished professor explain basic maths to a student, and we shouldn't expect actual developers address Copilot's stupid, unredacted hallucinations or otherwise unrelated remarks.
This works for patches submission, too: you should be outright banned for submitting stuff you didn't bother to double check and properly document.