Comment Re:With Linus on board with AI (Score 1) 33
The issue is the situation isn't binary.
Linus comes along with an attempt at nuance and suddenly all sorts of high-slop vibe coders think they are just like Linus.
The issue is the situation isn't binary.
Linus comes along with an attempt at nuance and suddenly all sorts of high-slop vibe coders think they are just like Linus.
I know a team that has gone very hard on slopping it up AI, though they just had a flamewar where the AI bros bitched that the more careful people were holding them back by insisting on human review and rejecting merge requests where the human didn't understand what they were submitting.
The thing is, this team was already pumping out shit code for years, so in their case the AI might actually be compelling. Infested by PHB thinking of 'hire many people in random geography, to change each year as different geographies are proven to be shit when you only pay bottom of the barrel'. They have been rotating cheap labor forever hoping for the magical geo where the cheapest people are still skilled (no such geography exists, the bottom of the barrel in any geo is trash). So AI is next on their search.
Absolutely on point. Even if you did decide the volume of code was acceptable, there's no way you need to land 30,000 commits in a day. That's less than 3 seconds per change.
If a human were pushing too many changes, I'd tell them to slow down and take a bit more time per commit. Larger commits that are more manageable instead of rapid fire tiny commits that are impossible to wrangle. If you say the AI commits are large even rapid fire, the point still stands in relative terms.
Commit histories should be there for humans to operate on. To follow the progression of changes, to bisect in case of a long delayed bug, or as the increment to trigger a deployment activity. No human can follow a commit log of 30,000, the AI doesn't need a commit log to do whatever it is doing, bisect is prohibitively slow with that many commits, you need to jump to something other than just picking out of the commit log by that time, and there's no software on earth than needs to be redployed every 3 seconds.
Slopping it up so hard that git was the bottleneck absolutely should not be the brag they think it is.
Run yourself *on normal hardware*? Yeah, there's a pretty big gulf between that and a frontier model.
It's not about the specific "BioPykrete" example, it's the technique that's interesting: using proteins to bridge dissimilar materials in composites. It's using them in a way that's sort of like how an emulsifier lets you bridge lipophilic and hydrophilic compounds
Think, say, plastic-ceramic or plastic-metal composites. We can do these today (say, Colorfabb Bronzefill 3d printing filament), but the addition of ceramic or metallic particles makes the material properties generally worse, not better. The plastic just does not bond well to the particles; you have to significantly limit the percentage of metal or ceramic in your mix, and it makes them much harder to work. But what if they *did* bound well? You could easily produce materials with significantly boosted strength, abrasion resistance, etc, but with the low-temperature workability of plastics (note: they'd probably have to be thermoset, not thermoplastic, or low-temperature thermoplastics; proteins have heat survivability limits)
And why stop at metals and ceramics? You could literally just use "dust", just ordinary mineral dusts (clays, silt, etc) as a bulk filler in plastics, yet instead of ending up with a weaker product than working with pure plastic, you'd end up with a stronger one.
Maybe you don't even need a plastic. Maybe you can do what they're doing and bridge cellulose to an inorganic material? Then you're *really* operating on waste. Ice has the advantage of a low melting point in this situation, letting you use that component as a fluid - but cellulose can be dissolved in a number of substances, so perhaps you mix a cellulose-protein slurry with metal or mineral powders and then vaporize/recover the solvent?
Or even forgetting "novel" products, what about conventional composites? If you can bridge high-tensile fibres (such as carbon fibre) better to the polymer matrix that they're in, then you can help eliminate one of the main failure mechanisms of said composites, as well as making the behavior far more predictable. Because like metals (and unlike ceramics), a protein-bridged compound shouldn't be brittle; breaking one bond shouldn't introduce a discontinuity (like a ceramic), it should just reconnect after breakage (like a metal). Such composites should have ductility.
I don't know how widely applicable this will be, but technology that helps bridge dissimilar compounds is nothing to scoff at. And today we have tools like AlphaFold to assist with the design
As for the caveats:
* The concept of coupling agents is also not new, we already use various coupling agents to bond plastic to metal particles in metal-plastic composites and the like - they're just not great at their jobs.
* The aforementioned temperature limits
* Potential production challenges (though industrial enzymes are as cheap as like $15-50/kg, so seems viable?)
* Other coupling agents may offer better advantages; it's not a static field.
I haven't looked up the history, but I would imagine that the "XL" is for the fact that it can handle images up to 1B x 1B pixels (1 exapixel).
Both lossy and lossless, and so much more.
It's this.
And on the compression side, there's a lot of really cool stuff that lets it happen. For example, it dynamically resizes the blocks from 2x2 to 256x256, and they don't even have to be square. It may apply DCT in one, AFAS in another, etc - whatever is most efficient. It uses edge preserving filters to keep the edges of features clean. It can draw in splines and clone regions from one part of an image to another. Where it has to throw away high frequency noise (film grain, noisy textures, etc), it statistically samples the properties of the noise and saves that, and then regenerates equivalent noise. In "busy" areas, like say tree bark or whatnot (where the human eye isn't good at discerning changes), it throws away more precision there, and instead allocates it to details located in fragile flat areas, such as skin and shadows, that the eye is attracted to. It works in default in XYB colour space, based on the actual interactions of the cones in the eye, so it can aggressively quantize things which the brain cannot detect. And in the choice between fast but not-great Huffman coding vs. better but slow and patent-encumbered arithmetic coding, they instead use rANS, which is nearly as fast as Huffman but as efficient as arithmetic coding, and faces no patent challenges. Which is also why you can take a legacy JPEG and rapidly losslessly reincode as JPEG-XL and get a file that's ~20% smaller - you're swapping Huffman for rANS.
(That's the lossy mode - there's also a dedicated lossless mode)
Though already CI/CD pipelines were choking on the unit tests. So they aren't *free*.
Had an LLM generated request that was pretty straightforward, and the LLM generated 272 unit tests for a very simple function. Can't really afford that.
Also, despite the 272 unit tests, when I tried to try it out in the way a human would, it immediately failed. All the mocking the AI generated never actually properly imitated the real world. However, the submitter was *quite* proud of having hundreds of unit tests, despite them being, in this scenario, utterly worthless.
Like always, more code != more valuable software behavior.
So you have the AI doing overtly silly things. Someone asked to adjust layout to fix a gap in a webpage. Eventually they submitted their pull request, hundreds and hundreds of lines of CSS. Often the exact same rule repeated 5 times, which I'm guessing is how many rounds the operator went with the system before the gap actually closed. The lines were *mostly* just '!important'ing already existing rules, which had no impact, but hey, worth a shot right? Ultimately I discarded the merge request and made the one-line css tweak that was actually relevant.
Then you have the AI doing... well arguably slightly silly things. Like protecting against an invalid value redundantly throughout a call stack. Arguably defensible, as maybe one day the deep function will be called from somewhere else and passing through the error might not present it with the most informative context.
Finally the AI doing... well things the human should have been doing. With the advent of a lot of code scanning, this is less likely, but things like calling functions in C and charging ahead without ever checking the status of the call. functions that, practically speaking, will likely never fail, however you really *should* be being more defensive about the possibility.
The 'human review as a bottleneck' isn't really the angle I would fixate on. Completely unfettered AI usage also stalls out in many situations. If the AI can't get there on its own trivially, then it's going to leave an almost-correct looking mess that isn't quite there but is very hard to get across the finish line. If the AI can get it, then it's probably not 'software being shipped', because while perhaps slightly better than a generic off-the-shelf existing procedure, probably not worth the trouble to 'ship' a solution that largely overlaps with a lot of generic stuff.
Everyone knows that pretty much by definition volumes are low, that's the whole definition of a shortage.
The vendors may still be happy, perhaps even happier if the sky high prices produce at least as much revenue at high margin.
with that little sneer at 'paperwork' that assumes that plausible nonsense is fine because whatever the 'paperwork' is it must be a fake problem imposed for stupid reasons
I'm with you, but realistically speaking, if the mindset is already there, the material was likely already at high risk of plausible nonsense, not as thought out as the reality, but something to satisfy a check box for someone else. And the hope for process improvement is frequently not there, as raising a "do we really need to do this" invites "you must not care about safety/security/whatever". In many scenarios *no one* wants to be potentially on the hook for approving a process optimization that ends up biting them because they didn't understand why those things were in the process. Even if it is patently obvious to all involved there's no point, or if there was it was already failing. Frequently process dictated by someone that has no *real* stakes in anything involved, but needs to be performative.
The GenAI approach is the way to pay lip service and skip the debate. And if something messes up? "Ooops, well you know how AI just does that sometimes". I've seen that *so many times* and people just laugh it off and keep slopping and no one is holding folks accountable for failing to audit the AI results adequately. So they get credit when the slop works, and they deflect blame when it doesn't.
Don't we all! Hard drives, RAM, *and* GPUs, I'm in the market for it all.
I also want to buy silver-tin alloy for casting, and hey, what do you know, silver and tin are also both at astronomical prices due to in no small part the AI boom.
At one point you have to just stop waiting. Prices could start falling tomorrow, but then again, that could have been said at any point for the past several years.
They don't have the revenue to survive much longer,
They were profitable in Q2. You can't extrapolate that endlessly, but they're not a cash incinerator anymore. And they have $15-20B on-hand pre-IPO. They're fine.
The Tao doesn't take sides; it gives birth to both wins and losses. The Guru doesn't take sides; she welcomes both hackers and lusers.