earhart | 1 year ago | on: Shape Rotation 101: An Intro to Einsum and Jax Transformers
earhart's comments
earhart | 1 year ago | on: Safe Superintelligence Inc.
earhart | 2 years ago | on: Artificial General Intelligence – A gentle introduction
I honestly worry about this - I've been tinkering with ideas to try to build towards AGI, and I'd love to share them publicly to get feedback ("This is dumb and here's why" would be enormously valuable to me), but it's hard to work openly, because while I do think capitalism has been an overall good, the capitalist imperative always seeks slaves, and I'm really not excited about helping the people who'd be trying to build a new slave class.
Thoughts? Is there a ethical way to work openly on AGI?
earhart | 2 years ago | on: Llama.cpp: Full CUDA GPU Acceleration
It turns out you need very different kernels for good performance on different GPUs, so OpenCL is a nice tool, but not sufficient; you need a hardware-specific kernel library.
From the framework side, each integration is relatively expensive to support, so you really don’t want to invest in many of them. Without some sort of kernel API standard, you’re into a proprietary solution, and NVidia did an amazing job at investing in their software, so that’s the way things go.
I think we had a pretty solid foundation for doing something smarter with PlaidML, but after we were bought by Intel, some architectural decisions and some business decisions consigned that to be a research project; I don’t know that it’s going anywhere.
These days, I’d probably look into OctoML / TVM, or maybe Modular, for a better solution in this space… or just buy NVidia.
(I worked a bit on Intel’s Meteor Lake VPU; it’s a lovely machine, but I’m not sure what the story will be for general framework integrations. I bet OpenVINO will run really well on it, though :-)
earhart | 2 years ago | on: Do open source licences cover the Ship of Theseus?
earhart | 3 years ago | on: $39 Cooler Master case turns your old Framework Laptop parts into a tiny PC
I do the "unplug and spend a couple of hours hacking without a charger" thing all the time with mine, and mine's using the previous-generation battery. Not running Windows seems to help a surprising amount.
earhart | 3 years ago | on: The Flare Programming Language
I landed in the same place they did, on using XML. I think there’re a couple of advantages over S-Expressions:
* There’s always a tag. So it’s like everything is a special form. Being able to omit the tag in sexprs is nice syntactic sugar, but I’m not expecting that anyone would be writing this code in text by hand (although it’s useful to preserve the ability to do so), and I’d rather have the clarity and explicit terminators.
* Namespaces are a killer feature - that’s what makes it an open datastructure, allowing you to incorporate multiple dialects at different semantic levels. (You can tell I’ve been using MLIR a lot the past few years… :-)
* There’s a whole ecosystem of standards and tools around it. Need a standard fragment identifier? Or to canonicalize an entity? There’s a good body of specs, carefully worked out by people more experienced than I.
I dunno about their Python approach; I was thinking of a structure editor (and trying to avoid all the historical pitfalls of structure editors, which will be tricky). We’ll see how it goes. :-)
Thanks again for the pointer!
earhart | 3 years ago | on: Huge pages are a good idea
earhart | 3 years ago | on: Ask HN: Has anyone here worked on the Windows kernel?
earhart | 4 years ago | on: White House eyes subsidies for nuclear plants to help meet climate targets
It's unclear to me that the military is currently any less effective and efficient than it was in the 90s. In Hollywood films in those days, it was typically portrayed as being incredibly efficient, but that has nothing to do with reality.
My own anecdote says that "The wastefulness of the military budget" has been an issue for many decades -- go look up Eisenhower's warnings of the military/industrial complex, and consider that the problem had been building for quite a while at that point.
Back then, of course, "cultural rot" would've meant "Treating black soldiers as equals"; in the 90s, IIRC, it would've meant "Treating female soldiers as equals". Just wondering, are you in favor of racism and sexism as well, or are you just anti-trans? Please note that anti-trans attitudes are likely to age about as well as racism and sexism have.
IMHO, every social change feels a little weird at the time; you're used to thinking a certain way, and now you're told that it's wrong; people take that sort of things personally. Other self-righteous people sometimes realize they can use the new woke attitude to swan around and club people who're moving more slowly -- bullying, really, and this bullying is the serious problem on the left, not the wokeness itself. We'd all be better off if we were better at granting grace to people making good-faith efforts to change their habits and attitudes.
So social change is hard. But that doesn't make it wrong, or rot, or virtue-signaling; it really does make life better for unfairly marginalized people, and as it spreads, the power of the leftist bullies will dissipate, and we'll be left with a better world overall.
And: if you want to disempower those leftist bullies faster, support racial justice, support women's rights, support trans rights. You don't have to club people over the head with it; just offer quiet support, because it's the right thing to do, and it'll make the bullies all the madder if there's nothing they can use to feel superior to you. :-)
earhart | 4 years ago | on: Feynman: I am burned out and I'll never accomplish anything (1985)
(Good luck!)
earhart | 5 years ago | on: Proposal: expression to create pointer to simple types
earhart | 5 years ago | on: Are You Trading or Gambling?
If bitcoin could solve those problems, and the energy usage problem, I’d use it. As is, it’s solved the double-spend problem - admirable and impressive, but it’s not a substitute for a stable currency yet.
earhart | 5 years ago | on: Cydia, the original app store, sues Apple on antitrust grounds
More seriously, it's hard to know what all's installed on your phone, and what all it's doing; car parts are intrinsically sandboxed.
It'll be interesting to see what happens when always-connected self-driving cars have enough compute power to run self-driving systems and people are free to install random apps without great security (because car manufacturers seem to be awful at that). I'm predicting cutesy weather apps that quietly mine crypto all night long...
earhart | 5 years ago | on: Cydia, the original app store, sues Apple on antitrust grounds
In your example: Volkswagen imposes quality controls on those parts, making sure they're not going to blow up or subvert the car.
As soon as other shops can install 3rd-party parts, you have a race to the bottom for shops, no one's enforcing quality controls, and you wind up with cars that, for example, get better performance by violating emissions standards except when they're actively being tested.
(So, maybe we should be using some manufacturer other than Volkswagen. :-)
earhart | 5 years ago | on: The Grenfell Tower inquiry is uncovering a major corporate scandal
So... yes, American conservatives tend to dislike safety (people should be responsible for their own safety, regulation will slow down business and make everyone worse off), and they tend to support dishonest business practices (let the market handle punishment, it’s not the government’s job to decide what truth is and to make sure people are honest).
earhart | 5 years ago | on: Arecibo Observatory Collapsed
Socialism's more about the community owning and managing the means of production, and less about just giving people money. You could make a good case that the F-35 program, with all its bloat and cost overruns and inefficient distribution of funds by congressional district, is typical of a socialist jobs program -- granted, the F-35 also has a layer of capitalist shareholders parasitically skimming off the top, but if that were removed, the political pressures that result in the inefficiencies would remain.
earhart | 5 years ago | on: The Nintendo Switch uses my open source code
So... if you genuinely don't care, why wouldn't you release software as GPL instead, so that you're not enabling companies to more cheaply provide software that prevents people from making modifications?
(And to be clear, I'm asking as devil's advocate here -- for myself, I have a few personal projects I haven't released, but I've sometimes thought about what license I'd choose if I did; I haven't been able to decide.)
earhart | 5 years ago | on: The Nintendo Switch uses my open source code
Just curious, as a side question... suppose one really does believe that users should be able to improve and modify the software on devices they own and share those improvements with others; is there a better license out there?
(The current situation reminds me a lot of a Prisoner's Dilemma problem -- if the open-source community typically used the GPL, there'd be significant economic pressure on companies to work with GPL'd software, but in our current world, the individual developer has to choose between giving their code away as non-GPL open-source or toiling in complete obscurity, and it's no surprise that individuals choose to at least get the cred of seeing their code used.)
earhart | 5 years ago | on: Moderna Covid vaccine candidate almost 95% effective, trials show
(My own suspicion is that the lockdowns are better for the economy in the long run, but I’m definitely not an expert.)
(OTOH, I’m not an einsum expert; please feel free to delight me by pointing out how it’s possible to do these sorts of things :-)