Rendered at 02:30:40 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
romesc 1 days ago [-]
Hi, one of the authors here!
We can answer questions! But also, I want to highlight that the "AlphaNIST" name is an homage to the very well known work from David Silver's research group @ Deepmind circa 2016->2018. This was when we were coming up very early in our research careers and their work obviously had a big impact on us!
It has taken longer to make some of those ideas work for areas as challenging as robotics where there are physical constraints to deal with (and admittedly in this paper, we do not show the transfer to real hardware quite yet). But, we have some glimmer of evidence it is looking possible here (in another recent paper) that we cranked on for the last 6 months and will be featured at CoRL: https://x.com/octi_zhang/status/2108583315544682914
We are also all mega-lurkers here so we were honored to be featured on the front page!
serioussecurity 1 days ago [-]
ICYMI, the "alpha" is a reference to "alphabet", i.e., Google, after deepmind was acquired. You have branded your paper as coming from Google.
marcbeep 17 hours ago [-]
I don't think Google owns the term "Alpha".
jcattle 17 hours ago [-]
As far as I know Apple also does not own "i" or McDonalds owns "Mc".
If you're creating a Burger called McSomething or a device called iWhatever it does not feel like "paying homage" to Apple/McDonalds, it feels more like copying and trying to capture some audience from this bigger player.
williamdclt 14 hours ago [-]
Really trying to think about it, and I can't name a single product from Alphabet or Google that contains "alpha"
jcattle 13 hours ago [-]
That's because Google Deepmind has consistently used AlphaSomething for their scientific models. Not for their consumer models which are Gemini, but their models which are more cutting edge and specific to niche problems.
There are some revolutionary models in there. Especially AlphaZero and AlphaFold. AlphaFold even won a nobel price in 2024.
tete 14 hours ago [-]
Ah, I see, Ireland and McKinsey are trying to copy and capture McDonalds audience. /s
Yes, you said burger, but also AlphaNIST is not a technology conglomerate holding company. And the term Alpha is not at all used in their products. It's neither Alpha Phones, not AlphaGemini, nor is Google called Alpha. More than that Alphabet is never shortened Alpha.
jcattle 13 hours ago [-]
I would strongly argue against that. I would argue that Google Deepmind has consistently used AlphaSomething for their scientific models. Not for their consumer models which are Gemini, but their models which are more cutting edge and specific to niche problems.
There's a reason why so many people in the comments here thought that this was a model from Google.
Edit: Just looked through Wikipedia. Here's a few more: AlphaProof, AlphaDev, AlphaEvolve, AlphaStar, AlphaChip
seanhunter 9 hours ago [-]
AlphaStation (oh no, that was DEC).
Alpha Centauri (oh no, that's the star system).
Alpha-gal syndrome (oh no, that's the allergy to red meat you can get from being bitten by a tick).
Alpha-bits (oh that's the breakfast cereal)
Alpha course (oh no that's the thing for if you're Anglican and still want to feel like you're in a cult)
Alphabetti Spaghetti (actually I think that was Google Deepmind probably)
....
jcattle 8 hours ago [-]
Got any in a single category which all start with Alpha and named by the same organization? Say something like... I don't know... Deep learning models published by Google?
If there's 10 breakfast cereals from the same company all starting with Alpha, I would give you some credit. But like this I don't even know what your reply is trying to tell me.
I honestly feel like I am taking crazy pills here.
seanhunter 7 hours ago [-]
OK I'm telling you that I'm not as keen as you are to cede every possible name that starts with "Alpha" to Google.
And to answer your question directly, DEC had a whole series of things called "Alpha". eg AlphaStation family of workstations, the Alpha AXP series of processors etc (alpha 21064, alpha 21164, alpha 21264, alpha 21364).
romesc 22 hours ago [-]
Point received! We wonder what a better way to pay that same homage would be, since we followed the similar philosophy, but with considerations for our contact-rich robotic control setting.
dpe82 22 hours ago [-]
A shout-out in the paper, perhaps? But co-opting their naming convention for unearned publicity isn't cool.
hansmoravec 22 hours ago [-]
Very cool line of work and emergent behaviors are so fascinating and solving NIST standard is very impressive! This just shows robot dexterity doesnt necessarily always need hands atleast for industrial assembly tasks.
Came across your CoRL publication before I found alphaNIST. I was curious how much simulation asset engineering and sysID/tuning was needed for transfer to the real robot?
romesc 21 hours ago [-]
Thank you so much for your kind words!
Ensuring the assets are "CAD-level accurate" has a huge impact on making this work in practice. So much so, that our collaborators Yash Narang [1] and Iretiayo Akinola [2] have spent a number of years on just this - we are standing on the shoulders of giants!
Additionally, understanding the hardware well (including things like motor and controller dynamics) is non-negotiable. We learned the hard way that there is, in fact, no free lunch. You really have to get the deep understanding of physics and engineering right.
Woah, deepmind solved the national institute of standards and technology???
Den_VR 22 hours ago [-]
Situation Before: there are 14 competing standards.
Situation Soon: there are 15 trillion standards tailored to every possible situation.
grumbelbart2 17 hours ago [-]
I know you are joking, but that is absolutely a possible trajectory. Reliable and cheap LLMs could lead to software that re-implements everything, instead of using libraries.
geerlingguy 22 hours ago [-]
I thought of the National Institute of Standards and Technology... acronym/naming overload, like using "STL"!
Y_Y 19 hours ago [-]
That is indeed the reference
jasonjmcghee 1 days ago [-]
NIST makes sense, but co-opting Alpha is a bit odd.
Alpha historically had meant "Google DeepMind" not RL
24 hours ago [-]
amluto 1 days ago [-]
I’m highly entertained by the way the robot tightens nuts. There is no way this would work in the real world :)
(This whole thing is awesome. I think they will need to get the number of rollouts needed down before it translates well to real robots — running hundreds of thousands of rollouts on small parts with a real rollout will be a real logistical mess when cleaning up parts on the floor and dealing with everything that the robots physically break while learning.)
romesc 22 hours ago [-]
We use sim2real with distillation-based transfer :)
This means no need to do the rollouts on real robots first! Please check out https://sgs-rl.github.io for some transfer examples (albeit a simpler setting then the multi-part NIST board we examine in AlphaNIST).
wasabi991011 1 days ago [-]
The starting states being at different points in the task and having success-guided starting state sampling seem like really neat ideas. I haven't kept up with RL in a while, how novel is this?
romesc 22 hours ago [-]
The mechanism is loosely related to curriculum learning, though we argue there are some distinctions. In the methodological companion paper (https://sgs-rl.github.io), we try to get into more details in the related work and baselines including comparison to methods like PLR (also from Deepmind), SFL, and linear handcrafted curriculums over states.
You are giving me some inspiration, though, that it might be good to try to explain the related techniques in a lower-dimensional setting to help teach the concept more effectively! brb
BoppreH 1 days ago [-]
Really cool stuff. I especially liked the flicking behavior. Very organic movements.
In case somebody got the same question as me: the robot "sees" point clouds as input, so basically the full simulation state except for velocities (correct me if I'm wrong). As put in the limitations section, it "[does] not establish robustness to perception error, latency, or contact-model mismatch".
Kuyawa 1 days ago [-]
Without clicking the link. What is it? How about a short description?
Alphanist - Some app/lib/code that does something
jasonjmcghee 1 days ago [-]
It's the companion blog post to an Nvidia / UW paper of an approach to solving learning based high precision robotics tasks.
HN guidelines are to use the title of the blog post and not editorialize.
jagged-chisel 1 days ago [-]
HN guidelines don’t preclude the submitter from including a descriptive first comment on the story.
jasonjmcghee 1 days ago [-]
Fair - I should have
squanch 1 days ago [-]
The movements of the robot gripper arm and its interaction with the longer objects ("Single-component assembly experiment", 1:00 and onwards) somehow really reminds me of how a horse moves it head.
We can answer questions! But also, I want to highlight that the "AlphaNIST" name is an homage to the very well known work from David Silver's research group @ Deepmind circa 2016->2018. This was when we were coming up very early in our research careers and their work obviously had a big impact on us!
It has taken longer to make some of those ideas work for areas as challenging as robotics where there are physical constraints to deal with (and admittedly in this paper, we do not show the transfer to real hardware quite yet). But, we have some glimmer of evidence it is looking possible here (in another recent paper) that we cranked on for the last 6 months and will be featured at CoRL: https://x.com/octi_zhang/status/2108583315544682914
We are also all mega-lurkers here so we were honored to be featured on the front page!
If you're creating a Burger called McSomething or a device called iWhatever it does not feel like "paying homage" to Apple/McDonalds, it feels more like copying and trying to capture some audience from this bigger player.
Let's list them!
AlphaZero, AlphaGo, AlphaFold, AlphaGenome, AlphaEarth, AlphaGeometry, AlphaProteo, AlphaTensor.
There are some revolutionary models in there. Especially AlphaZero and AlphaFold. AlphaFold even won a nobel price in 2024.
Yes, you said burger, but also AlphaNIST is not a technology conglomerate holding company. And the term Alpha is not at all used in their products. It's neither Alpha Phones, not AlphaGemini, nor is Google called Alpha. More than that Alphabet is never shortened Alpha.
Let's list them!
AlphaZero, AlphaGo, AlphaFold, AlphaGenome, AlphaEarth, AlphaGeometry, AlphaProteo, AlphaTensor.
There's a reason why so many people in the comments here thought that this was a model from Google.
Edit: Just looked through Wikipedia. Here's a few more: AlphaProof, AlphaDev, AlphaEvolve, AlphaStar, AlphaChip
Alpha Centauri (oh no, that's the star system).
Alpha-gal syndrome (oh no, that's the allergy to red meat you can get from being bitten by a tick).
Alpha-bits (oh that's the breakfast cereal)
Alpha course (oh no that's the thing for if you're Anglican and still want to feel like you're in a cult)
Alphabetti Spaghetti (actually I think that was Google Deepmind probably)
....
If there's 10 breakfast cereals from the same company all starting with Alpha, I would give you some credit. But like this I don't even know what your reply is trying to tell me.
I honestly feel like I am taking crazy pills here.
And to answer your question directly, DEC had a whole series of things called "Alpha". eg AlphaStation family of workstations, the Alpha AXP series of processors etc (alpha 21064, alpha 21164, alpha 21264, alpha 21364).
Ensuring the assets are "CAD-level accurate" has a huge impact on making this work in practice. So much so, that our collaborators Yash Narang [1] and Iretiayo Akinola [2] have spent a number of years on just this - we are standing on the shoulders of giants!
Additionally, understanding the hardware well (including things like motor and controller dynamics) is non-negotiable. We learned the hard way that there is, in fact, no free lunch. You really have to get the deep understanding of physics and engineering right.
[1] https://scholar.google.com/citations?user=M3NuG7AAAAAJ&hl=en [2] https://scholar.google.com/citations?user=e1zesfMAAAAJ&hl=en
It is not an Alphabet/Deepmind paper, and it also has nothing to do with the "NIST" OCR dataset.
Was there really not a more appropriate name than "AlphaNIST"?
Situation Soon: there are 15 trillion standards tailored to every possible situation.
Alpha historically had meant "Google DeepMind" not RL
(This whole thing is awesome. I think they will need to get the number of rollouts needed down before it translates well to real robots — running hundreds of thousands of rollouts on small parts with a real rollout will be a real logistical mess when cleaning up parts on the floor and dealing with everything that the robots physically break while learning.)
This means no need to do the rollouts on real robots first! Please check out https://sgs-rl.github.io for some transfer examples (albeit a simpler setting then the multi-part NIST board we examine in AlphaNIST).
You are giving me some inspiration, though, that it might be good to try to explain the related techniques in a lower-dimensional setting to help teach the concept more effectively! brb
In case somebody got the same question as me: the robot "sees" point clouds as input, so basically the full simulation state except for velocities (correct me if I'm wrong). As put in the limitations section, it "[does] not establish robustness to perception error, latency, or contact-model mismatch".
Alphanist - Some app/lib/code that does something
HN guidelines are to use the title of the blog post and not editorialize.