synquid | 2 years ago | on: Show HN: Flash Attention in ~100 lines of CUDA
Triton has an AMD backend, although work is still ongoing.
synquid's comments
synquid | 4 years ago | on: A modern self-referential weight matrix that learns to modify itself
Schmidhuber has written about recursive self-improvement since his diploma thesis in the 80s: "Evolutionary principles in self-referential learning, or on learning how to learn: The meta-meta-... hook".
Your quote sounds like it could just as well have been from that thesis.
synquid | 4 years ago | on: Russian forces invade Ukraine after Putin orders attack
Poland will definitely accept them, they have publicly stated so.
synquid | 4 years ago | on: What the Omicron wave is revealing about human immunity
Myocarditis isn't that dangerous, it's acute and can be managed. Infection is much more risky.
synquid | 4 years ago | on: Ireland drops most Covid restrictions in wake of 'Omicron storm'
I wish that people who say things like "learn to live with it" actually meant it. We do indeed need to learn from the past two years, and that will result in something quite different from pretending that we're still in 2019.
synquid | 4 years ago | on: Scientists believed Covid leaked from Wuhan lab, but feared debate could hurt
Zeynep has been wrong so many times during the pandemic that it hurts. She will not admit to it, though. She claimed that the Delta variant would end the pandemic, in the same way it is claimed for Omicron now. She's very naive about how the immune system works.
Her writing is generally more propaganda than science.
synquid | 4 years ago | on: To Understand Language Is to Understand Generalization
This seems very similar to the research program led by the late Patrick Henry Winton: https://groups.csail.mit.edu/genesis/index.html
Besides, I wish that causality had been mentioned more than once in passing. Due to the existence of the ladder of causality, many important queries cannot be answered by mere observation, or even by intervention; such queries require counterfactual reasoning, and structural causal models generalize because they describe something that is very invariant in the world.
synquid | 4 years ago | on: U.S. Kids Are Getting Nearly 70% of Their Calories from 'Ultra-Processed' Foods
They're processed foods, but not ultra-processed. Generally that means advanced factory processes and chemicals that are only used in industrial settings. Factory made bread is likely to be ultra-processed, however.
synquid | 4 years ago | on: Tortured phrases: A dubious writing style emerging in science
The smog is just the Chinese cloud.
synquid | 4 years ago | on: Where has all the productivity gone?
Sounds like a case of Goodhart's law,
"Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes."
synquid | 4 years ago | on: Software engineering research is a train wreck
Semantic Scholar exists, and does a decent job mostly, in my opinion.
synquid | 4 years ago | on: Cancer risks increase with alcohol use, leading to over 740k cases last year
If heavy consumers under-reported in an observational study, that would make drinking less seem worse than it really is.
synquid | 4 years ago | on: Cancer risks increase with alcohol use, leading to over 740k cases last year
But that amount is based on available research, so what is your point? See e.g. https://www.jacc.org/doi/full/10.1016/j.jacc.2017.07.710
synquid | 4 years ago | on: Cancer risks increase with alcohol use, leading to over 740k cases last year
https://www.jacc.org/doi/10.1016/j.jacc.2017.06.054
What do you make of studies such as this? Their baseline was strictly lifetime abstainers, absolutely no people who stopped drinking for medical reasons. Still, moderate drinking results in lower all-cause mortality.
synquid | 4 years ago | on: Cancer risks increase with alcohol use, leading to over 740k cases last year
Lowering your expected lifetime probably also lowers your expected time until disease.
synquid | 4 years ago | on: Cancer risks increase with alcohol use, leading to over 740k cases last year
This is a very uneducated comment, considering available research. While some doubt can be cast on the J-shaped curve, we have a lot of evidence for all-cause mortality either decreasing or at least not increasing with low levels of consumption.
synquid | 4 years ago | on: NSA spying row: Denmark helped US gather data on European officials, says report
That sounds about right, as I read it. The sources seem to be 9 (former?) employees, confirming a classified internal report from 2015.
page 1