Quintiles are defined using the *entire* international PISA student pool. These figures allow us to compare equivalent SES cohorts across countries and to project how developing countries will perform as they get richer and improve schooling.
Pessimism of the Intellect, Optimism of the Will Favorite posts | Manifold podcast | Twitter: @hsu_steve
Wednesday, December 13, 2023
PISA 2023 and the Gloomy Prospect
Quintiles are defined using the *entire* international PISA student pool. These figures allow us to compare equivalent SES cohorts across countries and to project how developing countries will perform as they get richer and improve schooling.
Tuesday, October 10, 2023
SMPY 65: Help support the SMPY Longitudinal Study
The Study of Mathematically Precocious Youth (SMPY) needs your help to support the Age-65 phase of their unique longitudinal study.
• Prodigies destined for eminent careers can be identified as early as age 13.
• There is no plateau of ability; even within the top 1%, variations in mathematical, spatial, and verbal abilities profoundly impact educational, occupational, and creative outcomes.
• The blend of specific abilities, such as mathematical, spatial, and verbal aptitudes, shapes the nature of one's accomplishments and career trajectory.
More information:
Indicate "Please designate this gift to Study of Mathematically Precocious Youth" in the Special Instructions.
Thursday, October 05, 2023
Yasheng Huang: China's Examination System and its impact on Politics, Economy, Innovation — Manifold #45
Thursday, September 07, 2023
Meritocracy, SAT Scores, and Laundering Prestige at Elite Universities — Manifold #43
Thursday, December 15, 2022
Geoffrey Miller: Evolutionary Psychology, Polyamorous Relationships, and Effective Altruism — Manifold #26
Thursday, November 17, 2022
Abdel Abdellaoui: Genetics, Psychiatric Traits, and Educational Attainment — Manifold #24
Sunday, November 13, 2022
Smart Leftists vs Dumb Leftists
Smart Leftists vs Dumb Leftists:
— steve hsu (@hsu_steve) November 13, 2022
Who qualifies as former?
How about Soros, the top donor to the Democratic Party?
A few years ago I gave a talk on genomics (including of cognitive ability) to top leadership at Soros Fund Management.
Reaction: overwhelmingy positive 🤔 1/
Smart Leftists know things which they cannot admit in public.
— steve hsu (@hsu_steve) November 13, 2022
Dumb Leftists fight over these things like retards scuffling in the hallway.
2/
See, e.g., https://t.co/iiqc9TM5ue pic.twitter.com/IUIKp5Y60L
If you are not a billionaire, but want to know what I told the Soros people, see the talks I've given at Berkeley Innovative Genomics Institute, DeepMind, OpenAI, Janelia Farms (HHMI), Allen Institute, Cold Spring Harbor, etc.
— steve hsu (@hsu_steve) November 13, 2022
Links below. 3/https://t.co/xrvxOm1Ld4
Note, the forward looking statements I made in these talks - which were considered bold by the academic genomics community at the time - have almost all been proven correct. 4/https://t.co/vVq4m1Hr11https://t.co/bHYr7vfhdAhttps://t.co/ONdOKyDmQc
— steve hsu (@hsu_steve) November 13, 2022
The impact of progess in polygenic prediction is not confined to academic science.
— steve hsu (@hsu_steve) November 13, 2022
It is going to change how humans reproduce, and even the course of human evolution. 5/https://t.co/Z1fr1zMhD3 pic.twitter.com/iJx5yoZRaR
Tuesday, October 04, 2022
SAT score distributions in Michigan
The state of Michigan required all public HS seniors to take the SAT last year (~91k out of ~107k total seniors in the state). This generated an unusually representative score sample. Full report.
I'm aware of this stuff because my kids attend a public HS here.
To the uninformed, the results are shocking in a number of ways. Look specifically at the top band with scores in the 1400-1600 range. These are kids who have a chance at elite university admission, based on academic merit. For calibration, the University of Michigan median SAT score is above 1400, and at top Ivies it is around 1500.
Some remarks:
1. In the top band there are many more males than females.
2. The Asian kids are hitting the ceiling on this test.
3. There are very few students from under-represented groups who score in the top band.
4. By looking at the math score distribution (see full report) one can estimate how many students in each group are well-prepared enough to complete a rigorous STEM major -- e.g., pass calculus-based physics.
Previously I have estimated that PRC is outproducing the US in top STEM talent by a factor as large as 10x. In a decade or two the size of their highly skilled STEM workforce (e.g., top engineers, AI researchers, biotech scientists, ...) could be 10x as large as that of the US and comparable to the rest of the world, ex-China.
This is easy to understand: their base population is about 4x larger and their K12 performance on international tests like PISA is similar to what is found in the table above for the Asian category. The fraction of PRC kids who perform in the top band is probably at least several times larger than the overall US fraction. (Asian vs White in the table above is about 6x, or 7x on the math portion.) Also, the fraction of college students who major in STEM is much larger in PRC than in the US.
This table was produced by German professor Gunnar Heinsohn, who analyzes geopolitics and human capital.
Note, I will censor racist comments.
Wednesday, September 28, 2022
The Future of Human Evolution -- excerpts from podcast interview with Brian Chau
The transcript excerpts below are from my recent conversation with Brian Chau (aka Cactus Chu) on his podcast.
— steve hsu (@hsu_steve) September 28, 2022
Segments begin at 47m and 1h07m.
They have been lightly edited.https://t.co/RJ68FasfJchttps://t.co/TnSuNaxhnQ
Sunday, August 14, 2022
Tweet Treats: AI in PRC, Semiconductors and the Russian War Machine, Wordcels are Midwits
Tsinghua University (dad's alma mater) seems to be the only academic institution in the world keeping up with big corp labs like OpenAI, Google Brain / DeepMind, Baidu, etc. in large AI models.
— steve hsu (@hsu_steve) August 12, 2022
(NB: partnership with AI startup. Similar US examples?)https://t.co/lFjMBbVU7p pic.twitter.com/0il2R2iE2s
Wordcels (e.g., in policy or geostrategy) have mystical ideas re: at-scale AI research, mistakenly linking progress to lone geniuses / democracy / open society..
— steve hsu (@hsu_steve) August 12, 2022
They don't realize it's an engineering problem that requires *very* capable teams, but well within PRC capability 🤔
RUSI report: semiconductor content of Russian weapons. Snapshot below from conclusions.
— steve hsu (@hsu_steve) August 14, 2022
Miltech almost never uses leading edge (e.g., 7nm) chips. Much older e.g. 200nm process sufficient. RUS can source from PRC or use sanction evasion networks...https://t.co/ol5cpTPA0l pic.twitter.com/bdL4SqEn4f
I quote "expert" reports like this because wordcels / midwits can't reason from first principles.
— steve hsu (@hsu_steve) August 14, 2022
Right-tail obvious inferences which go against conventional wisdom ("sanctions will crush RUS economy and war machine!" "UKR will win!") need to be "sourced" from "real experts" 🤔
On midwits and wordcels: g factor depends on M,V,S. If only V is high while M,S are mediocre, implies total g is ony in midwit range even if V (ability to make vacuous but impressive sounding BS arguments) is exceptional.
— steve hsu (@hsu_steve) August 14, 2022
See Stephen J. Gould!https://t.co/958kZW7MIb pic.twitter.com/pqwQywyTWc
Yes. Chips RUS needs for weapons cost ~$1 these days & can be sourced widely. Plus PRC is on the verge of indigenous 7nm.
— steve hsu (@hsu_steve) August 14, 2022
Confusion reveals Dunning Kruger nature of our punditry and political (even strategic) leadership.
Plenty more strategic confusion:https://t.co/u2Zwk18z10 pic.twitter.com/ML4YXs0bbi
Saturday, July 16, 2022
Meritocracy and Political Leadership in China
In my conversation with @RichardHanania on his podcast we discussed meritocracy and political leadership in PRC. This short video gives a good overview of how it works. Keep in mind CCP ~ 100M people or ~10% of adult population! 1/4https://t.co/dgLrW25fM8
— steve hsu (@hsu_steve) July 16, 2022
PRC civil service exam appears highly g-loaded and is taken by 1-2M people each year. Further promotion depends on performance over ~20y timescale, purportedly monitored by a dedicated and independent I/O sub-org. 2/4https://t.co/W5YC2juWRI
— steve hsu (@hsu_steve) July 16, 2022
For example, Yuan Jiajun, frmr gov. of Zhejiang province and Central Committee member, is a PhD in Aero Eng and ran the manned spaceflight program. Resumes of top PRC leaders are qualitatively different from those of western politicians... 3/4https://t.co/CWqjnLdfyT
— steve hsu (@hsu_steve) July 16, 2022
Academic studies of how this all works yield conflicting results, see e.g. https://t.co/lFrLv7O7xJ
— steve hsu (@hsu_steve) July 16, 2022
However most people familiar with the process believe that the CPC *is trying* to promote meritocracy even at the highest levels of government. 4/4
Tuesday, May 03, 2022
How We Learned, Then Forgot, About Human Intelligence... And Witnessing the Live Breakdown of Academia (podcast interview with Cactus Chu)
Timestamps:
3:24 Interview Starts
15:49 Cactus' Experience with High Math People
19:49 High School Sports
21:26 Comparison to Intelligence
26:29 Is Lack of Understanding due to Denial or Ignorance?
29:29 The Past and Present of Selection in Academia
37:02 How Universities Look from the Inside
44:19 Informal Networks Replacing Credentials
48:37 Capture of Research Positions
50:24 Progressivism as Demagoguery Against the Self-Made
55:31 Innumeracy is Common
1:06:53 Understanding Innumerate People
1:13:53 Skill Alignment at Cactus' High School
1:18:12 Free Speech in Academia
1:21:00 You Shouldn't Fire Exceptional People
1:23:03 The Anti-Excellence Progressives
1:28:42 Rawls, Nozick, and Technology
1:34:00 Freedom = Variance = Inequality
1:37:58 Dating Apps
1:41:27 Jumping Into Social Problems From a Technical Background
1:41:50 Steve's High School Pranks
1:46:43 996 and Cactus' High School
1:50:26 The Vietnam War and Social Change
1:53:07 Are Podcasts the Future?
1:59:37 The Power of New Things
2:02:56 The Birth of Twitter
2:07:27 Selection Creates Quality
2:10:21 Incentives of University Departments
2:16:29 Woke Bureaucrats
2:27:59 Building a New University
2:30:42 What needs more order?
2:31:56 What needs more chaos?
@hsu_steve on innumerate journalists, professors, and politicians:
— Cactus Chu (@cactus_chu) May 3, 2022
"If you are not high [Math], you cannot reason from statistical data" pic.twitter.com/N3glUITCXH
Monday, March 14, 2022
"The Pressure to Conform is Enormous": Steve Hsu on Affirmative Action, Assimilation and IQ Outliers (CSPI Podcast with Richard Hanania)
Full transcript at Richard's substack.Begin: American society, growing up as child of immigrants18m: Russia-Ukraine conflict (eve of invasion), geopolitical implications (China, India, Germany, EU)38m: Affirmative Action, Harvard case at SCOTUS54m: Woke leftists at the university, destruction of meritocracy, STEM vs Social Justice advocacy, Sokal Hoax1h25m: Academic economics, 2008 credit crisis, Do economists test theories?1h33m: Maverick thinking, Agreeableness, Aspergers, Pressure to conform1h39m: Far-tail intelligence, Jeff Bezos and physics, progress in science and technology
Saturday, February 05, 2022
Annals of Psychometry: Wordcels and Shape Rotators
It is nothing more than the calculus of words.Yet there are people who have nothing more than the calculus of words with which to build their models of the world. See Bounded Cognition, and Oppenheimer:
Mathematics is "an immense enlargement of language, an ability to talk about things which in words would be simply inaccessible."
There are many verbally gifted writers and speakers that, when pressed to visualize some math problem in their mind's eye, must helplessly watch their normally high-octane intelligence sputter and fail. They often write or talk at a blistering clip, and can navigate complex mazes of abstractions — and yet, when it comes time to make contact with the real world or accomplish practical tasks, they may be helpless. They'll do great in English class, and terrible in Physics. They can be very fun to listen to due to their terrifying leaps in logic and the exceptional among them will be natural leaders.
The wordcel moniker describes more than just one’s level of verbal skill: it’s also a socioeconomic classifier that refers to people whose verbal ability borders on self-sabotage (thus the “-cel”). Perhaps they’re driven mad by political rage, postmodernism, and disconnection from reality. It might refer to the priestly figures who work in the culture factories of the New York Times with their incomes and social prestige both precipitously declining only for the unperturbed masses on the internet to tell them in unison: “learn to code”! There’s even an implication that these folks are entirely rent-seekers (wrong, but directionally interesting).
...
The shape rotators have been a minor force until very recent history. Though they’ve produced a significant portion of human progress through feats of engineering excellence, they were rarely celebrated until the dawn of the Enlightenment, perhaps 500 years ago. While the long-lasting glory of the Roman aqueducts is renowned to this day, nobody knows the chief engineer behind the project (probably Marcus Vipsanius Agrippa, but who’s counting). Today their stock is climbing to the moon. The world’s richest (self-made) men are almost uniformly engineers, computer scientists, or physicists. Vast portions of society that in a prior age might have been organized by government bureaucrats or private sector shot-callers have been handed over to cybernetic self-organizing systems designed and run by mathematical wizards. We have been witness to the slow, and then rapid transfer of power from the smooth-talking Don Drapers of boardroom acclaim to the multi-armed bandits of Facebook Ads.
It’s clear that these big tech CEOs are verbally gifted, but by affinity and by practice they are in the rotator camp. Elon continually attributes his success to studying physics in college. Zuck programmed the original iteration of Facebook himself. Larry & Sergei did an entire PhD in linear algebra based information retrieval, a platonic ideal of shape rotation. Of the ten largest companies in the world, several are driven by fundamental technical breakthroughs. Society at large seems to respect and fear the forces of technology more and more as its cultural and financial capital rises.
This figure displays the math, verbal and spatial scores of gifted children tested at age 12, and their eventual college majors and career choices. This group is cohort 2 of the SMPY/SVPY study: each child scored better than 99.5 percentile on at least one of the M-V sections of the SAT.3. There are systematic differences in cognitive abilities and profiles in different fields (business, medicine, engineering, physics, etc.)

Scores are normalized in units of SDs, within this cohort of gifted children. (So above and below average are defined with respect to the gifted population of >99th percentile kids, not relative to the general population.) The vertical axis is V, the horizontal axis is M, and the length of the arrow reflects spatial ability: pointing to the right means above the group average, to the left means below average; note the arrow for business majors should be twice as long as indicated but there was not enough space on the diagram. The spatial score is obviously correlated with the M score. More data here.
SMPY helps to establish a number of important facts about individuals of high ability:
1. We can (at least crudely) differentiate between individuals at the 99th, 99.9th and 99.99th percentiles. Exceptional talent can be identified through testing, even at age 13.
2. Probability of significant accomplishment, such as STEM PhD, patents awarded, tenure at leading research university, exceptional income, etc. continues to rise as ability level increases, even within the top 1%.
3. There are systematic differences in cognitive abilities and profiles in different fields (business, medicine, engineering, physics, etc.)
4. Men and women of exceptional ability differ in life aspirations and preferences.
No one can claim to understand high level human capital, technological innovation, scientific progress, or exceptional achievement without first familiarizing themselves with these results.
Needless to say, I think this Research Associate position will entail important and fascinating work.
Research Associate:Some relevant figures based on SMPY results of Lubinski, Benbow, and collaborators. See links above for more discussion of the data displayed.
The Study of Mathematically Precocious Youth (SMPY) seeks a full-time post-doctoral Research Associate for study oversight, conducting research, writing articles, laboratory management, and statistical analyses using the vast SMPY data base. SMPY is a four-decade longitudinal study consisting of 5 cohorts and over 5,000 intellectually talented participants. One chief responsibility of this position will be to manage laboratory details associated with launching an age-50 follow-up of two of SMPY’s most exceptional cohorts: a cohort of 500 profoundly gifted participants initially identified by age 13 in the early 1980s, and a second cohort of over 700 top STEM graduate students identified and psychologically profiled in 1992 as first- and second-year graduate students. Candidates with interests in assessing individual differences, talent development, and particularly strong statistical-technical skills are preferred. Send vitae, cover letter stating interests, (pre)reprints, and three letters of recommendation to: Dean Camilla P. Benbow, Department of Psychology & Human Development, 0552 Peabody College, Vanderbilt University, Nashville, TN, 37203. The position will remain open until a qualified applicant is selected. For additional information, please contact either co-director: Camilla P. Benbow, camilla.benbow@vanderbilt.edu, or David Lubinski, david.lubinski@vanderbilt.edu.
http://www.vanderbilt.edu/Peabody/SMPY/. Vanderbilt University is an Equal Opportunity/Affirmative Action Employer.
We are aiming for a June 30th start date but that’s flexible.
Monday, January 10, 2022
Recent Papers on Socio-Economic Status and Student Achievement: Marks and O'Connell
Dear Scholar,There is a widely-held perception that many of life’s key outcomes are fundamentally driven by people’s socio-economic status (SES). More specifically, there is a view that children’s educational attainment is largely a by-product of their familial SES. As a consequence of this pervasive paradigm, much of the energy in seeking to ameliorate or resolve poor educational attainment is based around trying to use SES as a social lever.However, in the six papers listed below, published between 2019-2022, evidence has been gathered demonstrating that SES is only very modestly correlated with educational attainment. Furthermore, once a child’s cognitive ability is taken into account, even the modest link between SES and attainment diminishes to slight influence. This is true of datasets drawn from international groups of young people, as well as those from the US, UK, or Ireland. Future attempts to aid and study young people experiencing difficulty with educational attainment should be built on an awareness of the limited role of SES.Gary N Marks Michael O’Connell1. O’Connell, M. and Marks, G.N. (2022)
Cognitive ability and conscientiousness are more important than SES for educational attainment: An analysis of the UK Millennium Cohort Study
Personality and Individual Differences, 188
https://doi.org/10.1016/j.paid.2021.111471
Highlights Antecedents of educational attainment of great interest Dominant paradigm focuses on SES of children. Cognitive ability and conscientiousness have stronger record in research findings. Using new UK MCS longitudinal survey data, GCSE state exam performance assessed Cognitive ability and conscientiousness explained far more than SES measures
2. Marks, G. N. (2021)
Is the relationship between socioeconomic status (SES) and student achievement causal? Considering student and parent abilities
Educational Research and Evaluation, 10.1080/13803611.2021.1968442: 1-24.
Abstract Most studies on the relationship between students’ socioeconomic status (SES) and student achievement assume that its effects are sizable and causal. A large variety of theoretical explanations have been proposed. However, the SES–achievement association may reflect, to some extent, the inter-relationships of parents’ abilities, SES, children’s abilities, and student achievement. The purpose of this study is to quantify the role of SES vis-à-vis child and parents’ abilities, and prior achievement. Analyses of a covariance matrix that includes supplementary correlations for fathers and mothers’ abilities derived from the literature indicate that more than half of the SES–achievement association can be accounted for by parents’ abilities. SES coefficients decline further with the addition of child’s abilities. With the addition of prior achievement, the SES coefficients are trivial implying that SES has little or no contemporaneous effects. These findings are not compatible with standard theoretical explanations for SES inequalities in achievement.
3. Marks, G. N. and O’Connell, M. (2021)
No Evidence for Cumulating Socioeconomic Advantage. Ability Explains Increasing SES Effects with Age on Children’s Domain Test scores
Intelligence, 88
https://doi.org/10.1016/j.intell.2021.101582
Highlights Data analysed for five domains for children of the NLSY79 mothers study. SES effects increase for only some domains and not substantially. No increase in SES effects when considering mother's or children's prior ability. Effects of child's prior ability on test scores increase substantially with age. SES effects are small net of mother's ability.
4. Marks, G. N. and O'Connell, M. (2021)
Inadequacies in the SES–Achievement model: Evidence from PISA and other studies
Review of Education, 9(3): e3293.
https://doi.org/10.1002/rev3.3293
Abstract Students’ socioeconomic status (SES) is central to much research and policy deliberation on educational inequalities. However, the SES model is under severe stress for several reasons. SES is an ill-defined concept, unlike parental education or family income. SES measures are frequently based on proxy reports from students; these are generally unreliable, sometimes endogenous to student achievement, only low to moderately intercorrelated, and exhibit low comparability across countries and over time. There are many explanations for SES inequalities in education, none of which achieves consensus among research and policy communities. SES has only moderate effects on student achievement, and its effects are especially weak when considering prior achievement, an important and relevant predictor. SES effects are substantially reduced when considering parent ability, which is causally prior to family SES. The alternative cognitive ability/genetic transmission model has far greater explanatory power; it provides logical and compelling explanations for a wide range of empirical findings from student achievement studies. The inadequacies of the SES model are hindering knowledge accumulation about student performance and the development of successful policies.
5. O'Connell, M. and Marks, G. N. (2021)
Are the effects of intelligence on student achievement and well-being largely functions of family income and social class? Evidence from a longitudinal study of Irish adolescents
Intelligence, 84: 101511. 10.1016/j.intell.2020.101511
Highlights Power of cognitive ability and social class contrasted. Large representative sample from longitudinal study, waves 1–3, of 6216 children Outcomes were attainments, difficulties and relationships. Cognitive ability explained large amounts of variance. Social background only minor effects
6. O'Connell, M. (2019)
Is the impact of SES on educational performance overestimated? Evidence from the PISA survey
Intelligence, 75: 41-47
https://doi.org/10.1016/j.intell.2019.04.005
Highlights Policy-makers overly attribute differences in educational performance to SES. PISA survey used to assess roles of parental education and household income. Combining them concealed differences in outcomes between rich and poor countries. Household income important in poor countries, parental education in rich countries.
Tuesday, September 07, 2021
Kathryn Paige Harden Profile in The New Yorker (Behavior Genetics)
Can Progressives Be Convinced That Genetics Matters?
The behavior geneticist Kathryn Paige Harden is waging a two-front campaign: on her left are those who assume that genes are irrelevant, on her right those who insist that they’re everything.
Gideon Lewis-KrausGideon Lewis-Kraus is a talented writer who also wrote a very nice article on the NYTimes / Slate Star Codex hysteria last summer.
1. The paper Harden was attacked for sharing while a visiting scholar at the Russell Sage Foundation: Game Over: Genomic Prediction of Social Mobility2. Harden's paper on polygenic scores and mathematics progression in high school: Genomic prediction of student flow through high school math curriculum3. Vox article; Turkheimer and Harden drawn into debate including Charles Murray and Sam Harris: Scientific Consensus on Cognitive Ability?
On the genetic architecture of intelligence and other quantitative traits
https://arxiv.org/abs/1408.3421
How do genes affect cognitive ability or other human quantitative traits such as height or disease risk? Progress on this challenging question is likely to be significant in the near future. I begin with a brief review of psychometric measurements of intelligence, introducing the idea of a "general factor" or g score. The main results concern the stability, validity (predictive power), and heritability of adult g. The largest component of genetic variance for both height and intelligence is additive (linear), leading to important simplifications in predictive modeling and statistical estimation. Due mainly to the rapidly decreasing cost of genotyping, it is possible that within the coming decade researchers will identify loci which account for a significant fraction of total g variation. In the case of height analogous efforts are well under way. I describe some unpublished results concerning the genetic architecture of height and cognitive ability, which suggest that roughly 10k moderately rare causal variants of mostly negative effect are responsible for normal population variation. Using results from Compressed Sensing (L1-penalized regression), I estimate the statistical power required to characterize both linear and nonlinear models for quantitative traits. The main unknown parameter s (sparsity) is the number of loci which account for the bulk of the genetic variation. The required sample size is of order 100s, or roughly a million in the case of cognitive ability.The predictions in my 2012 BGA talk and in the 2014 review article above have mostly been validated. Research advances often pass through the following phases of reaction from the scientific community:
1. It's wrong ("genes don't affect intelligence! anyway too complex to figure out... we hope")
2. It's trivial ("ofc with lots of data you can do anything... knew it all along")
3. I did it first ("please cite my important paper on this")Or, as sometimes attributed to Gandhi: "First they ignore you, then they laugh at you, then they fight you, then you win.”
Sunday, April 18, 2021
Francois Chollet - Intelligence and Generalization, Psychometrics for Robots (AI/ML)
Show Notes:
...Francois has a clarity of thought that I've never seen in any other human being! He has extremely interesting views on intelligence as generalisation, abstraction and an information conversation ratio. He wrote on the measure of intelligence at the end of 2019 and it had a huge impact on my thinking. He thinks that NNs can only model continuous problems, which have a smooth learnable manifold and that many "type 2" problems which involve reasoning and/or planning are not suitable for NNs. He thinks that many problems have type 1 and type 2 enmeshed together. He thinks that the future of AI must include program synthesis to allow us to generalise broadly from a few examples, but the search could be guided by neural networks because the search space is interpolative to some extent.
Tim Intro [00:00:00]
Manifold hypothesis and interpolation [00:06:15]
Yann LeCun skit [00:07:58]
Discrete vs continuous [00:11:12]
NNs are not turing machines [00:14:18]
Main show kick-off [00:16:19]
DNN models are locally sensitive hash tables and only efficiently encode some kinds of data well [00:18:17]
Why do natural data have manifolds? [00:22:11]
Finite NNs are not "turing complete" [00:25:44]
The dichotomy of continuous vs discrete problems, and abusing DL to perform the former [00:27:07]
Reality really annoys a lot of people, and ...GPT-3 [00:35:55]
There are type one problems and type 2 problems, but...they are enmeshed [00:39:14]
Chollet's definition of intelligence and how to construct analogy [00:41:45]
How are we going to combine type 1 and type 2 programs? [00:47:28]
Will topological analogies be robust and escape the curse of brittleness? [00:52:04]
Is type 1 and 2 two different physical systems? Is there a continuum? [00:54:26]
Building blocks and the ARC Challenge [00:59:05]
Solve ARC == intelligent? [01:01:31]
Measure of intelligence formalism -- it's a whitebox method [01:03:50]
Generalization difficulty [01:10:04]
Lets create a marketplace of generated intelligent ARC agents! [01:11:54]
Mapping ARC to psychometrics [01:16:01]
Keras [01:16:45]
New backends for Keras? JAX? [01:20:38]
Intelligence Explosion [01:25:07]
Bottlenecks in large organizations [01:34:29]
Summing up the intelligence explosion [01:36:11]
Post-show debrief [01:40:45]
On the Measure of Intelligence
François Chollet
https://arxiv.org/abs/1911.01547
To make deliberate progress towards more intelligent and more human-like artificial systems, we need to be following an appropriate feedback signal: we need to be able to define and evaluate intelligence in a way that enables comparisons between two systems, as well as comparisons with humans. Over the past hundred years, there has been an abundance of attempts to define and measure intelligence, across both the fields of psychology and AI. We summarize and critically assess these definitions and evaluation approaches, while making apparent the two historical conceptions of intelligence that have implicitly guided them. We note that in practice, the contemporary AI community still gravitates towards benchmarking intelligence by comparing the skill exhibited by AIs and humans at specific tasks such as board games and video games. We argue that solely measuring skill at any given task falls short of measuring intelligence, because skill is heavily modulated by prior knowledge and experience: unlimited priors or unlimited training data allow experimenters to "buy" arbitrary levels of skills for a system, in a way that masks the system's own generalization power. We then articulate a new formal definition of intelligence based on Algorithmic Information Theory, describing intelligence as skill-acquisition efficiency and highlighting the concepts of scope, generalization difficulty, priors, and experience. Using this definition, we propose a set of guidelines for what a general AI benchmark should look like. Finally, we present a benchmark closely following these guidelines, the Abstraction and Reasoning Corpus (ARC), built upon an explicit set of priors designed to be as close as possible to innate human priors. We argue that ARC can be used to measure a human-like form of general fluid intelligence and that it enables fair general intelligence comparisons between AI systems and humans.Notes on the paper by Robert Lange (TU-Berlin), including illustrations like the ones below.
Sunday, March 21, 2021
The Contribution of Cognitive and Noncognitive Skills to Intergenerational Social Mobility (McGue et al. 2020)
The Contribution of Cognitive and Noncognitive Skills to Intergenerational Social Mobility
(Psychological Science https://doi.org/10.1177/0956797620924677)
Matt McGue, Emily A. Willoughby, Aldo Rustichini, Wendy Johnson, William G. Iacono, James J. Lee
We investigated intergenerational educational and occupational mobility in a sample of 2,594 adult offspring and 2,530 of their parents. Participants completed assessments of general cognitive ability and five noncognitive factors related to social achievement; 88% were also genotyped, allowing computation of educational-attainment polygenic scores. Most offspring were socially mobile. Offspring who scored at least 1 standard deviation higher than their parents on both cognitive and noncognitive measures rarely moved down and frequently moved up. Polygenic scores were also associated with social mobility. Inheritance of a favorable subset of parent alleles was associated with moving up, and inheritance of an unfavorable subset was associated with moving down. Parents’ education did not moderate the association of offspring’s skill with mobility, suggesting that low-skilled offspring from advantaged homes were not protected from downward mobility. These data suggest that cognitive and noncognitive skills as well as genetic factors contribute to the reordering of social standing that takes place across generations.From the paper:
We believe that a reasonable explanation of our findings is that the degree to which individuals are more or less skilled than their parents contributes to their upward or downward mobility. Behavioral genetic and genomic research has established the heritability of social achievements (Conley, 2016) as well as the skills thought to underlie them (Bouchard & McGue, 2003). Nonetheless, these associations may be due to passive gene–environment correlation, whereby high-achieving parents both transmit genes and provide a rearing environment that promotes their children’s social success (Scarr & McCartney, 1983). Our within-family design controlled for passive gene–environment correlation effects. Although offspring inherit all of their genes from their parents, they inherit a random subset of parental alleles because of meiotic segregation. Consequently, some offspring inherit a favorable subset of their parents’ alleles, whereas others inherit a less favorable subset. We found, as did previous researchers (Belsky et al., 2018), that the inheritance of a favorable subset of alleles was associated with an increased likelihood of upward mobility...
...In summary, our analysis of intergenerational social mobility in a sample of 2,594 offspring from 1,321 families found that (a) most individuals were educationally and occupationally mobile, (b) mobility was predicted by offspring–parent differences in skills and genetic endowment, and (c) the relationship of offspring skills with social mobility did not vary significantly by parent social background. In an era in which there is legitimate concern over social stagnation, our findings are noteworthy in identifying the circumstances when parents’ educational and occupational success is not reproduced across generations.
Thursday, May 21, 2020
University of California to end use of SAT and ACT
This decision by the UC Regents (most of whom are political appointees) is counter to the recommendation of the faculty task force recently assigned to study standardized testing in admissions. It is obvious to anyone who looks at the graphs below that SAT/ACT have significant validity (technical term used in psychometrics) in predicting college performance for all ethnic groups.
See Report of the University of California Academic Council Standardized Testing Task Force for more.
... SAT and HSGPA are stronger predictors than family income or race. Within each of the family income or ethnicity categories there is substantial variation in SAT and HSGPA, with corresponding differences in student success. See bottom figure and combined model R^2 in second figure below; R^2 varies very little across family income and ethnic categories. ...
Test Preparation and SAT scores: "...combined effect of coaching on the SAT I is between 21 and 34 points. Similarly, extensive meta-analyses conducted by Betsy Jane Becker in 1990 and by Nan Laird in 1983 found that the typical effect of commercial preparatory courses on the SAT was in the range of 9-25 points on the verbal section, and 15-25 points on the math section."
Tuesday, February 04, 2020
Report of the University of California Academic Council Standardized Testing Task Force
Some remarks:
1. SAT and High School GPA (HSGPA) are both useful (and somewhat independent) predictors of college success. In terms of variance accounted for, we have the inequality:
SAT + HSGPA > SAT > HSGPA
There are some small deviations from this pattern, but it seems to hold overall. I believe that GPA has a relatively larger loading on conscientiousness (work ethic) than cognitive ability, with SAT the other way around. By combining the two we get more information than from either alone.
2. SAT and HSGPA are stronger predictors than family income or race. Within each of the family income or ethnicity categories there is substantial variation in SAT and HSGPA, with corresponding differences in student success. See bottom figure and combined model R^2 in second figure below; R^2 varies very little across family income and ethnic categories.
There is not much new here. In graduate admissions the undergraduate GPA and the GRE general + subject tests play a role similar to HSGPA and SAT. See GRE and SAT Validity.
See Correlation and Variance to understand better what the R^2 numbers above mean. R^2 ~ 0.26 means the correlation between predictor and outcome variable (e.g., freshman GPA) is R ~ 0.5 or so.
Test Preparation and SAT scores: "...combined effect of coaching on the SAT I is between 21 and 34 points. Similarly, extensive meta-analyses conducted by Betsy Jane Becker in 1990 and by Nan Laird in 1983 found that the typical effect of commercial preparatory courses on the SAT was in the range of 9-25 points on the verbal section, and 15-25 points on the math section."
Blog Archive
Labels
- physics (420)
- genetics (325)
- globalization (301)
- genomics (295)
- technology (282)
- brainpower (280)
- finance (275)
- american society (261)
- China (249)
- innovation (231)
- ai (206)
- economics (202)
- psychometrics (190)
- science (172)
- psychology (169)
- machine learning (166)
- biology (163)
- photos (162)
- genetic engineering (150)
- universities (150)
- travel (144)
- podcasts (143)
- higher education (141)
- startups (139)
- human capital (127)
- geopolitics (124)
- credit crisis (115)
- political correctness (108)
- iq (107)
- quantum mechanics (107)
- cognitive science (103)
- autobiographical (97)
- politics (93)
- careers (90)
- bounded rationality (88)
- social science (86)
- history of science (85)
- realpolitik (85)
- statistics (83)
- elitism (81)
- talks (80)
- evolution (79)
- credit crunch (78)
- biotech (76)
- genius (76)
- gilded age (73)
- income inequality (73)
- caltech (68)
- books (64)
- academia (62)
- history (61)
- intellectual history (61)
- MSU (60)
- sci fi (60)
- harvard (58)
- silicon valley (58)
- mma (57)
- mathematics (55)
- education (53)
- video (52)
- kids (51)
- bgi (48)
- black holes (48)
- cdo (45)
- derivatives (43)
- neuroscience (43)
- affirmative action (42)
- behavioral economics (42)
- economic history (42)
- literature (42)
- nuclear weapons (42)
- computing (41)
- jiujitsu (41)
- physical training (40)
- film (39)
- many worlds (39)
- quantum field theory (39)
- expert prediction (37)
- ufc (37)
- bjj (36)
- bubbles (36)
- mortgages (36)
- google (35)
- race relations (35)
- hedge funds (34)
- security (34)
- von Neumann (34)
- meritocracy (31)
- feynman (30)
- quants (30)
- taiwan (30)
- efficient markets (29)
- foo camp (29)
- movies (29)
- sports (29)
- music (28)
- singularity (27)
- entrepreneurs (26)
- conferences (25)
- housing (25)
- obama (25)
- subprime (25)
- venture capital (25)
- berkeley (24)
- epidemics (24)
- war (24)
- wall street (23)
- athletics (22)
- russia (22)
- ultimate fighting (22)
- cds (20)
- internet (20)
- new yorker (20)
- blogging (19)
- japan (19)
- scifoo (19)
- christmas (18)
- dna (18)
- gender (18)
- goldman sachs (18)
- university of oregon (18)
- cold war (17)
- cryptography (17)
- freeman dyson (17)
- smpy (17)
- treasury bailout (17)
- algorithms (16)
- autism (16)
- personality (16)
- privacy (16)
- Fermi problems (15)
- cosmology (15)
- happiness (15)
- height (15)
- india (15)
- oppenheimer (15)
- probability (15)
- social networks (15)
- wwii (15)
- fitness (14)
- government (14)
- les grandes ecoles (14)
- neanderthals (14)
- quantum computers (14)
- blade runner (13)
- chess (13)
- hedonic treadmill (13)
- nsa (13)
- philosophy of mind (13)
- research (13)
- aspergers (12)
- climate change (12)
- harvard society of fellows (12)
- malcolm gladwell (12)
- net worth (12)
- nobel prize (12)
- pseudoscience (12)
- Einstein (11)
- art (11)
- democracy (11)
- entropy (11)
- geeks (11)
- string theory (11)
- television (11)
- Go (10)
- ability (10)
- complexity (10)
- dating (10)
- energy (10)
- football (10)
- france (10)
- italy (10)
- mutants (10)
- nerds (10)
- olympics (10)
- pop culture (10)
- crossfit (9)
- encryption (9)
- eugene (9)
- flynn effect (9)
- james salter (9)
- simulation (9)
- tail risk (9)
- turing test (9)
- alan turing (8)
- alpha (8)
- ashkenazim (8)
- data mining (8)
- determinism (8)
- environmentalism (8)
- games (8)
- keynes (8)
- manhattan (8)
- new york times (8)
- pca (8)
- philip k. dick (8)
- qcd (8)
- real estate (8)
- robot genius (8)
- success (8)
- usain bolt (8)
- Iran (7)
- aig (7)
- basketball (7)
- free will (7)
- fx (7)
- game theory (7)
- hugh everett (7)
- inequality (7)
- information theory (7)
- iraq war (7)
- markets (7)
- paris (7)
- patents (7)
- poker (7)
- teaching (7)
- vietnam war (7)
- volatility (7)
- anthropic principle (6)
- bayes (6)
- class (6)
- drones (6)
- econtalk (6)
- empire (6)
- global warming (6)
- godel (6)
- intellectual property (6)
- nassim taleb (6)
- noam chomsky (6)
- prostitution (6)
- rationality (6)
- academia sinica (5)
- bobby fischer (5)
- demographics (5)
- fake alpha (5)
- kasparov (5)
- luck (5)
- nonlinearity (5)
- perimeter institute (5)
- renaissance technologies (5)
- sad but true (5)
- software development (5)
- solar energy (5)
- warren buffet (5)
- 100m (4)
- Poincare (4)
- assortative mating (4)
- bill gates (4)
- borges (4)
- cambridge uk (4)
- censorship (4)
- charles darwin (4)
- computers (4)
- creativity (4)
- hormones (4)
- humor (4)
- judo (4)
- kerviel (4)
- microsoft (4)
- mixed martial arts (4)
- monsters (4)
- moore's law (4)
- soros (4)
- supercomputers (4)
- trento (4)
- 200m (3)
- babies (3)
- brain drain (3)
- charlie munger (3)
- cheng ting hsu (3)
- chet baker (3)
- correlation (3)
- ecosystems (3)
- equity risk premium (3)
- facebook (3)
- fannie (3)
- feminism (3)
- fst (3)
- intellectual ventures (3)
- jim simons (3)
- language (3)
- lee kwan yew (3)
- lewontin fallacy (3)
- lhc (3)
- magic (3)
- michael lewis (3)
- mit (3)
- nathan myhrvold (3)
- neal stephenson (3)
- olympiads (3)
- path integrals (3)
- risk preference (3)
- search (3)
- sec (3)
- sivs (3)
- society generale (3)
- systemic risk (3)
- thailand (3)
- twitter (3)
- alibaba (2)
- bear stearns (2)
- bruce springsteen (2)
- charles babbage (2)
- cloning (2)
- david mamet (2)
- digital books (2)
- donald mackenzie (2)
- drugs (2)
- dune (2)
- exchange rates (2)
- frauds (2)
- freddie (2)
- gaussian copula (2)
- heinlein (2)
- industrial revolution (2)
- james watson (2)
- ltcm (2)
- mating (2)
- mba (2)
- mccain (2)
- monkeys (2)
- national character (2)
- nicholas metropolis (2)
- no holds barred (2)
- offices (2)
- oligarchs (2)
- palin (2)
- population structure (2)
- prisoner's dilemma (2)
- singapore (2)
- skidelsky (2)
- socgen (2)
- sprints (2)
- star wars (2)
- ussr (2)
- variance (2)
- virtual reality (2)
- war nerd (2)
- abx (1)
- anathem (1)
- andrew lo (1)
- antikythera mechanism (1)
- athens (1)
- atlas shrugged (1)
- ayn rand (1)
- bay area (1)
- beats (1)
- book search (1)
- bunnie huang (1)
- car dealers (1)
- carlos slim (1)
- catastrophe bonds (1)
- cdos (1)
- ces 2008 (1)
- chance (1)
- children (1)
- cochran-harpending (1)
- cpi (1)
- david x. li (1)
- dick cavett (1)
- dolomites (1)
- eharmony (1)
- eliot spitzer (1)
- escorts (1)
- faces (1)
- fads (1)
- favorite posts (1)
- fiber optic cable (1)
- francis crick (1)
- gary brecher (1)
- gizmos (1)
- greece (1)
- greenspan (1)
- hypocrisy (1)
- igon value (1)
- iit (1)
- inflation (1)
- information asymmetry (1)
- iphone (1)
- jack kerouac (1)
- jaynes (1)
- jazz (1)
- jfk (1)
- john dolan (1)
- john kerry (1)
- john paulson (1)
- john searle (1)
- john tierney (1)
- jonathan littell (1)
- las vegas (1)
- lawyers (1)
- lehman auction (1)
- les bienveillantes (1)
- lowell wood (1)
- lse (1)
- machine (1)
- mcgeorge bundy (1)
- mexico (1)
- michael jackson (1)
- mickey rourke (1)
- migration (1)
- money:tech (1)
- myron scholes (1)
- netwon institute (1)
- networks (1)
- newton institute (1)
- nfl (1)
- oliver stone (1)
- phil gramm (1)
- philanthropy (1)
- philip greenspun (1)
- portfolio theory (1)
- power laws (1)
- pyschology (1)
- randomness (1)
- recession (1)
- sales (1)
- skype (1)
- standard deviation (1)
- starship troopers (1)
- students today (1)
- teleportation (1)
- tierney lab blog (1)
- tomonaga (1)
- tyler cowen (1)
- venice (1)
- violence (1)
- virtual meetings (1)
- wealth effect (1)