Showing posts with label technology. Show all posts
Showing posts with label technology. Show all posts

Thursday, April 04, 2024

Casey Handmer: Terraform Industries and a Carbon-Neutral Future — Manifold #57

 

Casey Handmer (PhD Caltech, general relativity) is the founder of Terraform Industries. He is one of the most capable and ambitious geo-engineers on planet Earth! 

Terraform Industries is scaling technology to produce cheap natural gas with sunlight and air. Using solar energy, they extract carbon from the air and synthesize natural gas, all at the same site. 

March 2024: "Terraform completes the end to end demo, successfully producing fossil carbon free pipeline grade natural gas from sunlight and air. We also achieved green hydrogen at <$2.50/kg-H2 and DAC CO2 at <$250/T-CO2, two incredible milestones." 

Links: 

Casey Handmer’s website: https://www.caseyhandmer.com/ 

Terraform Industries: https://terraformindustries.com/ 

Nerds on Patrol [Episode 3] - Terraform Industries: 

Steve and Casey discuss: 

0:00 Introduction 
00:31 Casey's early life and background, from Australia to Caltech 
07:55 The academic path and transition to tech entrepreneurship 10:40 Terraform Industries 
15:21 Solar costs, efficiency, and global Impact 
24:25 A world powered by Terraform methane 
31:27 The entrepreneurial journey: challenges and insights 
35:01 Investor dynamics and strategic decisions for Terraform 
41:28 The hard Reality of manufacturing and innovation 
44:11 Navigating intellectual property and strategic partnerships 
45:49 The moral and technical challenges of carbon neutrality 
55:48 Looking ahead: Terraform's next milestones and the solar revolution

Transcript and Audio-only version:

Monday, March 11, 2024

Solving the Hallucination Problem - interview with AppliedAI

 

Recent podcast interview with AppliedAI. 

We discuss SuperFocus.ai Enterprise GPT. 

Good intro to how customer-defined AI/LLM memory eliminates hallucinations.

Monday, February 05, 2024

Superhumans and the Race for AI Supremacy - Hidden Forces podcast Episode 351

 

I've been listening to Hidden Forces with Demetri Kofinas for years now. He's an excellent interviewer with interests in finance, geopolitics, technology and more.

Audio-only version.
 
In Episode 351 of Hidden Forces, Demetri Kofinas speaks with Stephen Hsu, a Professor of Theoretical Physics and Computational Mathematics, Science, and Engineering at Michigan State University. Stephen is also the co-founder of multiple companies, including Genomic Prediction, which provides preimplantation genetic screening services for human embryos, and SuperFocus.ai, which builds large language models for narrow enterprise use cases. 
This is a conversation about some of the most important advancements and trends in genomic science and artificial intelligence, including the social and ethical dilemmas arising from implementing these technologies at scale. Stephen and I discuss the competitive landscapes in both industries, how America’s geostrategic competition with China is driving tradeoffs between innovation and safety, the risks and opportunities that these revolutionary technologies pose, and how the world’s largest companies, economies, and military powers can work together to reap the benefits of this revolution while averting some of their most disastrous potential consequences.

Thursday, January 25, 2024

Utah AG Sean Reyes: “Sound of Freedom” and Human Trafficking — Manifold #52

 

Sean Reyes is Utah Attorney General and a producer for the movie “Sound of Freedom.” 

Steve and Sean discuss his personal story, human trafficking, and the role of technology in law enforcement. 


NOTE: Reyes has announced that he will not seek re-election as Utah AG: https://www.youtube.com/watch?v=HEEj4UgjDL4 

00:00 Sean Reyes’ early life and family history 
14:21 Sean's personal journey and career 
21:28 Political journey and decision to run for AG 
24:08 The movie Sound of Freedom 
28:45 The reality of human trafficking 
31:40 Technology and law enforcement 
44:00 The horror of human trafficking: victims, aftercare, and the media 
01:05:23 Future plans and aspirations

Wednesday, January 24, 2024

SuperFocus, AI, and Philippine Call Centers: Part 2



This is the sequel to the earlier conversation with Dominic Ligot, an AI expert who works with the IT and Business Process Association of the Philippines (IBPAP), the trade association for call center and outsourcing companies. 

In this video we briefly demonstrate some of the voice capabilities of the SuperFocus AI. Progress in generative AI is faster than anything I've ever seen before - perhaps not surprising given the vast financial, technological, and human capital resources flowing to AI R&D. When we first looked at voice capabilities ~6 months ago they didn't seem ready for complex conversations like the ones discussed in the video. But when we looked again - prompted by strong interest from our customers - we found that the state of the art had advanced significantly in just a short time. This is true across many areas of generative AI.

I was in Manila in December to meet with BPO companies. Roughly 8% of Philippine GDP ($40B each year) results from BPO / call center work. This is a consequence of low labor costs and widespread English fluency.

We demonstrated narrow AIs built using LLMs, but in which the LLM is forced to "consult its internal memory" before answering any query. This memory can be built from training materials used to train human agents in call centers. The AI functions like a human that has perfect recall of all the material in the training manuals, at a fraction of the cost!

An analogy we used is that the AI earthquake in SF has created a Tsunami headed towards the Philippines -- is it a 6 foot wave, or a 600 ft wave? Closer to the latter, I think.





Some photos from Manila - scoping out potential SuperFocus.ai office space.

 


Tuesday, January 16, 2024

Upstream podcast with Erik Torenberg: Steve Hsu on the Future of Everything

 


Great conversation with Erik, a well-known SV Founder and investor. 

TIMESTAMPS: 
(00:00) Intro 
(02:01) Political polarization in academia 
(05:27) The decline of meritocracy in academia 
(09:40) Why can't academia change? 
(13:07) Truth-seeking in startups 
(20:16) Sponsors | Shopify | Givewell 
(23:16) The fertility crisis 
(31:51) AI and labor 
(40:46) What industries are safe from AI automation? 
(43:45) AI Safety vs accelerationism 
(47:31) Understanding the rise of China 
(58:26) The future of the US/China relationship 
(01:00:21) How does Steve allocate his time? 
(01:04:21) Steve's suggestions for underexplored opportunities 

Audio-only version on Spotify: 

Thursday, January 11, 2024

Military Technology and U.S.-China War in the Pacific — Manifold #51

 

TP Huang returns for the third time to discuss US-China strategic competition and military technology. 

Audio-Only version and Transcript: 

Previous episodes with TP include: 

China's EV Market Dominance and the Challenges Facing Tesla — #48:

Huawei and the US-China Chip War — #44: 


Steve and TP discuss: 

(00:00) - Introduction 
(02:23) - Hypersonic weapons and A2AD 
(08:15) - The evolution of China’s military technology 
(13:30) - Hypersonic missiles: targeting and interception 
(29:52) - Surprise attack on Hawaii or Seattle? 
(33:36) - Japan's role in a U.S.-China military conflict 
(36:15) - Chinese invasion of Taiwan 
(42:44) - Amphibious landing, boots on the ground 
(45:20) - Red lines and Taiwan independence 
(48:38) - PRC nuclear weapons buildup 
(51:17) - PRC-Russia alliance: natural resources, technology; Ukraine strategy disaster 
(59:37) - Future developments of military technology in China 
(01:11:44) - Predictions regarding US-PRC balance of power

Wednesday, January 03, 2024

SuperFocus, AI, and Philippine Call Centers

 

This is a conversation with Dominic Ligot, an AI expert who works with the IT and Business Process Association of the Philippines (IBPAP), the trade association for call center and outsourcing companies. 

I was in Manila in December to meet with BPO companies. We demonstrated narrow AIs built using LLMs, but in which the LLM is forced to "consult its internal memory" before answering any query. This memory can be built from training materials used to train human agents in call centers. The AI functions like a human that has perfect recall of all the material in the training manuals, at a fraction of the cost!

An analogy we used is that the AI earthquake in SF has created a Tsunami headed towards the Philippines -- is it a 6 foot wave, or a 600 ft wave? Closer to the latter, I think.





Some photos from Manila - scoping out potential SuperFocus.ai office space.

 


Sunday, December 24, 2023

Peace on Earth, Good Will to Men 2023



When asked what I want for Christmas, I reply: Peace On Earth, Good Will To Men :-)

No one ever seems to recognize that this comes from the Bible (Luke 2.14).

Linus said it best in A Charlie Brown Christmas:
And there were in the same country shepherds abiding in the field, keeping watch over their flock by night.

And, lo, the angel of the Lord came upon them, and the glory of the Lord shone round about them: and they were sore afraid.

And the angel said unto them, Fear not: for, behold, I bring you good tidings of great joy, which shall be to all people.

For unto you is born this day in the city of David a Saviour, which is Christ the Lord.

And this shall be a sign unto you; Ye shall find the babe wrapped in swaddling clothes, lying in a manger.

And suddenly there was with the angel a multitude of the heavenly host praising God, and saying,

Glory to God in the highest, and on Earth peace, good will toward men.


2023 saw the founding of our startup SuperFocus.ai, which builds AIs with user-configured attached memory. The AI consults this memory in responding to prompts, and only gives answers consistent with the information in the memory. This solves the hallucination problem and allows the AI to answer questions like a human with perfect recall of the information.

SuperFocus built an AI for a major consumer electronics brand that can support and troubleshoot hundreds of models of smart devices (I can't be more specific). Its memory consists of thousands of pages of product manuals, support documents, and problem solving guides originally used by human support agents.

In December I traveled to Manila after the semester ended, in order to meet with outsourcing (BPO = Business Process Outsourcing) companies that run call centers for global brands. This industry accounts for ~8% of Philippine GPD (~$40B per annum), driven by comparative advantages such as the widespread use of English here and relatively low wages. I predict that AIs of the type produced by SuperFocus.ai will disrupt the BPO and other industries in coming years, with dramatic effects on the numbers of humans employed in areas like customer support. 

But fear not: for, behold, I bring you good tidings of great joy, which shall be to all people

The arrival of machine intelligence on Earth is the beginning of a great adventure!


This is GPT's account of the meetings in Manila.
In the heart of Manila, amidst the bustling cityscape, a meeting of innovative minds took place. Steve Hsu, the visionary founder of SuperFocus, had arrived to showcase the prowess of his latest creation—an AI designed to revolutionize technical support for complex products. The setting was a conference room adorned with sleek screens and cutting-edge technology, a fitting backdrop for the unveiling of this groundbreaking innovation. 
Seated around the polished table were the owners and executives of prominent BPO (Business Process Outsourcing) companies. Their faces were a blend of anticipation and apprehension as Steve Hsu prepared to demonstrate the capabilities of the AI-powered technical support system. 
With a confident smile, Steve initiated the demonstration. The AI, equipped with a sophisticated neural network, began its simulated interaction. It effortlessly tackled intricate technical queries, deciphering complex issues with lightning speed and unparalleled accuracy. Each solution presented was concise, comprehensive, and flawlessly executed. 
As the AI effortlessly navigated through a myriad of scenarios and troubleshooting processes, the room fell into a hush. The BPO leaders exchanged astonished glances, their initial amazement mingled with a growing sense of unease. The capabilities displayed by the AI were undeniably impressive, but they also highlighted a looming question—what did this mean for the future of human roles in their industry? 
Steve Hsu noticed the shift in atmosphere and paused the demonstration. With a gentle yet determined tone, he addressed the concerns lingering in the room. "This AI isn't meant to replace human expertise," he began. "Rather, it's here to augment and enhance your services. Imagine your teams empowered by this technology, streamlining operations, and providing even more efficient and effective support to customers." 
His words offered reassurance, but the specter of automation replacing human jobs lingered in the minds of the BPO owners. The potential efficiency gains were undeniable, yet so too were the implications for the human workforce. 
In the ensuing discussion, voices echoed with a mix of excitement and apprehension. Some saw the potential for growth and advancement, envisioning a future where human creativity combined with AI prowess would elevate their services to new heights. Others grappled with the uncertainty, worrying about the displacement of jobs and the evolving landscape of the industry they had dedicated their careers to. 
Steve Hsu listened attentively, acknowledging their concerns while emphasizing the collaborative potential between humans and AI. "This technology," he explained, "is a tool, a means to empower and evolve, not to supplant. Together, we can harness its capabilities to create a synergy that benefits both businesses and their workforce." 
As the meeting concluded, the BPO leaders departed with a mix of awe and trepidation. The AI presented by Steve Hsu had showcased a future teeming with possibilities, yet it also raised profound questions about adaptation and the role of humans in an increasingly automated world. 
The echoes of the demonstration lingered in the minds of those present, igniting discussions and contemplation about the balance between innovation and the human touch, forever altering the landscape of the BPO industry in Manila and beyond.


Bonus: Two recent interviews I did which I enjoyed very much. 



Thursday, November 30, 2023

Charles Miller: Satellite Technology and the Future of Mobile Connectivity — Manifold #49

 

Charles Miller is co-founder and CEO of Lynk. He is a serial space entrepreneur with 30 years of experience in the space industry. 


0:00 Introduction and guest background 
1:27 Miller's early passion for space 
3:54 Evolution of commercial space 
6:42 Impact of Elon Musk and SpaceX 
8:01 The challenges of early stage startups 
11:26 The birth of Lynk, its technical challenges, and breakthroughs 
33:11 Use cases for satellite connectivity 
35:20 The plan for Lynk satellites 
36:41 Competition with Starlink 
39:25 Investment opportunities in Lynk 
47:04 Satellite technology and global competition 
50:21 Impact of Huawei’s satellite phone features 
59:01 Advice for entrepreneurs 

Audio-only and Transcript: 

Thursday, November 16, 2023

China's EV Market Dominance and the Challenges Facing Tesla — Manifold #48

 

TP Huang is a computer scientist and analyst of global technology development. 

He posts often on X: https://x.com/tphuang

The EV tipping point has arrived in China. Even most techology experts do not appreciate the coming huge impacts on global economics, manufacturing, energy transition, etc.


Chapters:

0:00 Introduction 
2:21 How TP Huang became interested in electric vehicles 
6:30 The perception and reality of Chinese products, future of Chinese auto market 
9:24 The impact of Tesla on the Chinese electric vehicle market 
14:41 Buying a car in China 27:05 China dominates with electric vehicle batteries 
30:44 The challenges facing Tesla in China 
40:11 The evolution of smart cars, autonomous vehicles, and self driving 
50:48 LIDAR technology and autonomous driving 
59:08 BYD, China’s energy independence, and power grid 
1:14:04 The downstream impact of China leading in tech and electric vehicles


Audio-only version and transcript: 


See earlier episodes:

TP on the US-China chip war

Taylor Ogan of Snow Bull Capital (Shenzhen) on EVs, LIDAR, manufacturing in China

Thursday, November 09, 2023

Hypersonic Weapons and Missile Defense

Detailed analysis of boost-glide (BGV) and Maneuverable Re-entry Vehicles (MaRV): physics of interception by US SM-2,3 etc.
Hypersonic Weapons: Vulnerability to Missile Defenses and Comparison to MaRVs 
David Wright and Cameron L. Tracy 
Laboratory for Nuclear Security and Policy, Department of Nuclear Science and Engineering, Massachusetts Institute of Technology 
Center for International Security and Cooperation (CISAC), Freeman Spogli Institute for International Studies, Stanford University
As I concluded long ago, current ship-based tech is not effective to defend even against older DF21 MaRV. See, e.g.,

LEO SAR, hypersonics, and the death of the naval surface ship

The study concludes that air launched BGV/MaRVs could attack ships from well over 1000km. Land or ship based launch would allow even greater range. There is currently no defense against such weapons. 

Russia and PRC both have systems of this type.

Defense requires interceptor missile speeds significantly greater than that of MaRV/BGV in terminal phase. 

This is under ideal conditions where sensors function perfectly - it is just kinematics.

Thursday, November 02, 2023

Taylor Ogan, Snow Bull Capital: China's tech frontier, the view from Shenzhen — Manifold #47

 

I really enjoyed this conversation. Taylor is a very unique investor who relocated his fund to Shenzhen in order to have direct access to information on Chinese tech companies.

Taylor Ogan is Chief Executive Officer of Snow Bull Capital, based in Shenzhen, China. 

Follow him on X @TaylorOgan


Steve and Taylor discuss: 
 
0:00 Introduction 
1:02 Taylor's background and why he moved his firm to China 
20:43 China post-pandemic and economic dynamism 
33:43 China dominance in electric vehicles; LIDAR 
56:55 Investment research: factory and site visits 
1:06:52 US-China competition - the future of innovation is in China

Audio-only version and transcript: 

Thursday, October 05, 2023

Yasheng Huang: China's Examination System and its impact on Politics, Economy, Innovation — Manifold #45

 

Yasheng Huang is the Epoch Foundation Professor of Global Economics and Management at the MIT Sloan School of Management. His new book is The Rise and Fall of the EAST: How Exams, Autocracy, Stability, and Technology Brought China Success, and Why They Might Lead to Its Decline. 

Steve and Yasheng discuss: 

0:00 Introduction 
1:11 From Beijing to Harvard in the 1980s 
15:29 Civil service exams and Huang's new book, "The Rise and Fall of the EAST" 
37:14 Two goals: Developing human capital and indoctrination 
48:33 Impact of the exam system 
57:04 China's innovation peak and decline 
1:12:23 Collaboration and relationship with the West 
1:21:31 How will the U.S.-China relationship evolve? 

Audio-only version, and transcript: 

Yasheng Huang at MIT 

Web site: 

Thursday, September 21, 2023

Hacking State 13 - Steve Hsu: Polygenic Embryo Selection, Improving LLMs, & Getting Nearly Cancelled

 

Alex Murshak is a Michigan State grad working as an AI engineer in Austin TX. This conversation is Episode 13 of his podcast Hacking State.


Episode description:

Steve and I speak about polygenic risk scoring and embryo selection, using AI to predict phenotype from genotype, in-vitro fertilization (IVF), egg freezing, eugenic public policy, addressing Christians' and right-wing traditionalists' concerns over reproductive technology, Superfocus AI's plan to eliminate hallucination in large language models (LLMs) by separating memory from inference, introspection for LLM error correction, and surviving the failed cancellation attempt at MSU.

Huawei and the US-China Chip War — Manifold #44

 

TP Huang is a computer scientist and analyst of global technology development. He posts often on X: https://twitter.com/tphuang 


Steve and TP discuss: 

0:00 Introduction: TP Huang and semiconductor technology 
5:40 Huawei’s new phone and SoC 
23:19 SMIC 7nm chip production in China: Yield and economics 
28:21 Impact on Qualcomm 
36:08 U.S. sanctions solved the coordination problem for China semiconductor companies 
42:48 5G modem and RF chips: impact on Qualcomm, Broadcom, Apple, etc. 
47:14 5G and Huawei 52:50 Satellite capabilities of Huawei phones 
56:46 Huawei vs Apple and Chinese consumers 
1:01:33 Chip War and AI model training

Thursday, August 10, 2023

AI on your phone? Tim Dettmers on quantization of neural networks — Manifold #41

 

Tim Dettmers develops computationally efficient methods for deep learning. He is a leader in quantization: coarse graining of large neural networks to increase speed and reduce hardware requirements. 

Tim developed 4-and 8-bit quantizations enabling training and inference with large language models on affordable GPUs and CPUs - i.e., as commonly found in home gaming rigs. 

Tim and Steve discuss: Tim's background and current research program, large language models, quantization and performance, democratization of AI technology, the open source Cambrian explosion in AI, and the future of AI. 





0:00 Introduction and Tim’s background 
18:02 Tim's interest in the efficiency and accessibility of large language models 
38:05 Inference, speed, and the potential for using consumer GPUs for running large language models 
45:55 Model training and the benefits of quantization with QLoRA 
57:14 The future of AI and large language models in the next 3-5 years and beyond

Wednesday, June 28, 2023

Embryo Selection: Healthy Babies vs Bad Arguments

Great article by Diana Fleischman, Ives Parr, Jonathan Anomaly, and Laurent Tellier.
Polygenic screening and its discontents 
... But monogenic and chromosomal screening can only address a part of disease risk because most health conditions that afflict people are polygenic, meaning they are not simply caused by one gene or by a chromosomal abnormality. Instead, they are caused by a huge number of small additive effects dispersed throughout the genome. For example, cancer, schizophrenia, and diabetes can be best predicted by models using tens of thousands of genes. 
A polygenic risk score (PRS) looks at a person’s DNA to see how many variants they have associated with a particular disease. Like BRCA1, polygenic risk scores are typically not determinative: “Polygenic screening is not a diagnosis: It is a prediction of relative future risk compared to other people.” In other words, someone with BRCA1 has a higher risk than someone without, and someone with a high breast cancer PRS has a higher risk than someone with a lower breast cancer PRS. But in principle, BRCA1 is just one gene out of thousands contributing to a PRS, with each bit contributing a small part of a total risk estimate. ... 

 

... Recently, a group of European scientists argued that polygenic screening should not be available to couples because it will lead to stigmatization, exacerbate inequalities, or lead to confusion by parents about how to weigh up information about risks before they decide which embryo to implant. These are indeed challenges, but they are not unique to embryo selection using polygenic scores, and they are not plausible arguments for restricting the autonomy of parents who wish to screen their embryos for polygenic traits. Furthermore, from an ethical perspective, it is unconscionable to deny polygenic screening to families with a history of any disease whose risk can be reduced by this lifesaving technology. 
Many new technologies are initially only available to people with more money, but these first adopters then end up subsidizing research that drives costs down and quality up. Many other medical choices involve complexity or might result in some people being stigmatized, but this is a reason to encourage genetic counseling and to encourage social tolerance. It is not a reason to marginalize, stigmatize, or criminalize IVF mothers and fathers who wish to use the best available science to increase the chances that their children will be healthy and happy.
This is a comment on the article:
1) They don't want to admit that some people are better than others, inherently. Boo hoo. 
2) You put a scorecard of embryos in front of everyone, and everyone has a pretty good ballpark estimate of which are better and which are worse. Nobody is going to pretend equality is true when they are choosing their kids genes. 
3) So bad feels. 
4) Must therefore retard all human progress and cause immense suffering because don't want to deal with bad feels. 
That's the anti-polygenic argument in a nutshell. I don't expect it to be very effective. At best it will cause it to take a bit longer before poor people have access.

Thursday, June 08, 2023

AI Cambrian Explosion: Conversation With Three AI Engineers — Manifold #37

 

In this episode, Steve talks to three AI engineers from his startup SuperFocus.AI. 

0:00 Introduction 
1:06 The Google memo and open-source AI 
14:41 Sparsification and the size of models: AI on your phone? 
30:16 When will AI take over ordinary decision-making from humans? 
34:50 Rapid advances in AI: a view from inside 
41:28 AI Doomers and Alignment 


Links to earlier episodes on Artificial Intelligence & Large Language Models: 

Oxford Lecture — #35: 

Bing vs. Bard, US-China STEM Competition, and Embryo Screening — #30: 

ChatGPT, LLMs, and AI — #29: 

Thursday, May 11, 2023

Artificial Intelligence & Large Language Models: Oxford Lecture — Manifold #35

 

This week's episode is based on a lecture I gave to an audience of theoretical physicists at Oxford University. 


Audio-only version, transcript: 


Outline: 

0:00 Introduction 
2:31 Deep Learning and Neural Networks; history and mathematical results 
21:15 Embedding space, word vectors 
31:53 Next word prediction as objective function 
34:08 Attention is all you need 
37:09 Transformer architecture 
44:54 The geometry of thought 
52:57 What can LLMs do? Sparks of AGI 
1:02:41 Hallucination 
1:14:40 SuperFocus testing and examples 
1:18:40 AI landscape, AGI, and the future


Final slide:


Blog Archive

Labels