This week we are leaning into multiple metaphors: AI as a mirror, UX design as a window or room, and life as information. Plus: read about Michael Levin's upcoming presentation at the Imagining Summit, Helen's Book of the Week, and our upcoming events.
It’s easy to fall prey to the design illusion that because LLMs look sleek, they must be well-designed. But aesthetics alone do not equal design. As Steve Jobs once said, “Design is not just what it looks and feels like. Design is how it works.”
It’s curious that these two papers, tackling such similar ideas, came out at the same time. Is this coincidence, or does it tell us something about where the study of life and intelligence is heading?
In this episode, we provide updates from our Artificiality Pro presentation, including key developments in mechanistic interpretability for understanding AI models and considerations around the costs of large language models: aka memory vs margins.
In this episode, we provide updates from our Artificiality Pro presentation, including key developments in mechanistic interpretability for understanding AI models and considerations around the costs of large language models: aka memory vs margins. We also highlight an upcoming webinar we are hosting on discussing AI with teenagers.
Mechanistic Interpretability & Memory vs. Margins
0:00
/970.4751020408163
Episode Notes:
Mechanistic Interpretability
An emerging way for us to unravel the "blackbox" of AI models by understanding their internal representations and computations.
Allows for safer and more reliable use of AI, especially in critical applications like healthcare.
Involves conceptualizing models in terms of "features" and "circuits" instead of just neurons.
Anthropic has developed new methods for creating sparse representations to query models.
Costs of Large Language Models: Memory vs. Margins
Costs broken down into prompt (input) and response (output) costs per 1000 tokens from our perspective.
Conversations require sending full context back and forth, rapidly increasing costs.
Assistants that aim to maintain long-term conversational context could get expensive because memory requires processing many more tokens.
Upcoming Webinar on Teens & AI
Free webinar on December 23 at 11am Pacific that we are hosting on talking to teenagers about AI.
Dave Edwards is a Co-Founder of Artificiality. He previously co-founded Intelligentsia.ai (acquired by Atlantic Media) and worked at Apple, CRV, Macromedia, Morgan Stanley, and Quartz.
Helen Edwards is a Co-Founder of Artificiality. She previously co-founded Intelligentsia.ai (acquired by Atlantic Media) and worked at Meridian Energy, Pacific Gas & Electric, Quartz, and Transpower.