“Conjecture: A Roadmap for Cognitive Software and A Humanist Future of AI” by Connor Leahy, Gabriel Alfour
Listen now
Description
On Carcinogenic Complexity, Software Senescence and Cognitive Provenance: Our roadmap for 2025 and beyond It is mandatory to start any essay on AI in the post-ChatGPT era with the disclaimer that AI brings huge potential, and great risks. Unfortunately, on the path we are currently on, we will not realize those benefits, but are far more likely to simply drown in terrible AI slop, undermine systemic cybersecurity and blow ourselves up. We believe AI on its current path will continue to progress exponentially, to the point where it can automate, and summarily replace, all of humanity. We are unlikely to survive such a transition. Powerful technology always comes with powerful risks, but this does not mean we have to wait idly for the other shoe to drop. Risks can be managed and prevented, while harnessing the benefits. We have done it with aviation, nuclear and other risky technologies [...] --- Outline: (01:47) Part 1: Cognitive Software (03:01) AI, what is it good for? (04:37) A Tale of a Database (06:35) The Punchline Should Be Obvious (08:36) Part 2: AI Slop and Complexity Debt (12:02) The Strange Decoupling and Software Senescence (15:33) Algorithmic Carcinogenesis (20:53) Neither New Nor Unsolvable (28:20) Part 3: A Better Future and How to Get There: A Roadmap (29:41) Phase 1: Foundational Infrastructure (32:52) Phase 2: Cognitive Language Design and Computational Control (38:47) Phase 3: Horizontal Scaling: Scaling Without Sprawling (44:31) Phase 4: Vertical Scaling: Deliberate Teaching and Cognitive Provenance (48:19) Phase 5: Cognitive Emulation (CoEm) (51:51) Conclusion: A Future Worth Building The original text contained 3 images which were described by AI. --- First published: December 2nd, 2024 Source: https://www.lesswrong.com/posts/H26ndkABmGvoc9PTC/conjecture-a-roadmap-for-cognitive-software-and-a-humanist --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
More Episodes
Audio note: this article contains 449 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description. Based off research performed in the MATS 5.1 extension program, under the mentorship of Alex Turner (TurnTrout). Research...
Published 12/04/24
Preface Several friends have asked me about what psychological effects I think could affect human judgement about x-risk. This isn't a complete answer, but in 2018 I wrote a draft of "AI Research Considerations for Human Existential Safety" (ARCHES) that included an overview of cognitive biases...
Published 12/04/24
In the spirit of the season, you can book a call with me to help w/ your interp project (no large coding though) Would you like someone to: Review your paper or code? Brainstorm ideas on next steps? How to best communicate your results? Discuss conceptual problems Obvious Advice (e.g. being...
Published 12/03/24