The Technium

The Technium

The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. read less

Xanadu: The lost vision of the hypertext future
Jan 19 2023
Xanadu: The lost vision of the hypertext future
Xanadu was the first hypertext project founded in 1960 by Ted Nelson. It aims to facilitate a type of media called hypermedia, which is non-sequential writing in which the reader can choose their own path through an electronic document.Links/Resources:http://www.rheingold.com/texts/tft/14.htmlhttps://en.wikipedia.org/wiki/Project_Xanaduhttps://mimix.io/en/blog/xanaduhttps://sentido-labs.com/en/library/201904240732/Xanadu%20Hypertext%20Documents.htmlhttps://www.notion.so/blog/ted-nelsonhttps://www.wired.com/1995/06/xanadu/https://xanadu.com.au/ararathttps://www.youtube.com/watch?v=-_-5cGEU9S0https://www.youtube.com/watch?v=hMKy52Intachttps://www.youtube.com/watch?v=1gPM3GqjMR4https://www.youtube.com/watch?v=hGKbRcvIZT8https://www.youtube.com/watch?v=qyzgoeeloJAhttps://www.youtube.com/watch?v=_xYwgJW7T8ohttps://jasoncrawford.org/the-lessons-of-xanaduhttps://blockprotocol.org/https://github.com/subconsciousnetwork/noosphere/blob/main/design/explainer.mdhttps://maggieappleton.com/xanadu-patternshttps://aaronzlewis.com/blog/2019/05/01/spreading-threading/https://www.zombo.com/https://stratechery.com/concept/aggregation-theory/https://maggieappleton.com/tools-for-thoughthttps://cdixon.org/2015/01/31/come-for-the-tool-stay-for-the-networkChapters:[00:00:00] Intros[00:03:22] What is Xanadu?[00:15:49] Transclusion and Bidirectionality[00:26:32] Versioning[00:29:47] Vision divorced from implementation[00:35:13] Baked in Payments[00:46:15] Hypermedia as Envisioned[00:56:20] Tiktok as Hypermedia[01:01:52] Alternative business model for the web[01:16:19] Failure to Launch[01:26:15] Linearization as a forge[01:31:51] Success of Xanadu's Vision[01:37:04] Passing the torch===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
ChatGPT Part 2 (S04E03)
Jan 12 2023
ChatGPT Part 2 (S04E03)
ChatGPT is a language model by OpenAI which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests.00:00 S04E03 ChatGPT Part 2 02:30 Expanding Humanity's Limits 11:33 Tool-assisted speedrun of Science 16:18 As a Civic Moderator 24:32 Social Upheaval 28:40 Platform Risk 49:51 Billion Dollar Solo Founder 58:35 Running out of Data 01:03:22 In other industries 01:24:52 Limitations 01:31:50 Build something that gets better as AI gets betterLinks:https://chat.openai.com/https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulator#Simulatorshttp://www.incompleteideas.net/IncIdeas/BitterLesson.htmlhttps://xyproblem.info/https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1===== About “The Technium” ===== The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials ===== WEBSITE:https://technium.transistor.fm/SPOTIFY:https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7APPLE PODCASTS:https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Nix Package Management (S04E02)
Dec 21 2022
Nix Package Management (S04E02)
Nix is a functional package manager. It creates completely reproducible builds and package management, including support for multiple versions of packages side-by-size with no issues.Chapters:[00:00:00] Intro[00:02:41] What is Nix?[00:05:01] The Problem with Package Management[00:09:41] How Nix Works[00:15:08] Reproducible Environment = Less Bit Rot?[00:17:46] Nix vs. Docker[00:21:32] Adoption at Growing Startups[00:26:05] Use Case: Consistency Across Environments[00:28:04] Use Case: Provisioning New Dev Machines[00:32:24] Use Case: Portable Editor Configs[00:35:05] Why Hasn't This Taken Off?[00:40:27] Leaky Abstractions[00:44:17] Security and other enterprise value props[00:52:31] Improving the documentation[00:56:34] Nix for software archival/archaeology[01:02:21] Reducing DevOps/SRE burden[01:07:51] Integrating Nix directly into programming languages[01:09:57] Someone should build the Heroku for Nix[01:25:17] How to take a position on NixLinks/Resources:https://edolstra.github.io/pubs/phd-thesis.pdfhttps://www.iohannes.us/en/commentary/nix-critique/https://nixos.org/guides/how-nix-works.htmlhttps://nix.dev/https://blog.replit.com/powered-by-nixhttps://blog.replit.com/nix-vs-dockerhttps://blog.wesleyac.com/posts/the-curse-of-nixoshttps://bicompact.space/blog/2020/06/20/nix-os-thoughts/https://shopify.engineering/what-is-nixhttps://news.ycombinator.com/item?id=28241661https://nixcloud.io/tourhttps://www.youtube.com/playlist?list=PLRGI9KQ3_HP_OFRG6R-p4iFgMSK1t5BHs===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/ SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7 APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Visual Programming (S04 E01)
Dec 7 2022
Visual Programming (S04 E01)
'Visual Programming' refers a style of programming that allows the user to specify a programs in a two-(or more)-dimensional fashion. Visual programming environments represent the data, control flow, or program state in a graphical way, allowing them to be directly manipulated. It has been a hot area of research from the very beginning of personal computing, to today.This week we will cover a few major visual programming environments, why visual programming has remained compelling over the decades, and whether there is untapped potential for VP today.Chapters:[00:00:00] Intros[00:03:50] What is Visual Programming?[00:05:42] Origins[00:14:34] Block-based Visual Programming[00:20:26] Wire and Dataflow-based Visual Programming[00:31:51] An Umbrella Term[00:36:31] Conceptual History[00:48:23] The Duality of Direct Manipulation[00:58:40] Direct Manipulation of Running State[01:11:25] Programming by Example[01:21:17] Fill in the Details for Me[01:28:49] Strengths of Visual Programming[01:43:36] Leveraging the Visual Cortex[01:50:58] Second Order EffectsLinks/Resources:SketchPad demo: https://www.youtube.com/watch?v=2Cq8S3jzJiQ Pygmilion Paper: http://worrydream.com/refs/Smith%20-%20Pygmalion.pdfDemo:: https://youtu.be/xNW8wUpbqQM?t=319 GrailDemo: https://www.youtube.com/watch?v=2Cq8S3jzJiQ HypercardDemo: https://www.youtube.com/watch?v=2Cq8S3jzJiQ Viewpoint https://scottkim.com/2020/06/07/viewpoint/ Scratchhttps://www.bryanbraun.com/2022/07/16/scratch-is-a-big-deal/ Labview (imperative control flow): https://www.ni.com/en-us/shop/labview.html Unreal Engine Blueprint (functional)https://docs.unrealengine.com/5.0/en-US/blueprints-visual-scripting-in-unreal-engine/https://blueprintsfromhell.tumblr.com/ Max/MSP for musicianshttps://cycling74.com/products/max Othershttps://cables.gl/ https://nodes.io/ ===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/ SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7 APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Lightning Network: Payments so small, it's a stream (S03 E10)
Aug 31 2022
Lightning Network: Payments so small, it's a stream (S03 E10)
Lightning Network is a network of payment forwarders layered on top of Bitcoin to enable small, fast micropayments with low fees.Links/Resources:- https://lightning.network/- https://www.swanbitcoin.com/a-look-at-the-lightning-network/- [https://web.archive.org/web/20150301190111/http://lightning.network/lightning-network.pdf](https://web.archive.org/web/20150301190111/http://lightning.network/lightning-network.pdf)- [https://lightning.network/lightning-network-technical-summary.pdf](https://lightning.network/lightning-network-technical-summary.pdf)- [https://open.spotify.com/episode/1usKtNJonBszrq5lzad8eh?si=RvuAtKbjSqmyfT--FkNogg](https://open.spotify.com/episode/1usKtNJonBszrq5lzad8eh?si=RvuAtKbjSqmyfT--FkNogg) About routing- [https://www.kevinrooke.com/post/when-sending-money-is-instant-and-free](https://www.kevinrooke.com/post/when-sending-money-is-instant-and-free)- [https://www.kevinrooke.com/post/the-lightning-networks-next-big-use-case](https://www.kevinrooke.com/post/the-lightning-networks-next-big-use-case)- [https://bitfury.com/content/downloads/whitepaper_flare_an_approach_to_routing_in_lightning_network_7_7_2016.pdf](https://bitfury.com/content/downloads/whitepaper_flare_an_approach_to_routing_in_lightning_network_7_7_2016.pdf)- [https://1ml.com/](https://1ml.com/)- [https://explorer.acinq.co/](https://explorer.acinq.co/)- [https://github.com/davidshares/Lightning-Network](https://github.com/davidshares/Lightning-Network)- [https://docs.lightning.engineering/](https://docs.lightning.engineering/)- [https://twitter.com/kerooke](https://twitter.com/kerooke)- [https://blog.coinbase.com/is-the-bitcoin-lightning-network-for-real-26e47029687f](https://blog.coinbase.com/is-the-bitcoin-lightning-network-for-real-26e47029687f)- [https://vitalik.ca/general/2021/01/05/rollup.html](https://vitalik.ca/general/2021/01/05/rollup.html) (good summary on payment channels and how they compare to rollups, even though this is on ethereum network)- [https://www.impervious.ai/](https://www.impervious.ai/)- [https://diar.co/volume-2-issue-25/](https://diar.co/volume-2-issue-25/)- [https://www.youtube.com/watch?v=qUAyW4pdooA](https://www.youtube.com/watch?v=qUAyW4pdooA)- [https://github.com/bcongdon/awesome-lightning-network](https://github.com/bcongdon/awesome-lightning-network)Show notes- Patio11: https://twitter.com/patio11- Flare routing: https://bitfury.com/content/downloads/whitepaper_flare_an_approach_to_routing_in_lightning_network_7_7_2016.pdf- The nature of the firm https://onlinelibrary.wiley.com/doi/full/10.1111/j.1468-0335.1937.tb00002.xChapters:[00:02:21] What is Lightning Network?[00:08:53] How does it work?[00:18:51] Payments without Infrastructure[00:25:34] Routing the Network[00:36:00] Low value, High volume[00:39:42] Micropayments for API metering[00:43:09] Micropayments for Open Source[00:49:12] Idea Accrediation Network[01:01:20] Structuring Our Society [01:15:01] Micropayments Change Relationships of the Firm[01:21:36] Taking a position===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: [https://technium.transistor.fm/](https://technium.transistor.fm/)SPOTIFY: [https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7](https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7)APPLE PODCASTS: [https://podcasts.apple.com/us/podcast/the-technium/id1608747545](https://podcasts.apple.com/us/podcast/the-technium/id1608747545)
Hypercore: Lego Blocks for P2P Apps (S03E09)
Aug 25 2022
Hypercore: Lego Blocks for P2P Apps (S03E09)
Hypercore is a set of building blocks to build distributed peer-to-peer applications. It provides a variety of data structures, as well as a discovery mechanism to share data between peers. It is a suite of tools that are the Lego blocks to build peer-to-peer apps.Chapters:[00:00:00] Intros[00:02:16] What is Hypercore?[00:12:58] HyperDrive: A P2P File System[00:17:45] IPFS vs Hypercore[00:21:01] Bitfinex is using HyperBee[00:23:20] A Web of Data vs. Web of Pages[00:27:19] P2P Data Structures: Better Than P2P Files[00:29:52] IOT: a perfect candidate for decentralization?[00:34:30] P2P Databases for Civic Good[00:39:41] P2P Databases for Scientific Good[00:55:08] Impediments to adoption[01:03:54] Is this too futuristic even for us?[01:12:59] OutrosResources:[How the Hypercore Protocol Works](https://hypercore-protocol.org/protocol/)[Hypercore Protocol](https://hypercore-protocol.org/)[Dat Ecosystem](https://dat-ecosystem.org/)[On Dat://](https://www.kickscondor.com/on-dat)[What are the differences between IPFS and hyperdrive?](https://stackoverflow.com/questions/44859200/what-are-the-differences-between-ipfs-and-hyperdrive)[why-hypercore/FAQ.md at master · tradle/why-hypercore](https://github.com/tradle/why-hypercore/blob/master/FAQ.md)[Dripline: Taking the Mauve Pill: Exploring Alternatives to the Centralized Web](https://hypha.coop/dripline/p2p-primer-part-1/)[Dripline: Finding friends and staying safe: comparing peer discoverability and security in p2p networks](https://hypha.coop/dripline/p2p-primer-part-3/)[Dripline: Data Fast and Slow: Exploring Data Models and Mutability](https://hypha.coop/dripline/p2p-primer-part-2/)[Thinking about Filesystems, Databases, and Hypercores](https://paulfrazee.medium.com/thinking-about-filesystems-databases-and-hypercores-85de9d52d5b0)[Productizing P2P](https://paulfrazee.medium.com/productizing-p2p-bff5aed95f6a)https://github.com/automerge/pushpinhttps://github.com/kickscondor/duxtape===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Datomic: Immutable database for new web architecture S03E08
Aug 16 2022
Datomic: Immutable database for new web architecture S03E08
Datomic is an immutable database that borrows ideas from functional programming. We discuss how an immutable database changes the architectural possibilities of web apps. Links/Resources: - [Datomic with Rich Hickey](https://www.youtube.com/watch?v=9TYfcyvSpEQ) - [Database as Values with Rich Hickey](https://www.youtube.com/watch?v=V6DKjEbdYos) - [Intro To Datomic with Rich Hickey](https://www.youtube.com/watch?v=RKcqYZZ9RDY) - [KotlinConf 2018 - Datomic: The Most Innovative DB You've Never Heard Of by August Lilleaas](https://www.youtube.com/watch?v=hicQvxdKvnc) - [Love Letter To Clojure: And A Datomic Experience Report - Gene Kim](https://www.youtube.com/watch?v=5mbp3SEha38) - [Turning the database inside out](https://www.youtube.com/watch?v=fU9hR3kiOK0) - [Datomic - a scalable, immutable database system by Marek Lipert](https://www.youtube.com/watch?v=xGrCsIiiTUs) - ["Real-World Datomic: An Experience Report" by Craig Andera (2013)](https://www.youtube.com/watch?v=2WeFdAXZz30) - [https://tonsky.me/blog/unofficial-guide-to-datomic-internals/](https://tonsky.me/blog/unofficial-guide-to-datomic-internals/) - [https://www.infoq.com/articles/Architecture-Datomic/](https://www.infoq.com/articles/Architecture-Datomic/) - [https://www.infoq.com/presentations/The-Design-of-Datomic/](https://www.infoq.com/presentations/The-Design-of-Datomic/) - [Talking about Datomic, Datalog, GraphQL, APIs](https://www.notion.so/Datomic-52000e1e65d345509cbcde4681d5522f) - [What Datomic does to REST](https://web.archive.org/web/20210421110723/http://dustingetzcom.hyperfiddle.com/:what-datomic-does-to-rest/) - [Unofficial guide to Datomic Internals](https://tonsky.me/blog/unofficial-guide-to-datomic-internals/) - [Datomic Documentation Overview](https://docs.datomic.com/on-prem/overview/overview.html) - [The web after tomorrow](https://tonsky.me/blog/the-web-after-tomorrow/) - [APIs are about policy](https://acko.net/blog/apis-are-about-policy/) Chapters: 0:00 Intros [00:02:21] What is Datomic? [00:05:01] The Immutable Database [00:14:59] The N+1 Problem [00:20:59] Inference and Logical Programming [00:26:45] Database in the browser [00:39:24] Reducing the Impedence Mismatch [00:42:09] The Change in Perspective [00:51:14] Data as Social Artifact ===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/ SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7 APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Urbit: The Thousand Year Operating System (S03 E07)
Aug 9 2022
Urbit: The Thousand Year Operating System (S03 E07)
Urbit is an operating system for a global networked computer with a global filesystem. It has its own virtual machine, programming language, OS kernel, and identity layer. It dubs itself as “A clean-slate OS and network for the 21st century.”Links/Resources:-  https://media.urbit.org/whitepaper.pdf- https://developers.urbit.org/overview-  https://developers.urbit.org/guides/core/hoon-school- [https://vimeo.com/75312418- http://moronlab.blogspot.com/2010/01/urbit-functional-programming-from.html-  https://urbit.org/blog/precepts-discussion- COMMENTARY    - https://news.ycombinator.com/item?id=6438320    - https://alexkrupp.typepad.com/sensemaking/2013/12/a-brief-introduction-to-urbit.html    - https://thebaffler.com/latest/mouthbreathing-machiavellis    - https://wejn.org/2021/02/urbit-good-bad-insane/#tldr    - https://twitter.com/basileSportif/status/1544963208099909633    - https://www.vanityfair.com/news/2022/04/inside-the-new-right-where-peter-thiel-is-placing-his-biggest-betsChapters:[00:00:00] Intros[00:01:54] What is Urbit?[00:06:30] The Functional Kernel Avro[00:13:46] Application Network Ames[00:18:07] Code Update Mechanism[00:23:38] Hoon Lang and Nock VM[00:33:56] Personal Computing through Digital Sovereignty[00:38:53] A Personal Computing Experience You Own[00:43:46] Cypherpunk Values[00:45:32] A Computer as an Heirloom[00:51:48] Philosophical Origins and Its Influence on Design[01:01:09] Capitalism Softens Radical Ideas[01:05:40] A computer you can't break[01:12:48] A ghost in the shell for 100+ years[01:17:05] What if the internet had identity and payments built in from the beginning?[01:27:29] A Global ID[01:30:37] A Digital Extension of the Self[01:43:31] The Takeaway Despite the Roots===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Hyperfiddle: Compiler Managed Network Connections (S03 E06)
Aug 1 2022
Hyperfiddle: Compiler Managed Network Connections (S03 E06)
Hyperfiddle is an app builder in Clojure/Clojurescript that uses a compiler to manage the network connections in the app for you. We discuss what makes code easy vs simple, arches for software, home-cooked apps, and the implications of a compiler for everything.Links/Resources:- [https://www.hyperfiddle.net/](https://www.hyperfiddle.net/)- [https://hyperfiddle.notion.site/Reactive-Clojure-You-don-t-need-a-web-framework-you-need-a-web-language-44b5bfa526be4af282863f34fa1cfffc](https://www.notion.so/Reactive-Clojure-You-don-t-need-a-web-framework-you-need-a-web-language-44b5bfa526be4af282863f34fa1cfffc)- [https://www.hytradboi.com/2022/uis-are-streaming-dags](https://www.hytradboi.com/2022/uis-are-streaming-dags)    - [https://hyperfiddle.notion.site/UIs-are-streaming-DAGs-e181461681a8452bb9c7a9f10f507991](https://www.notion.so/UIs-are-streaming-DAGs-e181461681a8452bb9c7a9f10f507991)- How hyperfiddle changed over time    - [https://web.archive.org/web/20180217034740/http://www.hyperfiddle.net/](https://web.archive.org/web/20180217034740/http://www.hyperfiddle.net/)- First video proof of Hyperfiddle's "distributed dataflow" architecture for server-streamed UI. "UI as an Expression” [https://twitter.com/dustingetz/status/1474050461745528839](https://twitter.com/dustingetz/status/1474050461745528839)- [https://github.com/hyperfiddle/hyperfiddle-2020](https://github.com/hyperfiddle/hyperfiddle-2020)- [https://www.youtube.com/watch?v=6888V9YsObM](https://www.youtube.com/watch?v=6888V9YsObM)Show Notes:- Have you tried rubbing a database on it? https://www.hytradboi.com/- Self-adjusting Computations https://www.youtube.com/watch?v=G6a5G5i4gQU- Sloth ecosystems https://www.youtube.com/watch?v=VU9Tn_Qkjb8- Simple Made Easy https://www.youtube.com/watch?v=SxdOUGdseq4- Apps can be home-cooked meals https://www.robinsloan.com/notes/home-cooked-app/- Bundling and Unbundling https://reallifemag.com/bundling-and-unbundling/- Alan Kays: STEPS http://www.vpri.org/pdf/tr2012001_steps.pdf and the Niles Compiler https://github.com/damelang/nile https://raw.githubusercontent.com/wiki/damelang/nile/socal.pdfChapters:0:00 Intros[00:02:05] What is Hyperfiddle?[00:08:53] Managed Network through a Compiler[00:15:49] Arches for Software[00:19:21] Beyond Low Code[00:26:39] Abstractions: Simple vs Easy[00:29:14] Core of what's hard about apps[00:33:16] The Eight Fallacies[00:34:54] Home-cooked apps[00:40:28] The Piped Piper Dream[00:45:57] Reports for everyone![00:51:35] A compiler to help manage state?[00:55:12] A Compiler for the Metaverse [01:01:44] Making Integration Smoother[01:04:38] OG "bare metal"[01:12:01] Hypertext as Application State[01:20:03] Compilers do hard things all the time===== About “The Technium” ===== The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: [https://technium.transistor.fm/](https://technium.transistor.fm/)SPOTIFY: [https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7](https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7)APPLE PODCASTS: [https://podcasts.apple.com/us/podcast/the-technium/id1608747545](https://podcasts.apple.com/us/podcast/the-technium/id1608747545)
Generative AI Models (S03 E05)
Jul 27 2022
Generative AI Models (S03 E05)
Generative AI models are quickly reaching the point where their work is indistinguishable from that of humans. This include 3D models, voice, and other media types that were not previously possible to create without significant expertiseResources[Google's New AI: Flying Through Virtual Worlds! 🕊️](https://www.youtube.com/watch?v=N-Pf9lCFi4E)[OpenAI Dall-E 2 - AI or Artist? Which is Better? 🧑‍🎨](https://www.youtube.com/watch?v=mtkBIOK_28A)[NVIDIA's New AI: Next Level Image Editing! 👌](https://www.youtube.com/watch?v=cS4jCvzey-4)[NVIDIA's New AI Draws Images With The Speed of Thought! ⚡](https://www.youtube.com/watch?v=Wbid5rvCGos)[https://gptcrush.com/](https://gptcrush.com/)[Google's Imagen AI: Outrageously Good! 🤖](https://www.youtube.com/watch?v=HyOW6fmkgrc)[http://gaugan.org/gaugan2/](http://gaugan.org/gaugan2/)[DALL·E 2 and The Origin of Vibe Shifts](https://every.to/divinations/dall-e-2-and-the-origin-of-vibe-shifts)Chapters:0:00 Intros3:42 The amazing progress7:32 Dall-E 2 and Imagen11:11 NERF for 3d Scene Generation17:03 GauGan for Image Editing18:42 Models can understand the world21:45 Democratizing Content Creation24:46 Content to fill the metaverse28:58 AI = An Army of Interns31:17 Will Human Skills Atrophy?34:31 What is the role of humans in creation?45:03 What is the value of art anymore?52:43 NFTS, Artists, and "Vibes"58:59 Feedback Loops and Memeification1:09:03 Why isn't everyone losing their minds?!===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Zig: System programming without the warts (S03 E04)
Jul 18 2022
Zig: System programming without the warts (S03 E04)
Zig is a system programming language without the ugliness of C. We discuss its compile time features, its strive towards simplicity, and the potential for resource-efficient software.Links/Resources:• https://ziglang.org/learn/overview/• https://www.youtube.com/watch?v=Gv2I7qTux7g• https://www.youtube.com/watch?v=Z4oYSByyRak• https://www.scattered-thoughts.net/writing/assorted-thoughts-on-zig-and-rust/• https://www.scattered-thoughts.net/writing/how-safe-is-zig/• https://ziglearn.org/Chapters:0:00 Intros4:54 The Explicitness of Zig12:16 Compile Time Programming17:39 A Nice Build System that's Nice to You19:59 Zig's Integration with C is that it's a C compiler24:37 Compile time as Metaprogramming26:23 Compile time for String Interpolation28:33 Compile time for Queries31:12 Maybe We'd Get Faster Programs!33:55 Counter-forces to resource-efficient computing41:16 System programmers as far as the eye can see44:11 Zig as Pedagogy45:48 Cross-compilation and DSL it to the Blockchain!51:10 Proliferation of Zig Everywhere===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world. Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: [https://technium.transistor.fm/](https://technium.transistor.fm/)SPOTIFY: [https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7](https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7)APPLE PODCASTS: [https://podcasts.apple.com/us/podcast/the-technium/id1608747545](https://podcasts.apple.com/us/podcast/the-technium/id1608747545)
Multi-modal and Multi-task Models (S03 E04)
Jul 11 2022
Multi-modal and Multi-task Models (S03 E04)
Multimodal and multitask models are machine learning models that can generalize. Multimodal models can generalize to understand different types of input, for example images and text. Multitask models can generalize their knowledge by applying what they’ve learned about one task to solve another task.Links/Resources: • MUM: https://blog.google/products/search/introducing-mum/ • Gato: https://www.youtube.com/watch?v=wSQJZHfAg18 • MIA: https://www.youtube.com/watch?v=L9kA8nSJdYw • Flamingo: https://www.deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model • Flamingo explaining a funny photo: https://twitter.com/MelMitchell1/status/1522642194741538817 • Is LaMDA Sentient?: https://cajundiscordian.medium.com/is-lamda-sentient-an-interview-ea64d916d917Chapters:0:00 Intros2:33 Multimodal and Multitasks Models6:50 Deepmind's Gato: The All-Rounder Athlete14:43 Google's MUM: The Search Assistant18:12 Deepmind's Multimodal Interactive Agent: The Domestic Helper22:31 Deepmind's Flamingo: Reasoning about Pictures26:45 Why are these mind-blowing?31:20 Machine Learning has come a looooong way35:21 Could Flamingo be the real JARVIS?38:56 Could MIA assist the elderly? 43:05 Multimodal AI for self driving cars51:15 Multitask = A Shared Brain That Learns Everything1:00:19 Could these models transcend human knowledge?1:08:50 Breaking news: AI models are sentient1:10:37 Is this just a local maximum or a path to AGI?1:11:50 Outros===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/ SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7 APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Matrix: Let a Thousand Chat Clients Bloom (with Eric Migicovsky) S03 E01
Jun 20 2022
Matrix: Let a Thousand Chat Clients Bloom (with Eric Migicovsky) S03 E01
Matrix is a decentralized chat protocol that is end-to-end encrypted. It lets users communicate with each other using different clients and even run their own independent chat servers.Links/Resources:- https://matrix.org/docs/guides/introduction- https://salibra.com/p/the-death-of-jabber-8ea395e82f5b- http://jabbermania.blogspot.com/2013/06/how-google-pulled-plug-on-public-jabber.html- https://news.ycombinator.com/item?id=25850832- https://lukesmith.xyz/articles/matrix-vs-xmpp- Beeper: https://www.beeper.com/- Moxie's post on decentralization: https://moxie.org/2022/01/07/web3-first-impressions.htmlChapters:0:00 Intros2:23 What is Matrix?3:58 A Brief History of Chat11:51 Origins of Matrix15:14 What attracted people to Matrix?22:35 Motivation for Beeper25:14 Bridges to other networks32:09 Separation between protocol and client38:42 Chat overload43:19 Network Fragmentation47:48 The Chat Future to Look Forward To52:14 A Future of Specialized Clients58:01 Chat bots and Chat tools1:02:57 How do we get this future?===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: [https://technium.transistor.fm/](https://technium.transistor.fm/)SPOTIFY: [https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7](https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7)APPLE PODCASTS: [https://podcasts.apple.com/us/podcast/the-technium/id1608747545](https://podcasts.apple.com/us/podcast/the-technium/id1608747545)
Semantic Web (The Technium Podcast S02 E10)
Mar 18 2022
Semantic Web (The Technium Podcast S02 E10)
The semantic web was an effort to mark up webpages with facts about their content. The dream was to enable computers, to understand the world by reading these webpages. We discuss why the effort failed, how it relates to symbolic AI/knowledge graphs, and how the vision could still be realized today.Links/Resources:Introducing the Knowledge Graphhttps://twobithistory.org/2018/05/27/semantic-web.htmlMetacrap: Putting the torch to seven straw-men of the meta-utopiaWhatever happened to the Semantic Web? https://news.ycombinator.com/item?id=16806657 http://ai.stanford.edu/blog/introduction-to-knowledge-graphs/Aggregation Theory: https://stratechery.com/concept/aggregation-theory/ Chapters:0:00 Intros2:12 What is the Semantic Web?3:59 The Early 2000's8:32 The Idealism of the Semantic Web11:30 How it worked18:19 Roots in Symbolic AI22:53 The OG Web 3.025:28 Why Did the Semantic Web Fail?35:46 A Misalignment with the Medium41:10 Crypto and Semantic Web Collide43:25 Deep Learning and the Semantic Web Collide47:09 Vestiges of the Semantic Web49:44 Path to Intelligent Agents55:03 Incentive structures1:02:49 Token Curated Registries and the Semantic Web===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/ SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7 APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
TLA+ and Formal Methods (The Technium Podcast S02 E09)
Mar 11 2022
TLA+ and Formal Methods (The Technium Podcast S02 E09)
TLA+ is a language for formally modeling and verifying the correctness of programs, especially concurrent and distributed ones. We discuss how it could be used to improve the practice of software engineering and what it would take for formal methods to gain more popularity.Links/Resources:TLA+ Homepage https://lamport.azurewebsites.net/tla/tla.html https://learntla.com/introduction/https://lamport.azurewebsites.net/video/videos.htmlhttps://lamport.azurewebsites.net/tla/tutorial/contents.htmlhttps://lamport.azurewebsites.net/tla/industrial-use.htmlhttps://cacm.acm.org/magazines/2015/4/184701-how-amazon-web-services-uses-formal-methods/fulltextChapters:0:00 Intros2:14 What is TLA+?5:10 Bugs in Concurrent and Distributed Programming12:58 What's it like to use?19:09 Global State Machine20:34 Testimonials of Industrial Use Cases24:56 Why is it not more popular?27:32 How do we currently design our programs?37:16 Everyone is a distributed systems programmer now41:29 Thick client app management49:47 Can haz use for Security?53:08 TLA+ is for the design, not implementation59:35 TLA+ all the things1:02:55 Formal methods in Crypto?1:08:19 Intrigued with Formal Methods===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/ SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7 APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Transformers: One Model to Rule them All (The Technium Podcast S02 E08)
Mar 2 2022
Transformers: One Model to Rule them All (The Technium Podcast S02 E08)
Transformers are a building block of Machine Learning systems that have seen great success recently at subsuming all other techniques.We discuss at a high level, its attention mechanism and its multimodal properties, and the types of applications this can be put to use now and in the future.Links/Resources:Introductions to transformershttps://www.machinecurve.com/index.php/2020/12/28/introduction-to-transformers-in-machine-learning/https://deeplobe.ai/machine-learning-for-transformers-explained-with-language-translation/https://www.youtube.com/watch?v=yGTUuEx3GkA Attention is All you Need https://arxiv.org/pdf/1706.03762.pdf Attention: https://distill.pub/2016/augmented-rnns/ Transformers replacing CNNs https://becominghuman.ai/transformers-in-vision-e2e87b739feb AI models consolidating https://twitter.com/karpathy/status/1468370605229547522?ref_src=twsrc^tfwGTP implementation https://github.com/karpathy/minGPT/blob/master/mingpt/model.py Google introduces new arch to reduce cost of transformers https://analyticsindiamag.com/google-introduces-new-architecture-to-reduce-cost-of-transformers/ LaMDA by Google https://gpt3demo.com/apps/lamda-google Chapters:0:00 Intros1:57 What are Transformers?4:59 How does it work at a high level?9:27 Self Attention Mechanism14:03 Input structure agnostic16:59 Stack it high, pump it with data25:28 More MultiModal Learning27:22 The Narrow Waist34:34 Transformers for Compilation40:24 Specialized Hardware43:52 Multimodal Applications47:19 Generating Media as a Self-sustaining Entity52:42 The Jobs this Destroys58:02 Two machines need to talk to each other1:04:42 A Young Lady's Primer1:11:19 Try them out!===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545
Unison Programming Language (The Technium Podcast S02 E06)
Feb 17 2022
Unison Programming Language (The Technium Podcast S02 E06)
Unison is a programming language for distributed systems by leveraging immutable and content addressable code. We discuss the many implications of a language whose code is content addressable, from fast rename, easy caching, to feature flagging.Links/Resources:- Unison Lang https://www.unisonweb.org/- Unison at StrangeLoop https://www.youtube.com/watch?v=gCWtkvDQ2ZI- Unison and its Scala-based Runtime https://www.youtube.com/watch?v=knqlWboqf_U- What color is your function? https://journal.stuffwithstuff.com/2015/02/01/what-color-is-your-function/- Python Environment XKCD https://xkcd.com/1987/  Chapters:0:48 Intros2:32 What is Unison?6:46 Advantages of Content Addressable Code15:39 Realizing the Scale before it's Too Late22:03 Controlled Refactoring Experience25:54 Abilities or Algebraic Effects31:08 Programming the Whole Network34:57 Facilitating the Culture around Coding50:37 A Library Ecosystem1:00:50 Reproducibility and Old Computers1:07:55 Hot Patch Your Server1:10:37 The Road to Popularity===== About “The Technium” =====The Technium is a weekly podcast discussing the edge of technology and what we can build with it. Each week, Sri and Wil introduce a big idea in the future of computing and extrapolate the effect it will have on the world.Follow us for new videos every week on web3, cryptocurrency, programming languages, machine learning, artificial intelligence, and more!===== Socials =====WEBSITE: https://technium.transistor.fm/SPOTIFY: https://open.spotify.com/show/1ljTFMgTeRQJ69KRWAkBy7APPLE PODCASTS: https://podcasts.apple.com/us/podcast/the-technium/id1608747545