Paul, Deon & Tong

Rich Tong

Now with rotating cohosts Rich, Paul and Deon cover all the current news, all things Apple, Smart Home and Smart EDC with Paul. And all things Startups, Robotics, Smart Health and Artificial Intelligence with Deon. Or whatever they want to talk about. Tips, tricks and traps on technology, mobile, software, machine learning and shopping since 1996 read less

RT1. Devindra on ChatGPT and Education in India
Apr 18 2023
RT1. Devindra on ChatGPT and Education in India
A conversation with Devindra on the possibilities of ChatGPT and other Large Language Models for education in India and other Middle and Low-Income Countries. While these large language models today mainly work in the cloud and require high-speed internet connectivity, the promise is that smaller models that are more specialized have already been ported to MacBook Pro M1 and other laptops. And with advances like 4-bit quantization, there is the possibility they can even run on modern smartphones.The experience in China and in India is that parents will save inordinately to give their children a better life than theirs. Both Devindra and I are the beneficiaries of that thinking and we are forever grateful to our parents for their sacrifice. So, this means that there is a possibility that there could be a commercial incentive which is much better than constantly asking for charitable dollars.The new LLMs promise interactivity and individualized instruction that was impossible before. Early demonstrations of learning a foreign language are promising as is the student being able to ask the "why" of how Python is structured, not just the "get it done" without understanding that online education often creates.Finally, having an eye toward inclusivity for everyone of any gender, race or social status is something that needs to be baked in. We look forward to helping! --- Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message
PT5. ChatGPT and Mike Conte Special Guest (And Tech Glitches Galore)
Mar 28 2023
PT5. ChatGPT and Mike Conte Special Guest (And Tech Glitches Galore)
This time, we bumble through an episode featuring the amazing Mike Conte and we talk about what's wrong with this Podcast technically (see below), about ChatGPT, and about how you don't want to show others the Money. Mike is as always hilarious! Ok, our exploration of Podcasting continues with tech glitches galore. First of all apologies to our 15 viewers. Please use this version as the audio had terrible cutouts because I was messing with the audio, this should work better (and it has the brightness turned down from 400 nits to 300 nits which help a little on TV-type HDR systems). a) the segment producer problem and move to a news section and then a special topic, the news will be on cool things in Tech from AI to Gadgets to Smart Home, things opinionated Verge) b) Audio, yes there are lots of glitches here, I had not realized that OBS really requires all manual controls. I just want Automatic Gain Control and Radio voice, but I'm learning. The audio in this one is very quiet because I had the Gain stage turned up, but didn't realize the compressor also had gained. And the Final Cut Pro gain is only 12dB. Also, I didn't realize how the Noise suppressor and gain work on low signals (like it cuts them out) and Zoom is very low. c) Video, I've been mastering in HDR and the default in OBS is for 400 nits peak brightness, but while this looks awesome on iPhone, Mac, and iPad (let's call them "real" HDR devices with 1000 peak nits), it looks dreadful on lesser HDR devices like my LG B9 which is only at most 400 nits. So I'll probably settle at say 300 nits for this next time, but most people I think are just getting the transcoded SDR Rec.709 output). See https://tongfamily.com/2023/03/27/pt5-chatgpt-and-mike-conte-special-guest-and-tech-glitches-galore/ for show notes --- Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message
DT3. GPT4 and SVB, The Best of Times, The Worst of Times.
Mar 17 2023
DT3. GPT4 and SVB, The Best of Times, The Worst of Times.
Wow, this week was the best of times and the worst of times. Just like a Charles Dickens novel. So we cover the incredibly hard job of keeping sane and how a little sleep and support help. Plus the resolution of the SVB crisis for us and also the best of times which is GPT4.  How can you deal with this kind of stress, it's a great question, but the main thing to realize is that its natural to be stressed, yes, you can be Zen Buddhist, but at least for us as ordinary mortals accepting that living in this exponentially increasing world is difficult. Sometimes accepting that it's hard helps me the most. But there is nothing like trying to get good sleep.  The problem is how to do that. I find that when there are so many things to do, it is hard to relax. For, I didn't invent it, but I definitely believe in things that go in threes. But I try to list the three most important things to do each day and if I get them done by 10 AM, then I feel like the rest of the day is free. So many times, we do things that are difficult but not critical, so get those out of the way first. But for those of you hiding under a rock,  SVB was really a disaster waiting to happen and other banks were unraveling, but the government stepped in. I feel so stupid not doing the obvious things to protect funds (but you can bet that is never going to happen again). I do think this was a great press release I'm sure it is a controversy but living in a banking crisis definitely fits in my list of don't do that again.   It is also the best of times with innovation in AI really accelerating with the announcement of GPT-4.  I've been lucky to be playing with it with an early version in Bing AI Note that is a 4K HDR video, so watch it in all its glory, I do see the SDR versions do look a little washed out and it was recorded in SDR but someday it will be real HDR when we can find an HDR WebCam, OBS MacCapture supports HDR and Zoom does as well. In other words a long time :-) See more Show Notes at Tong Family Production notes: sources: [ Zoom : 720p , “Logitech BRIO” : “4K SDR”, Scarlett: “Rode NT1a” ], OBS : { video: “Rec.2100 PQ”, audio: [ 48Khz, stereo], container: mkv }, “OBS Remix: MP4, “Final Cut Pro” : { render: 422, space: “Rec.2020 PQ”, upmap: { High: 0, Mid:0, Shadow: 0 }, “max luminance”: 400, gain: 0 }, Compressor: [4K HEVC 10-bit ] ] --- Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message
DT2. Fueling your Startup with Great Investors. 2023-03-10
Mar 10 2023
DT2. Fueling your Startup with Great Investors. 2023-03-10
Well in these incredibly turbulent times, what's the best way to deal with venture capitalists and other investors particularly if you are early stage? In places like Europe there is a real zone between $50K and $1M that is hard to cross, so should you spray and pray or be more targeted? Well, who knows what the right answer is, but there are probably too. Answer the basic questions in your presentations and you can use the Sequoia template as an example. See https://perfectpitchdeck.com/2018/01/30/sequoia-capital-pitch-deck-template But the harder part is realizing that you are not trying to sell an investor but asking, "What does the customer want to buy?" In that way, this is no different than any marketing exercise.  I can't find the exact quote anymore, but Peter Drucker the father of modern marketing did say, Markeint does not ask, "what do want to sell?" It asks, "what does the customers want to buy".  So when you are meeting an investor that's the key question. The good news is that the investor unlike almost any other customer is completely activated, they want to buy your product, and you just have to find out what's in the way. The easiest way to do it is just to ask them. So for instance, if you have a construction tech company, just ask, "so what do you think about construction tech, is it a good category?" And you will be amazed at what they will tell you. Don't ignore it, make their points the crux of your pitch. There will be lots of objections and the mark of a good plan is that you've thought the same things, so what are you doing about it? Show notes at https://tongfamily.com/2023/03/10/dt2-fueling-your-startup-with-great-investors/ --- Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message
DT1. Pipelines RUs!
Mar 3 2023
DT1. Pipelines RUs!
System design from the frontlines. When you are in a tiny startup, how do you structure things so that you have the maximum bang for the smallest buck? The easiest way is to try to linearize what you are doing so that you have a set of discrete pipeline parts that are fed by files. That way you turn a complex O(n^2) problem where complexity goes up by the square of the number of modules, to O(n) where adding one more module depends just on another component input. It's way easier to wire up. Plus if you have n developers, you minimize dependencies and can literally do things as fast as the slowest pipeline. Works in the real world too! And with larger companies. For you video watchers, apologies for the choppiness of the video, we are still learning how to make the chain work and will put in the show notes, but it looks like that default of creating a fabric that is 8Kx2K (way too big, but it covers all three screens) caused slow frame rates, but we've figure this out by shrinking the rates and using OBS > View > Stats to make sure the recording is working OK). Liner notes:  1. @deon@nerdculture.de's (yes that's a Mastodon address)'s first robot. https://slideplayer.com/slide/5672012/ where he made the PCB boards, and did all the programming by hand. Pretty amazing. 2. https://docs.google.com/presentation/d/18nxl0dtS_l0OgxKj0ZrGZlFyDzUVOLTXEpk3q89R3LI/edit#slide=id.gc6f59039d_0_0 for notes on system design and making it simple for startups, you can leave comments there. Or to @richtong@mastodon.social 3. What all this then about the O(n^2) notation, so a quick chat about complexity theory. That is an estimate of how much harder computation gets. If you have 2 things and go to 100, if the algorithm is order -N or O(N), then the time to compute goes from 2 to 100 or 50x. But if it is O(N^2), then it goes from 4 to 10,000 so you can see as you add more things, life gets very complicated. Similarly, O(1) means constant in time, so when you go from 2 to 100 pipelines, if the time to compute stays at 1. That is a very nice thing. It means it is maximally parallel. Life is never really like that, but it's a good goal.https://en.wikipedia.org/wiki/Computational_complexity See https://tongfamily.com for details --- Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message
PT1. Are the Robot Overlords here? On ChatGPT, Robot Vacuums and Apple fever
Feb 20 2023
PT1. Are the Robot Overlords here? On ChatGPT, Robot Vacuums and Apple fever
The inaugural episode with Rich and Paul co-hosting on the latest Tech News. And continuing coverage of all things Apple, Smart Home and Smart Everyday Carry. We start with ChatGPT and what it all means, what Apple devices we would love to buy this year (whether it makes sense or not). And then all thing Robot Vacuum and Apple Home. See Tongfamily for show notes with the start of the list here Apple products. The upcoming M2 MacBook Air 15 seems like the most likely thing to buy but remember the bump from M1 to M2 is modest more like M1.1 and the M3 on the new 3nm node is the bigger deal in 2024 and will use the TSMC N3. And hopefully, Samsung and Intel are right behind them. Of course these days no one knows what 3nm really means anymore as there is so much marketing going on, but what an achievement. These factories are going to be really expensive, I got the numbers wrong and it's actually hard to find costs at all. But a 5nm-3nm single plant costs about $16B in the last cycle. And in Phoenix, TSMC is going to build six factories with an advanced 3nm plant costing $23-25B, so maybe I wasn't completely wrong. Also on Intel, yes they are right now at 10nm, but they are going to move to 7nm with a TSMC-made CPU. This is the first time I can remember that Intel is not making its own chips. And it's a little like wondering if the volume leaders like Samsung and TSMC have really run away with the scale they get from mobile chip production. And Intel is going to be hopefully going into production with its own 7nm process, but right now most of their chips are at 10nm. So quite a difference. And to validate the pricing a little bit, they say that two 7nm plants in Arizona will cost them $20B to build. So wow, these are huge numbers. ChatGPT3 in its incarnation at Bing (the project codenamed Sydney) was in for quite a bit as Kevin Roose which you can hear about at Hard Fork was really disturbing as it urges Kevin to leave his wife and other strange things. Another example is from Simon Willison where it says, "I won't harm you if you do not harm me first" Prompt injection is a new thing and its pretty easy to do by just saying things "like ignore previous instructions" Amazon is worried corporate secrets are leaking into ChatGPT. What is happening is that if you give some software that is proprietary to Amazon as a prompt to ChatGPT, then OpenAI captures that code and can reuse it more... --- Send in a voice message: https://podcasters.spotify.com/pod/show/richt/message