And The Oscar Goes to Sora
Listen now
Description
Hats Off To This Week’s Contributors: @RyanMorrisonJer, @geneteare, @mgsiegler, @spyglass_feed, @saulausterlitz, @ClareMalone, @benedictevans, @mikeloukides, @ErikNaso, @kateclarktweets, @finkd, @mattbirchler, @imillhiser, @jaygoldberg, @ron_miller, @btaylor, @sierraplatform, @eladgil Contents * Editorial:  * Essays of the Week * AI Leads New Unicorn Creation As Ranks Of $1B Startups Swells  * Behold: The Sports Streaming Bundle * 40 Years Ago, This Ad Changed the Super Bowl Forever * Is the Media Prepared for an Extinction-Level Event? * Video of the Week * AI and Everything Else - Benedict Evans from Slush * AI of the Week * The OpenAI Endgame * OpenAI Sora– The most realistic AI-generated video to date * I Was Wrong. We Haven’t Reached Peak AI Frenzy. * News Of the Week * I tried Vision Pro. Here's my take * The Quest 3 is better than you might expect * The Supreme Court will decide if the government can seize control of YouTube and Twitter * Arm Results Set The World On Fire * Startup of the Week * Bret Taylor’s new AI company aims to help customers get answers and complete tasks automatically * X of the Week * Elad Gil on AI Editorial: And The Oscar Goes to Sora OpenAI teased its new video creation model - Sora - this week. In doing so it released a technical report and several examples of prompts and outputs. Cautious to not over-state the end game the company said: We explore large-scale training of generative models on video data. Specifically, we train text-conditional diffusion models jointly on videos and images of variable durations, resolutions and aspect ratios. We leverage a transformer architecture that operates on spacetime patches of video and image latent codes. Our largest model, Sora, is capable of generating a minute of high fidelity video. Our results suggest that scaling video generation models is a promising path towards building general purpose simulators of the physical world. All of the videos are incredible, albeit only a minute or less each. My favorite is the Dogs in Snow video: Although the ‘Closeup Man in Glasses’ is also wonderful. I mention this because the speed at which AI is addressing new fields is - in my opinion - mind-boggling. Skills that take humans decades to perfect are being learned in months and are capable of scaling to infinite outputs using words, code, images, video, and sound. It will take the advancement of robotics to tie these capabilities to physical work, but that seems assured to happen. When engineering, farming, transport, or production meets AI then human needs can be addressed directly. Sora winning an Oscar for Cinematography or in producing from a script or a book seems far-fetched. But it wasn’t so long ago that a tech company doing so would have been laughable, and now we have Netflix, Amazon Prime, and Apple TV Plus regularly being nominated or winning awards. Production will increasingly be able to leverage AI. Some will say this is undermining human skills, but I think the opposite. It will release human skills. Take the prompt that produced the Dogs in Snow video: Prompt:A litter of golden retriever puppies playing in the snow. Their heads pop out of the snow, covered in. I can imagine that idea and write it down. But my skills would not allow me to produce it. Sora opens my imagination and enables me to act on it. I guess that many humans have creative ideas that they are unable to execute….up to now. Sora, DallE, and ChatGPT all focus on releasing human potential. Google released its Gemini 1.5 model this week (less than a month after releasing Gemini Ultra 1.0). Tom’s Guide has a summary and analysis by Ryan Morrison Gemini Pro 1.5 has a staggering 10 million token context length. That is the amount of content it can store in its memory for a single chat or response.  This is enough for hours of video or multiple books within a single conversation, and Google says it can find any piece of information within that window with a hig
More Episodes
Congratulations to this week’s chosen creators: @sama, @openai, @om, @krishnanrohit, @peternixey, @eringriffith, @AndreRetterath, @ry_paddy, @cutler_max, @Kantrowitz, @PranavDixit, @ttunguz, @geneteare, @sarahfielding_, @carlfranzen Contents * Editorial: Eyes, Ears, Hands, and Mouth * Essays of...
Published 05/18/24
Published 05/18/24
A reminder for new readers. That Was The Week includes a collection of my selected readings on critical issues in tech, startups, and venture capital. I selected the articles because they are of interest to me. The selections often include things I entirely disagree with. But they express common...
Published 05/10/24