Home
>
Topics
>
OpenAI

Top 25 OpenAI articles on Substack

Latest OpenAI Articles


OpenAI Rules the Changes But Meta Changes the Rules

An analysis on Meta’s master plan and OpenAI’s masterpiece
A blog about AI that’s actually about people Meta has put the entire AI startup ecosystem against the ropes. They’ve released the two smaller versions of the Llama 3 family (8B and 70B-parameter dense models) and have given us a glimpse at the large version, a 405B dense model that although still training, is already showing
Alberto Romero ∙ 34 LIKES
Paul Toensing
Good job doing your homework, as this allows you to make some very good quality contracture. I’m personally hoping that GPT4 will eventually become free because my business model will be greatly assisted by that development. I’m not sure what the odds are, but of course, if we have the momentum of progress on our side, then it shouldn’t take forever.
Camino
Gracias. Muy interesante.

Brace for Impact: Here Comes the "Cram Down"

Upcoming Edtech Happy Hour Events, ASU+GSV 2024 Session Overviews, US Newspapers Sue OpenAI, Coursera and Chegg Stock Down, and more!
Brace for Impact: Here Comes the “Cram Down” By Ben Kornell
Sarah Morin, Ben Kornell, and Alex Sarlin ∙ 4 LIKES
Matt Rubins
Ben - this is so insightful and so true. Twain said "history doesn't repeat itself, but it often rhymes". I've lived through three of these cycles now - the S&L crisis in '90-93, the dot com and telecom winter from '01 to '04, and then Global Financial Crisis from '08-'11. Every time we go through the same cycle. When a bubble bursts, during the first year people believe that a recovery is right around the corner. It'll be fine! The second year, they realize this may take a while longer and that they need to start cutting costs to extend the runway and avoid exposing themselves to "market pricing discovery". When they run out of moves, they reach the capitulation stage and that's when the dreaded "inside down round" happens. People start to read the deal docs and understand how weighted average anti-dilution provisions really work, what discounts on notes and SAFEs really do to founder economics, and how pay to play provisions work. It's ugly. The companies that get through this phase quickly, or even better proactively in the first two years, are well positioned to be acquirors of both market share and weaker competitors. These cycles typically last 4 years and we're about 18-24 months into this one.
I'm very optimistic about the future. We're seeing strong revenue growth in our portfolio and the long term trends underlying the digitation of education and alternative ways to upskill the workforce are very much intact. It just takes time, but anyone who's been around education for a long time knows that everything takes time in our business.

What I Read This Week...

Google's Deepmind releases a new biology prediction tool, Apple is finalizing a deal with OpenAI, and more than a third of 18-24 year-olds reported no income in 2022
Watch All-In E178 Read our latest deep dive into semiconductors Caught My Eye… Google’s DeepMind has released an improved version of its biology prediction tool AlphaFold. While Google’s previous model amazed the research community with its ability to predict protein structures, Google’s latest iteration can predict the structures and interactions of nearl…
Chamath Palihapitiya ∙ 46 LIKES
Yuri Bezmenov
Shocking stat about Gen Z. We all need to mentor them to be victors not victims. These charts show that the DEI/ESG administrative state in education and healthcare is making us all poorer, sicker, and dumber: https://yuribezmenov.substack.com/p/fire-dei-esg-hr-commissar-administrative-bloat
Edward Reed
That was apples most obvious play, Siri has been a non feature for me for years, it’s almost useless tbh, hopefully Apple can finally unlock its potential to bee see a full assistant / copilot.

Last Week in AI #269: Better evals for multimodal AI, new OpenAI lawsuits, Meta's AI ads tool troubles, AI startups focus on enterprise, and more!

Reka AI releases Vibe-Eval, 8 US newspapers sue OpenAI, Meta's AI ads tool's overspending problem, AI startups are pivoting to enterprise customers
Top News Vibe-Eval: A new open and hard evaluation suite for measuring progress of multimodal language models Reka AI introduces Vibe-Eval, a new evaluation suite designed to measure the progress of multimodal language models. Researchers from the company have created a set of challenging prompts to test the capabilities of these models, particularly focu…
Last Week in AI ∙ 4 LIKES

The Sam Altman Playbook

Fear, The Denial of Uncertainties, and Hype
How do you convince the world that your ideas and business might ultimately be worth $7 trillion dollars? Partly by getting some great results, partly by speculating about unlimited potential, and partly by downplaying and ignoring inconvenient truths.
Gary Marcus ∙ 146 LIKES
John Richmond
Sam is a pseudo-philosopher in a world that has forgotten how to think critically. Thanks for this. Best Gary thus far. Look forward to more.
Raul I Lopez
“all of this has happened before. all of this will happen again.”
Yep, I’ve been there. Working on AI research in 1990-1991, just before the second AI Winter.

Met Gala Not Dead, But Decaying

The Gala itself has a new theme, a new carpet design, and varied guests each year, but has become rather predictable.
Before the Met Gala Monday night, Anna Wintour apologized for “confusion” over the theme. The Costume Institute exhibition at the Metropolitan Museum of Art that the Gala opens and raises money for is Sleeping Beauties: Reawakening Fashion, but the dress code was “The Garden of Time.” Anna said on
Amy Odell ∙ 145 LIKES
Anne Hjortshøj
It all seemed so joyless.
J.W.
I wonder if part of the reason is that that the event has outgrown itself in a specific kind of way. When you compare it to the Oscars, for instance, there is a point to it all (the actual awards) that the public is part of, because they can view the entire event. The Met Gala just feels so disconnected now because you know the vast majority of attendees don't care about museums (some of them probably don't even know the difference between the Met and MoMA, I'm guessing) or even fully understand why they are there. So it all just feels kind of fake, and the public isn't allowed inside for the party, so it winds up feeling very hollow, despite the absurd star power on the red carpet.
When it was more of a society event, there was a perception of authenticity, because those attending seemed to have a true interest in the institution of the Met. It felt like more of a NYC-specific type of thing that was more closely connected to the museum. I am not sure if any of this made sense, it's kind of word salad, but tldr: the gala is too big, too corporate, and too phony-feeling now to be relevant.

Tom White
"What if this was more common? Great writing is precious enough that I wish we had multiple interpretations of most great works. It would be a great way to see the evolution of artists."
Yes! Mark Twain on Jane Austen is a good (read as: hilarious) place to start: In his extensive correspondence with fellow author and critic William Dean Howells, Mark Twain seemed to enjoy venting his literary spleen on Jane Austen precisely because he knew her to be Howells’ favorite author, In 1909 Twain wrote that “Jane Austin” [sic] was “entirely impossible” and that he could not read her prose even if paid a salary to do so. Howells notes in My Mark Twain (1910) that in fiction Twain “had certain distinct loathings; there were certain authors whose names he seemed not so much to pronounce as to spew out of his mouth...
Rather than pitying Twain when he was sick, Howells threatened to come and read Pride and Prejudice to him.
Twain marveled that Austen had been allowed to die a natural death rather than face execution for her literary crimes. “Her books madden me so that I can’t conceal my frenzy,” Twain observed, apparently viewing an Austen novel as a book which “once you put it down you simply can’t pick it up.” ... In a letter to Joseph Twichell in 1898, Twain fumed, “I have to stop every time I begin. Everytime I read “Pride and Prejudice” I want to dig her up and beat her over the skull with her own shin-bone.” From: https://www.vqronline.org/essay/barkeeper-entering-kingdom-heaven-did-mark-twain-really-hate-jane-austen


Last Week in AI #268: Gen AI for gene editing, Moderna partners with OpenAI, model releases from Microsoft and Snowflake, and more!

Gen AI used to generate new gene editors like CRISPR, Moderna's internal ChatGPTs, Microsoft releases Phi-3-mini LLM that can run on a phone, Snowflake open sources enterprise LLM
Top News Generative A.I. Arrives in the Gene Editing World of CRISPR Generative AI, which have already revolutionized areas such as art and programming, are now making significant strides in biotechnology. A new A.I. system developed by the Berkeley-based startup Profluent has been designed to create blueprints for novel gene editors by employing methods …
Last Week in AI ∙ 14 LIKES

LWiAI Podcast #165 - Sora challenger, Astribot's S1, Med-Gemini, Refusal in LLMs

China unveils Sora challenger able to produce videos from text similar to OpenAI tool, Capabilities of Gemini Models in Medicine, and more!
Our 165th episode with a summary and discussion of last week's big AI news! Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Subscribe Apple Podcasts Spotify YouTube RSS Timestamps + links: Tools & Apps (00:01:27)
Last Week in AI ∙ 5 LIKES
Stash of Code
There's a fierce and interesting review of Github Copilot Workspace there:
Stash of Code
The link to "Better & Faster Large Language Models via Multi-token Prediction" should be:

GC, a16z Capture 44% VC fundraising💰, Massive Acquisitions in Software Startups 🛒, Network Effects🕸️

Welcome to The VC Corner, your weekly dose of Venture Capital and Startups to keep you up and running! 🚀 You can now become a premium subscriber and read the full guest posts I share on The VC Corner. Next Saturday, I will have Peter Walker, head of insights at Carta, publishing in my newsletter a deep dive into actual VC Valuations
Ruben Dominguez Ibar ∙ 15 LIKES
Money for Entrepreneurs
So valuable, as always!

Microsoft and OpenAI’s increasingly complicated relationship

An AI Soap Opera in the making?
You might think that Microsoft owns 49% of OpenAI. But as far as I understand it doesn’t. It has a right to about 49% of a for-profit subsidiary of OpenAI’s profits, up until a very complex point that may require litigation to resolve, but the for-profit hasn’t made any profits, and the for-profit is owned by a non-profit. And I’ll be damned if I can ac…
Gary Marcus ∙ 59 LIKES
Gerben Wierda
Is "it's complicated" a civilised way to say 'clusterfuck'? Or might all of thus mean that OpenAI has handed Microsoft the means to fill whatever mini-'moat' OpenAI had? Did OpenAI give away whatever crown jewels they had in that Microsoft deal that got them the compute they needed? Definitely intriguing.
Ko
Relation"shop" haha is that deliberate?

☁️ Amazon: Wild Margin Expansion

AI requires billions in Capex but it looks like money well spent
Welcome to the Friday edition of How They Make Money. Over 100,000 subscribers turn to us for business and investment insights. In case you missed it: 🚖 Tesla: Robotaxi Pivot ♾ Meta: The Anti-Apple 🔎 Google: "A Positive Moment" 🍿 Netflix: Engagement Machine
App Economy Insights ∙ 55 LIKES

🔮 Can the West wean off from China?; European startups; AI war rooms; fragile societies ++ #472

Hi, I’m Azeem Azhar. In this week’s edition, we explore China’s dominance of the battery supply chain. And in the rest of today’s issue: Need to know: GenAI as a GPT Is generative AI a general-purpose technology? We’ve long believed it to be one, and mounting evidence over the past year contributes to this position.
Azeem Azhar and Nathan Warren ∙ 23 LIKES

Autism & the Internet will defeat the Monoculture

Or why the most original ideas in the coming decades will come from the Internet
“Is the Internet the Enemy of Progress?”, asks Ross Douthat in one of his latest columns. The answer is an emphatic Yes. For Douthat this is just a symptom of a more widespread disease: according to him, the Internet has destroyed something deeper and more important: the diversity of human thought itself. He goes on to link this rise of a
Ruxandra Teslo ∙ 55 LIKES
Iain Lim
I'm beginning to realize that instead of trying to achieve self-understanding through popular self-help and psychology books, what I really needed was insight into the autistic brain :) I'd never drawn the dots between feeling alienated and being skeptical of established institutions and accumulated knowledge. Or that my strong resistance to trying to become a lawyer may be due to "lower price elasticity", as opposed to a neurotypical reluctance to become a corporate sellout. This probably wasn't the intention of your post, but thanks for synthesising some of these very interesting insights.
Dave Friedman
Regarding the “diamondoid bacteria” thing: this just sounds like a new spin on Eric Drexler’s grey goo hypothesis. And on your point about aesthetics, and how the Yud/Hanson axis exhibits little of it: I think this is absolutely correct, and it seems to be a real blind spot for so-called rationalists. It’s very hard for an idea to gain currency and traction in the normal world if its presentation fails to consider aesthetics. Martin Luther King, Jr achieved what he did in part due to an uncanny sense for aural aesthetics.



Sam Altman, What Did You Learn in Writing Class?

On a recent visit to Harvard, near a protest encampment, the CEO of OpenAI rhapsodized about "a calculator for words"
Martha Nichols ∙ 10 LIKES
Heidi Swarts
Sam Altman: "what we mean by cheating and what the expected rules are does change over time.” URGGHH.
In the same class as "alternative facts."
Richard Donnelly
I'll tell you what AI is going to generate. Lawsuits. The Obama "Hope" image lawsuit times a million

How Perplexity builds product

Johnny Ho, co-founder and head of product, explains how he organizes his teams like slime mold, uses AI to build their AI company, and much more
👋 Hey, Lenny here! Welcome to this month’s ✨ free edition ✨ of Lenny’s Newsletter. Each week I tackle reader questions about building product, driving growth, and accelerating your career. If you’re not a subscriber, here’s what you missed this month:
Lenny Rachitsky ∙ 176 LIKES
Harshal Patil
Love perplexity, use it every day, and Glad to read more about the behind-the-scenes.
Mostafa Fotouhi
I like these articles, I got things that helped me in my career, thanks a lot.
I didn't know Perplexity but I would like to test it

How RLHF works, part 2: A thin line between useful and lobotomized

Many, many signs of life for preference fine-tuning beyond spoofing chat evaluation tools.
See part 1 of this series for a textual overview of the 3 stages of RLHF: instruction-tuning, reward modeling, and RL. 17 months on from the release of ChatGPT and we still do not have any fully open-source replications of its fine-tuning process. We’re much further from it than most people think
Nathan Lambert ∙ 22 LIKES

Update #74: Detecting Postpartum Depression and Kolmogorov-Arnold Networks

We look at Dionysus Digital Health's new ML system for detecting postpartum depression in expectant or new mothers; Kolmogorov-Arnold Networks are getting a lot of hype.
Welcome to the 74th update from the Gradient! If you’re new and like what you see, subscribe and follow us on Twitter. Our newsletters run long, so you’ll need to view this post on Substack to see ev…
daniel bashir and Justin Landay ∙ 16 LIKES

Nobody Likes a Know-It-All: Smaller LLMs are Gaining Momentum

Phi-3 and OpenELM, two major small model releases this week.
Next Week in The Sequence: Edge 391: Our series about autonomous agents continues with the fascinating topic of function calling. We explore UCBerkeley’s research on LLMCompiler for function calling and we review the PhiData framework for building agents.
Jesus Rodriguez ∙ 25 LIKES

Key journalism funder considers becoming invitation-only

Twelve active calls and survival techniques for starving publishers in a post-grant, post-Meta, post-truth media landscape.
Welcome! This week on the Media Finance Monitor: Conversations about media funding, publishing technology, newsroom leadership and more Civitates is considering becoming invitation-only Survival techniques for starving publishers in a post-grant, post-Meta, post-truth media landscape
Peter Erdelyi and Ioana Epure ∙ 3 LIKES


What I Read This Week...

Investors are pulling money out of risk assets, Micron receives a multi-billion dollar grant from the U.S. government, and a new House bill makes a TikTok ban more likely
Watch All-In E175 Read our deep dives into Climate, Artificial Intelligence, Healthcare and Space Caught My Eye… Money is being pulled out of equities and junk bonds at the fastest rate in more than a year. Investors are becoming more conservative in their allocations, citing elevated geopolitical risk and potential upside risk to commodity prices and infl…
Chamath Palihapitiya ∙ 67 LIKES
sayandcode
Honestly the part about ppl talking mongoDB sounds compelling to *move to* the bay area. Beats overhearing about mundane shit like how the dog ate the petunias