Three observations that really excite me about today's announcements (through my TPU-focused Product Manager lenses):
1) TPUs (Tensor Processing Units) designed by Google are powering ML applications for billions of users. Like, literally BILLIONS - via Gmail, YouTube, Maps,
Seems to solidly compete with GPT-4 on benchmarks.
Google has existing customers and surfaces to start the feedback loop, without worrying about adoption.
And Google will use TPUs for inference, so doesn't have to pay NVIDIA their 70% margins (like
@OpenAI
and
@Microsoft
has to
@ChrisJBakke
My favorite: "let's take it offline" = let's not discuss it at all, cause it's outside of my comfort zone.
(Often see this when important but challenging topics get silenced cause folks prefer easier topics where "everyone is aligned" and "no debate needed")
Absolutely in awe so far with our new
@MercedesBenzUSA
EQS 580 sedan.
@Tesla
really disappointed with their disfunctional insurance and inflexible lease terms so great to try something new 🙂 also fun listening to
@lexfridman
on the background - your cover looks quite organic
@RayDalio
at the
#AllInSummit
Some rought notes:
- decline of the US empire is likely
- we need to have a bipartisan group engineering solutions to problems like debt, wealth gap and relationship with China
- Running for the President? You need to have a unified system, which we
@elonmusk
@ilyasut
Interesting how many Soviet Union-born folks are shaping the presence and future of AI:
@ilyasut
at OpenAI, Sergey
#Brin
at Google (seems like he is not on X?),
@ibab_ml
at X,
@dmitri_dolgov
at Waymo, Misha Bilenko at Microsoft etc
I think there are a handful of other, esp
@DavidSacks
Would be great to get opinions from
@elonmusk
and
@bgurley
on the pod this week (or here). Looks like they are on two different sides of the spectrum wrt AI regulation?
@HaihaoShen
@EMostaque
@intel
@huggingface
Thanks for sharing! Curious when "experts" will finally stop spreading misinformation that "all ML runs on NVidia's GPUs" or "ML is impossible without NVidia's CUDA"
@Harvard
professor Graham Allison at the
#AllInSummit
- The US vs China now is the fiercest rivalry we've ever seen
- historically, 16 cases of such rivalries: 12 war and 4 - not war. These 4 - somehow parties managed to do strategic negotiations - US vs Soviet Union
- cuban
#Musk
on
#China
: "Space X or Starlink have no connections which China whatsoever.
#Tesla
- has one factory in China. It's a significant car market. Most of my business interests are outside of China though. However, I have good understanding of China. The fundamental thing here
@ArisAlexis
@soumithchintala
@OpenAI
@Microsoft
While I can't disclose specific numbers, many ML teams do see considerable perf/$ advantages on TPU v4 and v5p/e compared to A100/H100, respectively, esp for LLM and diffusion training with JAX and Pytorch XLA
@DavidSacks
Curious what are MSFT investors planning to do tomorrow. Buy more because MSFT will have more control in the new board and hence can rip more benefits? Or sell because of this uncertainty/ mess?
@Nick_Davidov
Just curious - do you see a possible scenario that the board did the right call and it wasn't actually a coup? Or what makes you believe it's a coup?
This year's Google Cloud Next is going to be 🔥🔥🔥.
Can't wait to chat with some of the world's best AI teams about our new ML Infra Products & Services, learn about other great stuff that my colleagues are launching, and even attend an afterparty headlined by a surprise rap
@fchollet
So oftentimes it's hard to get a raise at a big company unless you leave. Then you leave, do something else, and suddenly your ex-employer invites you back with a better package, scope etc. A chess move here?
$7,500 for the VIP ticket to the
@allinsummit
in LA - was it worth it?
This post is long-overdue and I was originally planning to publish it on my Substack, but since
@X
is now allowing long-form content, I decided to experiment with writing stuff here, esp since I'm a "Premium"
Standing ovation to
@bgurley
. It's the best talk in the
#allinpodcast
history according to
@DavidSacks
.
Three takeaways:
1) we are not good with regulation - all 4 stories illustrate this
2) where capitalism is broken is where regulation captures are the highest
3) Regulation
The announcements from
#GoogleCloudNext
keep coming!
1️⃣ TPUs are now more accessible and cost-effective than ever with Cloud TPU v5e (Preview)
2️⃣ A3 GPUs are now generally available
Power your large-scale
#AI
models with Cloud TPU v5e and A3 VMs today ↓
Great dinner with
@runwayml
founder and CEO
@c_valenzuelab
- really enjoyed the conversation (and looking forward to relaunch my rap career some day by generating rap videos using Runway 🙂)
Super exciting work by many at Google to push forward ML models that help with many aspects of the software development process. Not just simple code completion, but fixing compilation errors, suggesting test cases, helping w/ code review comments, and all kinds of other things.
@RayDalio
Curious is the announced collaboration between
@Bridgewater
and
@AnthropicAI
would produce some AI-powered version of the Principles (e.g. AI-assisted believability-weighted decision making)? Pretty sure many organizations would benefit from smth like that
Super exciting poker at the
#allin
summit - at a table with
@DavidSacks
, the winner was a lady from Dubai (didn't catch her name) who had never played poker before 🥳 I was a runner up but she crushed me at the end 🫣🙂
@wagieeacc
Isn't there a good scenario where there would simply be a new strong AI player started by Sam and Greg? So win-win-win for them-researchers-world?
One of my favorite sessions was
@yayalexisgay
comedy show at the
#AllInPodcast
. Some jokes:
- my boyfriend was a VC guy but I got layoffed. 50% reduction in workforce
- like VC, I love spending others money with punity
- VCs are so important. They are responsible for some of the
@ilyasut
Ilya, still curious to learn more (in English/Hebrew/Russian or any other language you speak, maybe Python) - what exactly happened on Friday and why? 🙂
So when you start a non-profit with an altruistic mission (as per
@elonmusk
original plan) and then turn this into a for-profit machine (what
@vkhosla
called "ahh whatever, those are details" at
@theallinpod
summit) - bad things happen. "Details" actually become "conflicts of
@Jason
@sama
will be fine - he will start a new Open/Closed/Semi-Open/Semi-Closed AI, right? Hopefully he'll use some GPU alternatives this time for his ML infra needs (e.g. Cloud TPU)🙂
SwissRe just published a study on Waymo data. It found that compared to human drivers, Waymo had:
3x lower bodily injury claims
4x lower property damage claims
Only a matter of time until this starts really impacting insurance premiums
🚀🦄🤙
#CloudTPU
Contextual AI plans to use Google’s internally developed TPU machine learning chips. The latest addition to the chip series, the TPU v4, debuted last year. Google says the processor is 2.1 times faster than its previous-generation silicon and nearly three times
.
@ContextualAI
has chosen Google Cloud as its preferred cloud provider to build and train its LLMs for enterprises, leveraging our AI-optimized infrastructure.
Hm, I was thinking why so many new people started following me on
@LinkedIn
. Somehow my post about our partnership with
@AnthropicAI
has made it to the LinkedIn Top News. It's funny that I didn't even mention anything about $300M, but the news feed still picked up my post
Super excited to host
@gromko7
, Head of
@ufc
for Eurasia, for our upcoming
@LeaderTalksUS
webinar on Nov 21 (11am PST):
We'll be talking about "Sex and Leadership: the psychodynamic connection between our work, sex and personality".
If you'd like to
Some nuggests from
@Google
's Q2 2023 Earnings call:
- # of GenAI customers on Google Cloud grew 15x from April to June
- >70% of gen AI unicorns are Google Cloud customers
- GCP: Q2 revenue of $8 billion, up 28%, and operating profit of $395 M
I asked Bard, Claude and chatGPT - "what's wrong with this paragraph from critical reasoning perspective?"
Here are the answers:
Bard:
From a critical reasoning perspective, the paragraph is lacking in clarity and objectivity. It makes sweeping statements about the future of
A.I. is projected to generate movies on demand, provide tutelage to children, and teach cars to drive themselves. All of these advances will occur on graphic processing units made by Nvidia—which is now one of the biggest companies in the world.
@TennisONEApp
@MiamiOpen
Hello. I purchased my ticket at the box office for the evening session that got cancelled yesterday. I still haven't received any info regarding replacement. What should I do?
@allinsummit
@X
💟
@tobi
talk ()
He shared some interesting stories about
@Shopify
and
@amazon
relationship and his view on the economy, technology and leadership principles. My wife has built her e-commerce startup on Shopify - - and I wanted to
@Nick_Davidov
Got it. I thought you intentionally implied a negative connotation, e.g. coup as "a sudden, violent, and unlawful seizure of power" (as per Chrome's disctionary) but looks like that's not the case
The
@googlecloud
MultiSlice system (see blog post in tweet below) is an external version of some internal software+hardware we've been using for a while to scale some of our largest ML training runs across multiple TPUv4 and TPUv5e pods.
Scaling made easy!
Albert Einstein: “I am enough of the artist to draw freely upon my imagination. Imagination is more important than knowledge. Knowledge is limited. Imagination encircles the world.”
#quoteoftheday
@ylecun
@mustafasuleyman
mentioned in his book that you didn't believe AlphaGo would have any chance against Lee Sedol a few days before the famous series of games. Is this true? Curious why?
@DivGarg9
@OpenAI
@janleike
@DivGarg9
curious about your thoughts - what's the difference between OpenAI and other labs (e.g. Deepmind, Meta AI etc) wrt data for training? Do they use more or less the same data sets and the difference is just in RLHF?
So when you start a non-profit with an altruistic mission (as per
@elonmusk
original plan) and then turn this into a for-profit machine (what
@vkhosla
called "ahh whatever, those are details" at
@theallinpod
summit) - bad things happen. "Details" actually become "conflicts of
"Meta is owned by shareholders. OpenAI is owned by a non-profit. Which would you have more confidence in? Getting your technology from a non-profit or a for profit company that is entirely controlled by one human being" -- Brad Smith, Microsoft
... absolutely ridiculous
@linkedlivin
is a really nice platform to find short-term housing or sublet your own apartment from other professionals. No need to pay enormous
#airbnb
fees or worry about tenants - the guys are creating peace-of-mind for you by nurturing a community on both sides of the
@DjokerNole
@carlosalcaraz
@Wimbledon
I also asked
@AnthropicAI
's Claude 2, and here is what Claude had to say: Unfortunately I don't have enough information to predict who will win the Wimbledon final between Djokovic and Alcaraz. Since this is hypothetical and Wimbledon already happened in 2022, I don't have