At
@ycombinator
W24 kickoff today,
@sama
suggested ppl build w/ the mindset GPT-5 and AGI will be achieved "relatively soon"; most GPT-4 limitations will get fixed in GPT-5, per YC founder Richard He.
Expect
@OpenAI
#GPT5
in 2024 and
#AGI
in 2025?
What's your interpretation? ๐
@4c_cccc
@ycombinator
@sama
@OpenAI
Just attended the kickoff event for Y Combinator W24 at OpenAI HQ with Sam Altman. Here are some key takeaways:
1. Startups need contextual optimization more than behavior optimization. Providing more information via RAG etc. can be more beneficial than fine-tuning.
@4c_cccc
@ycombinator
@sama
@OpenAI
3. It's not advisable to build companies that focus primarily on addressing current
#GPT4
limitations. Most limitations will get partially/entirely fixed in GPT-5.
Holy cow, GPT-4.5 beta is out in the wild already per DK.
Congratulations to the
#LLM
community &
@OpenAI
!
I will share a video recording of the reading on the LLM landscape survey /
@Stanford
#AI
index report, LLaMA-3, & where to find "GPT-4.5 beta" if still hidden then.
@4c_cccc
@ycombinator
@sama
@OpenAI
2.
@OpenAI
API will continue to be faster, more reliable, and cheaper. However, there will always be a balance between perf and cost. For example, iPhone will keep its 1-1.5 day battery life to optimize for perf even though battery technology has improved significantly.
Thanks to
@protocol
for recognizing me as one of the "10 people shaping the future of
#breach
#prevention
" and thanks to my colleagues for making it possible:
/thread
3 pivotal
#AI
deals that redefined
@Microsoft
1)
@GitHub
in 2018: a step into AI's future that even
@satyanadella
didn't foresee๐
2)
@OpenAI
in 2019: impact beyond everyone's expectations๐ฅ
3)
@inflectionAI
in 2024: a master plan Satya knew but the world was yet to discoverโจ
Have you seen
#SanFrancisco
at 9am? ๐
I have always been intrigued by the SF city, where you can find so many "insane" entrepreneurs full of hope, energy, and hunger. Despite all the "leaving SF" newspaper stories, this is the world's most concentrated talent place. ๐ฅ
GenAI in Enterprise: Builder's Insights
1 year after
@OpenAI
's
#ChatGPT
shook the world, the cautious enterprise adoption of GenAI has raised some questions.
Happy Year of the
#Dragon
! ๐ Hereโs to another year of powerful
#crowdsourcing
.
Just look at the gazillion
#fireworks
that lit up the sky in a city in China - a true testament to what humans can achieve together. ๐
Happy new year!๐
The world's GDP is $94 trillion now. In 1970 it was only $3T.By 2050 it could total $180T. US is growing at ~4% on a $22.3T base, China 6% on $16.7T, EU 2.2% on $17T.
We are lucky to live in the fastest GDP volume growth era, thanks to
#DigitalTransformation
!
Transformers are here to stay for a while. Not because itโs the absolute best architecture, but because the staggering amount of resources lock us to the existing weights.
Starting another model evolution tree will literally burn forests to ground (CO2). You only train once.
In
I'm eagerly anticipating my deep dive with
@LangChainAI
Founder and CEO, Harrison Chase, tomorrow. Platforms like
@LangChainAI
@llama_index
@vectara
are playing a pivotal role in helping developers and enterprises globally to launch impactful
#GenAI
applications.
#zscaler
is Salesforce for Security. With an amazing rev growth & gross margin, stock reached all time high $5B+ yesterday! Perhaps 2 more things helped too: 1) NASDAQ reached historical high 7,945; 2)ZS doubling down on Machine Learning/AI with an acquisition of TrustPath!:)
Remember
@Cisco
that led the
#Internet
booming in the 90s?
#Infra
always goes first in a transformation.
To date, >80% of the $12B of 2023
#GenerativeAI
funding (10% of total global 2023
#VC
capital deployed) has been to
#LLMs
builders rather than downstream
#app
builders.
Had a real good chat with Matthew Hull, VP of AI Solutions at
@nvidia
, and
@barisg
, Head of AI Products at
@SnowflakeDB
about the enterprise
#Generative
#AI
adoption landscape. Youtube link is here
Here are three insights but the inpatient:
/thread
A rewarding thing to be a
#leader
is hearing my ex colleague's career or life trajectory took a turn for the better.
Thank you Munish for letting me know my evangelization of
#SaaS
many years ago inspired you to take on an a nice
#cloud
journey. Proud of your accomplishments๐
Two decades ago, hitech companies, Wall Street analysts, VCs would watch closely on the
@Cisco
earning report and make important business decisions such as whether to go IPO next week or sell/buy stocks etc.
Today
@SnowflakeDB
plays this role, at least in the
#SaaS
industry.
@VMware
is the best
#system
#software
company in the last 25 years.
#virtualization
made
#cloud
#infra
feasible and paved some roads for 3 public companies to reach trillion dollar market cap!
Today is the last party ever, but not the last celebration of your achievement!โค๏ธโค๏ธโค๏ธ
Me: You know computation power advanced a million time last 50 yrs?
Son: How come humans have not been back to the moon?
Me: We landed an object on the moon this week!
Son: An object? Seems like a step backward. Elon plans to colonize Mars by 2050.
@elonmusk
@VeryAdamish
One of my first tasks at
@VMware
was working on the
@Broadcom
Gigabit Ethernet NIC driver on
#ESX
1.5.
VMware software has since driven the Broadcom hardware for more than two decades.
From today on though, Broadcom gets to drive VMware stack, a remarkable milestone for all!
Congratulations to
@PGelsinger
and our entire
@VMware
team for being the highest-ranked ๐ ๐ฅin the โComputer Softwareโ category, on
@Fortune
's 'Change the World' List.
1) I came to
@zscaler
through the TrustPath acquisition with the sole mission to transform the
#security
industry with
#AI
and
#MachineLearning
. It has been a super fruitful journey so far and we are still in the early inning.
Last year, I said, "
@Microsoft
future depends on
@OpenAI
."
Today, CEO
@satyanadella
: "OpenAI is going to drive innovation & competitive differentiation in every one of the Microsoft solutions by leading in AI."
Note the "every one"!!
More on
#ChatGPT
:
Legendary
@GreylockVC
investor
@chandna
crowned a future cyber legend Ben Colman. Great to have had a chance to work with both.
Congrats to
@DetectDeepfakes
for winning Most Innovative Startup @ 2024
@RSAConference
! ๐
I am lucky to have invested in 2 out of 10 finalist!
I had a chance to talk to
@bdeeter
who led the "State of the Cloud"
@BessemerVP
:
1) The "traditional" channel does not really work for SaaS
2) The new "digital channel" is picking up the steam
3) The "digital channel" that can really pull in customers deserves a healthy cut
Super nice summary from
@dvellante
and
@furrier
of
@Wikibon
:
Recent data shows slower growth in the
#IaaS
/
#Cloud
space due to the macro impact.
Although I will add that there was never a $100 billion industry still doubling in size every 2 years in human mankind history. :)
@sama
Perhaps my breakfast table chat this morning paved the way:
Me: Son, you went to bed too early last night.
@sama
announced he's joining
@Microsoft
.
Son: As
#CEO
of
#Microsoft
?
Me: No.
Son: Then
@OpenAI
should poach Sam back.
I'm thrilled to host a live discussion panel w Matthew Hull
@nvidia
VP of AI Solutions and
@barisg
@SnowflakeDB
VP of AI Products. As I prepare for this discussion,
#ChatGPT
assisted me in formulating five questions:
Here, I'm challenging X too:
/thread
@elonmusk
of
@xai
and
@tim_cook
of
@Apple
are redefining "Open AI".
The entire
#AI
research, practitioner, entrepreneur, investment community has grappled for much of the past year with two pivotal decisions: 1) whether to open source a cutting-edge large language model;
/thread
Happy birthday to 50-year old Unix! Hats off to all
#operating
#system
pioneers! My very first contribution to
#Unix
was to this offspring, FreeBSD 2.0. :)
Paper title is all you need: The monumental 2020
#GPT3
is about "Language Models are Few-Shot Learners" (aka
#PromptEngineering
) and the 2022
#InstructGPT
paper is about "Training language models to follow instructions with human feedback" (aka
#RLHF
). Happy birthday!
@OpenAI
#LLM
Today is the 2-year birthday of InstructGPT, the mother of all modern LLMs. The AI circle has a time dilation effect - can't believe it's been 2 yrs! InstructGPT laid out the canonical recipe of pre-training -> supervised finetuning -> RLHF, a strategy that everyone is still
@Stanford
Prof Gordon Lee gave my daughter, who dreams of becoming a
#doctor
, a tour of Stanford Hospital. His glimpse into the rigorous 14-year training (under+med+residency) contrasted with tech's tales of dropping out to be entrepreneurs. It sparked my interest in
#motivation
.
My friend
@ItsYamnitsky
polled me on
#DevSecOps
. I told him among 30 newly minted
#unicorn
last quarter, 10%+ of them target developers (gitlab, jfrog, pageduty), so
#DevOps
era is getting more real.
We have
@H0wie_Xu
on the Infinite ML pod today.
He's the VP of Machine Learning and AI at Zscaler.
He was previously the cofounder and CEO of TrustPath where they built a product to transform security with ML.
๐ฅ
#ByteIntoFuture
launched on
@NYSE
this week! ๐ฅ
Live interviews on the trading floor with six visionary founders/CEOs.
#AI
,
#Data
, and
#SaaS
are transforming Silicon Valley and Wall Street. Go
#GenerativeAI
!
Watch the playlist: and like it please๐
4. Watching, understanding, and distinguishing if an OpenAI Sora video is AI or not.
Gemini 1.5 highlighted the famous Sora cat video and highlighted key factors of why it could be AI-generated.
I was suprised by how in-depth it went on the response.
We're hiring
#MachineLearning
#Engineer
(apply here: ) to build a ML platform. With 70 billion transactions/day & amazing data scientists/domain experts at
@Zscaler
, it's a rare opportunity if you want to make a big impact to the $120B
#security
industry.๐
Top 30 Internet company's market cap evolution in the past 3 years -- thanks to Mary Meeker's 2019 Trend Report. Interesting to see how fast the bigger market cap companies were able to grow. Looking forward to seeing the first $2 trillion market cap company soon! :)
If you are raising your seed or pre-seed money, you are in a very good spot!๐ช
If you are raising Series A, B, or even C round, you are not in a bad spot historically.๐
If you are raising Series D and have no cash flow positive story for your business, you are in trouble. ๐ฅฒ
No surprise that Apple is not paying for ChatGPT. LLMs are at risk of commoditization with increasingly nominal performance differences. Apple distribution is the differentiator and drives brand value.
What is surprising is that Google/Gemini presumably wasnโt willing to pay up
After teaching the final investment class that he taught for 35 years on Monday,
@Yale
#Endowment
head David Swensen passed away on Wednesday after a long battle with cancer. He not only lifted endowments of so many top schools, but also shaped so many top
#VentureCapital
funds.
Jensen Huang (
@nvidia
CEO) came to
@Stanford
and offered his wish of "pain and suffering" for students. No one can label him, one of the richest men on earth, for not having empathy, because Jensen cleaned up more
#toilets
than everyone in the audience in their life.
#resilience
stop trying to destroy America you misled fool
America is the greatest country in the world for a reason (among others: work ethic, individualism, freedom, capitalism, democracy, immigration, risk-taking, nat. resources, security) and your forced communist ideas are unwelcome