Nick Schrock Profile Banner
Nick Schrock Profile
Nick Schrock

@schrockn

12,977
Followers
2,069
Following
378
Media
4,631
Statuses

Founder of Dagster Labs. Creator of Dagster. GraphQL co-creator.

Joined October 2008
Don't wanna be here? Send us removal request.
@schrockn
Nick Schrock
7 years
Jeff Dean and co at GOOG just released a paper showing how machine-learned indexes can replace B-Trees, Hash Indexes, and Bloom Filters. Execute 3x faster than B-Trees, 10-100x less space. Executes on GPU, which are getting faster unlike CPU. Amazing.
45
3K
6K
@schrockn
Nick Schrock
3 years
The terms "data cleaning" and "data wrangling" should be retired. They undervalue and trivialize the work. It is the design and construction of an organization's data products that outlive any particular model or dashboard. It's the bulk of the work and it's hard.
43
240
2K
@schrockn
Nick Schrock
4 years
@webdevMason In Cuomo's America, this nurse in Israel that grabbed a pizza boy to vaccinate when a vaccine was about to expire would be fined a million dollars.
16
194
1K
@schrockn
Nick Schrock
4 years
Tweet media one
4
108
1K
@schrockn
Nick Schrock
4 years
Here's a prediction: This is the moment Buffet has been waiting for his entire career. Berkshire has 125B in cash and a universe of distressed assets to buy (when the time is right) with real, underlying value. Buffet is going to end his career in a blaze of glory.
31
110
1K
@schrockn
Nick Schrock
4 years
Microservices are such a fundamentally and catastrophically bad idea that there are going to an entire cohort of multi-billion companies built that do nothing but contain the damage that they have wrought.
59
131
868
@schrockn
Nick Schrock
3 years
All the dunking on the Zillow team––ICs and leadership alike––is not a good look. Business is hard, they took a shot, and they missed. Can happen to anyone.
58
36
815
@schrockn
Nick Schrock
5 years
How is this not the biggest story in the world right now?
@Joyce_Karam
Joyce Karam
5 years
Wow. Sea of protestors in #HongKong ‘s Victoria Park today, estimate of 1.7 million say organizers despite rain. 11th week, 5 demands & rejecting police brutality:
117
2K
3K
22
139
770
@schrockn
Nick Schrock
10 months
@paulg Yes in my experience CEOs never exaggerate anything.
16
4
673
@schrockn
Nick Schrock
5 years
Disney acquiring LucasFilm and Marvel for 4 billion a pop turned out to be a steal in the streaming era. By comparison, this year Netflix got the rights to just Seinfeld for 500 million for 5 years. Can't really fathom what would Marvel and LF would go for today.
11
72
658
@schrockn
Nick Schrock
2 years
I can’t quote tweet @ryxcommar but this fake account fraud is one of my favorites yet. Outed by the excel row limit by bankers lmao
Tweet media one
12
91
621
@schrockn
Nick Schrock
4 years
Tweet media one
37
162
479
@schrockn
Nick Schrock
5 years
From the talk about the rewrite of fb using Relay and GraphQL. This feature is so amazing and intuitive. Deliver js only if the graphql query returns data that requires that js.
Tweet media one
7
85
468
@schrockn
Nick Schrock
5 years
Degradation of Uber customer experience under CA’s new regulatory regime is pretty shocking. 5x wait time. 2.5x price increase. Thanks AB5!
30
47
428
@schrockn
Nick Schrock
4 years
@Austen One of the most high leverage things a non-technical person can learn at a tech company is SQL. Extraordinarily empowering.
18
28
402
@schrockn
Nick Schrock
3 years
My heartfelt congratulations to the PR geniuses at Lyft and Stripe for getting this story framed this way.
Tweet media one
5
8
388
@schrockn
Nick Schrock
2 years
Every time I’m satisfied with some engineering thing I’ve done I remember what engineers who program video games pull off and most engineering is child’s play by comparison.
@JamesIvings
James Ivings
2 years
mind blown by this every time I think about it 🤯
Tweet media one
29
164
1K
3
15
379
@schrockn
Nick Schrock
5 years
1/ Today we at Elementl are excited to launch an early release of Dagster, an open-source Python library for building data applications. Here's a post about what Dagster is, why I moved to data infra, why data is hard, and why we need a new system.
10
100
373
@schrockn
Nick Schrock
2 years
@adityaag Live in SF long enough and your politics end up looking like Ra's al Ghul's
5
9
355
@schrockn
Nick Schrock
5 years
Unrelated to to WeWork S-1, but I am still amazed that Neumann (WeWork CEO) banned meat in the workplace for environmental reason while gallivanting around the world on a company-owned G650. The hypocrisy is so brazen I almost admire it in a perverse way.
7
23
355
@schrockn
Nick Schrock
3 years
Thoughts and prayers to the engineer at HBO Max that just pushed this bug.
Tweet media one
18
22
351
@schrockn
Nick Schrock
3 years
Should unrealized cap gains and a QSBS repeal pass while preserving the step-up-in-cost-basis-on-death loophole, it should be understood as total, unrestricted warfare by those who are already wealthy against those trying to become wealthy.
15
28
336
@schrockn
Nick Schrock
3 years
"People think our new software is bad/not worth it so let's make them pay to not install it" is a galaxy brain business model.
Tweet media one
14
27
335
@schrockn
Nick Schrock
3 months
1/ Wrote a document explaining to the @dagster team why I always write technical documents and discussion in GitHub Discussions rather than Notion, Google docs, or similar tools
Tweet media one
10
30
332
@schrockn
Nick Schrock
3 years
California (and San Francisco in particular) is a grand, fascinating sociological experiment. Are the network effects of talent so strong that they can withstand a government that actively hates that network and wants it eliminated.
@LorenaSGonzalez
Lorena Gonzalez
3 years
@ramzpaul 🤣 you mean Elon Musk is such a snowflake he moved from California because I said a censored bad word about him? Wow, isn’t that weak.
1K
27
197
20
22
314
@schrockn
Nick Schrock
4 years
My father is an epidemiologist and believes that East-Asian-style universal mask wearing is critical to fighting coronavirus, but that healthcare workers must get priority. So he and my mother designed a DIY mask and produced this video. Proud son today.
8
104
307
@schrockn
Nick Schrock
6 years
React team is now at Jedi-level adoption strategy: build some really good (hooks), call it alpha quality, and tell people not to use it. Reverse psychology at ecosystem scale.
5
53
315
@schrockn
Nick Schrock
4 years
@VCBrags Funny enough while watching the Jordan documentary I turned to my wife and said: “Jordan plays with such simultaneous elegance and aggressiveness. It is both beautiful and terrifying. The thing that compares that I know of is watching Sacca sign a term sheet.”
8
9
281
@schrockn
Nick Schrock
5 years
1/ As part of the FB interview series (see ) I'm going to posting some summaries and commentaries/hot takes on each interview. First up: @floydophone .
@schrockn
Nick Schrock
5 years
1/ Last week @software_daily did a series of interviews on Facebook engineering that had interviews with myself, @dan_abramov , @floydophone , @jgoldfein , and @mvernal . This series will continue in spurts over the next few months.
3
38
248
3
68
268
@schrockn
Nick Schrock
5 years
Finally read High Output Management by Andy Grove this weekend. It's 235 pages, 35 years old, and from what I can tell is the primary source for nearly every other tech-oriented management book ever since. Pretty amazing.
5
17
262
@schrockn
Nick Schrock
4 years
Noise about AAPL reminds me of this line from @BillGates about being told FB was a platform: “That’s a crock of shit. This isn’t a platform. A platform is when the economic value of everybody that uses it, exceeds the value of the company that creates it. Then it’s a platform.”
4
37
251
@schrockn
Nick Schrock
6 years
Wow. C# now will have opt-in-only nullability. Null disallowed by default. Huge change.
@terrajobst
Immo Landwerth
6 years
Here is what's coming in C# 8.0 (by @MadsTorgersen ).
32
383
614
4
78
242
@schrockn
Nick Schrock
5 years
1/ Last week @software_daily did a series of interviews on Facebook engineering that had interviews with myself, @dan_abramov , @floydophone , @jgoldfein , and @mvernal . This series will continue in spurts over the next few months.
3
38
248
@schrockn
Nick Schrock
10 months
A year ago I sent the attached message to the @dagster team, making @floydophone CEO. One year later: best decision I’ve made in my career. Company is thriving (Series B, >4x rev growth 🤯), team is on fire, product is better, org is healthier.
Tweet media one
14
3
227
@schrockn
Nick Schrock
5 years
@RaminSetoodeh I think it’s remarkable that they are all retreads or sequels. Nothing new.
9
1
197
@schrockn
Nick Schrock
5 years
How did I just learn about this? This is genius. Drive incremental adoption of GraphQL by generating REST APIs from GraphQL, rather than the other way around. Counterintuitive but brilliant. @UriGoldshtein amazing work
5
39
214
@schrockn
Nick Schrock
6 years
1/ I posted about this paper this weekend and about how awesome it is. It's the Berkeley RISELab report on serverless computing. Wanted to elaborate the parts I found really interesting and insightful.
4
68
212
@schrockn
Nick Schrock
5 years
@rabois This is from wwdc 1997. I watch this entire Q&A at least once per year to remind myself what clarity of vision and communication should look like. It’s extraordinary.
3
17
198
@schrockn
Nick Schrock
2 years
Thoughts and prayers to data/tech journalists: Dbt–-the leading transform tool in the MDS–-acquires Transform––which is not a transform tool, but a metrics tool––to transform their transformation tool into a metrics and transformation layer to enable digital transformation.
2
12
198
@schrockn
Nick Schrock
5 years
Apple no longer sells any laptops without touchbars. Their insistence on active hostility towards developers (and vi people in particular) in this regard is both confusing and maddening. Might be time to corner market on MacBook Pro 2015 15”, which was peak MacBook.
26
15
195
@schrockn
Nick Schrock
4 years
1/ Dagster has been public over a year. Last week we pushed out a new version that marks a new level of maturity for the project. We now call Dagster a data orchestrator. Here is a post about what we’ve built, learned, and principles we've developed:
4
41
194
@schrockn
Nick Schrock
5 years
@andrewchen I thought the FB acquisition of Instagram was overpriced at the time. Turned out to be the best acquisition of the decade.
2
6
180
@schrockn
Nick Schrock
5 years
"Agile" 😂😂😂
Tweet media one
12
22
184
@schrockn
Nick Schrock
5 years
Whelp there is a GraphQL documentary now :-) It's not just about GraphQL, but also about FB's transition to be mobile-first in 2012. It captures the urgency and stress of that *very* well. Thanks to the team at @honeypotio for such amazing work.
4
35
182
@schrockn
Nick Schrock
2 years
1/ We at @dagster have a Python monorepo. About 500K lines of code and 70 python packages. Not big compared to bigco, but big enough where some python tools fall over. One of these is pylint. We've switched to Ruff () by @charliermarsh . It's a gamechanger.
10
19
180
@schrockn
Nick Schrock
6 years
1/ I’m seeing a lot of hemming, hawing, and gnashing of teeth over AirBnB’s announcement that they are sunsetting React Native. They are unrolling a pretty massive investment. Obviously this is a setback for React Native ecosystem.
@gpeal8
Gabriel Peal
6 years
After two years, 220 screens, and 120,000 lines of javascript, we're moving away from React Native at Airbnb. I tried to summarize our experience in a single blog post but that wouldn't do it justice so it turned into five!
85
2K
4K
3
69
179
@schrockn
Nick Schrock
3 years
Tesla reaching eclipsing a trillion dollar market cap represents a stunning, epoch-defining defeat for the cynical, East coast financial class that set out to destroy the company. Victory has never tasted so sweet. Glory to the builders and the optimists.
3
9
174
@schrockn
Nick Schrock
6 years
The impact of Microsoft’s new leadership and strategy on the industry is simply put, stunning.
3
21
172
@schrockn
Nick Schrock
4 years
Just got caught up on the wallstreetbets GameStop drama and can confirm that it is the funniest shit to happen in a long time.
@Cokedupoptions
John W. Rich (Wealthy)
4 years
Tweet media one
26
159
2K
3
23
151
@schrockn
Nick Schrock
4 years
TIL Chick-fil-A runs a local Kubernetes cluster per store🤯
10
3
168
@schrockn
Nick Schrock
4 years
Truly shocked Twitter is still up. In 2012 while working on a risky, high stakes project at FB I asked @jayparikh what we do to bring down the site if we totally screwed it up. He said he would just unplug the global load balancer. Maybe Twitter should do that right now.
6
23
163
@schrockn
Nick Schrock
6 years
All the haterade for @LambdaSchool today is some the stupidest shit I’ve seen on Twitter in while
3
5
157
@schrockn
Nick Schrock
3 years
I will die on the Fahrenheit-is-better hill.
@decustecu
Dominik Stecuła
3 years
As a smug European, I definitely used to think that Celsius is just a superior scale for measuring temperature. After 21 years in North America, though, I definitely concede that Fahrenheit is simply better and more intuitive for temperature.
Tweet media one
871
4K
38K
16
10
154
@schrockn
Nick Schrock
5 years
I never get sick of the magical DevEx that is TypeScript combined with modern GraphQL tools like Apollo/Relay. It really is amazing. Imagine traveling back in time to 2010 and showing a frontend dev. They wouldn't even comprehend it.
6
18
155
@schrockn
Nick Schrock
2 years
Dear LinkedIn: Never in my life have I wanted to say the words "Congrats on your work anniversary!" to anyone
8
4
158
@schrockn
Nick Schrock
2 years
1/ Well this got scooped by the press (didn't see that coming Business Insider!) but I am moving from CEO to CTO at Elementl (the company behind @dagster ) and Pete Hunt ( @floydophone ) is now CEO.
11
6
158
@schrockn
Nick Schrock
6 years
This is how you dress for a conference. Ladies and gentlemen, I present to you @leeb @graphqleu
Tweet media one
3
9
153
@schrockn
Nick Schrock
10 months
@ken_wheeler Frontend eng is more difficult and complicated than backend most of the time. Most backend eng's heads would explode if they had to deal with a modern, complicated frontend.
19
4
155
@schrockn
Nick Schrock
5 years
Is there a worse UI on this earth than a smoke detector?
34
8
146
@schrockn
Nick Schrock
4 years
1/ This year students are facing the prospect of returning to a degraded college experience while still paying full tuition. We at Elementl suggest an alternative: a well-paid, year-long fellowship where you work on an open source project, Dagster.
1
39
139
@schrockn
Nick Schrock
1 year
If you ever found a company, never, ever use your real phone number for anything ever. I get 5-15 spam/sdr calls a day now.
35
1
134
@schrockn
Nick Schrock
4 years
Approximately 100% of my social circle have contracted mid-grade alcoholism during the pandemic.
11
8
130
@schrockn
Nick Schrock
2 years
I read: "A deep dive into how Khan Academy took a 1 million-line Python monolith and split it into ~40 Go services in a more than 3 year-long project." My triggered lizard brain translates: "Welcome to your nightmare made flesh."
7
8
129
@schrockn
Nick Schrock
3 years
@tayloramurphy I actually think engineers underestimate the ability of people to write "code". For example python. Lots of people could do some work in python, but they would have *zero* ability to deal with virtual environments, etc. I think it less about code and more about the infra.
9
6
126
@schrockn
Nick Schrock
6 years
Just made a post about code reviews. This came up in an ex-Facebook discussion group so I got the original text and adapted it for the outside world. Code review is incredibly important and often a source of unnecessary frustration and churn, My thoughts:
3
50
125
@schrockn
Nick Schrock
5 years
@rickhanlonii Because it natively executes in a web browser. Nearly all other reasons are either incidental or downstream from that underlying fact.
1
2
125
@schrockn
Nick Schrock
1 year
Remember how people acted this weekend. Remember who fomented panic; who spread misinformation and rumor in private threads; who abandoned business relationships in seconds that should be measured in years; who used their public platform to help and those who used it to destroy.
4
12
124
@schrockn
Nick Schrock
1 month
@powerbottomdad1 Can’t imagine the hysteria is this were a spacex mission
3
0
125
@schrockn
Nick Schrock
4 years
Finding appropriate zoom backgrounds is now critical board meeting prep.
Tweet media one
2
2
122
@schrockn
Nick Schrock
4 years
"When you're operating on the maker's schedule, meetings are a disaster" -- @paulg 2009 They actually think they invented the idea that meetings are a tax on productivity.
@jasonfried
Jason Fried
4 years
Eventually it happened. Paul Graham is quoting from REWORK, REMOTE, and It Doesn’t Have to Be Crazy at Work. It took a virus for the valley to validate our ideas.
25
126
1K
4
3
118
@schrockn
Nick Schrock
6 years
Really excited to speak at the DataEngConf SF. It will be the first time discussing Dagster, the project I’ve been working on for nearly a year. Data processing — ETL, ML, data pipelining — is a massive, critical, growing discipline and better developer tooling is a huge need.
@DataCouncilAI
Data Council
6 years
Data Council SF '19 Speaker Announcement: @schrockn from Elementl will talk about " #Dagster : A new programming model for data processing". Book your tickets now
Tweet media one
0
1
9
7
21
123
@schrockn
Nick Schrock
2 years
@dhh @3M After seeing this picture I was extremely concerned about your health and working environment. Thanks for the clarification and reassurance.
4
0
120
@schrockn
Nick Schrock
5 years
From the chatter in FB eng groups, anytime an ex-FB engineer enters a company, they are appalled at the number of repos and immediately start to consolidate and merge them if they can.
3
4
120
@schrockn
Nick Schrock
4 years
TIL I learned that has 2.2M yearly unique visitors 🤯🤯🤯 Pretty surreal.
3
13
119
@schrockn
Nick Schrock
6 years
@mjackson @ryanflorence The biggest gap in the ecosystem is a “rails for graphql” esque system. Vertically integrated, opinionated toolkit that manages db schema, data loader interactions, software abstractions etc. Huge opportunity. Way way too hard to write high quality graphql backends today.
10
22
117
@schrockn
Nick Schrock
5 years
2.1/ Technical Strategy: “Evolutionary Means For Revolutionary Ends: The Art of Changing Large Systems” Bunch of my career was spent building/tech-leading the abstraction stack that led to GraphQL. Operated mostly on instinct but formed a philosophy around what worked.
2
44
117
@schrockn
Nick Schrock
6 years
@kellabyte GraphQL exists not just because it was designed and implemented by engineers who could write backends, but also who had the ability to listen to empathize with the product developers they served, rather than insult and belittle them.
2
13
113
@schrockn
Nick Schrock
7 years
A new, successful Brazilian bank called Nubank has built a banking tech stack from scratch using Clojure, Dataomic, Kafka, and functional programming nerdery in general. Fascinating presentation.
0
46
114
@schrockn
Nick Schrock
1 year
🤘🏻🤘🏻🤘🏻
@TechCrunch
TechCrunch
1 year
Elementl raises $33M Series B for its data orchestration platform based on Dagster by @fredericl
2
12
54
12
4
114
@schrockn
Nick Schrock
3 years
1/ It’s time to rebundle the data platform. Today @dagsterio is unveiling a new concept: the software-defined asset. It makes Python a true first-class citizen in the MDS and unifies disparate tools into a single fabric that models all your data assets:
1
27
114
@schrockn
Nick Schrock
3 years
1/ It’s an exciting day: Dagster Cloud, the new standard for productivity, scalability, and trust in enterprise data orchestration, is here. We’re opening up for Early Access today.
1
15
110
@schrockn
Nick Schrock
3 years
This is an incredible hiring coup. Congrats @rauchg and the entire @vercel team for snagging one of the most talented engineers of our era.
@sebmarkbage
Sebastian Markbåge
3 years
Therefore, I'm joining Vercel starting next year! I'm lucky that I'll get to keep working on React together with the amazing teams at Meta. I'm also excited to work closely with the equally stacked team at Vercel.
53
123
1K
1
0
111
@schrockn
Nick Schrock
10 months
FB Eng ❤️
@rauchg
Guillermo Rauch
10 months
Zuck has so far open sourced and given the world: ◆ React ◆ React Native ◆ PyTorch ◆ Llama ◆ GraphQL ◆ Flow ◆ Jest ◆ Relay ◆ HHVM / Hack ◆ Yoga ◆ Hermes ◆ RocksDB ◆ Zstandard Goated.
361
864
11K
0
4
108
@schrockn
Nick Schrock
5 years
IT HAS AN ESCAPE KEY.
Tweet media one
3
5
108
@schrockn
Nick Schrock
4 years
It's important to occasionally go back and read this thread to remind yourself of what @voxdotcom , @recode and their ilk really are.
@balajis
Balaji
5 years
Incredible. Last week I called out a journalist who I thought was writing a piece that would be a disservice to public health. Unfortunately, my concerns proved well-founded. Recode’s virus piece ignores WHO & CDC, gets the science wrong…and focuses on handshakes! Thread: 🧵
Tweet media one
187
985
5K
1
7
98
@schrockn
Nick Schrock
4 years
Apropos of nothing, just a reminder of the greatest meme of the year.
Tweet media one
1
11
101
@schrockn
Nick Schrock
3 months
The Rise of Medium Code: Why the reports of software's demise are greatly exaggerated
5
20
99
@schrockn
Nick Schrock
2 years
@amasad “When men stop believing in God they don't believe in nothing; they believe in anything.” — GK Chesterton
4
8
98
@schrockn
Nick Schrock
6 years
Google trends isn’t at all scientific, but still, is there any open source piece of software that has had as much impact and adoption as @reactjs from zero to five years? It’s a stunning achievement. Props to the original, @jordwalke , and the entire team.
Tweet media one
4
10
99
@schrockn
Nick Schrock
5 years
Turned on Apple two factor auth on a new laptop. I think I’ve had to enter my password 15-20 times across 4 devices. You can really feel their organizational compartmentalization in their software sometimes. No escaping Conway’s law.
5
6
98
@schrockn
Nick Schrock
6 years
Even xkcd knows about the reality of data pipelines. Alt image text: "Is the pipeline literally running from your laptop?" "Don't be silly, my laptop disconnects far too often to host a service we rely on. It's running on my phone."
Tweet media one
1
19
93
@schrockn
Nick Schrock
2 years
Your view of @elonmusk says a lot about how much you value norms versus how much you value outcomes.
12
1
89
@schrockn
Nick Schrock
4 months
@tobi I also see a misuse of the rule to justify engineering mistakes that make it *impossible* to do optimizations/improvements in the future. Programs must be structured properly and have understand perf complexity. Premature *micro*-optimization is often a waste of time.
1
0
92
@schrockn
Nick Schrock
5 years
We should definitely spend Christmas arguing about how hard is too hard to work.
2
4
88