Matt Busigin Profile Banner
Matt Busigin Profile
Matt Busigin

@mbusigin

18,581
Followers
2,360
Following
4,373
Media
62,865
Statuses

Wrote first LLM application platform (Cognosis). Former CIO @Hover_Networks . 35 years of writing code.

Rochester, NY
Joined January 2009
Don't wanna be here? Send us removal request.
@mbusigin
Matt Busigin
2 months
@DrBriefsScratch Sup man. Don't know who you are, but I'm sorry your neurochemistry and life circumstances are giving you such a hard time. You are doing very cool shit. DM me if you ever need someone to talk to
5
7
2K
@mbusigin
Matt Busigin
2 years
This chart is astounding.
Tweet media one
50
245
1K
@mbusigin
Matt Busigin
3 months
I call this technique "grave-to-cradle prompting", and boy does it work. Here's how: 1) When an LLM conversation becomes too long or convoluted, we end up with coherence degradation. Some LLMs degrade more slowly, but we all know this. 2) We tell it that memories are like tears
Tweet media one
Tweet media two
24
58
770
@mbusigin
Matt Busigin
4 months
IMO this may end up being as important as Attention Is All You Need
Tweet media one
28
51
588
@mbusigin
Matt Busigin
2 years
Last night, I wrote a tool which allows you to scrape data out of GPT models using SQL queries. Just make up a relevant database, and use your imagination of what kind of query you'd like, and it will return the data within GPT's parameters. Results are structured. Example:
Tweet media one
15
39
437
@mbusigin
Matt Busigin
1 year
ChatGPT Code Interpreter is *outstanding*. Everyone flipping out about this is right.
10
33
428
@mbusigin
Matt Busigin
4 years
This is basically what I'd expect someone who didn't experience '08 to think it felt like
19
19
347
@mbusigin
Matt Busigin
3 months
GPT-4o is best used in the assistants API. I see it now - it's a function calling monster. It's the only agents platform that matters really.
17
17
276
@mbusigin
Matt Busigin
6 years
@nycsouthpaw These people should be called Constantites -- followers of the state religion. That's all this ever was. Jesus was an anti-establishment pacifist hippie that hung out with social outcasts and degenerates, and there never was (or will be) any mass appeal for that.
2
17
238
@mbusigin
Matt Busigin
3 months
@nullpointered It wasn't defeated (The larger defensive system was, of course, but the Maginot line worked, and the Belgians are most at fault. The French were very concerned, but they were ignored.) Comedy of errors really. Hitler doesn't make it past France in most universes
19
2
213
@mbusigin
Matt Busigin
7 years
Musk has launched rockets into space, built highest rated car in history, guided the creation and explosion of internet payments, and most of you hate him -- and not bc you disagree w/ him, or minimise his accomplishment, but purely bc he needs to raise capital to form capital.
20
43
180
@mbusigin
Matt Busigin
1 year
I'm starting to think @ylecun may be right
18
8
172
@mbusigin
Matt Busigin
10 months
gpt-4-turbo represents a HUGE improvement in context utilization. Around 8k tokens, retrieval of facts is double that of prior gpt-4 iterations. a16z guy mostly misses the point, while demonstrating huge progress. But, yeah, longer context lengths are about what you'd expect if
Tweet media one
9
19
175
@mbusigin
Matt Busigin
2 years
FYI this is up at to experiment with. Also includes everything else you need in one spot to build LLM apps: AI-first database (Elastic w/ lots of helpers for stuff like vector search), an embedding generation service, prompt templating, map/reduce, etc.
@mbusigin
Matt Busigin
2 years
Last night, I wrote a tool which allows you to scrape data out of GPT models using SQL queries. Just make up a relevant database, and use your imagination of what kind of query you'd like, and it will return the data within GPT's parameters. Results are structured. Example:
Tweet media one
15
39
437
4
18
148
@mbusigin
Matt Busigin
4 years
@redrawnoxen Copy and paste to me the full email with headers and I will analyse it
Tweet media one
1
3
134
@mbusigin
Matt Busigin
3 years
Rural WNY town.
Tweet media one
19
14
132
@mbusigin
Matt Busigin
2 months
@GrantSlatton I feel this way looking at almost every AI paper these days. My opinion of CS domain PhDs is not high rn
1
0
124
@mbusigin
Matt Busigin
4 years
@redrawnoxen Yeah, you'll need desktop browser gmail, I think. My email address is my twitter username @ . With any luck (and it sounds like it might be the case), the sender was sloppy in covering their tracks
4
2
120
@mbusigin
Matt Busigin
8 years
Actually, gold is an infinite duration TIPS bond with an embedded short call on equities.
Tweet media one
10
38
104
@mbusigin
Matt Busigin
1 year
YAML-Runner: a protocol (and executer) for GPT-4 agents to use the file system and execute commands
6
15
109
@mbusigin
Matt Busigin
2 years
Great map from @jturow & @palak_go on the ecosystem around LLMs/FMs: GPT is a cognitive engine, and the apps around them are still CGI scripts. Real intelligence is in connectivity, conversations & flows. This stack is "how" and "who" makes that happen.
Tweet media one
7
22
106
@mbusigin
Matt Busigin
2 years
Once in a lifetime -- if we're lucky -- all of the stars align: the technology, the people, and the moment. I am starting an AI company with @blennon_ . Think B2C household name.
15
2
102
@mbusigin
Matt Busigin
1 year
I cannot believe how unbelievably fast gpt-3.5-turbo-0613 is.
5
6
103
@mbusigin
Matt Busigin
8 years
It's pretty amazing that, just 4 years ago, Romney was sunk on 49%, a roof rack dog carrier, and binders full of women.
8
43
95
@mbusigin
Matt Busigin
4 years
This chart still blows me away.
Tweet media one
4
25
89
@mbusigin
Matt Busigin
9 years
This is my baby girl, Aria. She is healthy, her mother is healthy, and I can't articulate the fullness of my feeling
Tweet media one
29
3
86
@mbusigin
Matt Busigin
4 years
Admittedly fairly minor in the grand scheme of things, but a 2020 thing that pisses me off is that well-advertised site offering "master classes" that are a gentle introductions.
8
5
86
@mbusigin
Matt Busigin
3 months
@GrantSlatton Me too, but it never worked well. Two reasons, I think: - Opus is just vastly smarter than any other model - Giving it confidence is actually important to getting high quality outputs in the face of coherence decline
1
1
84
@mbusigin
Matt Busigin
7 years
I normalised the spread between Used and New autos, and found that Used has practically never been cheaper to new.
Tweet media one
8
41
82
@mbusigin
Matt Busigin
2 years
This might be the best photograph I ever take. My wife caught what we think is a eastern lubber grasshopper. He's back where he belongs - he's OK.
Tweet media one
1
3
73
@mbusigin
Matt Busigin
7 years
All I read about is robots. All I see in the data is the 2nd lowest productivity growth in history, and accelerating labour share of income.
Tweet media one
5
39
74
@mbusigin
Matt Busigin
1 year
@ShitcoinSherpa @goodside Good job creating Judgment Day in a bunch of parallel universes, Riley
0
0
73
@mbusigin
Matt Busigin
4 years
@Popehat @kairyssdal I also think about my grandparents in the 40s as well, but in Soviet Union. My grandfather was only one of thirteen children who survived. And that was barely surviving most of the war in Nazi camps. Significant difference between the lessons Americans and Europeans draw from WW2
0
2
75
@mbusigin
Matt Busigin
6 years
60% disapproval rating following a 4.3% quarter. Man.
9
17
74
@mbusigin
Matt Busigin
10 years
Question: who predicted 5% real GDP and $50 oil? Anyone at all?
16
65
73
@mbusigin
Matt Busigin
9 years
So, maybe @NateSilver538 isn't such a chump after all.
2
18
71
@mbusigin
Matt Busigin
8 years
The real rent chart is pretty spectacular.
Tweet media one
7
47
67
@mbusigin
Matt Busigin
5 years
I can't think of a guy I care less about politically or economically than Ray Dalio. I'd rather listen to your grandmother on these subjects.
9
1
66
@mbusigin
Matt Busigin
1 year
Excited to announce @HeyOllieAi with @blennon_ , @max_fergus & team! Discover the fun side of gift-giving! Ollie tailors unique recommendations for any person in your life for every occasion and holiday. Our first step to a personal shopper for everyone -
12
25
64
@mbusigin
Matt Busigin
2 years
Even if we add another $60B or so from the past few weeks of gas price increases, the % of personal income spent on energy is still lower than any time pre-2014, except extremely brief periods of time in '99 and '01.
Tweet media one
Tweet media two
6
14
66
@mbusigin
Matt Busigin
8 years
Oooof course, this isn't exactly well publicised
Tweet media one
6
47
63
@mbusigin
Matt Busigin
5 years
@TheStalwart Our productivity could support 15-hour workweeks at a 1930 standard decades ago. Society has chosen to roll productivity gains into more material gains, instead of trading off for more leisure time. But also make no mistake: most 2019 work is leisure time relative to 1930 work.
6
12
62
@mbusigin
Matt Busigin
4 years
Where does Andrew Cuomo go to get his apology?
Tweet media one
8
6
63
@mbusigin
Matt Busigin
1 year
@TheStalwart It's been an adventure, hasn't it?
1
1
66
@mbusigin
Matt Busigin
1 year
@yacineMTB Digital Ocean baby
2
0
65
@mbusigin
Matt Busigin
1 year
@paulg It reallllllly depends on what you're doing, and how good you are at using the new toys. And it will depend highly on the creation of new tools. I've had access to GPT-4 32k since mid-March. We literally have spent ~10k on GPT-4 32k for code gen. It ranges from not helpful at
6
2
64
@mbusigin
Matt Busigin
2 years
@gwenpasch Tell me you're very experienced in business intelligence without telling me you're very experienced in business intelligence
0
0
62
@mbusigin
Matt Busigin
8 years
BTW, 1,300 jobs are still going to Mexico.
Tweet media one
5
79
52
@mbusigin
Matt Busigin
7 years
My Uber driver, upon realizing that I was flying to Buffalo without a jacket, offered to lend me his leather jacket in his trunk. #humansaregood
1
6
55
@mbusigin
Matt Busigin
7 years
I've made mid thousands econometric models. In over half of them, one of China WTO, NAFTA, or Termination of Bretton Woods is an epoch, where all of the correlations and independent coefficients flip. Bretton Woods being the most common breakage.
6
13
57
@mbusigin
Matt Busigin
11 months
@paulkrugman What fraction of consumer spending is left after you take out food, energy, shelter and autos? What happens to demand in the balance of the composition when these components are high?
3
0
57
@mbusigin
Matt Busigin
7 months
@NickADobos OpenAI is demonstrably mid at best at productising their models
6
0
56
@mbusigin
Matt Busigin
2 months
@GrantSlatton A waterloo CS PhD is also a math PhD
0
0
52
@mbusigin
Matt Busigin
1 year
If you aren't immediately reformulating your life around using GPT-4 for organizing your life, thoughts and endeavors, what are you even doing
6
5
54
@mbusigin
Matt Busigin
8 years
The average S&P 500 1y total return since '62 is about 8%. When unemployment is >5%, that jumps to 11%. 12.6% for 7%. 16% for 8%. <5% -> 0%.
2
24
52
@mbusigin
Matt Busigin
6 years
With the recent talk about recessions, I think it's useful to clarify what recessions actually are, and what happens during one. The answer, without a lot of reduction, is a drop off in private investment.
Tweet media one
3
17
52
@mbusigin
Matt Busigin
4 months
Opus is still way smarter than new Turbo
7
1
52
@mbusigin
Matt Busigin
2 years
Bing Chat is amazing. I've built whole bunch of GPT-3 and NeoX-20B chatbots, and it's clear to me that this is a new level of underlying model.
2
3
52
@mbusigin
Matt Busigin
10 years
There literally have never been this quantity of young, educated people entering the workforce ever. Boomers similar size, far less educated
13
38
46
@mbusigin
Matt Busigin
1 year
@0xjasper @_akhaliq Yeah, but OpenAI has GPT-4, so it's still the only game in town
8
2
49
@mbusigin
Matt Busigin
9 years
The biggest mistake made in economics and finance is, has been, and continues to be the serial under-estimation of the size of USA economy.
7
29
45
@mbusigin
Matt Busigin
7 years
Chart is nuts. For several reasons (mainly cheap financing), very few people have realised that 5y growth in Real Unit Labor is 96th %ile.
Tweet media one
4
24
44
@mbusigin
Matt Busigin
1 year
What a crazy few months. If you had asked me in November whether I'd be doing a webinar on AGI and code gen agents with @hwchase17 and @yoheinakajima , I'd have thought.... yeah, that sounds about right
4
2
46
@mbusigin
Matt Busigin
4 years
This is why a lotta people here don't think much of what's going on. If you own stocks, you almost certainly still have your job.
3
12
45
@mbusigin
Matt Busigin
6 years
This is pretty shameful. And explains a lot.
Tweet media one
3
21
45
@mbusigin
Matt Busigin
2 years
@fed_speak Well, there goes the 90 percent of American millionaires who got their wealth from real estate.
1
1
45
@mbusigin
Matt Busigin
2 months
@TweetsOfSumit Bold of you to assume those aren't suicide
2
0
43
@mbusigin
Matt Busigin
2 years
@sama $300 for a plumbing job? Have you hired a plumber recently? My quote yesterday was very nearly your first number.
7
0
41
@mbusigin
Matt Busigin
4 years
If you think masks are oppression, it's hard for me to say this in anything other than angry, reactive manner, but: no. You clearly know nothing about history. Or oppression. And there *is* oppression in the United States, but you have very clearly never experienced it.
5
7
43
@mbusigin
Matt Busigin
2 years
LLM misbehaving? Unreliable? Break the problem up. You're asking it to do too much cognitive work in one cycle. You should be able to segment practically any problem.
3
6
45
@mbusigin
Matt Busigin
2 years
@ikashnitsky We detect gravitational waves from the early universe. Imaged black holes after discovering them out of pure mathematics. Discovered now more than 4,000 planets outside of our solar system. Just nuts. And JWST going to give us things we can barely imagine.
2
4
42
@mbusigin
Matt Busigin
7 years
Just took this with my telescope using my phone camera
Tweet media one
4
1
40
@mbusigin
Matt Busigin
6 years
@nycsouthpaw Does that mean that the USA has been a captive of Canada all of this time? We definitely didn't take advantage of this properly
4
9
42
@mbusigin
Matt Busigin
6 years
The degree of both fiscal and monetary policy accommodation verges on unbelievable. This is close to as loose as we've ever seen.
Tweet media one
6
18
43
@mbusigin
Matt Busigin
7 years
Basically nobody quits government jobs.
Tweet media one
8
22
37
@mbusigin
Matt Busigin
8 years
Here it is -- my piece on valuation and expected EPS growth:
0
10
42
@mbusigin
Matt Busigin
8 years
The past 2 years have seen the highest increase in real hourly compensation since 1998-2001. Yup.
Tweet media one
10
32
40
@mbusigin
Matt Busigin
2 years
It definitely feels like most people around LLM application building have matured into realising that data interfaces are the key between bridging differentiable and deterministic worlds. The next big realisation is that we actually need protocols, not just single interfaces.
5
1
43
@mbusigin
Matt Busigin
6 years
Someone asked for a recession model run yesterday while I was in and out of cell coverage, and I can't recall who, but here it is. The economy remains on excellent footing, and Drumpf is lucky to have inherited such a strong foundation to wage supply shocks to via trade wars.
Tweet media one
3
21
41
@mbusigin
Matt Busigin
3 years
This came out of a phone.
Tweet media one
5
2
43
@mbusigin
Matt Busigin
6 years
Recession in the next 14 days? Anything is possible, but leading indicators -- which are certainly progressively squishier the longer the forecasting interval -- has *24 month* recession probabilities below 1 in 3.
Tweet media one
6
13
40
@mbusigin
Matt Busigin
4 years
Reopning and ignoring need for distancing+masks is pissing in the face of every American who lost a job, had their business crushed, had their hours cut, lost a loved one, performs EMT/nursing/physician work. It's all a big fuck you: it didn't matter. Your sacrifice means nothing
2
15
40
@mbusigin
Matt Busigin
1 year
@TheStalwart Nah, I never post my bangers. I keep that shit to myself
0
0
40
@mbusigin
Matt Busigin
8 years
Markets have essentially superimposed Obama-level rational stability onto new political structure & policy projections.
0
15
38
@mbusigin
Matt Busigin
6 months
@MistralAI is probably a 1st class fine-tuning service with great DX away from really chipping away at OpenAI inferencing share. And especially if they ride @lateinteraction 's DSPy train, which is establishing itself as an inter-LLM compatibility layer. Huge opportunity there.
4
6
41
@mbusigin
Matt Busigin
10 years
The next time someone tells you that the stock market isn't driven by economic fundamentals, show them this. http://t.co/1MAKMuUwLX QED.
9
14
38
@mbusigin
Matt Busigin
9 years
Households have saved the energy dividend nearly dollar for dollar, and then some.
Tweet media one
3
20
37
@mbusigin
Matt Busigin
9 years
Oh, yeah, and because part-time workers are every conspiracy nut's favourite vice, part-time -349k. Full-time +435k.
2
30
34
@mbusigin
Matt Busigin
4 months
A little table I did this AM -- I'm drawing Big O notation parallels to different complexities in Agent models.
Tweet media one
5
4
38
@mbusigin
Matt Busigin
5 years
Tweet media one
5
9
37
@mbusigin
Matt Busigin
9 years
: Cato Institute "With few exceptions, immigrants are less crime prone than natives or have no effect on crime rates"
5
46
39
@mbusigin
Matt Busigin
9 years
This shit was settled by Ben Franklin in 1729
1
12
38
@mbusigin
Matt Busigin
6 years
I'm seeing the same sort of ideological rejection of empiricism from the left of the excellent economic data the US government produces that I heard from the right when Obama was POTUS. Tribalism makes you stupid. Don't do tribalism.
6
7
36
@mbusigin
Matt Busigin
4 months
@HingumTringum and I did some hacking over the weekend and created a streaming TypeScript-based agent platform, and the first version of our code gen agent: Apex. This was entirely bootstrapped: we started in Claude console, and quickly ended up here.
Tweet media one
2
4
38
@mbusigin
Matt Busigin
8 years
The Fed is repeating a 1937 mistake -- but not the one you think:
4
8
36
@mbusigin
Matt Busigin
1 year
Just in time for Fathers Day, we've released our new Ollie: Some key features: - Generative search UI - Wishlists - User profiles - Improved product search - See more like this (product) I would love to hear your feedback, and if you love it,
4
9
36
@mbusigin
Matt Busigin
2 years
Testing some of the best SERP+GPT-3 style examples. vs . tried a little harder, but whiffed, while Perplexity had no clue. Neither got me closer than Google.
Tweet media one
Tweet media two
Tweet media three
3
4
36
@mbusigin
Matt Busigin
10 months
Perhaps the most crucial factor in intelligence is the ability to hold multiple pieces of knowledge in superposition during an information transformation that uses that knowledge for either rules, or as input for those rules.
4
6
35
@mbusigin
Matt Busigin
1 year
The first thing I did with this is some oldskool time series analysis. It claims no network access, so I had to upload some CSVs from FRED. It checks it out, makes some observations about it. Cool. I do the same for U3 unemployment rate, too.
Tweet media one
Tweet media two
1
5
36
@mbusigin
Matt Busigin
7 months
gpt-4-1106-preview just continues to blow me away with how capable it is at doing useful work on large context lengths.
3
2
34