Hector Yee Profile Banner
Hector Yee Profile
Hector Yee

@eigenhector

6,112
Followers
3,396
Following
669
Media
17,546
Statuses

AI stuff, recsys, machine learning, mythology, meditation. Doing an MA in Asian Contemplative studies. Tech Emmy & book author.

San Francisco, CA
Joined January 2014
Don't wanna be here? Send us removal request.
@eigenhector
Hector Yee
4 years
My day job is to speak in an arcane snake language to a crystal vibrating at 3,000,000,000 cycles per second sitting in a cloud so that it can alter probabilities in the real world. If that isn't magic what is.
30
299
2K
@eigenhector
Hector Yee
11 months
Who remembers when LLMs were LSTMs?
63
40
786
@eigenhector
Hector Yee
3 years
numpy is the best python library
33
27
636
@eigenhector
Hector Yee
2 years
ML languages over time 2010 C/C++ 2016 python 2022 yaml
21
32
520
@eigenhector
Hector Yee
7 years
My team open sourced #FHIR (Fast Healthcare Interoperability Resources) protocol buffers today. It allows #EHR data to be handled in a portable way
9
140
374
@eigenhector
Hector Yee
5 years
Fun to see Self Organizing Maps make a return. I remember coding one and my ML colleagues were very skeptical it could scale etc. Interesting new use for them in interpretability
Tweet media one
5
64
345
@eigenhector
Hector Yee
5 years
I'm 44. I co-led Google image search quality. I have a MS in architectural science (graphics). Lots of papers including ICLR , technical Emmy, stars on github, dozens of patents etc and I still get asked to write code that runs in Python in interviews. *Shrug*
@yazicivo
Volkan Yazıcı
5 years
I am 35. I co-lead the search engine in NL+BE's biggest e-commerce platform. I have a MS+PhD in CS. Starred in GitHub projects, blog posts, confs/meetups. But I still need to deliver a silly amount of algorithm & data structure puzzles in job interviews. 👈 #WrongDecisionsInLife
4
31
178
7
33
311
@eigenhector
Hector Yee
6 years
Google 2019 research internships are now open
4
125
268
@eigenhector
Hector Yee
3 years
It feels like NLP has changed a lot since the transition from LSTMs to transformers or is that an illusion?
19
11
247
@eigenhector
Hector Yee
6 years
Today is my last day @GoogleAI for the third time. This time round worked on VR, had a nature digital healthcare paper and did deep learning on medical records and signals. Going off to do startup entrepreneurial stuff next.
28
9
222
@eigenhector
Hector Yee
3 years
Today's alien glyphs
Tweet media one
10
15
219
@eigenhector
Hector Yee
11 months
Why is France suddenly so active in AI. Do they have a sudden influx of government funding or something?
37
9
194
@eigenhector
Hector Yee
3 years
Wow there are very mediocre ml medium posts out there
26
4
190
@eigenhector
Hector Yee
3 years
A career in machine learning is moving data around in sql and pushing a button on a web interface to train your models
@andrew_n_carr
Andrew Carr (e/🤸)
3 years
A career in Machine Learning is about not knowing how to implement cuda kernels until you die
3
17
226
5
14
188
@eigenhector
Hector Yee
5 years
Achievement unlocked, first invoice for my AI/ML consulting got paid, hooray!
9
4
188
@eigenhector
Hector Yee
3 years
I'm double vaccinated but apparently I caught the covid. Not much symptoms, I only tested because work sends us kits and I test once a month. This new variant seems to spread very fast. Don't worry about me, I'm ok, just take care of yourself and get vaccinated!
20
5
187
@eigenhector
Hector Yee
5 years
I'm really loving the machine learning infrastructure that @DeepMind develops. I like the interface for Sonnet for Tensorflow 2.0 and other infrastructure that they made available for use internally. Very usable and researcher friendly.
2
30
174
@eigenhector
Hector Yee
2 years
As a research engineer I sit between two worlds. Research: maximize surprise for readers Engineer: minimize surprise for readers
5
10
171
@eigenhector
Hector Yee
2 years
Impossible to control a super intelligent AI? You don't say. We can't even control cats.
16
18
166
@eigenhector
Hector Yee
4 years
The main languages I use at work: 2000 - C 2005 - C++ 2010 - C++ 2015 - Scala 2020 - Python 2021 - SQL 😂😂😂😂😂
18
5
168
@eigenhector
Hector Yee
4 years
@deconstructized @ryxcommar You'd need to Excel at humor
0
0
159
@eigenhector
Hector Yee
5 years
Colab, numpy and Jax are amazingly pleasant and fast to do @Peter_shirley 's . I still haven't vectorized some parts with Jax and dealing with conditionals and the jit but the interactivity of colab makes it fun. Extra challenge making it functional
Tweet media one
4
27
162
@eigenhector
Hector Yee
6 years
It looks like the physical version of the shuffle phase of a map-reduce
@MikeQuindazzi
Mike Quindazzi
6 years
9
329
467
1
36
161
@eigenhector
Hector Yee
3 years
Now that remote work is getting more common why would people still want to stay in crowded and expensive cities?
68
13
159
@eigenhector
Hector Yee
3 years
My brother is visiting tomorrow for the first time in decades. Gonna tell him in person I'm a 🌈🦄. Given that he's a conservative christian not sure how he'll react but he'll have a couple hours in the car to process while we drive to the Napa wineries with my partner 😂
16
1
158
@eigenhector
Hector Yee
4 years
It would be a huge cosmic joke if it turned out that the theory of everything can only be represented by function approximation using deep neural networks
11
10
156
@eigenhector
Hector Yee
4 years
What's the difference between engineer code and research code? Usually float vs double 🤣
9
12
130
@eigenhector
Hector Yee
4 years
If an arxiv tab is open for a month, it's time to close it.
11
8
130
@eigenhector
Hector Yee
6 months
Quick announcement. My team and I are left behind in Google Research after the GDM rapture.
5
2
125
@eigenhector
Hector Yee
6 years
uh TF-IDF comes from information retrieval. It's a document feature not an AI. There is no learning at all involved! " It uses a kind of (rudimentary) artificial intelligence called TF-IDF "
11
15
119
@eigenhector
Hector Yee
4 years
I like my Twitter connections way more than my LinkedIn connections.
10
0
106
@eigenhector
Hector Yee
2 years
Data scientists - be sure to thank all the people setting up your data warehouse, label database, ETL engines, machine schedulers, metrics trackers, artifact management etc because lemme tell ya, it takes a lot of work to get the nicely packaged tensorflow examples.
3
16
107
@eigenhector
Hector Yee
2 years
Today I am grateful for python, numpy, jax, linux, pip, apt get, gpg, bash, emacs, chrome, emacs ~ backups, cold SF weather, chocolate covered coconut snacks, a roof over my head, nice co-workers, road trips, the weekend and that off tune singing in the bar across the street.
2
7
100
@eigenhector
Hector Yee
1 year
I'm transferring back to Google Research next week working on climate and Public health. So Blue Carbon to Green stuff. ☘️🌿🌵🌞
10
1
104
@eigenhector
Hector Yee
6 years
Won't it be cool if we could just publish papers as a wiki post and then people can add missing citations and upvote / downvote the post and citations and then a neat graph propagation algorithm automatically computes the relevance of the article, author h-index and all that.
4
8
97
@eigenhector
Hector Yee
5 years
It it makes y'all feel better even with a grad degree, lots of papers, lots of open source code, a technical Emmy and Google on your resume you still get to do a python coding phone screen these days.Wonder when the industry will have a portable means of software accreditation 😂
7
2
99
@eigenhector
Hector Yee
6 years
At the joint workshop on AI and health everyone seems to be using rnns and lstms but no simple baseline :/ #ICML2018 don't know if they realize that linear models can do really well
3
20
100
@eigenhector
Hector Yee
6 years
Huh someone just pointed out to me that imagenet was scraped from Google image search which was already ranked using models I had built a long time ago so that makes the images selected kinda biased to work with several generations of machine learning already. #generalization
7
14
97
@eigenhector
Hector Yee
2 years
Man now I wanna go back to college and take operations research, electronic engineering, philosophy, comparative mythology, poetry, art, mathematics and physics. Wished I was more liberal arty in college instead of rushing through and finishing my degrees ASAP.
13
3
97
@eigenhector
Hector Yee
5 years
If Einstein or Newton had Twitter would they have come up with their theories of gravity?
12
7
93
@eigenhector
Hector Yee
3 years
Who wants a tombstone that reads managed X amount of people, increased revenue by YYY M and moved metrics by Z%
9
8
95
@eigenhector
Hector Yee
4 years
So excited! First time having *math homework* in 21 years! Now to learn LaTeX
8
1
84
@eigenhector
Hector Yee
2 years
Wow I first joined Google 16 years ago. I mean I'm going to overflow 4 bits soon
5
0
80
@eigenhector
Hector Yee
2 years
I generally love python but have this love hate relationship with dependency management. So many options, pip, bazel, poetry. What's your favorite?
36
4
79
@eigenhector
Hector Yee
3 years
PaLM barely got it's day in the sun and then got upstaged by Dall-e-2 😂
4
5
77
@eigenhector
Hector Yee
10 months
I can't believe it, I actually just became a book author
16
0
76
@eigenhector
Hector Yee
2 years
What's the compressed size of all of human knowledge? LLMs seem to indicate for language under 1TB?
27
7
76
@eigenhector
Hector Yee
4 years
Math homework, I feel like a kid again, starting to actually grok the meaning of a manifold after years of just throwing it around in ML.
Tweet media one
5
4
74
@eigenhector
Hector Yee
5 years
Finally made a decision. Gonna work on organic Brains with @stardazed0 starting next week! It's a nice juicy project. mmmm brains
13
5
72
@eigenhector
Hector Yee
6 years
Twitter seems better for #AI networking than LinkedIn! I mostly get recruiters on LinkedIn and a lot more interesting pointers to new papers, ideas and connections on Twitter related to the fields I am interested in. #AI #healthcare #EHR #DeepLearning
5
3
71
@eigenhector
Hector Yee
8 years
On my feed it looks like @scalzi is talking about spicy seagulls in @cstross 's tweet!
Tweet media one
1
9
66
@eigenhector
Hector Yee
4 years
Can you believe it ... uint16 is soon not going to be able to cover the average US daily case rate. Overflowing uint16.
@COVID19Tracking
The COVID Tracking Project
4 years
Our daily update is published. States reported 63k new cases, about the same number as last Tuesday. They also recorded more than 1,000 deaths for the first time since May 29th. Today’s number of currently hospitalized (59k) COVID-19 patients is the third-highest in our data.
Tweet media one
77
1K
2K
9
8
65
@eigenhector
Hector Yee
5 years
@F_Vaggi @carlesgelada It does generate the largest gradients...
1
0
65
@eigenhector
Hector Yee
4 years
@haqim212 @g_k_swamy Innocently confused machine learners
0
2
63
@eigenhector
Hector Yee
6 years
Our Nature digital paper on "Scalable and accurate deep learning with electronic health records" is finally published. My first #healthcare and #AI paper! My contribution was the modelling work, specifically one of the models, interpretable boosting.
3
24
63
@eigenhector
Hector Yee
4 years
So many papers with "___ is all you need". Remember when it was "the unbelievable effectiveness of ___"
9
2
60
@eigenhector
Hector Yee
3 years
Are matrix multiplies with relus more conscious than meditators in nirodha sammapathi trance?
8
2
59
@eigenhector
Hector Yee
4 years
I doubt GPT-2 can come up with this transcript.
8
2
58
@eigenhector
Hector Yee
2 years
Yay, finally got jax[cuda] working on Windows via WSL2
5
2
57
@eigenhector
Hector Yee
2 years
How do people successfully be both a tech lead as well as a deep individual contributor? I find I have to focus on one or the other.
13
1
58
@eigenhector
Hector Yee
4 years
I still can't believe they taught me in Econ 101 that humans were rational
8
4
58
@eigenhector
Hector Yee
3 years
I love einsum notation, no need to think through all the crazy reshapes to do something, just specify with the indices. Was thinking of how to do outer product with matmul in batches but in einsum it's just "ij,ik->jk". boom.
3
2
57
@eigenhector
Hector Yee
3 years
I'm not kidding. I went from pioneering image ranking models, self driving car perception, Emmy award winning personalized recommender systems, pioneering dynamic pricing, neural lightfield rendering, writing Nature articles to writing SQL and running automl.
3
6
55
@eigenhector
Hector Yee
4 years
@chipro Wat ... how did they have a TF course in 2008?
3
1
55
@eigenhector
Hector Yee
1 year
I decided to do a grad degree in humanities to balance out my tech and science background. We'll see how it goes. I had lots of fun doing comparative mythology in college and ancient languages so this is an extension of my undergrad interests.
5
2
54
@eigenhector
Hector Yee
4 years
Nooooooo I closed all my tabs and now I've forgotten what papers and books I was reading....
10
0
54
@eigenhector
Hector Yee
3 years
The amount of books I want to read grows exponentially but I can only consume the read queue linearly
7
4
54
@eigenhector
Hector Yee
3 years
Are there humble people on twitter?
26
1
52
@eigenhector
Hector Yee
4 years
This is so weird to see things we'd just do routinely suddenly have a formal name
1
3
53
@eigenhector
Hector Yee
1 year
Welcome to ancestral simulator, shard number 42. In this realm you will spawn on a pre FTL civilization about to - encounter aliens for the first time - invent AGI Join in fun group activities such as: - balancing budgets - survive a global pandemic - survive climate change
0
3
53
@eigenhector
Hector Yee
4 years
Samy was the one who first taught me machine learning and my first collaborator in the field. He's a super nice mentor and researcher.
@kat_heller
Katherine Heller
4 years
Samy Bengio has stood by all of us in Brain Research, and it’s meant so much. Particularly for all the women who speak up. We started to call it “Samyland”, a safe space for the underrepresented and overlooked.
Tweet media one
3
85
839
1
2
53
@eigenhector
Hector Yee
4 years
@quantumVerd @ChrSzegedy One day we might discover that gamma ray bursts are aliens mining for their bitcoin
3
5
52
@eigenhector
Hector Yee
3 years
My colleagues were working on this for a while, glad to see it finally pay off!
@GoogleAI
Google AI
3 years
Today, in collaboration with the @Harvard Lichtman Laboratory, we're releasing a novel resource to study the human brain — an imaging dataset covering a cubic mm of cortical tissue with traces of tens of thousands of neurons and 130M annotated synapses.
Tweet media one
29
518
2K
3
3
52
@eigenhector
Hector Yee
4 years
I need a gps for mathematics. Like ok google find me the shortest route from where I am to inter-universal teichmüller theory
5
3
52
@eigenhector
Hector Yee
3 years
AI: muhahaha I have achieved sentience and shall... Scheduler: sorry have to pre-empt you for random_ecommerce_job
1
3
52
@eigenhector
Hector Yee
4 years
Getting my 5g microchip implanted in an hour so excited
2
0
50
@eigenhector
Hector Yee
4 years
Who in the world runs a physics simulation on slapping chickens
7
1
51
@eigenhector
Hector Yee
4 years
Someone told me today I was all fluff, no substance and have dunning-kruger ... let me eat this random statue I found at a bar for dinner 😂
Tweet media one
6
0
50
@eigenhector
Hector Yee
5 years
December hobby project - implement something in Jax
5
8
50
@eigenhector
Hector Yee
5 years
I flew back last Thursday on 10 minutes notice with just the clothes on my back, just in time to hold my mom's hand and sing her to sleep with my brother. She went peacefully and gracefully as we sang, heart rate dropping slowly
16
2
50
@eigenhector
Hector Yee
7 months
Why does it feel that everyone in research has the same ideas at the same time. Are the ways forward just so obvious?
19
0
49
@eigenhector
Hector Yee
3 years
Is ML the only field where every few years something new just makes entire sub branches of the field become neglected? People still learn Newton's laws with general relativity being around. Some audiophiles still like analogue over digital signal processing.
6
2
50
@eigenhector
Hector Yee
3 years
There should be a regularization term on how much power a single human can have.
8
0
49
@eigenhector
Hector Yee
5 years
Reminds me of the time a journalist called TFIDF (word frequency counting) AI. My twitter handle is a pun on eigenvector by the way. Eigenvector decomposition is something they teach in high school in Singapore in the very first linear algebra course in grade 11....
@WIRED
WIRED
5 years
Stitch Fix is using something called eigenvector decomposition, a concept from quantum mechanics, to tease apart the overlapping “notes” in an individual’s style. Using physics, the team can better understand the complexities of the clients’ style minds.
239
202
997
4
9
48
@eigenhector
Hector Yee
8 years
May be a bi-directional reflectance distribution capture device but it sure does look like a sprite can teleporter
Tweet media one
5
15
48
@eigenhector
Hector Yee
3 years
Caustics used to be very expensive to render with bidirectional ray tracing and then photon maps made it easier but biased, then metropolis sampling.
Tweet media one
9
2
47
@eigenhector
Hector Yee
11 months
I remember that apartment having alpha tested their interview process. So surreal to see this arc from start to ending like this
@gdb
Greg Brockman
11 months
After learning today’s news, this is the message I sent to the OpenAI team:
Tweet media one
2K
5K
36K
3
3
45
@eigenhector
Hector Yee
3 years
Why do I end up with days debugging tensor shapes ... seems to happen all the time
13
2
47
@eigenhector
Hector Yee
5 years
Used to think Science was about merit and hard work and now it feels like everything else human -- a popularity contest with in crowds and all that. Or is it just the human condition? Any good books about this part of human psychology accessible for a fun read?
6
2
47
@eigenhector
Hector Yee
3 years
Does anyone else reorder chores so they do a minimal distance traversal through their apartment or is it just me?
13
1
46
@eigenhector
Hector Yee
3 years
LMAO LinkedIn is sending me ads for my own job
Tweet media one
4
1
47
@eigenhector
Hector Yee
2 years
How long before we get tools that look at your ML code and automatically picks parts to automatically vectorize and parallelize? For comparison it took like 20 years from when I learned about auto vectorization in compiler class to seeing my SSE code get compiled from regular C++
8
4
44
@eigenhector
Hector Yee
5 years
Strangely one way I tend to pick projects is to find roles I am underqualified for so that I can grow while in the role. It's at the edge of the explore / exploit trade-off. Find something that exploits your current skills but also lets you explore new ones!
@uncatherio
uncatherio
5 years
The discourse about impostor syndrome bothers me, because it IS POSSIBLE to be underqualified for a role or responsibility I've had multiple experiences of attempting to raise to a supervisor "Hey, I'm not doing well at this" only to be told I was doing fine. This sucked!
4
0
40
4
3
45
@eigenhector
Hector Yee
4 years
I am a not PhD who did well in ML. Did a 2 year MS because I knew I was going to go to industry (in graphics)
@deliprao
Delip Rao e/σ
4 years
One odd job I do is help some companies by reviewing their AI job reqs. One of the common mistakes I notice HR/hiring managers make in hiring deep learning talent is to put “PhD preferred” in product AI research job req. This goes wrong in so many ways:
8
32
296
3
1
45
@eigenhector
Hector Yee
2 years
My ML tweets might seem weird like a mix of newbie and experienced and it's because I'm new to doing stuff outside of a mature walled code garden which is different from doing stuff in the chaos of the open source wilderness.
2
1
42
@eigenhector
Hector Yee
5 years
Why don't we terraform Sahara before Mars
7
5
44