4/14: Look at AI research. Not too long ago, advancements like GANs or Transformer were groundbreaking. Now, similar leaps happen more frequently/unexpectedly, leading to an increased rate of acceleration - look at
@tri_dao
’s work with FlashAttention-2 as one example.