ARC Prize @arcprize Twitter profile

Pinned Tweet

ARC Prize

3 months

Announcing ARC Prize. A $1M+ competition to beat the ARC-AGI benchmark and open source the solution. Hosted by @mikeknoop & @fchollet .

20

96

295

Last Seen Profiles

@g9567719531324

@guardianodifaro

@vegasdickwizard

@TeamJack

@stw_pdg

@akajovemlu

@Arab8xSexEgypt

@lamin44930891

@ahiddendrummr

@stw46

@jessciel8

@helgship

@ontahe

@puffiecreamy

@animanalytica

@75min_kingyo

@jackjack0817

@_Iammyalynn

@rkshyu

@IlaBrugal

@abo_faisaly

@AnnieC_Noodles

@cecbrn

@celineclaraaa

@martinus1972

@stwmaniax

@daiIysanemi

@airliquide_de

@frezgiko

@sot87opmbar

@Carlene4248

@kurniawan_afgan

@Ma8k0

@TinyManiacYT

@Donblor

@abipasutrii

ARC Prize

@arcprize

2 months

New ARC-AGI high score! 43% (Prize goal: 85%) Congratulations, MindsAI!

12

23

319

ARC Prize

@arcprize

18 days

New ARC-AGI high score! 46% (Prize goal: 85%) Congratulations, MindsAI!

5

33

288

ARC Prize

@arcprize

3 months

New ARC-AGI high score! 39% (Prize goal: 85%) Congratulations, MindsAI!

7

20

243

ARC Prize

@arcprize

3 months

New ARC-AGI high score! 38% (Prize goal: 85%) Congratulations, MindsAI!

6

15

241

ARC Prize

@arcprize

2 months

New ARC-AGI high score! 41% (Prize goal: 85%) Congratulations, MindsAI!

6

19

219

ARC Prize

@arcprize

2 months

New ARC-AGI high score! 42% (Prize goal: 85%) Congratulations, MindsAI!

5

10

213

ARC Prize

@arcprize

2 months

Not only can children solve ARC-AGI tasks, they can create them, too.

9

30

168

ARC Prize

@arcprize

19 days

"Abstraction is the key to generalization." @fchollet Where we are now vs where we are going on the spectrum of abstraction.

8

32

170

ARC Prize

@arcprize

10 days

[Paper] Neural diffusion models that... Invert "noise" applied to syntax trees Iteratively edit code while preserving syntactic validity, making it easy to combine the model w/search Learn to convert images into programs that produce those images

5

29

171

ARC Prize

@arcprize

2 months

New baseline score on ARC-AGI-Pub GPT-4o mini: 3.6% This score is against the public evaluation set

20

12

160

ARC Prize

@arcprize

18 days

[Paper] "Automated Design of Agentic Systems" features a case study on ARC-AGI. This approach - Meta Agent Search - progressively discovers novel agents that outperform state-of-the-art, hand-designed agents.

3

25

155

ARC Prize

@arcprize

30 days

Leading AGI research lab DeepMind is implementing nearly identical techniques we're seeing at the top of ARC Prize leaderboards. 1. test time fine-tuning 2. blast inference + search AlphaProof = closed source ARC Prize winning solutions = open source (by end of 2024)

7

14

148

ARC Prize

@arcprize

7 days

[Paper] Current high-scoring team member @bayesilicon shares an ARC-AGI training task generator. More examples "...should enable a wide range of experiments that may be important stepping stones towards making leaps on the benchmark ."

4

16

146

ARC Prize

@arcprize

16 days

[Paper] ARC-AGI remains unsolved despite its seemingly simple content and evaluation methods. To overcome the limitations of result-oriented analyses, this study embraces the Language of Thought Hypothesis (LoTH).

3

25

124

ARC Prize

@arcprize

20 days

[Paper] "A very cool example of how you can use LLMs with discrete program search...getting a 2x improvement on ARC-AGI." @fchollet #AGI24

3

9

127

ARC Prize

@arcprize

9 days

The spectrum of key factors that define intelligence. 1. Fluidity: Memorization vs skill synthesis. 2. Operational area: Low vs high abstraction in skill usage. 3. Information efficiency: High vs. low amount of data to acquire skills. @fchollet

4

51

143

ARC Prize

@arcprize

17 days

[Paper] ARC-AGI is hard: a vast action space, hard-to-reach goals, a variety of tasks... ARCLE is an environment for reinforcement learning research on ARC that shows agents can learn via proximal policy optimization.

1

18

103

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

21

5

100

ARC Prize

@arcprize

15 days

[Paper] Test-Time Training (TTT) layers show an ability to dynamically adapt & learn during test time, which is essential for the diverse & novel problems in ARC-AGI. This approach outperforms Transformers & RNNs in long-context tasks.

1

11

97

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

31

4

86

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

16

3

79

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

18

3

79

ARC Prize

@arcprize

1 month

New article from @freethinkmedia featuring @fchollet and ARC Prize. New ideas are needed. Maybe you could put the next event on this AGI timeline!

1

21

64

ARC Prize

@arcprize

29 days

From the @TuckerCarlson pod - @amasad (CEO, Replit) talks ARC Prize, AGI, and AI legislation. [Edited] Source:

5

19

73

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

13

6

70

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

20

3

71

ARC Prize

@arcprize

21 days

"Intelligence is the ability to blaze fresh trails and build new roads. It's not the road. Don't confuse the output of the process with the process itself." @fchollet at #AGI24 Full talk:

4

18

71

ARC Prize

@arcprize

1 month

ARC Prize Co-founder @mikeknoop presented a demo of ARC-AGI today to Senator @Scott_Wiener , FTC Chair @linakhanFTC , and Assistant Attorney General Jonathan Kanter.

Lina Colucci

@lina_colucci

1 month

@mikeknoop gave a masterclass at @ycombinator today on why we should not be trigger-happy on regulating AI. He pulled up this graph showing how far we are from actually achieving human-performance AGI according to the @arcprize benchmark. (Read: we're NOT close) "I think our

2

10

41

1

13

67

ARC Prize

@arcprize

2 months

Introducing the ARC-AGI Public Leaderboard. A second ARC Prize leaderboard to measure the AGI progress of frontier AI models. $150k verification fund. No prize money. 1st scores on the board.

Introducing the ARC-AGI Public Leaderboard

A new leaderboard for frontier AI models measuring the ARC-AGI public task set.

arcprize.org

1

5

62

ARC Prize

@arcprize

3 months

LLMs won’t lead to AGI $1,000,000 Prize to find true solution Hear the full story from @fchollet & @mikeknoop talking with @dwarkesh_sp * Why LLMs struggle with ARC * Skill vs intelligence * Future of AI progress Full ep:

6

9

61

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

22

3

59

ARC Prize

@arcprize

29 days

ARC Prize 2024 has reached 10k entrants on Kaggle! There's still plenty of time to get involved. In addition to high score prizes, there are also paper awards to reward novel approaches. 10,007 Entrants 726 Participants 677 Teams 4,132 Submissions

2

4

56

ARC Prize

@arcprize

2 months

"The point of [ARC Prize] is to incentivize people to go beyond large language models to develop AI sytems that truly are intelligent." - @seancarroll From a recent #MindscapePodcast interview w/ @fchollet .

2

9

57

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

16

2

53

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

14

3

53

ARC Prize

@arcprize

2 months

"The New Ideas Needed for AGI" - new essay on ARC Prize from @sequoia .

4

9

50

ARC Prize

@arcprize

2 months

"If you want to solve ARC - if you want the million dollars - you're going to have to come up with something original." @fchollet on the #MindscapePodcast w/ @seanmcarroll

1

6

52

ARC Prize

@arcprize

3 months

New ARC-AGI high score! 🎉 ▓▓▓▓▓▓░░░░░░░░░░░░░░ 34% (Human avg. = 85%)

1

2

49

ARC Prize

@arcprize

1 month

Can you solve it? Reply with the answer.

13

4

49

ARC Prize

@arcprize

1 month

[Paper] "Our result [...] unveils the fundamental difference between learning to reason and learning to achieve high performance on NLP benchmarks using statistical features."

On the Paradox of Learning to Reason from Data

Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this...

arxiv.org

1

6

45

ARC Prize

@arcprize

12 days

Are you going to NeurIPS in December? See you there. More details soon...

1

4

49

ARC Prize

@arcprize

2 months

"The purpose of ARC is to get researchers to refocus on intelligence (adaptation to novelty, generalization), away from pure memorization, because I believe this is how we'll get to AGI."

François Chollet

@fchollet

2 months

To be clear, I've never claimed that solving ARC was equivalent to solving AGI. The first ARC solver is not going to be an AGI (I already stated this all the way back in 2019). The claim is simply that: 1. Until we solve ARC, we don't have AGI, since the AIs we have cannot

46

84

847

1

5

47

ARC Prize

@arcprize

16 days

What if ARC-AGI were a 3D, Tron-like world? Would you go?

Smoke-away

@SmokeAwayyy

1 month

ARC-AGI

5

15

102

4

1

47

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

11

1

44

ARC Prize

@arcprize

1 month

AGI is not a solved problem. Scale is not all we need. ARC Prize was created to motivate AI researchers to, once again, work on new ideas and openly share progress. Hear @mikeknoop 's talk at a recent @ycombinator policy event.

2

3

40

ARC Prize

@arcprize

1 month

[Paper] This is interesting for ARC-AGI because it enhances pattern recognition and reasoning by efficiently encoding and processing relational data, enabling advanced logical inferences and hierarchical representations.

A logical re-conception of neural networks: Hamiltonian bitwise...

Despite current AIs' extravagant computational expense, they produce surprising errors, that are poorly understood; HNet is a novel formal system that builds rich symbolic representations (such as...

openreview.net

3

1

39

ARC Prize

@arcprize

8 days

"Forget about human exams. Generalization is the key question, and it wasn't at all taken into account in the way human exams are designed." @fchollet

4

5

41

ARC Prize

@arcprize

2 months

AGI progress has stalled. 2023: $20B LLMs; Maybe ~$100M AGI. Frontier research is no longer open. From @mikeknoop 's presentation at @arizeai Observe July 11 in SF.

4

6

40

ARC Prize

@arcprize

1 month

Can you solve it? Reply with the answer.

9

1

38

ARC Prize

@arcprize

14 days

"This arms race between the big tech companies to build the best possible LLM has led to an intellectual collapse, where everyone is working on the same things." "The top entrants in ARC Prize have been outsiders coming up interesting, novel ideas." @fchollet #AGI24 [edited]

1

38

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

8

1

37

ARC Prize

@arcprize

2 months

Can you solve it? Reply with the answer.

14

3

34

ARC Prize

@arcprize

2 months

Where it all began... The original paper from @fchollet introducing ARC-AGI as a measure of intelligence. Have you read it?

On the Measure of Intelligence

To make deliberate progress towards more intelligent and more human-like artificial systems, we need to be following an appropriate feedback signal: we need to be able to define and evaluate...

arxiv.org

0

6

32

ARC Prize

@arcprize

1 month

Around the world, people are working to defeat ARC-AGI. The puzzle remains unsolved. New ideas are needed.

Henry Mao

@Calclavia

1 month

We're just one week away from Singapore's first AI Tinkerers meetup! We've got community demos discussing the latest insights from testing Llama 3.1 and attempts at tackling the @arcprize . We're calling for more demos! Registration is now at 50% capacity. @jheitzeb

2

0

10

2

31

ARC Prize

@arcprize

2 months

New article on ARC Prize from @newscientist . “It is testing something very important, which is the ability of systems to deal with novelty.”

$1m prize for AI that can solve puzzles that are simple for humans

Deducing the correct pattern that links pairs of coloured grids is relatively easy for most people, but relies on skills that artificial intelligence models lack. A new $1 million prize hopes to...

www.newscientist.com

1

8

30

ARC Prize

@arcprize

18 days

Can you solve today's ARC Prize Daily Puzzle? Try your solution here:

3

0

28

ARC Prize

@arcprize

2 months

Community-hosted event: "Reverse-Engineering the Abstraction and Reasoning Corpus" with @bayesilicon .

Reverse-Engineering the Abstraction and Reasoning Corpus

Michael studied Computer Science in Zurich, Switzerland. He is currently working as a freelance programmer, but his main focus remains ARC.

www.eventbrite.com

0

2

28

ARC Prize

@arcprize

16 days

How fast can you solve this one? Describe the solution in as few words as possible! ARC Prize Daily Puzzle

12

2

26

ARC Prize

@arcprize

15 days

Brilliant minds are teaming up around the world to work on ARC Prize. 🙌

Jason Stock

@itsstock

16 days

First successful meetup for @arcprize with coffee! … reinforcement learning, compressive memory, meta learning, gflownets, … feeling inspired! 😃

2

1

29

0

27

ARC Prize

@arcprize

1 month

Have you played the Daily Puzzle today? The tricky thing today is: why is there only sometimes a horizontal flip? 🧐

5

2

24

ARC Prize

@arcprize

1 month

Introducing the ARC Prize Daily Puzzle! Can you solve it?

Introducing the ARC Prize Daily Puzzle

Wordle but with AI IQ tests.

arcprize.org

4

3

24

ARC Prize

@arcprize

26 days

"In the words of Jean Piaget, intelligence is what you use when you don’t know what to do. It’s how you learn in the face of new circumstances, how you adapt and improvise, how you pick up new skills." @fchollet

Center for Natural and Artificial Intelligence

@discoverycnai

29 days

Programmer: Chatbots Are a Dead End. Time for a New Contest!

1

4

2

0

23

ARC Prize

@arcprize

3 months

Behind the scenes of ARC Prize 2024 * What inspired ARC Prize 2024? * Why require open source solutions? * Why $1M+ in prize pool? Hear it all with @mikeknoop on the @NoPriorsPod Full Episode:

2

3

23

ARC Prize

@arcprize

2 months

"You ability to acquire that new skill...shows the general intelligence ability that you have." @mikeknoop to @eladgil on @NoPriorsPod

0

4

23

ARC Prize

@arcprize

2 months

Congrats on winning 🥉 at the @AGIHouseSF hackathon!

Aditya P. Advani

@aditya_advani

2 months

Weird flex but OK! We spent 85 million GPT-4o tokens ($727) this weekend hacking on the @arcprize at @AGIHouseSF using @ryanpgreenblatt 's SOTA pub code! #dedication cc @spatialweeb @iliazintchenko

1

2

29

1

22

ARC Prize

@arcprize

11 days

[Paper] "Despite 3 international competitions with [$1M+] in prizes, the best algorithms still fail to solve a majority of ARC tasks and rely on complex hand-crafted rules..." Explore DSL search, DreamCoder, LLM, and ensemble approaches.

0

2

20

ARC Prize

@arcprize

1 month

"Discovering and benefiting from artificial general intelligence in our lifetimes depends on open source and open science. We must establish policy and incentives to enable innovation and not let fear of the future set us back for years, or even decades."

Mike Knoop

@mikeknoop

1 month

On Monday, I shared a letter with Senator Wiener and his team opposing SB-1047 based on my experience leading Zapier AI and ARC Prize. Zapier is the largest automated AI platform in the world. And ARC Prize is the biggest frontier AGI research competition. Others have made

8

17

123

1

18

ARC Prize

@arcprize

23 days

Is today's ARC Prize Daily Puzzle easy for humans?

4

1

17

ARC Prize

@arcprize

2 months

Who do you admire most in AI? Here’s @mikeknoop ’s answer on @sequoia podcast Training Data w/ @sonyatweetybird @gradypb Spoiler: @RichardSSutton @fchollet

1

3

17

ARC Prize

@arcprize

3 months

ICYMI - catch @mikeknoop on @NoPriorsPod to learn more about ARC Prize.

Elad Gil

@eladgil

3 months

🎙️Pod w @mikeknoop founder of @zapier on new Arc Prize for AGI We discuss: -Redefining AGI -ARC Prize for AGI -Prizes vs investing - why do each? -LLM adoption at Zapier

3

12

61

0

3

14

ARC Prize

@arcprize

24 days

At #AGI24 this week: @fchollet on defining, measuring, and building AGI.

SingularityNET

@SingularityNET

1 month

We are pleased to announce that François Chollet @fchollet , AI researcher and Senior Staff Software Engineer at @Google , will speak at the 17th Annual Conference on Artificial General Intelligence. Register now to attend #AGI24 in-person or watch online:

5

28

200

0

2

13

ARC Prize

@arcprize

2 months

You can try this yourself using this Kaggle notebook template. <$1 to run.

Using Frontier Models on ARC-AGI via LangChain

Explore and run machine learning code with Kaggle Notebooks | Using data from ARC Prize 2024

www.kaggle.com

0

14

ARC Prize

@arcprize

1 month

[Paper] "The lifelong learning + flexibility to test-time tack on an arbitrary number of experts makes this research an interesting candidate for ARC-AGI (specifically for a test-time deep learning guided DSL generator)." @mikeknoop

0

1

14

ARC Prize

@arcprize

23 days

Inspiration for ARC Prize solutions can come from anywhere. Here's @fchollet on the TensorFlow podcast talking about how children behave like scientists in learning. What's inspiring your approach? Source:

1

3

13

ARC Prize

@arcprize

25 days

Can you solve the ARC Prize Daily Puzzle? 🤔

6

0

12

ARC Prize

@arcprize

7 days

Latest ARC Prize community newsletter just sent. 🟩 +13% in ARC-AGI world record 🟦 Chollet's talk @ AGI-24 🟨 Resources (papers, datasets...) 🟥 Community (team up, approaches...) Not on the list? Sign up now!

0

13

ARC Prize

@arcprize

3 months

Thanks for featuring the prize launch, @bensbitesdaily !

The ARC Prize - $1M challenge to build AGI challenges LLMs

François Chollet, the creator of Keras and Mike Knopp, co-founder of Zapier are launching a challenge to find alternative ways to get to “general intelligence”.

bensbites.beehiiv.com

0

1

11

ARC Prize

@arcprize

11 days

Can you solve today's ARC Prize Daily Puzzle in less than 1 minute? ⏱️ 👉

2

0

9

ARC Prize

@arcprize

9 days

@fchollet Source:

General Intelligence: Define it, measure it, build it

Dr. François Chollet (Keras, ARC-AGI, Google) presents a keynote talk at the AGI-24, The 17th Annual AGI Conference, on August 15, 2024, in Seattle, WA.The A...

www.youtube.com

1

3

8

ARC Prize

@arcprize

14 days

ARC Prize Daily Puzzle from last Sunday. Avg. time to solve: 4.5mins Avg. attempts: 5 How would you describe the output rule?

4

0

8

ARC Prize

@arcprize

24 days

ARC Prize mentioned on @TheAIFix w/ @gcluley & @MarkStockley . [Edited] Source:

0

1

6

ARC Prize

@arcprize

1 month

"ARC now is a $500,000 target where everyone is aiming at the bullseye." @MelMitchell1 on state of ARC-AGI progress.

On the “ARC-AGI” $1 Million Reasoning Challenge

In this post I’m going to go into the weeds, describing how some people are trying to win a big $$$ prize for solving a still-wide-open AI challenge, the “Abstraction and Reasoning Corpus,” and what...

aiguide.substack.com

0

1

6

ARC Prize

@arcprize

3 months

🟨🟦🟥🟧🟩

0

6

ARC Prize

@arcprize