Gilad Feldman @giladfeldman Twitter profile

Pinned Tweet

Gilad Feldman

4 years

Mass Judgment & Decision Making replication & extensions project [Updated] 72 completed (+13 ongoing) + 13 RRS1 Project: 2020: 2019: Pubs&preprints: Join:

1

15

82

Last Seen Profiles

@bokeplokalmalam

@seungchii

@fuz_games

@bokeplokalmalam

@kung83740639

@grassin_growup

@Teesa_Michele

@sotwecom

@_FAIIU

@d0csuser

@bokeplokalmalam

@Owels786

@Akiiakagu

@star2miniverse

@IzuochalsReal

@CoachWilk0

@Steph13Freed

@stw_pdg

@Grangepark2013

@BGroundhopping

@yandark_

@ACS211114

@denverstiffs

@PositiveMoneyUK

@MKWheelz

@JoenWoen_09

@tyler_Rardin04

@HmryLtyft

@hunter_wippert

@DrLizzie2

@Inshopbq

@JakeHornok

@doremifaso64

@cjlj_1

@ludaubian_

@Freemenssport

Gilad Feldman

@giladfeldman

4 years

"Methods and Algorithms for Correlation Analysis in R". I admit I did not know there are all these variants of correlations. 🤯 Multi-level correlations? Part of the easystats R package. Check it out: Preprint - Github -

6

138

409

Gilad Feldman

@giladfeldman

1 year

A reminder for the new academic year: We have a collaborative "Effect sizes and confidence intervals guide" to ease your/students' lives regarding all effect sizes related (examples in R): Use/adjust/adopt/contribute as you like.

Gilad Feldman

@giladfeldman

4 years

=Effect Size, Confidence Intervals, & Power Analyses Collaborative Guide= @qinyu_xiao did remarkable job revamping our collaborative guide. Extends @lakens (2013) ES guide to updated methods & using R. Please use, check, & give us feedback!

3

33

83

6

97

409

Gilad Feldman

@giladfeldman

4 years

We social psychologists really need to discuss "Humankind" by @rcbregman . I finished listening to audiobook yesterday. Putting aside inspirational message, I think social psychologists should read chapters regarding the classic findings in social psychology. Explanation👇

9

67

308

Gilad Feldman

@giladfeldman

4 years

Don't know what people think of when they think of #HongKong , but here's a bit from a morning #hike ...

16

14

290

Gilad Feldman

@giladfeldman

4 years

I ran a 3-hour "Practical open-science meta-analysis workshop: Conducting open and reproducible meta-analyses" yesterday. Video available online:

Practical open-science meta-analysis workshop: Conducting open and...

This is an online/remote workshop given at the University of Hong Kong on February 15, 2021, by Gilad FeldmanSlides: https://mgto.org/2021MAworkshop Cloud fo...

www.youtube.com

6

66

274

Gilad Feldman

@giladfeldman

3 years

🧑‍💻Beginner R/Rmarkdown workshop completed 🧑‍💻 Simple powertools making R easy with copy-paste. Get you started, overcome scary transition to R. No coding required to do amazing things, get started with point & click, build skills, learn, improve. Video:

Practical easy hands-on beginner R RMarkdown workshop | Open Science...

This is an online/remote workshop titled "Practical easy hands-on beginner R/RMarkdown workshop | R is easier than you think, time to move to R" given on Oct...

www.youtube.com

3

56

184

Gilad Feldman

@giladfeldman

3 years

= Moving the needle with replications = Submitted replication of Psychological Science classic to PS. Found errors in reporting in original, reproduced very brief methods in original, various extensions (between/within designs). Desk rejection: haven't moved the needle 🤷‍♂️

15

33

163

Gilad Feldman

@giladfeldman

4 years

=grant reviewers as gatekeepers hindering replication work= Two years of Hong Kong's GRC grant requests for doing replications+extensions. Last year: Score 3.5/5 Asked clarifications, I resubmitted with details. This year: Score 2/5. Fascinating feedback. Examples below 👇

8

42

154

Gilad Feldman

@giladfeldman

1 year

Have you watched "The Prevalence of Replications in Psychology"? Beth Clarke shares the result of their analysis. What's our replication ratio? It's 0.2%. No, not 20%, not 2%, it's 1/5 of a percent. 0.2%. 1 in 500 gets replicated. Video:

The Prevalence of Replications in Psychology

Session: The Prevalence of Replications in PsychologySpeaker: Beth Clarke, PhD Candidate, University of MelbourneAbstract: Despite lip service about replicat...

www.youtube.com

2

45

152

Gilad Feldman

@giladfeldman

1 year

A reminder for the new academic year: We have a collaborative "methods best practices" where we keep track of methods resources (~150 pages): Use/adjust/adopt/contribute. (If you contribute, add your name & contribution and become a coauthor)

3

37

140

Gilad Feldman

@giladfeldman

1 year

This came up on my YouTube, and I ended up listening to all of it: "Research methods lecture on internal, external, and statistical validity" by Simine Vazire. Recommended. I learned a few things, and found new tools and slides for my teaching.

Research methods lecture on internal, external, and statistical...

Simine Vazire's lecture to Masters students in an Applied Research Methods class, covering the topics of internal validity (causal inference), external valid...

www.youtube.com

1

25

127

Gilad Feldman

@giladfeldman

11 months

= Old school journals and Registered Reports = Case study thread 🧵 We had a Stage 2 Peer Community in =Registered Reports= endorsed. Was very surprised when JEP:G editor, which is an "interested" journal reached out and asked us to submit to them. We did. 👇

11

54

121

Gilad Feldman

@giladfeldman

4 years

We ran 4 replications of studies originally published at Journal of Risk & Uncertainty (JRU), & submitted to JRU. Decision: Desk reject Reason: "Sorry to tell you that Board decided not to pursue paper further. They believe it is better suited to psychology journal." 🤦‍♂️🙅‍♂️ Sigh

9

17

115

Gilad Feldman

@giladfeldman

1 year

😯 Never happened before. As part of a review for PCIRR Stage 1 a reviewer suggested randomizing direction of scale, we opted to stick with original's, & in round 2 she ran part of our experiment randomizing order to test possible impact (!). That's next level reviewing. 👏👏

1

13

109

Gilad Feldman

@giladfeldman

7 months

To me, grants are such an absurd wasteful academic cycle. Example I noticed below. Such as waste. Conclusion here was "Keep submitting". I think we need to rethink it all. Have other examples about the wastefulness in grants process/requirements? Please share.

Bryan William Jones

@BWJones

5 years

Junior scientist struggling w/ grants asked for advice. I agreed to help them out, but also wanted them to see this image. This image shows the grants that I’ve been involved with going back to 2012. The green dots are the successes, the red dots are failures. Keep submitting.

212

2K

7K

11

13

108

Gilad Feldman

@giladfeldman

3 years

= open teaching materials for your courses = Few have reached out to me recently to ask about how I run classes at HKU. Here is a thread of all resources we have to help you in your classes & consider mass mobilizing students for open & meta science. Thread 👇

1

37

108

Gilad Feldman

@giladfeldman

1 month

Unbelievable. Prestige and reputation cost us 2 billion US$ a year. The things we could have done and achieved with this money. I can't believe we just accept this and go along with this as if this is normal. This is not normal. 😔

Retraction Watch

@RetractionWatch

1 month

A new preprint estimates "that, globally, a total of $8.349 billion ($8.968 billion in 2023 US dollars) were spent on [article processing charges] APCs between 2019 and 2023.

7

130

244

7

27

106

Gilad Feldman

@giladfeldman

5 years

Trying to make a list of open-science supportive scholars working in the field of judgment and decision making, social cognition, and/or behavioral economics. Know any? please tag them below. Are you one? please reply below. (I'll share the full list with those interested)

58

37

103

Gilad Feldman

@giladfeldman

7 months

= Original authors responding to replication attempts = Shafir & Cheek respond to our (& Many Lab 2's) failed replication(s) of Shafir (1993). We are writing a reply, but it's worthwhile to share some highlights from this exchange. 🧵👇

4

21

101

Gilad Feldman

@giladfeldman

8 months

@adfillon That you took the time to look into our article, look through the code, find the mistake, and report it to us, is what real science looks like. Exceptional. This often goes unrewarded/unacknowledged. Wish I could do more to support this work. Thank you 🙏, keep going strong!

4

7

98

Gilad Feldman

@giladfeldman

5 years

Gave 3-hour workshop on JAMOVI/JASP/R at @hku_science yesterday. I thought maybe some of my students would come. 150-200 from all faculties showed up. Cloud Drive for workshop with PPT & lots of goodies: Our collaborative guide:

2

17

98

Gilad Feldman

@giladfeldman

1 year

A reminder for the new academic year: We have a Registered Report template to ease your/students' life writing manuscripts, especially (but not only) for replications: Our CORE team (with many UG/MSc students) used this successfully in many submissions.

1

26

98

Gilad Feldman

@giladfeldman

4 years

=Replications & angry original authors thread= Yesterday, we received decision letter on our replication & extension journal submission. It was revise & resubmit. Good news, right? Afraid not. Signed Reviewer #1 , original authors, went on a full-on rampage. On that below 👇

2

27

95

Gilad Feldman

@giladfeldman

4 months

Just found out that the psychology job market got a boost from someone finally setting up a Google Sheet: Don't know who did this, but whoever you are, THANK YOU! I really hope this will pick up, to be as good as the management sheet. Help improve this!

Gilad Feldman

@giladfeldman

1 year

= Psychology job market upgrade needed = "Psychology Job Wiki" appreciated, but you have to see what's happening in OB/Management market. We have to share FAR more information to make psych market better. Learn from this: Requires community effort.

1

14

62

2

35

88

Gilad Feldman

@giladfeldman

3 years

We get many rejections from various journals asking us replicators to fix original work they published, resolve mixed/failed findings (outcome based decisions) & add 'contributions'/'value'. Decade has passed, still very few replications published. Unsustainable, has to change.

2

4

86

Gilad Feldman

@giladfeldman

5 years

Know meta-analyses? Help improve "Resources for Learning (/Teaching) How to Conduct Meta-Analyses" GDoc. It's coming along nicely. I moved many of my syllabi there, & I add things when something comes up (e.g. today - mixmeta & @dsquintana meta videos)

Meta-Analysis and Systematic Reviews Syllabus

Resources for Learning (and Teaching) How to Conduct Meta-Analyses and Systematic Reviews John Sakaluk, Patrick Forscher, Katie Corker, Jin Goh, W. Kyle Hamilton, Michael Bosnjak, Nicholas Coles,...

docs.google.com

2

33

84

Gilad Feldman

@giladfeldman

4 years

=Effect Size, Confidence Intervals, & Power Analyses Collaborative Guide= @qinyu_xiao did remarkable job revamping our collaborative guide. Extends @lakens (2013) ES guide to updated methods & using R. Please use, check, & give us feedback!

3

33

83

Gilad Feldman

@giladfeldman

3 years

Finally some good news for open-science at HKU. "HKU Registered Reports challenge" was approved, aiming for motivating cultural change at HKU to promote @RegReports & working with students, funding students' in-principle accepted RRs up to HKD$8000 per student, 30+ overall. 👇

7

15

84

Gilad Feldman

@giladfeldman

4 years

Gave "JAMOVI, R, & JASP" 3 hours #OpenScience workshop yesterday. Covered: - @rstudio is easier than u think, teaser demo power of R - @jamovistats demo: data wrangling, experimental, correlational, meta designs - @JASPStats briefly

JAMOVI, R, and JASP | Open Science workshops | Gilad Feldman

This is an online/remote workshop given at the University of Hong Kong on September 28, 2020, by Gilad FeldmanSlides: https://mgto.org/hku2020jamoviworkshop ...

www.youtube.com

1

24

84

Gilad Feldman

@giladfeldman

5 years

12 JDM replications: Results are in! Successful: 9/12 (75%) 1 Mixed + 2 Failed (with good reasons/insights) Convergence, comparing results of... 2 teams per each replication: 11 of 12 MTurk US vs. Prolific UK samples: 8 of 8 More info in thread below 👇

1

40

82

Gilad Feldman

@giladfeldman

2 years

= Evaluating scientific evidence guide = Started yet another collaborative guide since couldn't find a guide to train my students how to evaluate scientific evidence. My initial attempt is outlined in: Help is welcome and much appreciated. 🙏🙏

4

23

82

Gilad Feldman

@giladfeldman

1 year

Results are in, very interesting! Thanks for voting. I'll start with the strongest effect here. Effectiveness/efficiency wise: I do not understand this one at all, but it's SO strong. 2 candidates, same outcomes: A spent millions, B got it done with no budget. Why is A>B?!?!

Gilad Feldman

@giladfeldman

1 year

Two candidates, with same number of publications (let's say, 10) from the same journals and very similar qualifications. A: Secured and led 5 external grants B: No external grants Which of those SHOULD your department hire? Why?

2

3

27

13

77

Gilad Feldman

@giladfeldman

4 years

🔬=Reproducible Meta-analysis Registered Report template=🔬 1. We face serious issues about reproducibility of meta-analyses. 2. We need to move towards model of meta-analysis Registered Reports. =Join us in creating meta-analysis open-science RR template!= Details below👇

5

34

76

Gilad Feldman

@giladfeldman

4 years

🔬Invitation: 2nd Zoom Workshop🔬 "Practical meta-analysis: Conducting open & reproducible correlational and experimental meta-analyses" 3:00pm-6:00pm (HK time GMT+8) | Feb 15, 2021 (Monday) | 7am GMT Free registration: Poster attached.

5

38

74

Gilad Feldman

@giladfeldman

5 years

Bit hesitant to share this, but thought it's helpful to layout rejection path leading to JESP publication for recent project. Most by editors strong supporting of open-science. Referring to this article: See rejection thread below:

Gilad Feldman

@giladfeldman

5 years

Inpress at JESP (w/ Jieying Chen) "Regret-action effect: Action-inaction asymmetries in inferences drawn from perceived regret" 4 experiments (3 prereg) w/ consistent effects "regret perceived more likely result of taking action than not acting" Link:

0

9

17

4

24

73

Gilad Feldman

@giladfeldman

6 years

Dec 20 I will summarize findings from 18 replications we conducted this semester. We wanted prediction markets, but were overwhelmed by work just running the replications. Instead, a Twitter vote, you're welcome to rate replicability. Below are studies we attempted to replicate.

2

47

71

Gilad Feldman

@giladfeldman

1 year

Please write APS at editorsearch @psychologicalscience .org and nominate Simine Vazire and Chris Chambers for Chief Editor of Psychological Science. We should try and support open-science supportive editors for such roles. Maybe, just maybe, if enough people write in...

Association for Psychological Science

@PsychScience

1 year

APS invites nominations for Editor of #PsychologicalScience , one of the most influential empirical journals in the field. Submit nominations by Friday, June 2, 2023.

1

14

10

9

17

68

Gilad Feldman

@giladfeldman

4 years

Ever wondered what John Bargh thinks about the replication crisis & outcomes of replications of priming research? Then you might be interested in @behavioralgroov interview with Bargh: I find this absolutely fascinating. 😟🤔

John Bargh: Dante, Coffee and the Unconscious Mind

John Bargh, PhD is a Professor of Psychology and Management at Yale University. His name may be familiar because of the replication crisis, but there is so much more to John Bargh than a couple of...

www.podbean.com

6

26

66

Gilad Feldman

@giladfeldman

5 years

Evaluations are truly humbling experience & window into human psyche. Teaching is hard, especially on crisis. Sure, evaluations tricky, bad>good, can't please all, & all that. Still, I feel for these students, understand their frustrations. Hope to do better next time around.

11

1

65

Gilad Feldman

@giladfeldman

3 years

= statistics best practices guide help request = For upcoming semester, trying to start collaborative guide for best practices in statistical methods. I couldn't find anything suitable, know any? See/join/edit: What resources do you know I can add?

1

15

65

Gilad Feldman

@giladfeldman

6 years

SPPS not accepting meta-analysis submissions?! @siminevazire :O Reject decision letter "I do not think that meta-analysis is a valid technique". This is generally worth discussing. And, if this is policy, it would save everyone time to put it on author submission guidelines, no?

16

23

61

Gilad Feldman

@giladfeldman

4 years

= Replication publications in reputable psychology journals = Let's talk about replication in psychology. We think we've been doing better in the last decade, but have we improved? Thread below. 👇

1

23

63

Gilad Feldman

@giladfeldman

2 years

🚨=List of free collaborative resources=🚨 We developed a lot of free collaborative resources that you can use in your research/teaching that you might not be aware of. Use/contribute/share as you like. Full updated list: See list below 🧵👇

2

24

64

Gilad Feldman

@giladfeldman

3 years

This is our... 4th rejection of replications from Psychological Science, all had nothing to do with our rigor, but about "contribution". We afterwards found homes in other "specialty journals" but obviously failing at attracting the attention originals are still getting. 🤷‍♂️

4

1

63

Gilad Feldman

@giladfeldman

3 years

= check me, replicate me, I'll help & pay you = Seeking help in validating & replicating my work. It's time to publicly invite 'red-team' approach & replicators to help me do better in my research. First draft: Feedback? Can I improve this call?

Check me, replicate me: Corrections & replications of my work

Please help me do better science!Jump to: What I offer / I'll pay you / Corrections of my work / Replications of my work / Questions about my work / Related readings & initiatives / Others wh

mgto.org

2

20

62

Gilad Feldman

@giladfeldman

1 year

= Psychology job market upgrade needed = "Psychology Job Wiki" appreciated, but you have to see what's happening in OB/Management market. We have to share FAR more information to make psych market better. Learn from this: Requires community effort.

2023 - 2024 Management PhD job doc

docs.google.com

1

14

62

Gilad Feldman

@giladfeldman

4 years

Just made aware of PSPP, the open-source completely free alternative/clone to SPSS. Do try & ditch SPSS, yet if somehow lecturers/department still insist on SPSS atleast offer students PSPP free open alternative. Tried this on an old project, works.🤷‍♂️

5

22

62

Gilad Feldman

@giladfeldman

2 years

Very surprised that most of the reactions to this are that this shows we need to blind authors & even less openness. I disagree. Strongly. Very strongly. We must open up the peer review system. Open and identified are important for accountability & learning. Reasons below 🧵👇

Brian Nosek (@[email protected])

@BrianNosek

2 years

I want a very simple story to be true: More transparency is better for science, always. I rebut most arguments against the simple story with evidence, theory, or really good rationalizing. Status bias in peer review is the most challenging reality against what I want to be true

16

34

296

4

20

58

Gilad Feldman

@giladfeldman

11 months

My personal conclusions: JEP:G does not understand @RegReports . JEP:G does not understand @PCI_RegReports . Editorials are one thing, actions are another. I hope our experience would benefit others next time around. My suggestions to PCIRR & for you if you get invited:

5

9

57

Gilad Feldman

@giladfeldman

3 years

How does @amazonmturk (w/ @CloudResearch_1 ) do compared to @Prolific ? Please look at effects in the same replication we ran with Brits in Prolific (0.57 [0.49, 0.64]) & Americans on MTurk (0.59 [0.51, 0.66]). Near identical! Atleast for JDM, MTurk almost same as Prolific.

Gilad Feldman

@giladfeldman

3 years

Accepted at @CollabraOA : "Self-interest is overestimated: 2 successful pre-registered reps & exts of Miller & Ratner (1998)" Congrats @CameronBrick @adfillon @yskjdm & 4 students & well done! PP: OSF:

1

4

16

3

13

57

Gilad Feldman

@giladfeldman

10 months

Mindblowing. Showed this to students, they were 🤯🤯😲😲. If you haven't tried it, take 5 minutes, have a look. It's free, and we, in Hong Kong, are GPT/AI blocked, so this solves 2 major issue for students in HK wanting to leverage AI for super easy data analysis. Brilliant.

Steven Ge

@StevenXGe

10 months

Talk to your data via AI using Massive upgrade in v0.98: GPT-4 enables better code, Explains codes, results, or statistics in general, Upload a 2nd file, EDA reports! Demo:

3

71

280

1

13

55

Gilad Feldman

@giladfeldman

4 years

Just noticed this inpress at Collabra on Researchgate: "A Multi-Site Collaborative Study of the Hostile Priming Effect". Probably missed announcement somewhere. Wow (for effort!), ouch, & ☹️ We really need to stop putting money/time/effort into these.

0

11

54

Gilad Feldman

@giladfeldman

1 year

Reminder for the new academic year : R/Rmarkdown is much easier than you think. How? JAMOVI exports R syntax, lots of point & click packages, R can be easy. Video & resources below 👇: Will update video with ChatGPT 4 code analyzer in a few weeks.

Practical easy hands-on beginner R RMarkdown workshop | Open Science...

This is an online/remote workshop titled "Practical easy hands-on beginner R/RMarkdown workshop | R is easier than you think, time to move to R" given on Oct...

www.youtube.com

Gilad Feldman

@giladfeldman

3 years

🧑‍💻Beginner R/Rmarkdown workshop completed 🧑‍💻 Simple powertools making R easy with copy-paste. Get you started, overcome scary transition to R. No coding required to do amazing things, get started with point & click, build skills, learn, improve. Video:

3

56

184

1

15

54

Gilad Feldman

@giladfeldman

1 year

Accepted for publication at Collabra:Psychology: "The Effort Heuristic" revisited: Mixed results for replications of Kruger et al. (2004)'s Experiments 1 and 2 More info below 🧵👇

1

12

54

Gilad Feldman

@giladfeldman

3 years

= unrealistic demands of replications & replicators = yes it's that time again, another rejection for 1 of our best replication projects. again, from JESP, which keeps disappointing me. again, editor that for 2nd time doesn't seem aligned w/ journal/editorial policy. [thread]👇

6

12

53

Gilad Feldman

@giladfeldman

2 years

== Preprints: Open guides - effect sizes, confidence intervals, and power. == Qinyu Xiao took over guides that I started to guide students in my courses, & did a remarkable job bringing these to become top notch resources. We would love feedback. Feel free to use/share. 🧵👇

1

22

51

Gilad Feldman

@giladfeldman

5 years

Great news. Our mass pre-registered replication project (~45 projects so far) received 250000HKD (~32000USD) from @hku_science Teaching Development Grant to support replications next semester. Info: Join us: More @ #sips2019

4

5

52

Gilad Feldman

@giladfeldman

4 years

🌐=Reproducible Meta-analysis Registered Report templates=🌐 1. We face serious issues in reproducibility of meta-analyses. 2. We need to move towards model of #metaanalysis Registered Reports. Join us in improving meta-analysis #openscience @RegReports templates! Details👇

1

24

51

Gilad Feldman

@giladfeldman

1 year

🟢Time to vote: Will it replicate?🟢 (please retweet!) We're again running Twitter prediction markets on #openscience Replications (+extensions) Registered Reports of classic findings in Judgment & Decision Making. For each study, please vote: Will it replicate? Thread 🧵👇

2

43

51

Gilad Feldman

@giladfeldman

6 years

Mass JDM pre-registered replications results are in. I presented preliminary (!) findings of 18 projects. Summary (see attached table): 9 successful, 5 inconclusive, 4 likely failures. Presentation: Prediction markets thread:

Gilad Feldman

@giladfeldman

6 years

Mass replication project: Twitter "prediction markets" results are in. Thread: Thanks for taking part! Summary: 12/18 sig success 0/18 sig failure 6/18 inconclusive split Results on Dec 20th, in the meantime... What do you make of these predictions?

2

8

25

3

23

51

Gilad Feldman

@giladfeldman

1 month

New preprint: "The value of replications goes beyond replicability and is tied to the value of the research it replicates: Commentary on Isager et al. (2024)" My very quick take on the Isager and team's work on value of replications. Read:

2

13

49

Gilad Feldman

@giladfeldman

3 years

Gave an online talk: "Endorsing open-science & supporting a science reform : Status, issues, challenges, & solutions" Video: 3 case studies: Feeling the future Ego Depletion Priming 2 demos: p-hacking p-curving Discussed open-science & @RegReports

Endorsing open-science & supporting science reform: Status, issues,...

This is a talk about the science crisis, science reform, and need for open-science and Registered Reports given by Gilad Feldman to the Asian Association/Jou...

www.youtube.com

1

12

49

Gilad Feldman

@giladfeldman

4 years

Why do open science? What is the science crisis? Why do replications? Lecture about my journey into open-science & mass-replications project I'm heading. Video: Slides: [1st video sharing, awkward & some errors. Go easy on me.]

Journey to open science: Mass mobilizing for credibility revolution...

Talk was given on March 16, 2020, at Sao Paulo University (Brazil) psychiatry department by Gilad Feldman.Chapters:00:00 Introduction03:20 2011 - Bem, realiz...

www.youtube.com

4

11

50

Gilad Feldman

@giladfeldman

5 years

#SIPS2019 was the best conference I ever attended. Really, my kind of people. Had great conversations that resulted in brilliant ideas, many that led to high-potential real projects w/ decent progress in short hackathons. Inspired, & motivated to work with teams onwards.

1

0

48

Gilad Feldman

@giladfeldman

1 year

== Peer Community In (SIPS): Are you interested? == At #SIPS2023 I've talked to many about the revolutionary Peer Community in Registered Reports. We should consider forming Peer Community in Psychology/Meta-Science. Anyone interested in leading/joining such initiatives?

4

14

48

Gilad Feldman

@giladfeldman

3 years

🟢Time to vote: Will it replicate?🟢 (please retweet!) This academic year, again, we're running Twitter prediction markets on pre-reg replications (+extensions) of classic findings in Judgment & Decision Making. For each study, please vote: Will it replicate? Thread below👇

3

63

46

Gilad Feldman

@giladfeldman

4 years

Positive note: - Editor granted us R&R despite angry original authors. I appreciate that. - 2nd reviewer emailed editor commenting on inappropriateness of original author review. - May lead to further work & maybe adversarial collaboration (if I can overcome current feeling).

5

3

48

Gilad Feldman

@giladfeldman

4 years

🌏Invitation: Zoom Workshop 3🌏 "Summarizing 3 years of running a 100 replications & extensions with students: Our experience, running your own, & joining our team" 3-6pm (HK time GMT+8) Jan 18 2021 (Monday) 7am GMT Free registration: Poster attached

1

19

46

Gilad Feldman

@giladfeldman

4 years

= Student early career researchers to follow = To wrap up 2020, I want to recommend several student early career researchers I've been fortunate to work with in the last year, that I think you should follow. They are doing terrific work and are dedicated to open science.

1

7

44

Gilad Feldman

@giladfeldman

3 years

= Our perspective regarding Heyman and Ariely (2004) expression of concern = Psychological Science issued an expression of concern regarding H&A2004 mentioning our team as raising the concerns. I wrote the following regarding our role and perspective:

Clarifications regarding Heyman and Ariely (2004) replications and extensions and Expression of...

On July 23, 2021 Psychological Science issued an "Expression of Concern: Effort for Payment: A Tale of Two Markets" regarding the article by Heyman and Ariely (2004). It details the role of our team i

mgto.org

1

18

45

Gilad Feldman

@giladfeldman

3 years

🔬 Recruiting peer reviewers for mass replications project 🔬 This year, again, we'll be running replications & extensions of classics in JDM & social psychology. UG students write Registered Reports during the semester. We have a replication targets list, details below.

1

26

43

Gilad Feldman

@giladfeldman

8 months

A major re-vamp of the "effect size and confidence intervals" guide. Matthew took this to a whole new level, above & beyond my expectations, building on our fairly simple guide to now cover great many things about all that's effect sizes related. 👏👏 Join us! help us improve.

Matthew B Jané

@MatthewBJane

8 months

Big 2024 announcement! The “Guide to Effect Sizes and Confidence Intervals” had a pretty substantial update and is slowly becoming the most comprehensive resource on effect sizes and confidence intervals. Here is a thread of some of the new additions 1/5

6

162

603

0

12

44

Gilad Feldman

@giladfeldman

11 months

Accepted for publication at Collabra: "Revisiting and Rethinking the Identifiable Victim Effect: Replication and Extension of Small, Loewenstein, and Slovic (2007)" Failed replication & ROBMA re-analysis of a published meta, concluding no effects. More info below 👇🧵

2

9

43

Gilad Feldman

@giladfeldman

3 years

= Upcoming #openscience online talk @ Uni of Vienna = "“Check me, replicate me” pledge: Promoting a science of collaborative replications, assessments, and corrections" Thursday, March 31, 2022; 3pm CET Email colloquium.psychologie @univie .ac.at for Zoom link.

1

13

43

Gilad Feldman

@giladfeldman

5 years

[Thread] I enjoy running classic JDM experiments on students in the classroom. Below I'll try & share some of what I run. All materials and slides shared on: Looking for more? See previous years JDM and Fundamentals here:

HKU PSYC3052 - 2019-20 Autumn - Advanced Social Psychology - Course materials - Gilad Feldman

University of Hong Kong Advanced Social Psychology PSYC3052 class Autumn 2019-20 Hosted on the Open Science Framework

osf.io

2

13

42

Gilad Feldman

@giladfeldman

3 years

Want high quality #openscience feedback on your @RegReports ? Try @PCI_RegReports In recent weeks, we received R&R feedback on 2 PCI-RR submissions. Open-science supportive identified peer-reviewers, with some of most positive, constructive, & detailed feedback we ever received.

2

18

42

Gilad Feldman

@giladfeldman

3 years

= Beginner R/Rmarkdown workshop = Will give online Zoom workshop "Practical hands-on beginner R/Rmarkdown workshop: R is easier than you think, time to move to R" 3-6pm HK time (GMT+8) | Oct 29 (Friday) Poster attached. All welcome. Registration:

2

15

41

Gilad Feldman

@giladfeldman

4 years

Going beyond the rejected grant application second year straight - which I didn't really have expectations of getting, there's a clear message here: Doing replications/open-science is harmful for careers of early career researchers. Is this the message HK's RGC wants to send?

2

4

39

Gilad Feldman

@giladfeldman

6 years

I gave a workshop at @HKUniversity on @jamovistats / @JASPStats / #R this week. Presentation: Materials: JAMOVI/JASP/R collaborative manual: Replication guide collaborative manual:

1

10

41

Gilad Feldman

@giladfeldman

5 years

Ever ran 22 studies in 2 weeks? This morning I concluded data collection for our mass pre-reg replications + extensions this semester (). Setup explained in the slide attached. Quick insights about the process:

1

2

40

Gilad Feldman

@giladfeldman

2 years

🟢Time to vote: Will it replicate?🟢 (please retweet!) We're again running Twitter prediction markets on #openscience Replications (+extensions) Registered Reports of classic findings in Judgment & Decision Making. For each study, please vote: Will it replicate? Thread 🧵👇

1

40

Gilad Feldman

@giladfeldman

3 months

= Help: Meta-analysis coder needed as coauthor = We have an experimental Meta-Analysis Registered Report on action-inaction that received a Stage 1 in-principle from Peer Community in Registered Reports. 🤜Looking for coder coauthor to join team to help us code.🤛 Details 👇

2

29

39

Gilad Feldman

@giladfeldman

5 months

@nataliavandoren Lots of great options in this thread. We try and collect options on this guide with some examples with R code and lots of links:

2

9

39

Gilad Feldman

@giladfeldman

5 months

🟢Time to vote 2024: Will it replicate?🟢 (please retweet!) We're again running Twitter prediction markets on #openscience Replications (+extensions) Registered Reports of classic findings in Judgment & Decision Making. For each study, please vote: Will it replicate? 🧵👇

1

31

37

Gilad Feldman

@giladfeldman

9 months

A decade of open-science and science reform, replications are much more mainstream now, right? Wrong. See Beth's preprint below. My summary slide is attached (Beth's sent by Simine). Have we improved? maybe, not by much. Sometimes feels like 1 step forward 2 backwards 👇

Beth Clarke

@bethclarke_

9 months

We’ve spent the last decade talking a lot about replications, but to what extent has this talk translated to a tangible change in how often replications are published in psychology journals? (1/9) /w Katherine Lee @SchiavoneSays @mijkenijk @siminevazire

2

27

66

1

11

39

Gilad Feldman

@giladfeldman

1 year

Published at Meta Psychology: "We are all less risky and more skillful than our fellow drivers: Successful replication and extension of Svenson (1981)" The result of a fun workshop I ran with the wonderful Linköping Sweden JDM team. More details: 👇🧵

Gilad Feldman

@giladfeldman

3 years

New preprint: "We are all less risky & more skillful than our fellow drivers: Replication & extension of Svenson (1981)" Fun little replication with amazing @jedilab_liu : @linakoppel @DanielVastfjall & @tinghog Preprint: OSF:

1

2

12

2

17

39

Gilad Feldman

@giladfeldman

2 years

@samuelmehr We maintain a LONG list of those resources (videos/guides/books/workshops) on the collaborative R/Rmarkdown/Quarto guide: Hope that helps.

R / Rmarkdown / Quarto collaborative guide

R / Rmarkdown / Quarto collaborative manual Guide link: https://mgto.org/rrmarkdownguide (please note that the JAMOVI/JASP guide is on a different Google Doc, please see: https://mgto.org/jamovijas...

docs.google.com

1

3

37

Gilad Feldman

@giladfeldman

4 years

Today, we received decision letter from SPPS. I share this because these are very rare & so I feel @EmirEfen @PRASAC & students deserve big congrats on work they did here. Balances a bit other hostile reviews we recently received on replications. Hope for more of those to come

1

5

37

Gilad Feldman

@giladfeldman

5 years

Thought I'd share something about my academic path. I graduated my PhD late 2014. I've been on academic path since ~2009. The paper retweet below is 1st preprint I've been invited to fully collaborate on. The 1st. All projects till now I've had to initiate & lead on my own.

Gilad Feldman

@giladfeldman

5 years

"Exceptionality Effect in Agency: Exceptional Choices Attributed Higher Free Will Than Routine" w/ Fillon, Lantian, & N'gbala. Preprint: Great to finally see this out. Ties well with our previous "bad is freer than good" ()

2

4

10

1

2

38

Gilad Feldman

@giladfeldman

3 years

Hong Kong had its first ever Judgment and Decision Making (JDM) day yesterday, arranged by @davidhagmann , hosted at HKUST Central with panoramic harbor views. 30+ enthusiastic early career JDM scholars. Great to see Hong Kong universities come together.

1

2

38

Gilad Feldman

@giladfeldman

3 years

Don't think I've seen a journal summarize a publication like that for authors before, that's just... Well done IRPS! 😳😳👏👏🤩🤩 And thanks! 🙏🙏

irsp_rips

@irsp_rips

3 years

In their latest paper, Nadia Adelina and Gilad Feldman ( @giladfeldman ) replicated and extended studies from Pronin and Ross (2006) on perception of past and future selves. A thread 👇👇👇1/

2

9

20

1

4

38

Gilad Feldman

@giladfeldman

5 years

Time to vote: Will it replicate? This year, again, we're running Twitter prediction markets. This semester we completed 12 pre-reg replications (+extensions) of classic findings in Judgment & Decision Making. For each study, please vote: Will it replicate? Thread below👇

2

29

37

Gilad Feldman

@giladfeldman

4 years

WOW. Noticed this in new preprint by @peez : "Thanks Results Reproduction (R-Squared) service of Cornell Institute Social & Economic Research (CISER) for proofreading our data & code" Leading to: How do I convince my uni to do this? ( @willhayward_nz 🤓🔬)

1

8

37

Gilad Feldman

@giladfeldman

4 years

In conclusion - perhaps the best of all: "Mass replications may not be a worthy research direction for an assistant professor, who is under time pressure for earning tenure and should focus on building/testing theories and developing expertise in a subject area." 😳😮🤦‍♂️

5

2

37

Gilad Feldman

@giladfeldman

3 months

HKU psychology hiring 3 faculty: Associate/Assistant Prof. in Clinical Psychology - Aug31 Professor/Associate/Assistant Prof. in Educational/School Psychology - Aug31 Associate Prof. (Research): June30 👇

HKU Careers

The University of Hong Kong (HKU) offers an intellectually-stimulating and culturally-rich academic environment, with attractive remuneration packages.

jobs.hku.hk

1

23

37

Gilad Feldman

@giladfeldman

8 months

2nd episode on issues with academic research in Freakonomics Radio podcast. A lot of important highlights Link: I'll list a few that I thought stood out: 🧵👇

1

12

37

Gilad Feldman

@giladfeldman

1 year

Now online: "Fallibility in Science: Responding to Errors in Work of Oneself and Others | Dorothy Bishop" Interesting chat with Dorothy Bishop. 🙏 Video: I care greatly about this topic, & am looking to collaborate with others on addressing it. 👇🧵

Fallibility in Science: Responding to Errors in Work of Oneself and...

In this "Meet the Authors" event, Prof. Bishop talked about an article on Fallibility in Science: Responding to Errors in the Work of Oneself and Others. See...

www.youtube.com

Open Applied Linguistics

@OpenAppLing

1 year

🤔As humans we are all fallible. When it comes to research, how should we deal with errors in the work of our own and others? ✨ Join us in our next “Meet the Authors” Reading Club event with Professor Dorothy Bishop @deevybee to find out more about fallibility in science!

1

3

11

1

12

36

Gilad Feldman

@giladfeldman

3 years

Every time I do copyediting proofs from publishers I end up spending more time correcting their mistakes than would take me to format things on my own. Takes hours to check things. Headings are never right, oversights, many small annoying mistakes. Such a frustrating process. 🤦‍♂️

3

0

36

Gilad Feldman

@giladfeldman

4 years

New semester started, 1st time I'm running remote. Teaching 2 Advanced Social Psychology sessions. Syllabus: Plan: - Registered Report Stage 1 Replications & Extensions - RRR assessment of originals vs. our previous replications - Meta Science reports

2020-21-Autumn-PSYC3052-ASP-Feldman-Syllabus

PSYC3052A/B: Advanced Social Psychology Course Outline (2020-21 Autumn Semester) Important: This course will be 100% remote online this semester, there will be -no- face to face lectures or tutoria...

docs.google.com

2

6

36