Phillip Dawson Profile Banner
Phillip Dawson Profile
Phillip Dawson

@phillipdawson

7,488
Followers
1,426
Following
527
Media
9,766
Statuses

Feedback, cheating, both AIs, and all things assessment and higher ed. Professor & Co-Director @CRADLEdeakin . Producer of comedy show 'The Peer Revue'.

Melbourne, Victoria, Australia
Joined November 2008
Don't wanna be here? Send us removal request.
Pinned Tweet
@phillipdawson
Phillip Dawson
9 months
Big news: our principles and propositions for assessment reform for a time of artificial intelligence are now published!
@TEQSAGov
TEQSA
9 months
We're delighted to announce our new resource Assessment Reform for the Age of Artificial Intelligence, is now available. Launched at today's #TEQSA23 Conference, this paper was developed in consultation leading Australian experts. ➡ #HigherEd #OzHe 1/2
Tweet media one
3
94
208
3
73
200
@phillipdawson
Phillip Dawson
2 years
For years I've been trying to get any proctoring company to agree to a study where I try to cheat. None have agreed. I've had legal advice not to do such a study without permission from the vendors. I'm delighted to share that someone else has done one:
24
568
2K
@phillipdawson
Phillip Dawson
2 years
"The most important findings were that none of the cheating students were flagged by Proctorio, whereas only one (out of 6) was caught out by an independent check by a human agent. The sensitivity of Proctorio, based on this experience, should therefore be put at very close to 0"
6
251
966
@phillipdawson
Phillip Dawson
2 years
"The use of online proctoring is therefore best compared to taking a placebo: it has some positive influence, not because it works but because people believe that it works, or that it might work." HT @Linkletter
13
115
759
@phillipdawson
Phillip Dawson
4 years
Is there a name for the 10 seconds everybody spends finding the exit button on a Zoom call after saying goodbye?
49
78
739
@phillipdawson
Phillip Dawson
2 years
A bunch of apps promise to detect ChatGPT. That's great! But before you go uploading student assignments to them, here are a few questions to ask yourself...
15
137
396
@phillipdawson
Phillip Dawson
2 years
Very excited to be awarded an @arc_gov_au #dp23 grant with David Boud, @emolloy1 @JaqiBFT @DrJoannaT @DocWinstone to longitudinally explore students’ feedback literacy, how we can improve it, and how it transfers into the world of work. Third time lucky!
41
25
334
@phillipdawson
Phillip Dawson
1 year
One way to think about ChatGPT etc is as 'cognitive offloading': using a tool to reduce the mental burden of a task. This framing has big implications for assessment, and how we think of things like academic integrity and cheating
9
86
262
@phillipdawson
Phillip Dawson
4 years
Taking leave today to celebrate a couple of things, including my promotion to professor. Thanks @_SamanthaDawson for this awesome home made fruit and nut sourdough, and your support in so many ways, from co-parenting to co-authorship
Tweet media one
76
0
241
@phillipdawson
Phillip Dawson
4 years
Submitted my book "Defending Assessment Security in a Digital World: Preventing E-Cheating and Supporting Academic Integrity in Higher Education" to Routledge yesterday! Hope we can get it out ASAP, lots in there for the COVID-19 online shift
Tweet media one
12
31
210
@phillipdawson
Phillip Dawson
3 years
With apologies to
Tweet media one
16
64
195
@phillipdawson
Phillip Dawson
3 years
Huge news: @Deakin ranked number 1 globally for #highered research, AND David Boud the top researcher globally not just in higher education but also in the broad field of education as well as academic and psychological testing @CRADLEdeakin @DeakinREDI
11
22
185
@phillipdawson
Phillip Dawson
2 years
Pleased to announce that David Boud and I are now co-directors of @CRADLEdeakin ! It's been a joy working together with Dave and the whole team over the past eight years and I think our best work is still ahead of us
@CRADLEdeakin
CRADLE: Assessment. Digital. Learning.
2 years
New year, new leadership structure for CRADLE! David Boud and @phillipdawson are now CRADLE co-directors.
1
3
43
16
5
179
@phillipdawson
Phillip Dawson
2 years
Case study of 4 proctoring suites finds "despite promises of high-security, all their anti-cheating measures can be trivially bypassed and can pose significant user security risks."
@shaananc
Shaanan Cohney @ USENIX
2 years
@phillipdawson My team did a similar investigation showing how easy it is for students to cheat:
0
4
43
1
29
177
@phillipdawson
Phillip Dawson
1 year
Of 14 AI detection tools, none worked well enough to warrant use in education. It’s a preprint so read with caution, but in my opinion it’s still some of the best evidence we have on the effectiveness of these tools.
@oepopoola
Olumide Popoola
1 year
Is AI detection a hoax? Co-author on new preprint testing 14 systems with a gold standard document set. None work well enough for use in educational settings Presenting at #ECEIA2023 today @WeWuWiWo @SonjaBjelobaba @TFoltynek @jguerreodib @LornaWaddington
2
22
54
4
74
145
@phillipdawson
Phillip Dawson
1 year
Huge new paper by @DocWinstone @DrRobNash on developing a 'cohesive psychological science of effective feedback' as part of their special issue. Some questions they think are important in this field
Tweet media one
6
52
142
@phillipdawson
Phillip Dawson
2 years
Wow thanks everyone for the interest. In lieu of a Soundcloud, can I use this opportunity to promote my latest co-authored paper, led by @DrJoannaT ? It’s on how we can redesign assessment from the ground up to prioritise inclusion
4
19
144
@phillipdawson
Phillip Dawson
2 years
Call for papers for a special issue of Assessment & Evaluation in Higher Education titled "Challenging Cheating". Edited by me and @molliedollin
Tweet media one
4
56
137
@phillipdawson
Phillip Dawson
9 months
In June 2024 Australian higher education institutions will have to submit a credible action plan for how they will address generative artificial intelligence
Tweet media one
9
45
136
@phillipdawson
Phillip Dawson
6 years
Just received a @Deakin Teaching Excellence award for work on contract cheating detection and prevention with @Wsutherlandsmit . Comes with this cool digital credential
13
15
125
@phillipdawson
Phillip Dawson
2 years
Yes, we have to do something about ChatGPT, but let's do so carefully. Our efforts to get students to act ethically should themselves be ethical.
4
16
127
@phillipdawson
Phillip Dawson
1 year
This paper I co-authored just reached 2,500 citations. My learnings: - Timing is probably 90% of this article's success. That's really hard to replicate. - Titles matter - Anybody can write a conceptual paper (we were very early career) - So much is random
8
14
126
@phillipdawson
Phillip Dawson
2 years
Tweet media one
5
15
118
@phillipdawson
Phillip Dawson
7 years
This is Larry Gough Dawson, born yesterday. I'm taking six precious months off work to care for him, so probably will be less active here for a while. It'll be so worth it!
Tweet media one
33
1
117
@phillipdawson
Phillip Dawson
3 years
I had zero published papers when I got my PhD scholarship, zero when I got my first full-time academic job, and one when I got a continuing position at a research-intensive uni. Junior scholars have it so much harder now - I would have struggled in today's job/scholarship market
8
5
118
@phillipdawson
Phillip Dawson
3 years
Digital doesn't replicate campus benefits. It has benefits and drawbacks of its own. We need to push back against simplistic equivalence arguments
@Phil_Baty
Phil Baty
3 years
Digital education should only endure if it can replicate campus benefits. The pandemic revealed that in-person teaching generates greater satisfaction and sense of belonging, say Leonard Saxe and Graham Wright via @timeshighered
8
6
17
5
24
114
@phillipdawson
Phillip Dawson
9 months
My best response so far to "where is the line on the use of AI in assessment?" is the same as it was a few years back: allow it when it doesn't get in the way of assessing the outcomes. It's all about validity
4
29
116
@phillipdawson
Phillip Dawson
9 months
If you only read one paper on rubrics, make it this one!
@ernestopanadero
Ernesto Panadero
9 months
A very special publication for me: A meta-analysis on rubrics effects on performance, SRL and self-efficacy. Open access!! With @Anders_hkr @Pinedo_Leire & Belén Fernández-Castilla @ERLAgroup @carpe_dcu @DCU_IoE @ppdcuioe @DCU
Tweet media one
5
29
117
2
23
113
@phillipdawson
Phillip Dawson
4 years
New book on cheating and online learning! "Defending Assessment Security in a Digital World: Preventing E-Cheating and Supporting Academic Integrity in Higher Education" published today with Routledge
2
36
110
@phillipdawson
Phillip Dawson
10 months
According to The @Australian , Australia's number one research strength is the field of Higher Education, by a large margin
Tweet media one
7
19
111
@phillipdawson
Phillip Dawson
7 months
Delighted that this paper has reached 500 citations. Lessons learnt: - As always, titles matter - If you do a good intro (this is my favourite intro I've written) a lot of the citations can be for that rather than the results
4
13
110
@phillipdawson
Phillip Dawson
3 years
I'm increasingly of the (unscientific, non-evidence-based, and possibly obvious) opinion that if students think a task is bullshit they are more likely to cheat
7
16
107
@phillipdawson
Phillip Dawson
5 years
Feedback is having its Biggs "learning is what the student does" moment. Shifting focus from what educators do to what students do. Regardless of definitions, it's a useful focus.
Tweet media one
4
32
106
@phillipdawson
Phillip Dawson
1 year
@ARC_Tracker @arc_gov_au This should be treated worse than just an inappropriate review. Research grants are meant to be confidential, and sharing them with OpenAI is a significant IP breach.
4
6
104
@phillipdawson
Phillip Dawson
3 years
Boud & Dawson "What feedback literate teachers do: an empirically-derived competency framework" just got accepted! Hope to share soon
3
3
102
@phillipdawson
Phillip Dawson
3 years
What can we say about the effectiveness of the flipped classroom? We combined all 15 published meta-analyses (n>150k students) and found an effect size of 0.37 in favour of flipping in our new #openaccess @AJET_eds paper
4
29
101
@phillipdawson
Phillip Dawson
1 year
About to present my new talk "Don’t fear the robot: future-authentic assessment and generative artificial intelligence" at #csai23 ! Slides:
6
14
98
@phillipdawson
Phillip Dawson
7 months
In the words of David Boud "students can, with difficulty, escape the effects of poor teaching; they cannot (if they wish to graduate) escape the effects of poor assessment"
@mslaurafacciolo
laura
7 months
At its core, higher ed has an assessment problem
4
0
13
6
21
101
@phillipdawson
Phillip Dawson
6 years
@psyIentfury -Won't accept your credentials, but wants you to accept his dodgy certificates
1
2
98
@phillipdawson
Phillip Dawson
5 years
@JFBonnefon How else is the journal supposed to maintain its low acceptance rates?
1
1
94
@phillipdawson
Phillip Dawson
2 years
Can someone, in a single tweet, please define what #ungrading is? Even better if you can state how it’s different to assessment for learning.
32
23
95
@phillipdawson
Phillip Dawson
2 years
My tier list of anti-cheating approaches from HERDSA is now up on YouTube. Timestamps in the description let you jump straight to whatever anti-cheating approach you're interested in
0
31
93
@phillipdawson
Phillip Dawson
4 months
I'll be speaking online about assessment design for a time of artificial intelligence for @CUHKofficial next Monday 13th May at 12:30pm HK / 2:30pm AEST. Free rego:
6
36
97
@phillipdawson
Phillip Dawson
4 years
Concerned about cheating as we rapidly move online? Our latest @CRADLEdeakin resource provides research-based suggestions
Tweet media one
1
48
91
@phillipdawson
Phillip Dawson
5 years
You can have your exotic sabbaticals, but here is my paradise: at home, 2 months, writing my new book on cheating and technology. 80k words by end of Jan - can it be done? I'll let you know.
Tweet media one
10
0
94
@phillipdawson
Phillip Dawson
2 years
We have a new Australian government. How do we get them to reinstate the Office for Learning and Teaching (or create something similar)?
6
15
90
@phillipdawson
Phillip Dawson
4 years
According to @australian the top uni for #highered research in Aus is @Deakin ! Also, @CRADLEdeakin Director David Boud is the top Higher Education researcher, and @r_ajjawi the top Science & Engineering Education researcher @DeakinREDI
3
10
87
@phillipdawson
Phillip Dawson
1 year
Useful and interesting - and to me highlights our obsession in education with the final written form of work (which you must not outsource you naughty student, that’s plagiarism), rather than the actual thinking and ideas behind it (which is fine to get from old mate Chatty G)
@msmiriamscott
Miriam Scott
1 year
As teachers, it is our responsibility to guide students through the use of generative AI in a way that is ethical & responsible. If we don't teach them these explicit skills, how can we expect them to make informed choices? #generativeai #education #ai #edchat #edutech #AIinEd
Tweet media one
2
13
58
4
27
90
@phillipdawson
Phillip Dawson
4 years
Out for dinner tonight with ⁦ @r_ajjawi ⁩ ⁦ @margaret_bea ⁩ ⁦ @DrJoannaT ⁩ celebrating having made it through 2020
Tweet media one
11
1
87
@phillipdawson
Phillip Dawson
5 years
Contract signed, putting pen to paper writing a @RoutledgeEd book on technology, cheating, assessment & academic integrity. I promise not to hire a ghostwriter/bot to do it for me
5
1
87
@phillipdawson
Phillip Dawson
2 years
Images from Chegg that contain the text "proctorio is sharing your screen". Chegg is often used by students to get answers to exam questions.
Tweet media one
Tweet media two
Tweet media three
Tweet media four
4
5
86
@phillipdawson
Phillip Dawson
1 year
We published our Feedback Literacy Behaviour Scale open access last month. You might have wondered: why another feedback literacy scale? The difference with ours is that we focus on what students *do* in feedback, not what they *think* about feedback.
0
21
85
@phillipdawson
Phillip Dawson
3 years
The Manifesto for Teaching Online is one of the landmark documents in the edtech field. Super excited to hear @sbayne talk about it in her upcoming @CRADLEdeakin seminar. Sept 7th, all welcome
3
32
80
@phillipdawson
Phillip Dawson
4 years
Had my grant draft go out to external paid experts. Some useful comments, but also lots of edits that just swap in bigger and more unusual words and longer sentences. I liked my smaller, more straightfoward words and sentences.
11
0
79
@phillipdawson
Phillip Dawson
6 months
Program-level assessment planning (a sort of compromise between programmatic assessment and a free for all) is in my opinion required for us to address AI in assessment. But there sure are a lot of barriers to it - see this paper
3
18
79
@phillipdawson
Phillip Dawson
2 years
The CEO of Chegg used to be the CEO of Guitar Hero. It makes sense, both are about pushing buttons to give the impression of capability but really learning nothing. Would be cooler if they'd called Chegg something related, like, I dunno, Course Hero? Just spitballing
11
3
77
@phillipdawson
Phillip Dawson
2 years
Book swap with ⁦ @DrSarahEaton ⁩ - excited to read “Plagiarism in Higher Education: Tackling Tough Topics in Academic Integrity”
Tweet media one
1
3
78
@phillipdawson
Phillip Dawson
2 years
Using an AI writer to generate my bio for a talk. Here's what it thinks I do: "Phill is known for his slightly unconventional teaching methods, from sending his students out to find cheating manuals on the dark web, to secretly planting cheating materials in their lockers."
14
1
78
@phillipdawson
Phillip Dawson
2 years
I know it's cool to list ChatGPT as an author on your paper and all, but make sure it meets the criteria for authorship and approves the final manuscript. Gift authorship is not cool
9
3
77
@phillipdawson
Phillip Dawson
5 years
Here's what I'd tell students about feedback in five minutes
Tweet media one
2
30
78
@phillipdawson
Phillip Dawson
1 year
A team from the European Network for Academic Integrity @ENAIntegrity studied the effectiveness of AI detection tools for student writing. Their advice: don’t use AI detection, it doesn’t work.
@BolandMairead
Mairéad Boland
1 year
The conclusions of their research? These tools are not currently reliable enough & shouldn’t be used in an educational setting. Instead, providers should focus on assessment design; the process by which students acquire skills rather than the product. @ENAIntegrity #ENAI2023
Tweet media one
Tweet media two
0
8
41
2
39
76
@phillipdawson
Phillip Dawson
11 months
What a double bill: @DrSarahEaton and @CCguerilla are at the forefront of academic integrity research and practice. It’s a well produced video too, easy to sit back and have your mind blown about degree fraud, cheating, and non-learning analytics
3
22
75
@phillipdawson
Phillip Dawson
2 years
When academics start using AI tools to reduce their 7,500 word paper to fit a 6000 word limit I imagine we’ll see all manner of justifications for why this is ok but students using AI writers is not
3
5
75
@phillipdawson
Phillip Dawson
5 years
Damning review study about the use of theory in #edtech research. Theory mostly absent. When present it's often vague. Very little advancement of theory.
7
37
73
@phillipdawson
Phillip Dawson
2 years
Call for papers now out for Assessment in Higher Education Conference @AheConference 22-23 June! My favourite higher ed conference. It'll take me at least 23 hours to get to Manchester from Melbourne but it'll be worth it. How's that for an endorsement?
2
17
74
@phillipdawson
Phillip Dawson
1 year
ChatGPT came out six months ago. What have we learnt about its impact on higher ed? Monday 2pm Melbourne time (10pm Sunday night in Calgary for me!) I join @RowenaHarper79 @sbuckshum and @TEQSAGov 's Dr Helen Gniel on this panel moderated by @margaret_bea
1
28
72
@phillipdawson
Phillip Dawson
11 months
Hills I am willing to die on: Unproctored online exams should not exist as a summative task
@GuyCurtis10
Guy Curtis
11 months
The validity of unproctored online exams is undermined by cheating | PNAS #academicintegrity
3
4
18
11
8
70
@phillipdawson
Phillip Dawson
1 year
You can do hundreds of research interviews with students, read the literature informed by millions more students, etc… but the moment you put one carefully selected student on a conference panel you’ll get a high five for “listening to the student voice”
7
1
73
@phillipdawson
Phillip Dawson
10 months
I usually say "I'm not scared of public speaking, because by comparison, improv is much harder for me". Then I escalated to freestyle rap (don't judge me) and that was the hardest thing I did. Well, today I spoke before a parliamentary inquiry, and wow, it sets the bar
5
2
73
@phillipdawson
Phillip Dawson
4 years
Been looking forward to this one: "A critical review of the arguments against the use of rubrics" by @ernestopanadero @Anders_hkr
3
19
70
@phillipdawson
Phillip Dawson
1 year
An endorsement from the godfather of feedback literacy for our new scale to measure feedback literacy behaviours! Thanks David!
@CarlessDavid
David Carless
1 year
Probably the best #feedbackliteracy scale in the world 🍺 kudos to @phillipdawson @ZiYan55010264 @ALipnevich @DrJoannaT Boud & Mahoney
2
33
119
1
2
69
@phillipdawson
Phillip Dawson
2 years
Academics: "Don't write edited book chapters, nobody reads/cites them" Also, academics: "Hey can you please write a chapter for my upcoming edited book?" (yes I'm guilty of both of these)
9
1
68
@phillipdawson
Phillip Dawson
1 year
Great summary of points from my recent workshop with @QQI_connect . Billed as a workshop on cheating it was really (sneakily) a session on validity. Featuring a great quote from @cathellis13
@HackettShackett
Sue Hackett
1 year
A recent NAIN Masterclass with Phill Dawson - some key takeaways - fantastic session!
Tweet media one
4
18
47
2
28
68
@phillipdawson
Phillip Dawson
4 years
Free PDF of first chapter of my new book "Defending Assessment Security in a Digital World: Preventing E-Cheating and Supporting Academic Integrity in Higher Education". Click 'Preview PDF'
1
22
66
@phillipdawson
Phillip Dawson
5 years
Old paradigm vs new paradigm feedback approaches. Focus on feedback information vs focus on feedback processes. @DocWinstone & @CarlessDavid who have written a book #AHEconf2019
Tweet media one
3
28
68
@phillipdawson
Phillip Dawson
6 years
"Important message: your job is cancelled forever" (Back to work today after 6 months parental leave despite this totally convincing note)
Tweet media one
Tweet media two
5
4
64
@phillipdawson
Phillip Dawson
2 years
Here's the completed tier list I'm in the process of making at #herdsa2022
Tweet media one
5
12
62
@phillipdawson
Phillip Dawson
1 year
A refinement of my hot take on ungrading: "Ungrading is the rediscovery of assessment for learning, with a social justice philosophy" Agree? Disagree?
12
5
65
@phillipdawson
Phillip Dawson
11 months
AI can do a lot of what we assess, and it's likely to be part of our students' future lives. How should we change assessment in response? Hear our thoughts in this recent @CRADLEdeakin @TEQSAGov webinar and send in your feedback:
3
23
66
@phillipdawson
Phillip Dawson
4 years
I have a joke about contract cheating. You can say you wrote it if you give me fifty bucks
3
4
64
@phillipdawson
Phillip Dawson
3 months
I've read too many thesis/paper-intro-section literature reviews that did all this stuff but contained zero argument. They leave me thinking "so what?!?!" Don't just summarise the literature - build a case for something.
@acagamic
Prof Lennart Nacke, PhD
3 months
Excellent tips for writing a literature review (from Professor Hall)
Tweet media one
4
520
3K
6
13
66
@phillipdawson
Phillip Dawson
3 years
From where I sit on “Pragmatists Peninsula” (highlighted) this map of higher education research by @profbmac seems pretty accurate. I’ve added in a local landmark, couldn’t think of a suitable pun
Tweet media one
10
25
65
@phillipdawson
Phillip Dawson
7 months
@ThePhDPlace In general, don't start paragraphs with author names, as it makes it look like you are just listing studies rather than presenting your own analysis
1
3
65
@phillipdawson
Phillip Dawson
11 months
Great point by @dannydotliu at AAIN conference: if AI detection lags behind genAI by about 6 months, students who pay for AI won’t get caught because they get the latest AI, whereas students who use the free version will get caught. Major equity issue
4
13
64
@phillipdawson
Phillip Dawson
5 years
179 registrants for our live YouTube stream/Q&A on feedback literacy 29 Oct 2pm Melb time with @ALipnevich @DocWinstone @emolloy1 @CarlessDavid & David Boud. We would love you to join us!
5
29
63
@phillipdawson
Phillip Dawson
1 year
Just read the statement "Integrity is 100% assured" in an article in The Conversation about a type of assessment. No, no, no. Integrity is never 100% assured, and it's dangerous to assert that it ever can be.
8
6
64