←
René Kizilcec315 posts
René Kizilcec avatar

René Kizilcec

@whynotyet

Associate Professor of Information Science @Cornell; Education, Technology, AI/ML, Fairness/Equity. Opinions are my own.

◷ Joined April 2009▧ 25 Photos and videos
AIDB avatar
⟳ René Kizilcec retweeted
AIDB@ai_database·Feb 24

コーネル大学の調査によると、低所得層の高校生ほどAIを使って大学出願の小論文を書くようになっており、それが合格に与える”ダメージ”が大きいとのこと。 AIを使えば文章の質は表面上は上がりますが、審査官はそれを「この学生らしくない」と受け取ることがあるためと考えられています。 今回研究者らが8万1千件以上の大学入試の小論文を分析したところ、ChatGPT登場後、低所得層の学生ほどAIに頼る割合が高くなっていました。これは理にかなっており、家庭教師や塾よりAIのほうが安価だからです。 ところが、AIを使った低所得層の出願者と同じ学力・属性の高所得層を比較すると、審査結果の格差は以前より31%も広がっていました。 なぜそうなるのか、実際は研究者たちも明確な答えは出せていませんが、AIが生み出す「うまい文章」は、文化資本を持つ人々の言葉のクセに基づいており、その規範に沿って書けば書くほど、規範から遠い学生が「不自然だ」と判断されてしまう構造になっているためと推測されています。 ということは、格差はAIを使った結果を評価する側の眼差しに宿っていることになります。そこが深いポイントです。

Post attachment
René Kizilcec avatar
René Kizilcec@whynotyet·17 Oct 2024

Excited for @LearningAtScale to be in Palermo next summer together with @AIEDconf and @EDMConf2025 and confirmed keynote by @chrispiech!

The 2025 ACM Learning at Scale Call for Papers is out! Check out all Submission Guidelines and Important Dates: learningatscale.acm.org/las2… Did we mention we are in sunny Palermo, Sicily in 2025, co-located with @AIEDconf & @EDMConf2025? @SusanRSinger @OlgaOvi @xaoch @Iriskie_Xia

Post attachment
Cornell Chronicle avatar
⟳ René Kizilcec retweeted
Cornell Chronicle@CornellNews·2 Oct 2024

What do LLMs write like? Researchers at @CornellCIS, @Stanford and @Penn found that #AI-generated college admissions essays are most similar to those written by male students with high socioeconomic status and privilege. @whynotyet @aj_alvero news.cornell.edu/stories/202…

AJ Alvero avatar
⟳ René Kizilcec retweeted
AJ Alvero@aj_alvero·27 Sep 2024

Sharing a paper just published in the Journal of Big Data! Studies have shown strong associations with writing and demography, so here we ask "who do LLMs write like?" Answer: higher social status people (with some caveats) BUT with very little variance link.springer.com/article/10…

Post attachment
René Kizilcec avatar
René Kizilcec@whynotyet·25 Sep 2024

In addition to showing the cultural bias in GPT’s responses, we demonstrate a simple but effective control strategy to improve cultural alignment: cultural prompting, I.e. instructing the model to respond like someone from your region. It works best for the latest versions.

Researchers concerned about cultural bias in large language models asked ChatGPT questions about values used in international surveys. All versions of the model answered like people in English-speaking and Protestant European countries. In PNAS Nexus: ow.ly/4Oy350Trj4S

Post attachment
PNAS Nexus avatar
⟳ René Kizilcec retweeted
PNAS Nexus@PNASNexus·23 Sep 2024

Researchers concerned about cultural bias in large language models asked ChatGPT questions about values used in international surveys. All versions of the model answered like people in English-speaking and Protestant European countries. In PNAS Nexus: ow.ly/4Oy350Trj4S

Post attachment
Olga Viberg avatar
⟳ René Kizilcec retweeted
Olga Viberg@OlgaOvi·25 Jul 2024

Our SI on Advancing Equity and Inclusion in educational practices with AI-powered educational decision support systems (AI-EDSS) is out! Check all the valuable contributions! bera-journals.onlinelibrary.… @BJETEds @whynotyet @IoanaJJ @alywise @NiaDowell