You can find me on Google Scholar.
Disclaimer: Electronic copies of papers are provided as a professional courtesy to ensure timely dissemination of academic work for individual, non-commercial purposes. Copyright resides with the respective copyright holders, as stated within each paper. These files may not be re-posted without permission.
2024
Cho, J., Tao, Y., Yeomans, M., Tingley, D., & Kizilcec, R. F. (2024). Which Planning Tactics Predict Online Course Completion? In Proceedings of the International Conference on Learning Analytics and Knowledge (LAK).
2023
Kizilcec, R. F., Baker, R. B., Bruch, E., Cortes, K. E., Hamilton, L. T., Lang, D. N., Pardos, Z. A., Thompson, M. E., & Stevens, M. L. (2023). From pipelines to pathways in the study of academic progress. Science, 380(6643).
Hohenstein, J., Kizilcec, R. F., DiFranzo, D., Aghajari, Z., Mieczkowski, H., Levy, K., Naaman, M., Hancock, J., & Jung, M. F. (2023). Artificial intelligence in communication impacts language and social relationships. Scientific Reports, 13(1), 5487.
Lee, H., Kizilcec, R. F., & Joachims, T. (2023). Evaluating a Learned Admission-Prediction Model as a Replacement for Standardized Tests in College Admissions. In Proceedings of the ACM Conference on Learning at Scale. Received Best Conference Paper Award.
Lee, J., Thymes, B., Zhou, J., Joachims, T., & Kizilcec, R. F. (2023). Augmenting Holistic Review in University Admission using Natural Language Processing for Essays and Recommendation Letters. In Workshop Proceedings at the Intl. Conference on Artificial Intelligence in Education (AIED).
Alon, L., Sung, S., Cho, J., & Kizilcec, R. F. (2023). From emergency to sustainable online learning: Changes and disparities in undergraduate course grades and experiences in the context of COVID-19. Computers & Education, 203(104870).
Allen, S., & Kizilcec, R. F. (2023). A Systemic Model of Academic (Mis)Conduct to Curb Cheating in Higher Education. Higher Education.
Gardner, J., Yu, R., Nguyen, Q., Brooks, C., & Kizilcec, R. F. (2023). Cross-Institutional Transfer Learning for Educational Models: Implications for Model Performance, Fairness, and Equity. In Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT).
Claure, H., Kim, S., Kizilcec, R. F., & Jung, M. (2023). The social consequences of machine allocation behavior: Fairness, interpersonal perceptions and performance. Computers in Human Behavior, 146, 107628.
Kizilcec, R. F. (2023). To Advance AI Use in Education, Focus on Understanding Educators. International Journal of Artificial Intelligence in Education.
Kizilcec, R. F. & Davis, D. (2023). Learning Analyitcs Education: A case study, review of current programs, and recommendations for instructors. In Olga Viberg and Åke Grönlund (Eds.). Practicable Learning Analytics. Springer Nature.
Kizilcec, R.F., Viberg, O., Jivet, I., Martínez-Monés, A., Oh, A., Hrastinski, S., Mutimukwe, C., & Scheffel, M. (2023). The Role of Gender in Students’ Privacy Concerns about Learning Analytics: Evidence from five countries. In Proceedings of the ACM Conference on Learning Analytics and Knowledge (LAK 2023). Best Short Paper Nominee.
Alon, L., Sung, S., & Kizilcec, R. F. (2023). “It’s Nice to Mix Up the Rhythm”: Undergraduates’ Experiences in a Large Blended Learning Course in Information Science in the Context of COVID-19. iConference 2023. Lecture Notes in Computer Science, vol 13971. Springer.
Kizilcec, R. F., Mason, J., McCarthy, K., Rodrigo, M. M., & Rose, C. (2023). Using Technology to Foster Equitable Access and Diverse Learning Communities. In Rapid Community Reports, Workshop Outcomes (pp. 1-9). International Society of the Learning Sciences.
Misevic, D., Atal, I., Bedard, D., Cherel, E., Escamilla, J., Evans, L., … & Van Der Leeuw, S. (2023). Harnessing collective intelligence for the future of learning–a co-constructed research and development agenda. Human Computation, 10(1), 1-30.
2022
Chen, Y., Fu, A., Lee, J., Wilkie Tomaski, I., & Kizilcec, R. F. (2022). Pathways: Exploring Academic Interests with Historical Course Enrollment Records. In Proceedings of the ACM Conference on Learning at Scale.
Cho, J., Li, Y., Krasny, M. E., & Kizilcec, R. F. (2022). Measuring Cultural Dimensions of Learning in Online Courses. In Proceedings of the ACM Conference on Learning at Scale.
Sung, S., Alon, L., Cho, J., & Kizilcec, R. F. (2022). How to Assess Student Learning in Information Science: Exploratory Evidence from Large College Courses. In Proceedings of the 85th Annual Meeting of the Association for Information Science & Technology (ASIS&T 2022).
Kizilcec, R. F. & Lee, H. (2022). Algorithmic Fairness in Education. In W. Holmes & K. Porayska-Pomsta (Eds.), The Ethics of Artificial Intelligence in Education, Routledge. DOI: 10.4324/9780429329067-10.
Kizilcec, R. F., Mimno, J. A., & Karhan, A. J. (2022). Effects of Framing Professional Development as a Career Growth Opportunity on Course Completion. In Proceedings of the ACM Conference on Learning at Scale.
McCarthy, K. S., Crossley, S. A., Meyers, K., Boser, U., Allen, L. K., Chaudhri, V. K., Collins-Thompson, K., D’Mello, S., De Choudhury, M., Garg, K., Goel, A., Gosha, K., Heffernan, N., Hooper, M. A., Hyman, E., Jarratt, D. C., Khalil, D., Kizilcec, R. F., Litman, D., Malatinszky, A., Marks, K., McNamara, D. S., Menko, R., Palermo, C., Porcaro, D., Roscoe, R., Shapiro, S., Khanh-Phoung, T., Trumbore, A. M., White, C., Wong, W., Yang, D., & Zampieri, M. (2022). Toward more effective and equitable learning: Identifying barriers and solutions for the future of online education. Technology, Mind, & Behavior, 3(1).
Rizvi, S., Rienties, B., Rogaten, J., & Kizilcec, R. F. (2022). Culturally-Adaptive Learning Design: A Mixed-method Study of Cross-Cultural Learning Design Preferences in MOOCs. In B. Rienties, R. Hampel, E. Scanlon, D. Whitelock (Eds.), Open World Learning: What Works?, Routledge.
Sabnis, S., Yu, R., & Kizilcec, R. F. (2022). Large-Scale Student Data Reveal Sociodemographic Gaps in Procrastination Behavior. In Proceedings of the ACM Conference on Learning at Scale. Best Student Paper.
Rizvi, S., Rienties, B., Rogaten, J., & Kizilcec, R. F. (2022). Beyond One-Size-Fits-All in MOOCs: Variation in Learning Design and Persistence of Learners in Different Cultural and Socioeconomic Contexts. Computers in Human Behavior, 126, 106973.
Williamson, K. & Kizilcec, R. F. (2022). Large-Scale Analysis of Discussion Networks in College Courses. In Proceedings of the ACM Conference on Learning at Scale.
Williamson, K. & Kizilcec, R. F. (2022). Review of Learning Analytics Dashboard Research in Higher Education: Implications for Justice, Equity, Diversity, and Inclusion. In Proceedings of the 12th International Conference on Learning Analytics and Knowledge (LAK).
2021
Kizilcec, R. F., Makridis, C., & Sadowski, K. C. (2021). Pandemic Response Policies’ Democratizing Effects on Online Learning. Proceedings of the National Academy of Sciences (PNAS), 118(11).
Allen, S. E., Phillips, A. M., & Kizilcec, R. F. (2021). Student perceptions of pre-assessments: “It’s basically just guessing anyways.” Proceedings of the Physics Education Research conference.
Kizilcec, R. F., Chen, M., Jasinska, K., Madaio, M., & Ogan, A. (2021). Mobile Learning During School Disruptions in Sub-Saharan Africa. AERA Open, 7.
Williams-Ceci, S., Grose, G. E., Pinch, A. C., Kizilcec, R. F., & Lewis, N. A. (2021). Combatting sharenting: Interventions to alter parents’ attitudes towards posting about their children online. Computers in Human Behavior.
Varanasi, R. A., Vashistha, A., Kizilcec, R. F., & Dell, N. (2021). Investigating Technostress Among Teachers in Low-Income Indian Schools. In Proceedings of the ACM on Human-Computer Interaction, 5(340).
Williamson, K. & Kizilcec, R. F. (2021). Effects of Algorithmic Transparency in Bayesian Knowledge Tracing on Trust and Perceived Accuracy. In Proceedings of the Conference on Educational Data Mining (EDM).
Cho, J., Li, Y., Krasny, M. E., Russ, A., & Kizilcec, R. F. (2021). Online Learning and Social Norms: Evidence from a Cross-Cultural Field Experiment in a Course for a Cause. Computer-based Learning in Context, 3(1), 18-36.
Yu, R., Lee, H., & Kizilcec, R. F. (2021). Should College Dropout Prediction Models Include Protected Attributes? In Proceedings of the ACM Conference on Learning at Scale (L@S). Best Paper Nominee
Williamson, K. & Kizilcec, R. F. (2021). Learning Analytics Dashboard Research Has Neglected Diversity, Equity, and Inclusion. In Proceedings of the ACM Conference on Learning at Scale (L@S).
Cho, J. & Kizilcec, R. F. (2021). Applying the Behavior Change Taxonomy from Public Health Interventions to Education Research. In Proceedings of the ACM Conference on Learning at Scale (L@S).
Cho, J., Li, Y., Armstrong, A., Russ, A., Krasny, M. E., & Kizilcec, R. F. (2021). Using Social Norms to Promote Actions Beyond the Course. In Proceedings of the ACM Conference on Learning at Scale (L@S).
Cho, J., Tomasik, I., Yang, H., & Kizilcec, R. F. (2021). Student Perceptions of Social Support in the Transition to Emergency Remote Instruction. In Proceedings of the ACM Conference on Learning at Scale (L@S). Best Undergraduate Student Paper Award
Cho, J. & Kizilcec, R. F. (2021). Delivery Ghost: Effects of Language Immersion and Interactivity in a Language Learning Game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI).
Chaturapruek, S., Dalberg, T., Thompson, M. E., Giebel, S., Harrison, M., Johari, R., Stevens, M. L., & Kizilcec, R. F. (2021). Studying Undergraduate Course Consideration at Scale. AERA Open, 7.
Alon, L., Sung, S. & Kizilcec, R.F. (2021). How Does Active Learning Change Undergraduate Learning Experiences? A Case of a Large Technology Design Course. In T. Bastiaens (Ed.), Proceedings of Innovate Learning Summit 2021 (pp. 201-208).
2020
Kizilcec, R. F., Reich, J., Yeomans, M., Dann, C., Brunskill, E., Lopez, D., Turkay, S., Williams, J., & Tingley, D. (2020). Scaling Up Behavioral Science Interventions in Online Education. Proceedings of the National Academy of Sciences (PNAS).
Kizilcec, R. F. & Kambhampaty, A. (2020). Identifying course characteristics associated with sociodemographic variation in enrollments across 159 online courses from 20 institutions. PloS one, 15(10), e0239766.
Chirikov, I., Semenova, T. Maloshonok, N., Bettinger, E., Kizilcec, R. F. (2020). Online Education Platforms Scale College STEM Instruction with Equivalent Learning Outcomes at Lower Cost. Science Advances, 6(15).
Kizilcec, R. F., Saltarelli, A. J., Bonfert-Taylor, P., Goudzwaard, M., Hamonic, E., & Sharrock, R. (2020). Welcome to the Course: Early Social Cues Influence Women’s Persistence in Computer Science. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). Virtual Event, USA.
Kizilcec, R. F. & Chen, M. (2020). Student Engagement in Mobile Learning via Text Message. In Proceedings of the ACM Conference on Learning at Scale (L@S). Virtual Event, USA.
Chen, Y. & Kizilcec, R. F. (2020). Examining Sources of Variation in Student Confusion in College Classes. In Proceedings of the ACM Conference on Learning at Scale (L@S). Virtual Event, USA.
Lee, H. & Kizilcec, R. F. (2020). Evaluation of Fairness Trade-offs in Predicting Student Success. In Proceedings of the Conference on Educational Data Mining (EDM) Fairness, Accountability, and Transparency in Educational Data (FATED) Workshop.
2019
Kizilcec, R. F. & Saltarelli, A. J. (2019). Psychologically Inclusive Design: Cues impact women’s participation in STEM education. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). Glasgow, Scotland.
Kizilcec, R. F. & Saltarelli, A. J. (2019). Can a diversity statement increase diversity in MOOCs? In Proceedings of the ACM Conference on Learning at Scale (L@S). Chicago, IL, USA. Received Best Conference Paper Award
Kizilcec, R. F. & Goldfarb, D. (2019). Growth Mindset Predicts Student Achievement and Behavior in Mobile Learning. In Proceedings of the ACM Conference on Learning at Scale (L@S). Chicago, IL, USA.
Rizvi, S., Rienties, B., Rogaten, J. & Kizilcec, R. F. (2019). Investigating Variation in Learning Processes in a FutureLearn MOOC. Journal of Computing in Higher Education.
Varanasi, R. A., Kizilcec, R. F., Dell, N. (2019) How Teachers in India Reconfigure their Work Practices around a Teacher-Oriented Technology Intervention. Proceedings of the ACM: Human-Computer Interaction.
2018
Davis, D., Kizilcec, R. F., Hauff, C., & Houben, G.-J. (2018). Scaling Effective Learning Strategies: Retrieval Practice and Long-Term Knowledge Retention in MOOCs. Journal of Learning Analytics, 5(3), 21–41.
Chaturapruek, S., Dee, T. S., Johari, R., Kizilcec, R. F., & Stevens, M. L. (2018). How a data-driven course planning tool affects college students’ GPA: Evidence from two field experiments. In Proceedings of the Fifth ACM Conference on Learning at Scale (L@S). London, UK. Received Best Conference Paper Award
Kizilcec, R. F., Bakshy, E., Eckles, D., & Burke, M. (2018). Social Influence and Reciprocity in Online Gift Giving. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). Montreal, Canada.
Maldonado-Mahauad, J., Pérez-Sanagustín, M., Kizilcec, R. F., Morales, N., & Munoz-Gama, J. (2018). Mining theory-based patterns from Big data: Identifying self-regulated learning strategies in Massive Open Online Courses. Computers in Human Behavior, 80, 179-196.
Davis, D., Kizilcec, R. F., Hauff, C., & Houben, G.-J. (2018). The Half-Life of MOOC Knowledge: A Randomized Trial Evaluating the Testing Effect in MOOCs. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (LAK). Sydney, Australia.
2017
Kizilcec, R. F., Saltarelli, A. J., Reich, J., & Cohen, G. L. (2017). Closing global achievement gaps in MOOCs. Science, 355(6322), 251-252. (Supporting Materials)
Kizilcec, R. F. & Cohen, G. L. (2017). Eight-minute self-regulation intervention improves educational attainment at scale in individualist but not collectivist cultures. Proceedings of the National Academy of Sciences (PNAS), 114(17), 4348–4353.
Kizilcec, R. F., Davis, G. M., & Cohen, G. L. (2017). Towards Equal Opportunities in MOOCs: Affirmation Reduces Gender & Social-class Achievement Gaps in China. In Proceedings of the Fourth ACM Conference on Learning at Scale (L@S). Cambridge, MA. Received Best Conference Paper Award
Kizilcec, R. F., Perez-Sanagustin, M., & Maldonado, J. J. (2017). Self-Regulated Learning Strategies Predict Learner Behavior and Goal Attainment in Massive Open Online Courses. Computers & Education, 104, 19-33.
Kizilcec, R. F. & Brooks, C. (2017). Diverse Big Data and Randomized Field Experiments in MOOCs. In C. Lang, G. Siemens, A. Wise, D. Gašević (Eds.), Handbook of Learning Analytics (pp. 211-222). Society for Learning Analytics Research.
Davis, D., Jivet, I., Kizilcec, R. F., Chen, G., Hauff, C., & Houben, G.-J. (2017). Follow the Successful Crowd: Raising MOOC Completion Rates through Social Comparison at Scale. In Proceedings of the 7th International Conference on Learning Analytics and Knowledge (LAK). Vancouver, Canada.
2016
Eckles, D., Kizilcec, R. F., & Bakshy, E. (2016). Estimating peer effects in networks with peer encouragement designs. Proceedings of the National Academy of Sciences (PNAS), 113(27), 7316-7322. (Supporting Information)
Kizilcec, R. F. (2016). How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2016. San Jose, CA.
Kizilcec, R. F., Perez-Sanagustin, M., & Maldonado, J. J. (2016). Recommending Self-Regulated Learning Strategies Does Not Improve Performance in a MOOC. In Proceedings of the Third ACM Conference on Learning at Scale, L@S 2016. Edinburgh, UK.
Li, J., Kizilcec, R. F., Bailenson, J. N., & Ju, W. (2016). Social Robots and Virtual Agents as Lecturers for Video Instruction. Computers in Human Behavior, 55(B), 1222-1230.
2015
Kizilcec, R. F., Bailenson, J. N., & Gomez, C. J. (2015). The Instructor’s Face in Video Instruction: Evidence from Two Large-Scale Field Studies. Journal of Educational Psychology, 107(3), 724-739.
Kizilcec, R. F. & Schneider, E. (2015). Motivation as a Lens to Understand Online Learners. ACM Transactions on Computer-Human Interaction (TOCHI), 22(2).
Kizilcec, R. F., & Halawa, S. A. (2015). Attrition and Achievement Gaps in Online Learning. In Proceedings of the Second ACM Conference on Learning at Scale, L@S 2015. Vancouver, Canada.
Krause, M. & Kizilcec, R. F. (2015). To Play or not to Play: Response Quality and Task Complexity in Games and Paid Crowdsourcing. In Proceedings of the Conference on Human Computation & Crowdsourcing, HCOMP 2015. San Diego, CA.
2014
Kizilcec, R. F., Papadopoulos, K., & Sritanyaratana, L. (2014). Showing Face in Video Instruction: Effects on Information Retention, Visual Attention, and Affect. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014. Toronto, Canada.
Kizilcec, R. F., Schneider, E., Cohen, G. L., & McFarland, D. A. (2014). Encouraging Forum Participation in Online Courses with Collectivist, Individualist, and Neutral Motivational Framings. eLearning Papers, 37, 13-22. ISSN: 1887-1542.
Thille, C., Schneider, D. E., Kizilcec, R. F., Piech, C., Halawa, S. A., & Greene, D. K. (2014). The Future of Data–Enriched Assessment. Research & Practice in Assessment, 9(2), 5-16.
Williams, J. J., Kizilcec, R. F., Klemmer, S., & Russell, D. (2014). Innovations for Learning at Scale Workshop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014. Toronto, Canada.
Zhang, K. & Kizilcec, R. F. (2014). Anonymity in Social Media: Effects of Content Controversiality and Social Endorsement on Sharing Behavior. In Proceedings of the 8th International Conference on Weblogs and Social Media, ICWSM 2014. Ann Arbor, MI.
Aymerich-Franch, L., Kizilcec, R. F., & Bailenson, J. N. (2014). The Relationship between Virtual Self Similarity and Social Anxiety. Frontiers in Human Neuroscience, 8(944).
2013
Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing Disengagement: Analyzing Learner Subpopulations in Massive Open Online Courses. In Proceedings of the Third International Conference on Learning Analytics and Knowledge, LAK 2013. Leuven, Belgium. | Recording of conference talk.
Kizilcec, R. F. (2013). Collaborative Learning in Geographically Distributed and In-person Groups. Proceedings of the 16th International Conference on Artificial Intelligence in Education, AIED 2013. Memphis, TN.