Penny: Transition Network Analysis of Learner-Chatbot Interactions in Scaffolded EFL Writing
arXiv cs.CL 6 hours ago
Researchers analyzed over 4,500 writing sessions with Penny, an LLM-powered chatbot designed to provide feedback on English writing by Japanese EFL learners. The study found that learners follow two main interaction patterns: a Revision Loop where feedback leads to error correction, and a Chat Loop involving sustained dialogue, with high-proficiency learners engaging in more open negotiation while low-proficiency learners rely more on repetitive corrections. The results suggest chatbot design should be differentiated by proficiency level to promote deeper cognitive engagement rather than focusing solely on error correction.