Use of An AI-powered Rewriting Support Software in Context with Other Tools: A Study of Non-Native English Speakers

Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology  ·  2023  ·  Impact 3

Takumi Ito; Naomi Yamashita; Tatsuki Kuribayashi; Masatoshi Hidaka; Jun Suzuki; Ge Gao; Jacky Jamieson; Kentaro Inui;

RELATED

Papers      Patents     Grants     Venues     Experts    Cite    Share    Save

ABSTRACT

Academic writing in English can be challenging for non-native English speakers (NNESs). AI-powered rewriting tools can potentially improve NNESs’ writing outcomes at a low cost. However, whether and how NNESs make valid assessments of the revisions provided by these algorithmic recommendations remains unclear. We report a study where NNESs leverage an AI-powered rewriting tool, Langsmith, to polish their drafted academic essays. We examined the participants’ interactions with the tool via user studies and interviews. Our data reveal that most participants used Langsmith in combination with other tools, such as machine translation (MT), and those who used MT had different ways of understanding and evaluating Langsmith’s suggestions than those who did not. Based on these findings, we assert that NNESs’ quality assessment in AI-powered rewriting tools is influenced by the simultaneous use of multiple tools, offering valuable insights into the design of future rewriting tools for NNESs.

 Paraphrase     Questionfy     Wikify     Simplify     Summarize

Download