Bridging the gap between complex scientific research and the curious minds eager to explore it.

Computation and Language, Computer Science

Unlocking Writing Excellence: Preventing Cheating with AI

Unlocking Writing Excellence: Preventing Cheating with AI

Writing assessment is crucial for evaluating students’ learning outcomes, but it can be challenging to measure writing coherence, which refers to how well ideas are connected and developed throughout an essay. Topic-based analysis is a method used to evaluate writing coherence by examining the relationships between topics in a piece of writing.

Topic Coherence

Topic coherence is the degree to which the topics in an essay are related, connected, and developed throughout the text. This concept is essential for evaluating writing quality as it helps assessors understand how well the writer has organized their ideas and addressed the topic at hand.

Methodology

Todd et al. (2004) proposed a method for measuring writing coherence using topic-based analysis. The method involves identifying the main topics in an essay and then examining how these topics are related to each other. This is done by analyzing the sentences that connect the topics, known as linkages, and evaluating their quality.

Linkages

Linkages are the connections between topics in an essay that help to develop the writer’s ideas. There are several types of linkages, including transition words, phrases, and clauses, which help to connect ideas within a paragraph or between paragraphs. Other linkages include summarizing phrases, contrasting phrases, and defining phrases.

Coherence Scores

Once the linkages have been identified and evaluated, coherence scores are calculated based on the quality of these connections. The scores can range from 0 to 1, with higher scores indicating better coherence. This method provides a quantitative measure of writing coherence that can be used to evaluate student writing.

Advantages

The use of topic-based analysis for measuring writing coherence has several advantages. Firstly, it provides a systematic approach to evaluating essay quality based on the relationships between topics. Secondly, it allows for the identification of areas where the writer may need improvement, such as weak linkages or insufficient connectivity between ideas. Finally, it can be used to evaluate writing coherence across different genres and assignments.

Conclusion

Measuring writing coherence using topic-based analysis provides a comprehensive approach to evaluating essay quality. This method helps assessors understand the relationships between topics in an essay and how well these ideas are connected, thereby providing a more accurate evaluation of writing coherence. By using this method, educators can provide constructive feedback to students, which can help improve their writing skills over time.