Writing Instruction Tips For Automated Essay Graders: How To Design an Essay for a Non-human Reader

Reviewed by J. Marlie Henry, Adjunct Faculty, University of Saint Francis on 4/4/24

Comprehensiveness rating: 4 see less

Considering the length of this book, it seems to address key areas effectively. There is a contents section, and the book does seem to be organized accordingly with appropriate alignment and logical flow of thought. There is no glossary. For a document of this length, a glossary does not seem like it would enhance it significantly, but it could help make information access even easier.

Content Accuracy rating: 5

Though the content could be more substantive, what is presented does seem to be accurate and without any significant problematic biases.

Relevance/Longevity rating: 2

Though the content itself seems to be approached with a current perspective in part, most of the content is noted to be based on sources that are notably aged. For instance, most sources are a decade or more old. Particularly given the significant evolution of this area over the past few years, incorporating more attention to current research and applications would strengthen this book.

Clarity rating: 5

The language used seems to be clear and appropriate. Unnecessary jargon is not used. What is used is understandably presented within a conceptual framework. The intent seems to be clear- to communicate simply in a straightforward manner.

Consistency rating: 5

The text seems to be internally consistent in terms of terminology and framework. There do not seem to be issues in this area. Terminology is internally consistent.

Modularity rating: 5

For a book of this length, the author structured this logically into sections effectively. This book could be used in whole or by section with limited modifications. For instance, the section addressing Toulmin Method might be used in isolation of others.

Organization/Structure/Flow rating: 5

The topics are presented with logical organization. The topics presented are conceptually sequenced in a manner that helps learners build logically on prior conceptualization.

Interface rating: 5

The visuals themselves are simple, but they are clear and understandable without distracting the learner. The purpose is clear- that of learning rather than visuals for the sake of visuals. Likewise, navigation is clear and without issues.

Grammatical Errors rating: 5

Grammatical errors are not evident.

Cultural Relevance rating: 5

It would be interesting to see even more evidence of cultural integration, but what is presented is not culturally insensitive or offensive in any way. The language seems to be consistent with general guidelines for unbiased language use.

Reviewed by Vickie Gray, Writing Adjunct, University of Saint Francis on 12/27/21

Comprehensiveness rating: 5 see less

Lamoreaux gives a thorough background of the Automated Grading System (AEG) and provides links for reference and for further study.

Content Accuracy rating: 5

Lamoreaux exhibits a vast working knowledge of AEG and provided information that appears to be accurate and error-free, and unbiased.

Relevance/Longevity rating: 5

With our growing dependency on technology, more and more educational institutions are utilizing AEG and this usage is often viewed in a negative manner. However, Lamoreaux gives teachers necessary tools to prepare their students to successfully adapt to, and positively embrace, these changes.

The organization of informational text in the book can be easily updated without needing major changes that will disrupt the original flow of each chapter.

Clarity rating: 5

The text is accessible and presented in a manner that is easily understood; jargon use was minimal, thus negating the necessity of glossary.

Consistency rating: 5

Text uses a consistent writing voice that is easily followed and understood.

Modularity rating: 5

Spatial aspects are given high consideration in that the chapters are divided into blocks of text broken up by bullet or numerical points that allow the reader to easily comprehend the presented material.

Organization/Structure/Flow rating: 5

Each chapter is an acceptable length that flows in an organized manner.

Interface rating: 4

I reviewed the book in PDF format and the text was periodically distorted in a “squished down” appearance, which I see happening often in documents saved as PDF files. The text is legible, but the distortion did tend to distract at times.

The images are clear and crisp.

All but one of the links (noted below) work, but they do not automatically open in a new tab/window when clicked on and having to remember to right-click to open them distracted from my reading at times. I checked the online format of the book and they do not automatically open there either.

Note: This source link doesn’t work where it is located on page 7, or on the References page: (Burstein et al, 1998)

Grammatical Errors rating: 4

Minor grammatical errors are present and there is at least one awkwardly phrased sentence due to a missing word or words.

Cultural Relevance rating: 5

Lamoreaux’s writing voice is very approachable and she writes in a culturally sensitive manner that is objective and respectful. Students feel vulnerable when writing, especially when it comes to the words they use that are influenced by their personal and/or educational backgrounds. Lamoreaux offers suggestions to encourage student improvement that will make them feel less like they are being singled out for possible poor word choices while helping them master their writing skills in positive ways.

Comments

This sentence sums up how I viewed AEG before reading this book: “Robo-graders cannot handle the nuances of expression and may penalize the writer for vocabulary choices” (p. 26). I felt that an AEG would only do students a disservice because they lack the human ability to understand context. However, after reading Lamoreaux’s suggestions for teaching students to understand the nature of their audience (AEG), I now see how students can be taught to improve their argumentative writing and language skills so that they are not only better understood by an AEG, but also by each other and their teachers.

As a teacher who uses Toulmin as part of my curriculum, I found Lamoreaux’s Toulmin instruction beneficial to my own understanding and that will help me to better instruct my students as well.

Reviewed by Donna Fiore, Adjunct English and Reading Instructor, Mount Wachusett Community College on 6/27/21

Comprehensiveness rating: 5 see less

The background information provided was sufficient to give the reader a basic understanding of what an automated essay grader is and how it is used in grading writing.

Content Accuracy rating: 5

As far as I am aware, the information presented was logical, unbiased, well thought out, and relevant to the topic at hand.

Relevance/Longevity rating: 5

This subject is more topical today than even a year ago due to the global pandemic. COVID-19 forced many institutions to rethink how they do business. Using a form of Artificial Intelligence to conduct business or even teach school has made these difficult times more manageable.

Clarity rating: 5

The text was reader- friendly without being over simple.

Consistency rating: 5

It was easy to follow the information because terminology was consistent.

Modularity rating: 5

The text divides the information into logical components so the reader is able to follow the process of becoming familiar with the important components of the essay grader.

Organization/Structure/Flow rating: 5

The text flows effortlessly from one chapter to the next.

Interface rating: 5

I especially loved the videos included and the sample activities included in the text.

Grammatical Errors rating: 5

I did not notice any errors.

Cultural Relevance rating: 5

Lamoreaux is very respectful of essay graders. She is not dismissive or negative. Information is presented objectively so that the reader is able to focus on the content being presented.

Comments

I will be incorporating some of this information in my own writing classes. I will also be recommending this text to my nephew who will be entering a doctoral program this fall as a helpful resource for reviewing his writing.