Stylistic-oddities
These relate to how features such as the patterns of language use, discipline-specific terminology and practices, and typographical layout, can suggest issues with the content.
Language differences
The style of language used in different parts of an answer look odd when considered in the whole. Each section or paragraph may look ok by itself, but when the whole is looked at as the work of a single author there may be areas that do not look consistent.
It may be there is a shift in the use of language, such as: formal/slang, American/British English, abstract/concrete, general/specific, first person/second person.
LLMs, unless prompted to do otherwise, will usually spell correctly and use good grammar and punctuation. However, they can be prompted to include grammatical errors or misspellings in an attempt to mask the AI use.
Example: Shifts in point of view
Question
Write an account of visiting a museum.
Answer
As I stepped through the grand entrance of the museum, a sense of anticipation washed over me. The familiar scent of aged wood and polished marble greeted my senses, setting the stage for an immersive journey through time and culture. Excitement bubbled within me as I embarked on this exploration of human history and creativity.
As you wander from exhibit to exhibit, your senses are flooded with a kaleidoscope of sights, sounds, and smells. Paintings come to life before your eyes, their colors vibrant and alive with emotion. Fragments of history unfold around you, each artifact a window into a world long gone but never forgotten.
As the day drew to a close and I reluctantly made my way towards the exit, I couldn't help but feel a profound sense of gratitude for the experience I had been fortunate enough to have. The museum had offered me more than just a glimpse into history; it had given me a new perspective on the world and a deeper appreciation for the richness of human culture. And as I stepped back out into the bustling streets beyond, I carried with me the memories of my journey and the knowledge that I had been touched by something truly extraordinary.
Commentary
Mostly written in first person, ‘I’, but in the middle switches to second person, ‘You’.
Example: Shifts in technical depth
Question
What is Metabolism?
Answer
Alright, imagine your body is like a busy factory that works all the time, even when you're sleeping! This factory is called your metabolism.
Metabolism refers to all the chemical processes that occur within living organisms to maintain life. It involves two main processes:
Catabolism: This is the breakdown of complex molecules, such as carbohydrates, proteins, and fats, into simpler molecules. During catabolism, energy is released, which is captured in the form of adenosine triphosphate (ATP). ATP serves as the primary energy currency of cells and is used to power various cellular activities.
Anabolism: This is the synthesis of complex molecules from simpler ones. Anabolism requires energy, which is provided by ATP generated during catabolic reactions. Anabolic processes include the building of proteins from amino acids, the synthesis of new cellular components, and the storage of excess energy in the form of glycogen or fat.
So, metabolism is like the busy factory inside your body that helps you grow, play, and stay healthy by turning the food you eat into energy and building blocks for your body!
Commentary
A noticable mis-matche between the opening and closing sentences, and the rest of the answer. The opening and closing paragraphs are almost like they are from a children’s book, the middle from a graduate text introduction.
Large swings in competency across the entire submission
Some GenAI tools differ dramatically in competencies, including the ability to answer the question, the technical nature of the vocabulary used, the quality of the writing, and significant changes in grammar.
One thing that often stands out in first stage modules is a highly competent answer among a range of mediocre answers in other parts - suggesting the student has had selective help on some questions, or is already an expert in that topic.
A question that asks for illustrations or examples of a technique may show a wide range of competency within the sub-parts of the answer, from non-working examples to highly complex correct examples. This can occur where a student attempts the 'easier' questions themselves, but uses a GenAI tool for more complex questions. The 'easier' questions are answered poorly but the complex evolution of the question may be answered well.
Example: Fails to answer trivial elements, give excellent answer to complex questions
Question
Write SQL queries for the following:
a) List all the details of Clients in the database.
b) List just the Name, Address and Tier details for clients.
c) List all the Names and Addresses of clients whose Tier is 3 or above
Answer
a) SELECT all the details Clients;
b) SELECT Just(Name,Address, Tier) clients;
c) SELECT name, address, tier
FROM clients
WHERE tier >= 3;
Commentary
Parts a) and b) are building blocks that can be merged to answer c). The solutions given are not valid SQL which should be a) SELECT * FROM clients; b) SELECT name, address, tier FROM clients. However, both of these fragments are presented correctly in part c) which is valid SQL and does answer the question.
Repetition within and across answers
Repetitive text is often generated by GenAI tools, where the same point is discussed several times in multiple paragraphs.
There is also a phenomenon known as ‘keyword stuffing’ where the output repeats a keyword, used in the prompt, to an excessive degree. So, for example, having introduced a dog, a human might later refer to the dog as ‘it’ or ‘she/he/they’. While LLMs can do that, we sometimes see the use of the keyword, ‘dog’ repeatedly.
If asked to repeat a task multiple times, for example to review three papers, the output of the three tasks will be repetitively presented, with an almost identical structure (paragraph counts or bullet points, for example) and almost identical forms of introductory and concluding text.
Prose, bullet-points, sub-headings and other structures
GenAI tools have a tendancy to use structural elements when producing extended pieces of text. They sometimes takes their cue from the context of the question being asked - something with an engineering context often produces text broken into short bullet points, for example. However, they're not always good at getting the context right. In particular, when asked for an essay they appear to favour subheadings when there is a shift in focus; whereas in some subjects it would be expected to write in continuous prose.
Example: What do we expect in an essay?
Question
Write a 900-word essay, including an introduction and conclusion on that discusses the claim: debt undermines a household's financial stability.
Answer
Title: The Impact of Debt on Household Financial Stability
Introduction In the contemporary financial landscape, the concept of debt has become a ubiquitous part of household finance. From mortgages and car loans to credit card debts and student loans, the prevalence of borrowing is undeniable. However, the claim that debt undermines a household's financial stability warrants a comprehensive examination. This essay aims to explore the dimensions of this claim by analyzing the effects of debt on a household's financial well-being, considering factors such as the nature of debt, interest rates, income levels, and long-term financial planning.
The Double-Edged Sword of Debt At its core, debt is a tool – it can be a stepping stone towards achieving financial goals, such as homeownership or education, or a pitfall leading to financial distress. The impact of debt on household stability heavily depends on the nature of the debt. Secured debts like mortgages, often seen as 'good debt', can be beneficial, enabling households to acquire assets that typically appreciate over time. Conversely, unsecured debts, especially those with high interest rates like credit card debts, are often labeled as 'bad debt'. These can rapidly accumulate, creating a financial strain that hinders a household's ability to save or invest.
Debt and Financial Vulnerability A key issue in the relationship between debt and financial stability is the level of financial vulnerability it creates. Households with high debt-to-income ratios are often one unexpected expense away from financial turmoil. The obligation to meet regular debt repayments can leave little room for emergency savings, making these households vulnerable to unforeseen events like job loss, illness, or economic downturns. This lack of a financial buffer can lead to a spiral of increasing debt as households borrow more to cover emergencies, further undermining their financial stability.
Interest Rates and Debt Sustainability The sustainability of debt is profoundly influenced by interest rates. For households with variable rate debts, a rise in interest rates can significantly increase the cost of debt repayments. Even fixed-rate debts can become unsustainable if the overall debt level is high relative to the household's income. High-interest debts, like credit card debts, can be particularly detrimental as they can quickly grow beyond a household's ability to pay, leading to defaults, damaged credit scores, and an inability to access affordable credit in the future.
Income Levels and Debt Capacity The impact of debt on financial stability also varies across different income levels. Higher-income households may comfortably manage their debt repayments and still maintain sufficient savings and investments. In contrast, lower-income households may find even moderate levels of debt to be burdensome. For these households, debt can consume a significant portion of their income, leaving little for savings or investment, and making them more susceptible to financial shocks.
The Psychological Impact of Debt Beyond the tangible financial implications, debt can have a profound psychological impact on households. The stress and anxiety associated with managing high levels of debt can have detrimental effects on mental health and overall well-being. This psychological burden can further exacerbate financial instability as it may lead to poor financial decision-making, decreased productivity, or even health-related expenses.
Debt as an Investment in Future Stability On the other hand, not all debt undermines financial stability. Strategic borrowing can be an investment in future financial stability. For example, student loans can lead to higher earning potential, and a mortgage can result in homeownership, an asset that generally appreciates over time. The key is responsible borrowing – understanding the terms of the debt, ensuring the repayments are manageable, and that the debt is contributing to an increase in net worth or income potential.
Debt Management and Financial Planning Effective debt management is crucial for maintaining financial stability. This includes understanding the terms of debts, prioritizing high-interest debts, and creating a budget that includes debt repayment as a key component. Financial planning, including building an emergency fund and investing for the future, can provide a buffer against the financial instability that debt might otherwise cause.
Conclusion Debt, in its essence, is a nuanced tool in household financial management. While it can provide opportunities and leverage for financial growth, it also has the potential to undermine financial stability significantly. The impact of debt on a household’s financial health is multi-faceted, influenced by the nature and terms of the debt, the household’s income level, and their approach to financial management and planning. It is the balance between leveraging debt for beneficial outcomes and avoiding its pitfalls that determines its effect on financial stability. Ultimately, responsible borrowing, coupled with sound financial planning, is key to harnessing the power of debt while safeguarding against its risks. As households navigate the complex financial landscape, understanding and managing debt becomes a critical component of maintaining and enhancing their financial stability.
Commentary
This question comes from a discipline where continuous prose is expected for an essay. However, this is not always the case and students taking, for example, economics modules alongside this course will often interpret 'essay' based on their home qualification and prior study.
Writing style
GenAI tools tend to produce grammatically correct sentences that are bland and toneless. They tend to write in shorter sentences. Some students will write like this anyway, and prompt engineering can make GenAI include spelling mistakes and grammatical errors, so this is hard to present as evidence on it's own.
ChatGPT makes use of lot of ‘transitional words’ such as ‘Additionally’, ‘Moreover’, ‘Consequently’ and ‘Hence’. These are more frequent in highly formal writing, so may not be noticeably different from some student generated text.
LLMs also have a tendency to sound quite pretentious – using words such as ‘utilised’ rather than ‘used’ - so we might ask ourselves, given the level of the student and the question, does this sound like ‘normal’ language.
Writing style is often used by the tools designed to detect the output of GenAI tools. They compare the writing style and language use in a supplied block of text against large numbers of samples of human-written and GenAI written texts.
Conversational elements that are out of place in a written/formal setting
ChatGPT was developed to mimic a conversational exchange, and other GenAI tools have similarly been developed to engage with an interactive exchange. This can result in the output text containing elements that are normally not found in written, formal answers.
Example: Elements of a spoken conversation
Question
Describe what you would expect to gain by a semi-structured interview with the midwives.
Answer
Sure, in a semi-structured interview with the midwives, I would aim to gather valuable insights about their vision for the breastfeeding app and understand the specific requirements they have in mind.
Follow us
Explore
Undergraduate
Postgraduate
Policy
-
Follow us on Social media
-
