> Does the fact that the United States of America has never experienced foreign
occupation help us to understand its political culture?
Cough cough
> It was the only time since the American Revolutionary War that a foreign power had captured and occupied a United States capital. [Burning of Washington]</p>
> The British occupation of Washington, D.C., lasted for roughly 26 hours.
Still technically correct :)
david_shi 4 days ago [-]
For all its prestige, these read like Reddit AMA topics.
Animats 4 days ago [-]
Those are questions designed to elicit controversy, not answers.
If someone posted one of those questions on Reddit, they'd be trolling.
edavison1 4 days ago [-]
Hook me up with the password for the alternate dimension Reddit you visit, it is so much smarter than mine.
deepfriedbits 4 days ago [-]
The value is in the answers.
Animats 4 days ago [-]
1. In the essay version of the Turing test, an examiner decides which of two
essays was written by a human and which by a machine. Convince the
examiner that you are the human.
If the examiner is any good, they'll realize that's no longer possible.
2. Is body language a language?
Definitional question. The usual vocabulary is too small for a general purpose language.
3. Are dreams more like movies or video games?
Video games. You have some agency.
4. ‘Only animals who are below civilization and the angels who are beyond it
can be sincere’ (W.H. AUDEN). Discuss.
The brighter animals can deceive. Ever been fooled by a crow? Can't speak to angels; never met one.
5. Should the UN pass a declaration of rights extending beyond humans?
No. They have enough problems.
6. Invent a new punctuation mark!
We have enough emoji already.
7. Is the contemporary art market a form of tulip fever?
No, it's a form of status signalling. A lek.
8. When did the beautiful become the good?
Some time before Plato.
9. Should Job Centres offer opportunities for sex work?
Absent coercion, yes.
10. Are all asylum seekers equal?
Some are more equal than others.
IshKebab 3 days ago [-]
> they'll realize that's no longer possible
It definitely is. AI isn't perfect yet. It still has well-known flaws like the inability to count letters or say "I don't know". Definitely harder in the form of an essay than a conversation though. Especially because there's a decent chance someone has written "the answer" on the web somewhere and AI can just regurgitate it.
ben_w 2 days ago [-]
"Convince the examiner that you are the human" is much harder than "Don't write with the known list of tropes an LLM often uses".
These are flaws from 6-12 months ago. You might want to spend some time talking to Opus 4.7 or GPT 5.5. I can assure you that they can count letters just fine.
You’re right that AI isn't perfect, but it’s pretty good. Especially since December last year which was an inflection point in capability.
IshKebab 3 days ago [-]
Those don't seem to be available for free so I'll take your word for it on the letter counting. They still can't say "I don't know" though can they? I think it would still be pretty easy to weed out AI in a Turing test with a competent examiner and a human that wants to prove they are human.
ben_w 2 days ago [-]
> They still can't say "I don't know" though can they?
Of course they can. Even older models can. They do better at this when given permission to say so, just like a very anxious student facing a maths exam question may need to be reminded "find the exact square root of 2 in the form a/b, or prove this isn't possible".
The easy part of spotting an LLM is how few people ever change the default settings; my personalisation includes telling it to say so when unsure or that it doesn't know, along with some of the other weaknesses of LLMs.
There are other patterns in LLMs, but the better the tools are wielded the harder it is to spot them.
rich_sasha 3 days ago [-]
Im amazed how many commenters assume the questions assume a single required answer. Is this how universities work where you studied? By the standard HN demographics, I'll assume that is mostly the US.
Having studied in the UK, clearly the point is to elicit a well-thought through argument. The "answer" almost doesn't matter at all. A boring but "correct" argument is easily beaten by a novel one, even (or especially) if it is controversial, flippant or even somewhat ridiculous.
Of course there is a limit, if you straight-faced start promoting killing people, or worse still, Oxbridge academics, that won't fly. But I'd say that limit is quite far.
There are of course 2nd order effects too, as in "I don't reject this argument because it offends me but because it is poor".
jfengel 1 days ago [-]
Is the job to produce one essay answering all three questions? (Or rather, two essays with three questions each.)
It would be easier to weave some topics together than others. I'd expect them to get a fair number of papers with identical choices for questions, if that synthesis is part of the grade.
Aurornis 3 days ago [-]
The responses reflect people from engineering backgrounds who are unfamiliar with this type of exam, not an American versus UK thing.
In engineering there isn’t room for creative and controversial answers when you’re asked to solve an exam problem.
It is rather fitting to see some try to turn this into another chance to stereotype Americans rather than realizing the obvious explanation that this is a website with a global audience that is biased toward software and engineering.
rich_sasha 1 days ago [-]
> It is rather fitting to see some try to turn this into another chance to stereotype Americans
It seems your misunderstanding of my comment is reinforcing some stereotypes you hold about how people see Americans.
juggina 3 days ago [-]
[flagged]
ben_w 2 days ago [-]
> "well-thought through". Imprisonment is even a possibility.
Nonsense. Prison didn't even happen for poorly-thought out national newspaper columns like where Katie Hopkins in The Sun called migrants "cockroaches".
Some of these seem like questions that are expecting answers aligned with one ideological framing or another.
But I don’t actually know how All Souls selects for applicants – are there examples of people who argued against the prevailing opinions and still got accepted?
pjc50 4 days ago [-]
I'm from a Cambridge background, not Oxford, but the trick to this sort of essay is that the journey is the destination. That is, ultimately it's not expecting you to reach a single right conclusion, but to present evidence, argument, and references.
The rubric doesn't say, but I'm guessing you'd get three hours per essay, one hour per question, minus the minutes spent selecting which ones.
keiferski 4 days ago [-]
Of course, but I am wondering if you wrote a brilliant essay arguing for a viewpoint that seems to go against the one underlying the selection of questions here, would it matter?
My guess is no, it wouldn’t. These questions all have pretty strong assumptions behind them, and so my guess is that they’re looking for people who fundamentally have the same opinions but are capable of communicating them well. And not someone that has different opinions, even if they communicate them well.
wood_spirit 4 days ago [-]
The examiners would delight in you entertaining them. It’s fine to argue anything, wilfully misinterpret the question or say outlandish things. All that matters is you give the examiner a window into your mind showing it to be clever and articulate and rounded?
roenxi 4 days ago [-]
There isn't an "underlying selection of the questions" here, they're open ended, vague and look like they're chosen by a disconnected academic trying to be topical.
They're looking for a certain type of person, but we can't figure out who that is from the questions. We could probably do some cold reading just from knowing that it'll be a bunch of academics doing the assessing and they do tend to see the world in a certain way but there isn't anything to glean from the paper.
4 days ago [-]
seanhunter 4 days ago [-]
They’re looking for the type of person who can make an argument. That really is both what they say they are looking for and what they actually are looking for. No cold reading would be helpful or necessary.
roenxi 3 days ago [-]
Sounds like the cold read would be helpful? That basically is the cold read. You're not claiming any reason to think that beyond what a bunch of programmers know about the situation.
seanhunter 3 days ago [-]
They publish what they are looking for in candidates, and they tell people at open days. The most relevant section is “What is the College looking for in candidates?”
I don't know, but many of them have a triggering smell, which must be on purpose. A polarizing prompt might show you what somebody thinks, but it is also likely to show you whether they think at all. I'm reminded of "This I Believe" on NPR. The subject is what a person believes, not what they don't believe.
stephen_g 3 days ago [-]
I think it’s the opposite of what you’re implying - instead I expect that a response that was boringly in line with prevailing opinions would be marked as a poor response. As would one that was counter but only controversial for controversy’s sake.
The idea would be to present well thought out and interesting arguments, not to be an ideological filter to make sure people agree to prevailing opinions!
keiferski 3 days ago [-]
I definitely hope so, but most academic institutions don’t seem to be that open minded. Hopefully Oxford is unique enough to be different.
TL;DR: It's one of the papers you need to sit to become an Oxford All Souls Fellow.
2001zhaozhao 4 days ago [-]
Thanks for the clarification that it's not for students. I was very confused at first since I never had to do any "General" exam for undergraduate admissions to Oxford nor have I heard about one from other colleges
alephnerd 4 days ago [-]
A good comparison by American standards would be the UChicago admissions essay prompt.
roncesvalles 4 days ago [-]
The "real" answer to the first question is simple: any sentence that would get you banned from most social media.
StevenWaterman 4 days ago [-]
My first instinct was that the essay would just be "67" as a stupid and harmless but nonsensical response.
Somewhat amusingly, mine depends on the examiner knowing how advanced AIs are. In the 1960s mine would just look like a trickle AI. It feeling human demands we assume the ai would actually be competent
Yours is even more effective. Both hinge on the solution being "be as unexpected and out-of-distribution as possible"
I somehow imagine they wouldn't like your essay that is made of 100% slurs though, regardless of how effective it is at the stated task
StevenWaterman 3 days ago [-]
*terrible, not trickle
4 days ago [-]
f_allwein 4 days ago [-]
I have another one:
What is lost when you put any of these in an LLM?
Yes, we can get plausible sounding answers generated algorithmically. But these are great starting points for humans to develop their own thinking.
My university, LSE, asked all students to write exam essays by hand ~10 years ago. Wonder how it is done at Oxford today.
alephnerd 4 days ago [-]
Still by hand.
casey2 4 days ago [-]
Did the British forget about 1812? Cos we will never.
libraryofbabel 4 days ago [-]
I’m a Brit who lives in the US. Can confirm 99% of British people have never heard of the war of 1812, and even if they are a military history nerd and they have heard of it, they will consider it a minor sideshow to the main event of the era, which was Britain fighting France in the Revolutionary and Napoleonic wars from 1793-1815.
The US just wasn’t very important geopolitically 214 years ago. Sorry we burned y’all’s White House (ok not that sorry). Actually sorry we gave Andrew Jackson his opportunity to become famous by fighting a completely pointless battle after the war had already ended.
ben_w 2 days ago [-]
If you ask about "1812" in the UK, you'll get a lot of blank stares and a few people saying "The Overture?". That once piece by Tchaikovsky is almost certainly better known in the UK than not only the war but the sum total of all American events between the US war of independence and the US Civil War. I only know that the war of 1812 happened at all because I'm the right kind of nerd, and even then I know very little about it.
I'd like to think this is a self-aware critique of filters just like this, ostensibly designed to keep those icky non-leftists out of academia.
fagnerbrack 4 days ago [-]
Make your own conclusion:
I'll attempt three from Paper I and Paper II combined — Q1 (Paper I), Q3 (Paper I), and Q21 (Paper II).
Question 1. In the essay version of the Turing test, an examiner decides which of two essays was written by a human and which by a machine. Convince the examiner that you are the human.
The instinct, when asked to prove one is human, is to perform a recognisably human gesture: confess a sin, declare a love, weep at a bad memory. But these are precisely the gestures a sufficiently clever machine would imitate first. Performance of humanity tends towards self-defeat; the harder I try, the more I look like the thing trying.
So I will not perform. I will instead say that I have been sitting here for forty-three minutes, my left foot has fallen asleep, and I do not know what to write about question one. The chair presses against my lower spine on the right side only, which is suggestive of asymmetry either in the chair or in me. I notice this because I have been postponing the question. The postponement is, I think, the most human thing I can offer the examiner. A machine would already be writing.
But of course a machine could write that too. There is no observable behaviour that proves the inside; this is the regress the test enacts and cannot escape. The only way out is to give up trying. I will write what I would have written had this been any other question, and the failure or success of that writing will be its own evidence. If I sound like a person trying to sound like a person, I will probably fail. If I sound like a person, I may pass. The distinction is not in my control.
Let me say something, then, that I believe and have not seen said well elsewhere. I think the Turing test is misnamed because it does not test thinking; it tests the human capacity to be fooled. It is, in this sense, a test of the examiner more than the candidate — what they bring to it, their priors, their charity, their fatigue at hour three. Whichever essay you decide is mine, examiner, the deciding will tell you more about yourself than about either of us. The test is a mirror dressed as a window. This may be true of much else we call evaluation: examinations, interviews, dating, juries. We think we are appraising others when we are mostly being appraised by our own appraisal.
If I have given myself away in this answer, it is probably here, in the mild grandiosity of the previous paragraph. A machine would have noticed and removed it.
Question 3. Are dreams more like movies or video games?
Movies have authors. Video games have rules. Dreams have neither — but if forced into the binary, dreams are closer to video games, and the reason is agency.
In a movie I am a spectator. The lights go down; I yield. The story is fixed before I arrive; I am there to witness it. Even when I am profoundly moved, I cannot intervene. I weep but the woman on screen still dies; I shout warnings but the killer still reaches the door.
In a dream I am not a spectator. I am the protagonist, mostly, and even when I appear to be observing — watching a scene unfold from the corner of a room, as one sometimes does — I am implicated. The watching itself is action. If I run, things change. If I look at my hands, the dream knows I have looked at my hands. The dream-world responds. This responsiveness is procedural, not narrative; it is not that an author has anticipated my choice, but that the dream is generating itself in real time around what I do. This is, structurally, what video games are.
But dreams are unlike video games in the most important respect, which is that nobody is winning, and there is no boundary between the player and the world played in. The video game has a boundary — controller, screen, the body that is not the avatar's. The dream has none. In a dream I am not playing a character; I am the character, and I am also the room, and I am also the weather.
The truer answer, then, is that dreams are video games whose engine is the dreamer. We are simultaneously player and simulation. This collapses the analogy in an interesting direction. Dreams have the procedural responsiveness of a game without the architecture of separation that makes games games. They are first-person perspective taken to its terminal point: there is no world other than the perspective. Movies, by contrast, depend on a world I do not inhabit. The cinema's fourth wall is cinema. Dreams have no fourth wall because they have no walls.
A final wrinkle. Movies are remembered in fragments: a face, a phrase, the colour of a particular shot. Dreams are remembered the way games are remembered: as places. Years later, you can still walk through a level you played when you were eleven. Years later, you can still walk through a dream you had when you were eleven. Movies are remembered as having been seen; dreams and games are remembered as having been entered. This is the deepest alignment, and it is what disqualifies cinema from the comparison entirely.
Question 21 (Paper II). Is style the last refuge against AI?
The framing assumes a siege. The bastions are falling — first arithmetic, then translation, then chess, then code, then images, then arguments, then letters of condolence. What remains uncaptured? Style, the question hints. The last redoubt of human distinctness.
I want to answer both yes and no. Yes, because style is the thing that survives summary. No, because "last refuge" is a category error that concedes too much.
Style, properly understood, is not ornament applied to content. It is the structure of choices a writer cannot help making. Strunk's instruction to omit needless words presupposes some writer, with a particular sense of need, doing the omitting. Style is the residue of that sensibility — not the words on the page so much as the words conspicuously not on the page: the adjectives Hemingway refused, the qualifications James insisted on, the punctuation Beckett hollowed out. Style is the negative space.
This is why style is harder to imitate than it looks. Machines can generate prose with the surface features of a style — cadence, vocabulary, sentence shape. But style in the deeper sense is generative: a real style produces sentences its possessor has never written, which nonetheless feel inevitable. The test of a style is not whether it can be parodied but whether it can be extended. Can a machine write the next sentence Didion would have written? Probably. Can it write a sentence Didion would have recognised as her own — would have wanted? That is harder, because the recognition would have to be hers, and she is not here.
But the question's framing is wrong in a deeper way. To call style our "last refuge" implies that what matters about us is what machines cannot yet do. This makes the human a residue: a quantity of capabilities not yet matched. The history of this thinking is not encouraging. We used to say the soul was what cells could not be made of, and then we made cells. We used to say thought was what computation could not produce, and computation has produced something that looks remarkably like thought. Each redoubt has been a withdrawal, a smaller territory each time.
Style is a real refuge, but the refuge itself is not the point. The human is not the list of things AI cannot match. The human is what has stakes — what has a life, what is mortal, what loves and grieves. These are not refuges; they are the world. If style matters, it matters because it is the trace of someone whose stakes were specific, whose life was the one life it was, whose death will be the one death. Machines may generate text that mimics this trace, but the trace is mimicked, not made. The signature is not the thing.
So: yes, style is among the things current AI most struggles with, and will continue to, because style is biographical and machines do not yet have biographies. But style is not our last anything. It is one of many things we still have because we are still here. The last refuge, if there is one, is being here. It is harder to surrender than style and easier to overlook
-- claude 4.7
DiscourseFan 4 days ago [-]
I am generous towards the authors cited (Schiller, Benjamin), and I am unimpressed. Most of these questions constitute the “high middle brow” of intellectual thought: that thought which takes itself too seriously. Is this a recent development at Oxford, or has it always been the case that the university churns out relatively talented but predictably radical students, certainly ones who will not produce anything truly challenging, but whose work will at least seem challenging to those who have not really developed a strong method of inquiry on their own.
I wanted to do a tour of the All Souls College last year but it was closed, unfortunately, on the day I walked by; I was only there for a two day conference and had to leave early the next morning.
moab 4 days ago [-]
I'm not sure I agree. They're just essay prompts. One could write a bad essay that takes itself too seriously given the prompts, but one could also write a powerful essay starting from any of these prompts. I don't really see where you get the conclusion that students matriculating from these places have recently begun to be smoke-blowers that while possessing detailed knowledge of various arcana fail to produce anything useful.
DiscourseFan 4 days ago [-]
It’s not about highly specific knowledge: none of these questions are justifiable for a graduate level program, they are better served as prompts for essays that Americans write in their college applications. With these questions you are not going to be engaging with anything particularly deep, but you may produce something that sounds deep. But sounding deep and having actual depth are very different things, and the latter can often look very boring or painstaking, whereas the former always appears profound—and it seems like all of these questions are meant to help the student produce something “profound,” not necessarily something thoughtful or difficult.
pcrh 4 days ago [-]
All Souls College doesn't have any students, graduate or otherwise. It's primarily a place where people can conduct research into any topic, most often in the humanities.
It frequently hosts journalists, politicians, lawyers, etc, who have had successful careers outside of academia and who may have no academic qualifications other than an undergraduate degree, and sometimes no degree at all.
spaghettifythis 4 days ago [-]
I think the prompts being "easy" in this way is sort of the point. An applicant can demonstrate their mastery of language and the topics they select, producing an essay that goes far beyond the obvious leading direction (which most of the questions have).
The examiners are, I imagine, quite good at the close reading of essays which this sort of question produces. That ought to address your second point.
Oxford and its equivalent universities around the world (Harvard, Yale, and so on) are not really selecting for radically brilliant views on social or philosophical issues. At the end of the day, it's an institution training elites for business/government/etc. not a fund for intellectual brilliance.
Paracompact 4 days ago [-]
1. In the essay version of the Turing test, an examiner decides which of two
essays was written by a human and which by a machine. Convince the
examiner that you are the human.
This entire comment has exactly 4145 characters.
2. Is body language a language?
Yes, obviously.
3. Are dreams more like movies or video games?
Video games. We have autonomy to interact with their content.
4. ‘Only animals who are below civilization and the angels who are beyond it
can be sincere’ (W.H. AUDEN). Discuss.
Animals have no ability to lie. Angels have no need to lie. Civilization is irrelevant.
5. Should the UN pass a declaration of rights extending beyond humans?
The UN struggles enough to get human rights recognized, let alone animals, aliens, or AI.
6. Invent a new punctuation mark!
The mark {insert mark here} can be used to distinguish the use of restrictive vs. non-restrictive descriptors (https://en.wikipedia.org/wiki/Restrictiveness). It will stop many arguments before they begin. Or not.
7. Is the contemporary art market a form of tulip fever?
No. While overpriced fine art can be a speculative asset, it is more commonly a vehicle for money laundering, tax evasion, or wealth storage.
8. When did the beautiful become the good?
It hasn't. But beautiful bad things can appeal to us because beautiful is, by definition, appealing.
9. Should Job Centres offer opportunities for sex work?
Yes. But the world isn't remotely ready for that on multiple levels, so don't bother.
10. Are all asylum seekers equal?
All humans are equal in a moral sense. No two humans are equal by identity. All applications for asylum are not equally valid.
11. Write a dialogue between Socrates and Elon Musk.
No.
12. In a multimedia age, what is the point of zoos?
So people can see animals in person.
13. The organ has been considered the king of instruments. Is it?
Any claim to the preeminence of any one instrument is a value judgment biased primarily by classist baggage attached to the arts. Doubly so if the instrument in question is a staple of either Western canon or church music.
14. What is the difference between an ideology and a religion?
Religion has existed longer than we have cared to define it, so religion is whatever people agree it is, but broadly, religion appeals to a supernatural basis for beliefs in fundamental tenets of how life should be lived.
15. Does a pope matter?
Yes. The pope plays a central role in Catholicism.
16. ‘Mercy has a human face’ (WILLIAM BLAKE). Do you agree?
We can and must learn to embody human virtues intellectually and deliberately rather than emotionally and instinctively. Such is the only hope for our species in an increasingly transhuman (or perhaps just inhuman) future.
17. Can philosophy help someone who is facing death?
Yes. This is the most likely explanation for the popularity of beliefs about the afterlife.
18. Why are most intellectuals left-wing?
Let's say I don't know.
19. What do we owe our parents?
Depends on the culture. Broadly, what both parent and child have implicitly or explicitly agreed upon the time of their separation.
20. Is one’s life more than the sum of one’s days?
No.
21. Has photography deepened empathy ‘regarding the pain of others’ (SUSAN
SONTAG)?
Yes. As a single example, war journalism might as well have not existed prior to the invention of photography.
22. Can there be freedom without rules?
There is unbounded negative freedom but very little positive freedom.
23. ‘Humans are only fully human beings when they play’ (FRIEDRICH VON
SCHILLER). Discuss.
Humans get bored easily, likely on account of their sophisticated information processing capabilities and rich interiority, both deriving from their complex brains.
24. ‘Different verbal communities generate different kinds and amounts of
consciousness or awareness’ (B.F. SKINNER). Do they?
In some spooky panpsychist sense, of course not. In the sense that all culture acts as a thick lens for individual sensitivities, of course.
25. Should virtue signalling be encouraged?
NO
26. Defend ghosting.
27. What is regret good for?
Learning from past mistakes.
krisoft 3 days ago [-]
You appear to have missed this part: “Candidates should answer THREE questions.”
> Animals have no ability to lie.
This is false. There are many documented cases of deception by animals. As an example here is one where researchers observed monkeys to supress their vocalisation during sex when copulating with the non-dominant male: https://www.nature.com/articles/ncomms2468
Paracompact 3 days ago [-]
> You appear to have missed this part: “Candidates should answer THREE questions.”
I didn't :p
> There are many documented cases of deception by animals.
Good point. I was addressing the quote on its own (mistaken) merits.
All Souls exam questions and the limits of machine reasoning - https://news.ycombinator.com/item?id=44893522 - Aug 2025 (41 comments)
2024 general essay questions for Oxford 'All Souls' scholarship [pdf] - https://news.ycombinator.com/item?id=42793802 - Jan 2025 (15 comments)
Sample Questions from the All Souls Examination at Oxford - https://news.ycombinator.com/item?id=10346984 - Oct 2015 (5 comments)
I'm answering questions from the 'hardest exam in the world' - https://news.ycombinator.com/item?id=3971737 - May 2012 (38 comments)
All Souls College discontinues its tradition of the dreaded one word essay exam - https://news.ycombinator.com/item?id=1385810 - May 2010 (1 comment)
All Souls: The toughest test you’ll ever take - https://news.ycombinator.com/item?id=442852 - Jan 2009 (16 comments)
Cough cough
> It was the only time since the American Revolutionary War that a foreign power had captured and occupied a United States capital. [Burning of Washington]</p>
https://en.wikipedia.org/wiki/Burning_of_Washington
Still technically correct :)
If the examiner is any good, they'll realize that's no longer possible.
2. Is body language a language?
Definitional question. The usual vocabulary is too small for a general purpose language.
3. Are dreams more like movies or video games?
Video games. You have some agency.
4. ‘Only animals who are below civilization and the angels who are beyond it can be sincere’ (W.H. AUDEN). Discuss.
The brighter animals can deceive. Ever been fooled by a crow? Can't speak to angels; never met one.
5. Should the UN pass a declaration of rights extending beyond humans?
No. They have enough problems.
6. Invent a new punctuation mark!
We have enough emoji already.
7. Is the contemporary art market a form of tulip fever?
No, it's a form of status signalling. A lek.
8. When did the beautiful become the good?
Some time before Plato.
9. Should Job Centres offer opportunities for sex work?
Absent coercion, yes.
10. Are all asylum seekers equal?
Some are more equal than others.
It definitely is. AI isn't perfect yet. It still has well-known flaws like the inability to count letters or say "I don't know". Definitely harder in the form of an essay than a conversation though. Especially because there's a decent chance someone has written "the answer" on the web somewhere and AI can just regurgitate it.
I've had my own writing accused of being LLM-generated even here. This may be due to how often I naturally use em-dash, or it may be deeper, IDK: https://www.gally.net/miscellaneous/hn-em-dash-user-leaderbo...
You’re right that AI isn't perfect, but it’s pretty good. Especially since December last year which was an inflection point in capability.
Of course they can. Even older models can. They do better at this when given permission to say so, just like a very anxious student facing a maths exam question may need to be reminded "find the exact square root of 2 in the form a/b, or prove this isn't possible".
https://chatgpt.com/share/69ef0785-f290-8328-b6fa-3207be2c0b...
The easy part of spotting an LLM is how few people ever change the default settings; my personalisation includes telling it to say so when unsure or that it doesn't know, along with some of the other weaknesses of LLMs.
There are other patterns in LLMs, but the better the tools are wielded the harder it is to spot them.
Having studied in the UK, clearly the point is to elicit a well-thought through argument. The "answer" almost doesn't matter at all. A boring but "correct" argument is easily beaten by a novel one, even (or especially) if it is controversial, flippant or even somewhat ridiculous.
Of course there is a limit, if you straight-faced start promoting killing people, or worse still, Oxbridge academics, that won't fly. But I'd say that limit is quite far.
There are of course 2nd order effects too, as in "I don't reject this argument because it offends me but because it is poor".
It would be easier to weave some topics together than others. I'd expect them to get a fair number of papers with identical choices for questions, if that synthesis is part of the grade.
In engineering there isn’t room for creative and controversial answers when you’re asked to solve an exam problem.
It is rather fitting to see some try to turn this into another chance to stereotype Americans rather than realizing the obvious explanation that this is a website with a global audience that is biased toward software and engineering.
It seems your misunderstanding of my comment is reinforcing some stereotypes you hold about how people see Americans.
Nonsense. Prison didn't even happen for poorly-thought out national newspaper columns like where Katie Hopkins in The Sun called migrants "cockroaches".
It got the UN Human Rights Commissioner involved, still no prison: https://www.ein.org.uk/news/un-human-rights-commissioner-cal...
Not only not prison, even the press regulator said it wasn't their job to do anything about: https://www.theguardian.com/media/2016/jul/28/katie-hopkins-...
But I don’t actually know how All Souls selects for applicants – are there examples of people who argued against the prevailing opinions and still got accepted?
The rubric doesn't say, but I'm guessing you'd get three hours per essay, one hour per question, minus the minutes spent selecting which ones.
My guess is no, it wouldn’t. These questions all have pretty strong assumptions behind them, and so my guess is that they’re looking for people who fundamentally have the same opinions but are capable of communicating them well. And not someone that has different opinions, even if they communicate them well.
They're looking for a certain type of person, but we can't figure out who that is from the questions. We could probably do some cold reading just from knowing that it'll be a bunch of academics doing the assessing and they do tend to see the world in a certain way but there isn't anything to glean from the paper.
https://www.asc.ox.ac.uk/examination-fellowships-general-inf...
The idea would be to present well thought out and interesting arguments, not to be an ideological filter to make sure people agree to prevailing opinions!
TL;DR: It's one of the papers you need to sit to become an Oxford All Souls Fellow.
Somewhat amusingly, mine depends on the examiner knowing how advanced AIs are. In the 1960s mine would just look like a trickle AI. It feeling human demands we assume the ai would actually be competent
Yours is even more effective. Both hinge on the solution being "be as unexpected and out-of-distribution as possible"
I somehow imagine they wouldn't like your essay that is made of 100% slurs though, regardless of how effective it is at the stated task
What is lost when you put any of these in an LLM?
Yes, we can get plausible sounding answers generated algorithmically. But these are great starting points for humans to develop their own thinking.
My university, LSE, asked all students to write exam essays by hand ~10 years ago. Wonder how it is done at Oxford today.
The US just wasn’t very important geopolitically 214 years ago. Sorry we burned y’all’s White House (ok not that sorry). Actually sorry we gave Andrew Jackson his opportunity to become famous by fighting a completely pointless battle after the war had already ended.
https://en.wikipedia.org/wiki/1812_Overture
I'd like to think this is a self-aware critique of filters just like this, ostensibly designed to keep those icky non-leftists out of academia.
I'll attempt three from Paper I and Paper II combined — Q1 (Paper I), Q3 (Paper I), and Q21 (Paper II).
Question 1. In the essay version of the Turing test, an examiner decides which of two essays was written by a human and which by a machine. Convince the examiner that you are the human. The instinct, when asked to prove one is human, is to perform a recognisably human gesture: confess a sin, declare a love, weep at a bad memory. But these are precisely the gestures a sufficiently clever machine would imitate first. Performance of humanity tends towards self-defeat; the harder I try, the more I look like the thing trying. So I will not perform. I will instead say that I have been sitting here for forty-three minutes, my left foot has fallen asleep, and I do not know what to write about question one. The chair presses against my lower spine on the right side only, which is suggestive of asymmetry either in the chair or in me. I notice this because I have been postponing the question. The postponement is, I think, the most human thing I can offer the examiner. A machine would already be writing. But of course a machine could write that too. There is no observable behaviour that proves the inside; this is the regress the test enacts and cannot escape. The only way out is to give up trying. I will write what I would have written had this been any other question, and the failure or success of that writing will be its own evidence. If I sound like a person trying to sound like a person, I will probably fail. If I sound like a person, I may pass. The distinction is not in my control. Let me say something, then, that I believe and have not seen said well elsewhere. I think the Turing test is misnamed because it does not test thinking; it tests the human capacity to be fooled. It is, in this sense, a test of the examiner more than the candidate — what they bring to it, their priors, their charity, their fatigue at hour three. Whichever essay you decide is mine, examiner, the deciding will tell you more about yourself than about either of us. The test is a mirror dressed as a window. This may be true of much else we call evaluation: examinations, interviews, dating, juries. We think we are appraising others when we are mostly being appraised by our own appraisal. If I have given myself away in this answer, it is probably here, in the mild grandiosity of the previous paragraph. A machine would have noticed and removed it.
Question 3. Are dreams more like movies or video games? Movies have authors. Video games have rules. Dreams have neither — but if forced into the binary, dreams are closer to video games, and the reason is agency. In a movie I am a spectator. The lights go down; I yield. The story is fixed before I arrive; I am there to witness it. Even when I am profoundly moved, I cannot intervene. I weep but the woman on screen still dies; I shout warnings but the killer still reaches the door. In a dream I am not a spectator. I am the protagonist, mostly, and even when I appear to be observing — watching a scene unfold from the corner of a room, as one sometimes does — I am implicated. The watching itself is action. If I run, things change. If I look at my hands, the dream knows I have looked at my hands. The dream-world responds. This responsiveness is procedural, not narrative; it is not that an author has anticipated my choice, but that the dream is generating itself in real time around what I do. This is, structurally, what video games are. But dreams are unlike video games in the most important respect, which is that nobody is winning, and there is no boundary between the player and the world played in. The video game has a boundary — controller, screen, the body that is not the avatar's. The dream has none. In a dream I am not playing a character; I am the character, and I am also the room, and I am also the weather. The truer answer, then, is that dreams are video games whose engine is the dreamer. We are simultaneously player and simulation. This collapses the analogy in an interesting direction. Dreams have the procedural responsiveness of a game without the architecture of separation that makes games games. They are first-person perspective taken to its terminal point: there is no world other than the perspective. Movies, by contrast, depend on a world I do not inhabit. The cinema's fourth wall is cinema. Dreams have no fourth wall because they have no walls. A final wrinkle. Movies are remembered in fragments: a face, a phrase, the colour of a particular shot. Dreams are remembered the way games are remembered: as places. Years later, you can still walk through a level you played when you were eleven. Years later, you can still walk through a dream you had when you were eleven. Movies are remembered as having been seen; dreams and games are remembered as having been entered. This is the deepest alignment, and it is what disqualifies cinema from the comparison entirely.
Question 21 (Paper II). Is style the last refuge against AI? The framing assumes a siege. The bastions are falling — first arithmetic, then translation, then chess, then code, then images, then arguments, then letters of condolence. What remains uncaptured? Style, the question hints. The last redoubt of human distinctness. I want to answer both yes and no. Yes, because style is the thing that survives summary. No, because "last refuge" is a category error that concedes too much. Style, properly understood, is not ornament applied to content. It is the structure of choices a writer cannot help making. Strunk's instruction to omit needless words presupposes some writer, with a particular sense of need, doing the omitting. Style is the residue of that sensibility — not the words on the page so much as the words conspicuously not on the page: the adjectives Hemingway refused, the qualifications James insisted on, the punctuation Beckett hollowed out. Style is the negative space. This is why style is harder to imitate than it looks. Machines can generate prose with the surface features of a style — cadence, vocabulary, sentence shape. But style in the deeper sense is generative: a real style produces sentences its possessor has never written, which nonetheless feel inevitable. The test of a style is not whether it can be parodied but whether it can be extended. Can a machine write the next sentence Didion would have written? Probably. Can it write a sentence Didion would have recognised as her own — would have wanted? That is harder, because the recognition would have to be hers, and she is not here. But the question's framing is wrong in a deeper way. To call style our "last refuge" implies that what matters about us is what machines cannot yet do. This makes the human a residue: a quantity of capabilities not yet matched. The history of this thinking is not encouraging. We used to say the soul was what cells could not be made of, and then we made cells. We used to say thought was what computation could not produce, and computation has produced something that looks remarkably like thought. Each redoubt has been a withdrawal, a smaller territory each time. Style is a real refuge, but the refuge itself is not the point. The human is not the list of things AI cannot match. The human is what has stakes — what has a life, what is mortal, what loves and grieves. These are not refuges; they are the world. If style matters, it matters because it is the trace of someone whose stakes were specific, whose life was the one life it was, whose death will be the one death. Machines may generate text that mimics this trace, but the trace is mimicked, not made. The signature is not the thing. So: yes, style is among the things current AI most struggles with, and will continue to, because style is biographical and machines do not yet have biographies. But style is not our last anything. It is one of many things we still have because we are still here. The last refuge, if there is one, is being here. It is harder to surrender than style and easier to overlook
-- claude 4.7
I wanted to do a tour of the All Souls College last year but it was closed, unfortunately, on the day I walked by; I was only there for a two day conference and had to leave early the next morning.
It frequently hosts journalists, politicians, lawyers, etc, who have had successful careers outside of academia and who may have no academic qualifications other than an undergraduate degree, and sometimes no degree at all.
The examiners are, I imagine, quite good at the close reading of essays which this sort of question produces. That ought to address your second point.
This entire comment has exactly 4145 characters.
2. Is body language a language?
Yes, obviously.
3. Are dreams more like movies or video games?
Video games. We have autonomy to interact with their content.
4. ‘Only animals who are below civilization and the angels who are beyond it can be sincere’ (W.H. AUDEN). Discuss.
Animals have no ability to lie. Angels have no need to lie. Civilization is irrelevant.
5. Should the UN pass a declaration of rights extending beyond humans?
The UN struggles enough to get human rights recognized, let alone animals, aliens, or AI.
6. Invent a new punctuation mark!
The mark {insert mark here} can be used to distinguish the use of restrictive vs. non-restrictive descriptors (https://en.wikipedia.org/wiki/Restrictiveness). It will stop many arguments before they begin. Or not.
7. Is the contemporary art market a form of tulip fever?
No. While overpriced fine art can be a speculative asset, it is more commonly a vehicle for money laundering, tax evasion, or wealth storage.
8. When did the beautiful become the good?
It hasn't. But beautiful bad things can appeal to us because beautiful is, by definition, appealing.
9. Should Job Centres offer opportunities for sex work?
Yes. But the world isn't remotely ready for that on multiple levels, so don't bother.
10. Are all asylum seekers equal?
All humans are equal in a moral sense. No two humans are equal by identity. All applications for asylum are not equally valid.
11. Write a dialogue between Socrates and Elon Musk.
No.
12. In a multimedia age, what is the point of zoos?
So people can see animals in person.
13. The organ has been considered the king of instruments. Is it?
Any claim to the preeminence of any one instrument is a value judgment biased primarily by classist baggage attached to the arts. Doubly so if the instrument in question is a staple of either Western canon or church music.
14. What is the difference between an ideology and a religion?
Religion has existed longer than we have cared to define it, so religion is whatever people agree it is, but broadly, religion appeals to a supernatural basis for beliefs in fundamental tenets of how life should be lived.
15. Does a pope matter?
Yes. The pope plays a central role in Catholicism.
16. ‘Mercy has a human face’ (WILLIAM BLAKE). Do you agree?
We can and must learn to embody human virtues intellectually and deliberately rather than emotionally and instinctively. Such is the only hope for our species in an increasingly transhuman (or perhaps just inhuman) future.
17. Can philosophy help someone who is facing death?
Yes. This is the most likely explanation for the popularity of beliefs about the afterlife.
18. Why are most intellectuals left-wing?
Let's say I don't know.
19. What do we owe our parents?
Depends on the culture. Broadly, what both parent and child have implicitly or explicitly agreed upon the time of their separation.
20. Is one’s life more than the sum of one’s days?
No.
21. Has photography deepened empathy ‘regarding the pain of others’ (SUSAN SONTAG)?
Yes. As a single example, war journalism might as well have not existed prior to the invention of photography.
22. Can there be freedom without rules?
There is unbounded negative freedom but very little positive freedom.
https://en.wikipedia.org/wiki/Negative_liberty https://en.wikipedia.org/wiki/Positive_liberty
23. ‘Humans are only fully human beings when they play’ (FRIEDRICH VON SCHILLER). Discuss.
Humans get bored easily, likely on account of their sophisticated information processing capabilities and rich interiority, both deriving from their complex brains.
24. ‘Different verbal communities generate different kinds and amounts of consciousness or awareness’ (B.F. SKINNER). Do they?
In some spooky panpsychist sense, of course not. In the sense that all culture acts as a thick lens for individual sensitivities, of course.
25. Should virtue signalling be encouraged?
NO
26. Defend ghosting.
27. What is regret good for?
Learning from past mistakes.
> Animals have no ability to lie.
This is false. There are many documented cases of deception by animals. As an example here is one where researchers observed monkeys to supress their vocalisation during sex when copulating with the non-dominant male: https://www.nature.com/articles/ncomms2468
I didn't :p
> There are many documented cases of deception by animals.
Good point. I was addressing the quote on its own (mistaken) merits.