If a decision closes off part of your life, you need somewhere to take your objection. Someone must be able to hear that the information was wrong, that your circumstances were misunderstood, or that a rule which looked reasonable in the abstract has produced something indefensible in practice.
That becomes harder when the explanation offered is that a system has made the decision. A system cannot accept responsibility. The people using it can, although whether they are required to do so is another matter.
Burges Salmon’s reported discussion of a Joint Committee on Human Rights report raises the question of AI-specific legislation in the UK. The supplied reporting does not establish the committee’s detailed recommendations, so it would be premature to endorse a particular legislative proposal. There is, however, a practical ethical test worth bringing to that debate: can a person meaningfully challenge a decision made about them?
An appeal procedure may exist on paper while offering very little. Imagine being allowed to submit a complaint, only for the complaint to be assessed through the same assumptions that produced the original refusal. Giving someone another form to complete does not necessarily give them a hearing.
There is a reasonable objection to writing fresh laws for each developing technology. Existing protections may already cover some harms, and a badly drawn AI law could become obsolete or encourage organisations to satisfy a checklist while avoiding the substance. Calling legislation “AI-specific” tells us little about whether it will help anyone.
Yet the alternative cannot be to leave the individual doing all the work. If an organisation chooses a tool whose reasoning it cannot adequately explain or examine, that limitation should remain the organisation’s problem. It should not become the affected person’s burden to unravel.
For an evolving philosophy concerned with how we live together, this reaches beyond technology. We regularly build arrangements that make responsibility difficult to locate, then treat that difficulty as unavoidable.
Any legislation should be judged partly by what happens at the point of challenge: whether somebody has the authority, the knowledge and the time to reconsider the decision, and whether they can actually change it. Otherwise, we risk giving people a right to object without requiring anyone to listen.