India's Supreme Court has taken a firm stance against the use of fake AI-generated orders by a junior judge, threatening legal consequences and emphasizing the importance of integrity in the adjudicatory process. The incident, which has sparked headlines, highlights a growing concern about the impact of AI on court proceedings. In a recent case, a junior civil judge in the southern state of Andhra Pradesh was found to have used AI-generated judgements in a property dispute, despite the defendants' objections. The judge dismissed their objection, citing four past legal judgements that were later revealed to be fake. This incident is not an isolated case; it is part of a broader trend where AI has disrupted court proceedings in India and globally. The use of AI in the workplace has simplified tasks, but generative AI systems are known for their ability to 'hallucinate' and present false information as fact. The defendants challenged the order in the state's high court, pointing out the fake citations. The high court acknowledged the error but accepted the judge's 'good faith' intention. However, the Supreme Court has taken a stern approach, viewing the use of AI in judgements as 'misconduct' rather than an error in decision-making. The court has stayed the lower court's order and is examining the case in detail, seeking reports from the junior judge and legal authorities. This incident underscores the need for human oversight and the importance of maintaining institutional safeguards in the use of AI in the courtroom. India's legal institutions are joining global efforts to regulate and monitor AI in the legal system. The Supreme Court has published a white paper on AI in India's judiciary, outlining best practices and guidelines for its use. The court emphasizes the need for human oversight and the importance of keeping institutional safeguards in place to ensure the integrity of the legal process.
