Brad Wendel on Legal Ethics Stuff

It's not just the hallucination problem, but there's a longer-term or more dynamic problem, which is that over-reliance on LLMs may lead to an erosion of lawyers' ability to do the work themselves, which in turn will mean they're not as good at working with the LLMs and monitoring their output. I was talking recently with a lawyer who has a lot of experience working with AI in practice and he gave the example of drafting a conflicts waiver. A commercial-grade AI system can do a not-bad job preparing a first cut through a waiver, but an experienced lawyer still needs to be able to review it and tune it up. A lawyer with preexisting, old school, not-AI-derived experience can do that. A lawyer who doesn't have that foundation will not be able to work as effectively with the technology. That puts too much trust in the technology, at least at this stage in its development.