Privacy seems like it would be a major issue. As a litigant, I would not want the opposing side piping my case information to a third party and having this information used to train the AI for future cases.

AI could be very useful for helping pro-so litigants prepare documents. I imagine with this use case as well as the oral argument use case, judges are also worried about low quality output wasting the court's time.