News for hackers. Stuff that matters.
Re:University Suspends Students for AI Tool It Gave Them $10... by VWWHFSfQ on Tuesday May 21, 2024 @11:24AM (#40429648)
Am I understanding that they trained their model on the real course materials, including specific assignments, exercises, and even the actual tests, without the institution's permission?

I don't see a problem with rescinding the prize and punishing the kids for dishonesty.

It's not a free-for-all no matter how much OpenAI wants it to be.

Re:University Suspends Students for AI Tool It Gave Them $10... by edwinjm on Tuesday May 21, 2024 @11:32AM (#40429753)
Student could upload their own material, which I think is fine as long as you use it personally. The intention was to connect to the school system with all course materials, but that never took place.
Re:University Suspends Students for AI Tool It Gave Them $10... by burkaman on Tuesday May 21, 2024 @11:40AM (#40429866)
No, I don't think you're understanding correctly. The students first pitched an idea explicitly based on users uploading "specific assignments, exercises, and even the actual tests" to their tool, and the institution approved this idea and gave them $10,000 to build it.

The change that prompted the suspension seems to be about the technical details of how users upload those files - using the Canvas API instead of manually downloading and uploading. Either way, there is no dishonesty alleged by anyone, even the school Honor Council.

Also, the tool did not use OpenAI or any other third-party AI service, so whatever opinions you have about OpenAI are not relevant.

Re:University Suspends Students for AI Tool It Gave Them $10... by dylan604 on Tuesday May 21, 2024 @12:09PM (#40430319)
> so whatever opinions you have about OpenAI are not relevant.

speaking of not relevant, neither is your comment. in fact, I would disagree and say that it is relevant. as the most well known company doing "AI", they will be looked at by anyone else looking to follow. the way they behave will influence those that follow. the lack of push back against they way they behave will also influence those that follow. so if the precedent has been laid by OpenAI that you can source whatever content you wish without asking for permission is not punished, it is easy to infer that it is okay to do as they have done.

Re:University Suspends Students for AI Tool It Gave Them $10... by loeg on Tuesday May 21, 2024 @11:29AM (#40429708)
The article quotes them as planning to train their model on course materials automatically. But it is not clear if that actually happened. Individual students were always free to upload course materials.

I'm not sure what is dishonest about that.

Edit: I'm not sure if the article has been updated from when I first skimmed it, or I just missed it, but this seems directly addressed now:

> The students were also accused of “disseminating course material” by allowing students to use their own, individualized Canvas API tokens to connect Eightball directly so they did not have to upload PDFs to the tool themselves. “The upgrade did not change what students could upload to Eightball or what learning materials Eightball could produce upon request,” the suspended students’ lawyers note in the lawsuit.

Re:University Suspends Students for AI Tool It Gave Them $10... by 8338550bff96 on Tuesday May 21, 2024 @11:31AM (#40429735)
It is not really clear to me if it had privileged access to answers or if it saw the same material a student would see reading through the syllabus + assigned readings.
Re:University Suspends Students for AI Tool It Gave Them $10... by doix on Tuesday May 21, 2024 @11:39AM (#40429848)
It's the latter. It sounds like they got suspended because they told their users (i.e students) to give them their canvas API tokens so that they could fetch course materials on their behalf.

Previously, students had to download the PDFs and manually upload them. If students gave eightball their API tokens, eightball could fetch their course materials on their behalf.

Perhaps I'm missing something, but that's how it reads to me.

Re:University Suspends Students for AI Tool It Gave Them $10... by dylan604 on Tuesday May 21, 2024 @12:12PM (#40430353)
> give them their canvas API tokens

in pretty much every single system's terms, providing someone else your tokens or other forms of sharing of credentials is expressly forbidden. this is why I am flabbergasted things like Plaid work. I will never provide a 3rd party my credentials to anything but damn sure not something like a bank or credit card.

Re:University Suspends Students for AI Tool It Gave Them $10... by javagram on Tuesday May 21, 2024 @12:44PM (#40430773)
There are many systems that allow generating a API token to be used with other apps. The article clearly indicates that this school learning system, “Canvas”, had such a functionality until it was removed during this saga, apparently by hiding it with CSS or something since there was an “inspect element” workaround to still access it.

Plaid uses OAuth for many of their connections and doesn’t violate ToS in that case. There usually are TOS related to not sharing your password and disclaiming liability if you do.

Re:University Suspends Students for AI Tool It Gave Them $10... by loeg on Tuesday May 21, 2024 @02:58PM (#40432403)
3rd party access is the entire point of API tokens. Use cases like this are why Canvas has them.
Re:University Suspends Students for AI Tool It Gave Them $10... by semi-extrinsic on Tuesday May 21, 2024 @11:52AM (#40430062)
From TFA: <<university’s IT department was angry that the company allowed students to connect their own Canvas API tokens to the app>>

Just a wild guess, but maybe the IT department gets charged an additional fee from Canvas based on the usage of API tokens?

Conflicts like these are always about money, one way or another.

Re:University Suspends Students for AI Tool It Gave Them $10... by loeg on Tuesday May 21, 2024 @12:04PM (#40430243)
Conflicts in bureaucracies like universities are often petty power struggles rather than anything financial. Especially between IT departments and anyone else.
Re:University Suspends Students for AI Tool It Gave Them $10... by loeg on Tuesday May 21, 2024 @11:40AM (#40429869)
I think it is pretty clear they did not have privileged access. Either because they never connected to the courseware service, or because they did so with students' credentials.

Edit: I'm not sure if I just missed it earlier or the article has been updated, but this issue is directly addressed now:

> The students were also accused of “disseminating course material” by allowing students to use their own, individualized Canvas API tokens to connect Eightball directly so they did not have to upload PDFs to the tool themselves. “The upgrade did not change what students could upload to Eightball or what learning materials Eightball could produce upon request,” the suspended students’ lawyers note in the lawsuit.

Re:University Suspends Students for AI Tool It Gave Them $10... by wccrawford on Tuesday May 21, 2024 @11:29AM (#40429694)
Yeah, it sounds like they were upfront about connecting it to the system in the original competition, but never actually received permission to do so after that. They just assumed they had permission.

The "it can be used to cheat" thing is just dumb and is totally on the university for selecting them in the first place if that was a problem.

Re:University Suspends Students for AI Tool It Gave Them $10... by nottorp on Tuesday May 21, 2024 @11:41AM (#40429889)
> They just assumed they had permission.

Being given money by the system's owner to do it does sound a bit like permission to me...

Re:University Suspends Students for AI Tool It Gave Them $10... by exe34 on Tuesday May 21, 2024 @11:46AM (#40429962)
i imagine that the people giving the money out and the people who then claim not to have given permission might be different persons. still, a lawsuit on that premise will probably result in a nice settlement.
Re:University Suspends Students for AI Tool It Gave Them $10... by nottorp on Tuesday May 21, 2024 @11:57AM (#40430145)
We could extrapolate that the diplomas given out by said university have no value because some other department could decide after the fact to cancel them :)
Re:University Suspends Students for AI Tool It Gave Them $10... by exe34 on Tuesday May 21, 2024 @12:32PM (#40430623)
the degrees are conferred by the highest authority at the university, the board of regents/trustees. the only reason they would rescind a degree would be evidence of academic fraud/plagiarism in the course of earning the credits for the degree.
Re:University Suspends Students for AI Tool It Gave Them $10... by nottorp on Tuesday May 21, 2024 @01:25PM (#40431281)
That's the theory, yes. But the institution has already shown it can arbitrarily change its mind...
Re:University Suspends Students for AI Tool It Gave Them $10... by abtinf on Tuesday May 21, 2024 @11:29AM (#40429699)
To which “dishonesty” do you refer?
Re:University Suspends Students for AI Tool It Gave Them $10... by 8338550bff96 on Tuesday May 21, 2024 @11:33AM (#40429758)
The dishonesty of building exactly what you said you would build and being forthright about how you accomplished it such that a technicality of how you accessed the data gets you suspended.