News for hackers. Stuff that matters.
Re:Big Data Is Dead by guardiangod on Tuesday February 07, 2023 @12:25PM (#34695719)
There is literally a post on front page on ChatGPT, and Microsoft and Google are preparing to duke it out starting in the _next 2 days_ over big-data generated 'chat' result.

Big data was never going to be useful to even medium size enterprises, unless anyone can get public access to PBs of data, but that doesn't mean big data is dead. ChatGPT is literally changing how school will test their students, for a start.

Maybe what the author is trying to say is 'small-scale big data is dead, but big data chugs on.'

Re:Big Data Is Dead by miguelazo on Tuesday February 07, 2023 @12:31PM (#34695833)
>ChatGPT is literally changing how school will test their students, for a start.

Sure, instead of schools checking for plagiarism from other students' papers using turnitin.com, they'll check for plagiarism using ChatGPT tools that scan for known output from their industrial-scale amalgamation of plagiarized materials. Big whoop.

Re:Big Data Is Dead by humanizersequel on Tuesday February 07, 2023 @12:40PM (#34695997)
All math homework through the high school level is now as simple as figuring out how to describe it to ChatGPT (or maybe ChatGPT 2.0 for particularly tricky examples). Paper-writing is now a matter of figuring out how to rephrase LLM output in your own words to get around any watermarking or pattern detection.
Re:Big Data Is Dead by eganist on Tuesday February 07, 2023 @12:42PM (#34696033)
Wolfram alpha has been around for math cheats (and people like me who just needed a more visual representation to learn) for a while now. Including proof of work.
Re:Big Data Is Dead by LarryMullins on Tuesday February 07, 2023 @02:37PM (#34698126)
Years before wolfram alpha, we had TI-89s with computer algebra systems for cheating your way through highschool math.
Re:Big Data Is Dead by eganist on Tuesday February 07, 2023 @03:01PM (#34698570)
Oh yeah, it's why most of my classes restricted us to TI-83s. The TI-89 was restricted in schools to basically calc and above, and the TI-92 was just banned. Lol
Re:Big Data Is Dead by LarryMullins on Tuesday February 07, 2023 @04:05PM (#34699635)
In my school TI-89s were unrestricted, but I think that was mostly because teachers were only trained with 83s and assumed the 89 had equivalent capabilities. The SAT permitting the 89 probably had something to do with it too, since the 92 was banned (because qwerty as I understand it.)
Re:Big Data Is Dead by frgtpsswrdlame on Tuesday February 07, 2023 @12:43PM (#34696052)
You can't figure out how to describe a math problem correctly to ChatGPT without already knowing the solution.
Re:Big Data Is Dead by dhdgrygev on Tuesday February 07, 2023 @10:42PM (#34703834)
Maybe this should give you a hint that said work is completely pointless and merely exists to waste student's time.
Re:Big Data Is Dead by bhhaskin on Tuesday February 07, 2023 @12:41PM (#34696007)
Or just require students to use software that keeps track of version history or require spyware installed.
Re:Big Data Is Dead by SoftTalker on Tuesday February 07, 2023 @12:55PM (#34696246)
Go back to longhand. Even if they are plagiarizing, they might learn something from the exercise of rewriting by hand.
Re:Big Data Is Dead by suddenclarity on Tuesday February 07, 2023 @03:41PM (#34699239)
That's solved by putting a pen on your 3d printer.
Re:Big Data Is Dead by genewitch on Tuesday February 07, 2023 @08:52PM (#34703064)
Or a second-hand Cricut...
Re:Big Data Is Dead by Loughla on Tuesday February 07, 2023 @12:42PM (#34696035)
I mean, that's certainly part of it. But you're also seeing very fast restructuring of individual courses (because programs overall will definitely take years to restructure because higher education moves so damned slow) to account for these tools.

In the small institution I am currently working with, the English courses, in one week, integrated chatgpt as a tool for students to work with. It's part of the collaborative idea building and development process now for every student enrolled in creative writing and writing analysis classes, and that happened in one week. I cannot stress enough how unbelievably fast that is for higher ed. That's faster than light speed.

And we're not even that well resourced. I have to imagine there are other examples where it's more than just running through a bot to scan for known outputs.

Re:Big Data Is Dead by stcroixx on Tuesday February 07, 2023 @01:35PM (#34696978)
Sounds like they simply panicked and threw something together with little thought or preparation, what, right in the middle of an actual course? And they want to charge kids for this kind of 'expert instruction'? I'd be pissed as a student.
Re:Big Data Is Dead by Loughla on Tuesday February 07, 2023 @02:18PM (#34697746)
What a weird assumption you made there. In what way does what I wrote sound panicked? Because it was a week? Yes it was fast, but it was a massive effort of the entire english faculty.

It's integrated into existing assignments, modifying processes that are super well established already. It was like integrating a new person into the class. Also, it was before semester, so the students literally saw nothing weird; that was another strange assumption for you to make.

Just a tip, and don't read tone in this statement, but don't assume things. 9/10 times you're going to be incorrect. It's much better to ask questions, instead of making statements with question marks at the end of them.

Re:Big Data Is Dead by pcthrowaway on Tuesday February 07, 2023 @02:58PM (#34698530)
> don't assume things. 9/10 times you're going to be incorrect

Isn't that... an assumption?

Re:Big Data Is Dead by Loughla on Tuesday February 07, 2023 @04:06PM (#34699644)
No, it's an assertion. It's like the bastard cousin of an assumption, in that it's only incorrect 8.67 times out of 10.
Re:Big Data Is Dead by bigbluedots on Tuesday February 07, 2023 @09:02PM (#34703142)
It's an assertion of an assumption, unless you've gone and measured.
Re:Big Data Is Dead by stcroixx on Tuesday February 07, 2023 @04:22PM (#34699873)
I simply don’t buy that they had anywhere close to enough time to integrate this into an existing curriculum in a way that would meet the high standards paying students should have for a university education. I don’t have to ask how an English department became experts in using a just released AI in the classroom in a week because I don’t think that’s what they actually achieved.
Re:Big Data Is Dead by Loughla on Tuesday February 07, 2023 @05:43PM (#34700925)
Again, stop putting words in my mouth, please. I never said they became experts. I said they integrated it into existing processes. I said that they were doing something other than just scanning for chatgpt hits like plagiarism checkers.

>It's part of the collaborative idea building and development process now for every student enrolled in creative writing and writing analysis classes

>It's integrated into existing assignments, modifying processes that are super well established already. It was like integrating a new person into the class.

I don't honestly know how else to say that. I legitimately do not know how to help you understand what I'm saying.

Re:Big Data Is Dead by miguelazo on Tuesday February 07, 2023 @11:55PM (#34704293)
It sounds like they’re chasing hype, like every idiotic modern US movement to “reform” education.
Re:Big Data Is Dead by noisy_boy on Tuesday February 07, 2023 @11:58PM (#34704313)
Not who you are replying to. I found your example fascinating - would you be able to share one or two concrete examples of this integration you mentioned? I would like a low-level peek or two into how the teaching landscape is changing in light of the rise of LLMs like chatGPT.
Re:Big Data Is Dead by Loughla on Wednesday February 08, 2023 @09:22AM (#34708379)
Sure - I'll use one of the creative writing classes.

In the past, the class would be centered around ideas and themes the class came up with together during the first week of the semester. They would then read and discuss short stories from various authors centered around that theme, preferably from different eras and/or cultures. From there, they would work in pairs/small groups to flush out original ideas they came up with for their own stories based on the themes and styles from the first month of reading. Then they would work individually to write the stories. Finally, they would come back together to edit and work through that process as a group, with a reading and discussion in the last week or two.

Now, the class works alone the first day or two to discuss themes with chatgpt, to identify relevant and appropriate literature (if possible), and to flush out initial ideas for the readings and discussion topics. Then we come back together for group work to figure out themes for the semester and possible readings, like it used to be, but primed with whatever information they had already discussed with Chatgpt. From there they work through the readings, using chatgpt to bounce ideas for discussion off of before coming to class. Then they work in teams, like before, to flush out their own stories, but again, using chatgpt as if it were another member of the group. They also have to track their question/comment and response, to evaluate their own thought processes and look for weak links in their reasoning and logic. Students are then free to use the software to edit their writing before coming together with their creative assignments.

We haven't made it past the step of reading, as it's still the first month of the semester. But,the discussion for the first section has been much more in-depth and (to use a word that is impossible to quantify) vibrant. The students had already aired the ideas they thought may be dumb, and would therefore be less willing to voice in a public setting; this allows them to really dive further into whatever is in each story, and connect dots between stories that generally took a week or two. Because they have another 'person' to talk to whenever they want, and however much they want, they tend to really get into the work. Further, and unexpectedly (and anecdotally sadly) it has allowed a couple of students I know personally who would not have been willing to participate in public discussion (anxiety disorder and TBI) a stronger voice, because they know their ideas are flushed out already, and it provides them with a 'script' of ideas they know are novel and valuable for the class. In other words, if they were able to get the idea from Chatgpt, they knew they had more work to do to build that thought, because that is really just a baseline.

I'm interested to see how the actual writing process goes. Chatgpt is okay at creative writing, but not at the level that we expect to see. Some faculty expressed concerns that students would just have the software do the work for them, but I'm not really bothered by that. First off, if someone can figure out how to make a career out of publishing chatgpt prompts, well, good for them. Second, if the software is able to write better than the students are, they don't really belong in this class in particular (graduate level writing class).

Anyway, like I said earlier in the thread - we're really just treating this as another 'person' in the class, but who is available to everyone, all the time. It's beneficial for the brainstorming sections, but not for the hard skills, from what I can tell. I am most excited to watch them evaluate their own thought processes when working with chatgpt to flush out their ideas. In the past, this has been a barrier, because every single person I’ve ever met never gives a partner 100% of their thoughts all the time. They always hold back. My theory is that, because it’s a dead-end conversation, they will be more willing to push into new topics, and really think hard about what they’re trying to say. We’ll see if that stands.

Re:Big Data Is Dead by noisy_boy on Thursday February 09, 2023 @05:13AM (#34721895)
I agree a lot with your analysis - thanks for sharing your insights.
Re:Big Data Is Dead by hgsgm on Tuesday February 07, 2023 @12:51PM (#34696172)
Wow, instead of learning and being creative, just write a out whatever the generic safe whitewashed chatbot says?

Why pay for the college?

Re:Big Data Is Dead by scottyah on Tuesday February 07, 2023 @12:45PM (#34696076)
> industrial-scale amalgamation of plagiarized materials

More Big Data!

Re:Big Data Is Dead by criddell on Tuesday February 07, 2023 @12:48PM (#34696127)
Is it crazy to think that instead of stepping up in the war against AI we instead try to figure out a way to teach kids assuming they will use AIs?
Re:Big Data Is Dead by SoftTalker on Tuesday February 07, 2023 @12:54PM (#34696220)
Are we trying to produce adults who are able to think critically and creatively, and who reach their full intellectual potential, or are we trying to produce adults who can push a few buttons and blindly believe what the machine tells them?
Re:Big Data Is Dead by criddell on Tuesday February 07, 2023 @01:25PM (#34696803)
If we end up producing adults who can't think critically or creatively, then we haven't succeeded in figuring out a way to teach kids assuming they will use AIs.
Re:Big Data Is Dead by nickersonm on Tuesday February 07, 2023 @02:13PM (#34697640)
> In fact, [writing] will introduce forgetfulness into the soul of those who learn it: they will not practice using their memory because they will put their trust in writing, which is external and depends on signs that belong to others, instead of trying to remember from the inside, completely on their own.

- attributed to Socrates by Plato. c.399-347 BCE. “Phaedrus.”

Re:Big Data Is Dead by drowsspa on Tuesday February 07, 2023 @02:38PM (#34698151)
Pretty sure there's a fallacy named after this whole "hey this is just exactly like before so we have nothing to be concerned about".
Re:Big Data Is Dead by nickersonm on Tuesday February 07, 2023 @02:45PM (#34698259)
The point is that all technology is a tool. Whether it be writing, calculators, or various narrow AI software. We can either bemoan the loss of a now-less-useful skill (memorization, long division, longform writing), or learn how to use these tools to better achieve our goals.
Re:Big Data Is Dead by miguelazo on Tuesday February 07, 2023 @11:59PM (#34704315)
Technologies develop for different purposes and have different effects. Modern digital technology has a very inhumane origin story, as noted in “New Dark Age” by James Bridle, and other works. https://jamesbridle.com/books/new-dark-age
Re:Big Data Is Dead by NineStarPoint on Tuesday February 07, 2023 @02:46PM (#34698297)
While likely not how it would be work out in practice, you would hope that with better tools would also come higher standards. If you expect more complex, more thorough, and/or less error-prone output from students using AI then you don’t necessarily have to lower how much critical and creative insight they need to have. Like the difference in a test that does and doesn’t allow calculators, you always have to fit the assignments to the tools that are used for them.
Re:Big Data Is Dead by ilyt on Tuesday February 07, 2023 @02:47PM (#34698325)
Definitely the second one
Re:Big Data Is Dead by TimTheTinker on Tuesday February 07, 2023 @07:07PM (#34701918)
The scene from the film Idiocracy where the main character is being triaged in a doctor's office comes to mind.
Re:Big Data Is Dead by red-iron-pine on Wednesday February 08, 2023 @10:21AM (#34709245)
The short story MANNA about AI directed folks and the future that creates comes to mind:

https://marshallbrain.com/manna1

Re:Big Data Is Dead by qup on Tuesday February 07, 2023 @12:58PM (#34696312)
The average human hates changes of things they've grown used to.

People are very attached to school being just like it was when they went.

Re:Big Data Is Dead by grugagag on Tuesday February 07, 2023 @10:31PM (#34703762)
As long as it pushes the students into mental effort I have no problem with changes in education. The world changes, it’s normal to have changes. But there’s nothing wrong to compare against prior models, sometimes we revisit abandoned ideas, artworks, models etc
Re:Big Data Is Dead by timfsu on Tuesday February 07, 2023 @11:44PM (#34704228)
Isn't the problem that kids (like all of us) are lazy and would rather use tools than their brain, rather than people trying to keep school "just like it was"?
Re:Big Data Is Dead by fijiaarone on Tuesday February 07, 2023 @10:46PM (#34703873)
Learn your times tables and then learn to use a calculator.

If you don’t do it that way, you’ll always be fooled by whatever the screen tells you.

Re:Big Data Is Dead by wongarsu on Tuesday February 07, 2023 @11:22PM (#34704097)
That's how we teach today, but that doesn't mean it's the only way. As a counter example, in chess, AI makes a great learning partner, and from beginners to world champions the level of proficiency has increased immensely in the last 30 years due to better chess engines.
Re:Big Data Is Dead by penjelly on Tuesday February 07, 2023 @12:51PM (#34696185)
what if teachers ask chatgpt how best to test students despite the existence of a tool like chatgpt enabling cheating
Re:Big Data Is Dead by maliker on Tuesday February 07, 2023 @02:54PM (#34698451)
It appears that it's hard to detect AI generated content. E.g. true detection rates are only around 25% and there are also techniques to further mask output [1].

[1] https://www.nbcnews.com/tech/innovation/chatgpt-can-help-foo...

Re:Big Data Is Dead by bombcar on Tuesday February 07, 2023 @10:07PM (#34703594)
You only need enough to flag suspect content, and then the teacher calls the student in for a quick oral exam - the fakers will flounder, the reals will pass.
Re:Big Data Is Dead by wongarsu on Tuesday February 07, 2023 @11:17PM (#34704066)
Even if you understand the material well, doing assigned tasks takes a lot of time. Especially if it's free form text. And "I want to do something more interesting right now" is at least as powerful a motivator to cheat assignments as "I don't know how to do this".
Re:Big Data Is Dead by red-iron-pine on Wednesday February 08, 2023 @10:02AM (#34708927)
Aye, if I mostly know a subject why bother to take the time to write 10 pages when I can outsource that to a bot, and if they question me I can do a 20 min oral interview and save myself the trouble?

seems like a no-brainer in the long term.

Re:Big Data Is Dead by gardenhedge on Tuesday February 07, 2023 @12:38PM (#34695966)
That is the author said. From the article: "Big Data is real, but most people may not need to worry about it."
Re:Big Data Is Dead by eppp on Tuesday February 07, 2023 @12:29PM (#34695798)
I kind of doubt they trained chatgpt on petabytes of application logs and web server logs. Is keeping all of this crap even useful for more than a small amount of time at this scale?

Actual good information will always be useful, most of this "big data" seems to be the equivalent of recording background static.

Re:Big Data Is Dead by epicureanideal on Tuesday February 07, 2023 @12:36PM (#34695925)
I wonder how long until training today’s ChatGPT will cost $1000 of AWS compute. 10 years?

At that point, does it keep scaling or is there an S curve where 100x more data and compute only leads to a 2x improvement?

Re:Big Data Is Dead by thfuran on Tuesday February 07, 2023 @12:42PM (#34696038)
I think you're underestimating the scale by a few orders of magnitude.
Re:Big Data Is Dead by the8472 on Tuesday February 07, 2023 @12:48PM (#34696130)
> At that point, does it keep scaling or is there an S curve where 100x more data and compute only leads to a 2x improvement?

Careful with the scales. 2x improvement could be interpreted from 80% human performance to 160% human performance. Or going from 10% error rate to 5% (which again crosses into superhuman territory on some tasks). Those last few bits are the critical ones.

Re:Big Data Is Dead by pphysch on Tuesday February 07, 2023 @12:48PM (#34696132)
We would need to see incredible advances in energy efficiency for that to happen.
Re:Big Data Is Dead by simplyluke on Tuesday February 07, 2023 @02:23PM (#34697868)
We are! Don't even have to reach for fusion potentially being commercial technology to show it. Solar is already approaching $0.03/kilowatt hour and likely to be half of that by the end of the decade. Energy getting very cheap coupled with computing capacity continuing to go way up is going to enable lots of interesting new technologies beyond LLMs
Re:Big Data Is Dead by pphysch on Tuesday February 07, 2023 @12:47PM (#34696101)
OpenAI and Google are clearly in the 1% as TFA describes.
Re:Big Data Is Dead by airstrike on Tuesday February 07, 2023 @01:19PM (#34696696)
> ChatGPT is literally changing how school will test their students, for a start.

Here's a novel idea: test students using pen and paper?

Re:Big Data Is Dead by 0cf8612b2e1e on Tuesday February 07, 2023 @01:43PM (#34697108)
Teachers assign better scores to papers with better penmanship. I forget how strong the effect was, but using a keyboard does help equalize some biases.
Re:Big Data Is Dead by albert_e on Tuesday February 07, 2023 @02:06PM (#34697499)
Keyboards and screens in an exam hall then?
Re:Big Data Is Dead by MonkeyMalarky on Tuesday February 07, 2023 @02:04PM (#34697465)
Typewriters for everyone!
Re:Big Data Is Dead by 0xdeadbeefbabe on Tuesday February 07, 2023 @02:19PM (#34697781)
Why equalize that bias?
Re:Big Data Is Dead by slaymaker1907 on Tuesday February 07, 2023 @04:29PM (#34699980)
Because there are a plethora of disabilities which make neat penmanship difficult.
Re:Big Data Is Dead by politician on Tuesday February 07, 2023 @02:17PM (#34697732)
Scan the hand-written work back into a digital format and present the results to the teachers for evaluation in their preferred typeface.
Re:Big Data Is Dead by throwmeout123 on Tuesday February 07, 2023 @02:14PM (#34697665)
In Italy we test with pen and paper and the quality of italian schools is abysmal. The point is not the test, is the quality of the teachers. They are the only hope to form good humans, not some standardized test.
Re:Big Data Is Dead by Mizza on Tuesday February 07, 2023 @02:51PM (#34698400)
Or, preferably, admit that testing wasn't a good idea to begin with and focus on optimizing children for learning, not test-taking.
Re:Big Data Is Dead by taftster on Tuesday February 07, 2023 @03:59PM (#34699534)
I don't even think we're just talking about children either. Test taking in academia (university and above) could stand a much needed fresh look.

I am hopeful that a change happens in academia to prepare students for jobs, which is why they are going to school in the first place. Yes, students need to learn how to "think", but really they are wanting to get the technical skills to perform their duties more than anything.

We have bestowed too much credence in traditional academia not useful to the average person or average job. College is a "game" for most students, and they put up going through the motions of testing, etc. for the sake of the diploma at the end.

I hope we're going to enter a new era of what college means for those looking to get something different out of it.

Re:Big Data Is Dead by juve1996 on Tuesday February 07, 2023 @07:01PM (#34701863)
At some point you need to see what people know to measure their progress and help them.
Re:Big Data Is Dead by snarf21 on Tuesday February 07, 2023 @01:32PM (#34696940)
Big Data drives the most profitable and society bending changes of all time, just to serve us better Ads.
Re:Big Data Is Dead by ryguyrg on Tuesday February 07, 2023 @04:31PM (#34700015)
Okay, Google as a company and as a product is definitely in the top 1%, or top 0.0001% where big data drives profitable and bending changes ;-)
Re:Big Data Is Dead by hn_throwaway_99 on Tuesday February 07, 2023 @02:35PM (#34698093)
> Maybe what the author is trying to say is 'small-scale big data is dead, but big data chugs on.'

That's pretty much exactly what the author says in the article.

Re:Big Data Is Dead by tootie on Tuesday February 07, 2023 @03:22PM (#34698896)
That's a completely different topic. "Data" is obviously a pretty generic term and "large sets of data" are going to be more and more relevant to the world in general. What he's talking about is the Big Data trend in industry specifically around Business Intelligence (BI). That is, collecting as much data as possible on your users to optimize your product experience and profits. Tracking clicks, purchases, form dropoffs, email opens, ad impressions. It's mostly going to be first-party data (ie what did they do with our own products and content).

ChatGPT and the like are not going to get much use from that kind of data and instead are looking at a giant corpus of text and images scraped from a variety of public sources to infer what humans might think sounds smart. It's possible the two worlds will meet, but that's probably not what's going to be announced this week.

Re:Big Data Is Dead by zmmmmm on Tuesday February 07, 2023 @05:22PM (#34700653)
Yes, this occurred to me as well. The counter narrative here is in fact that the story of the last 2-3 years has been break throughs in AI have come about mostly by scaling up their network sizes and training data sets 5 orders of magnitude or so.

I guess the take away however is still that regular businesses really just can't play in this game and should not be assuming they have big data until that fact asserts itself out of necessity rather than the other way around.