Show HN: MovieChat.org – Archive and Replacement for IMDb Message Boards

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by dave_sullivan on Wednesday February 15, 2017 @02:52PM (#13654861)

This is awesome and much needed.

Just throwing it out there, but would you consider making a dump of the data you scraped that could be used by data scientists? Maybe as a torrent or something like that? Data about movies and what people say about them could form the basis of a lot of NLP projects.

What other big datasets are there for forum post text data? The reddit dataset most immediately comes to mind, and I've also seen a similar one for HN comments. Any others?

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by mynewtb on Wednesday February 15, 2017 @05:06PM (#13655792)

ArchiveTeam's web archives will be available to everyone without restrictions or profit as usual.

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by amyjess on Wednesday February 15, 2017 @05:27PM (#13655978)

Well, thanks to your comment, I just found out ArchiveTeam exists.

Thank you!

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by kenorb on Tuesday February 21, 2017 @10:00AM (#13695945)

Where you can download the boards?

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by JimSmith84 on Wednesday February 15, 2017 @05:18PM (#13655891)

Yeah that's definitely something I could do. Are there any proposed projects you know of that could benefit from this type of data?

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by anilgulecha on Thursday February 16, 2017 @12:23AM (#13657927)

Everything from simple sentiment analysis, to archive.org, to another mirror. I hope that does not discourage you from releasing the data.

Edit: I see the other comment about archive team already collecting and releasing this data, for free in an open format. I think that will be a good first source as well.

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by waynecolvin on Thursday February 16, 2017 @06:34AM (#13659098)

I think the priority was to reenable discussion of new movies and TV shows, that would be useful moving forward. But maybe they could make an API.

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by johnymontana on Thursday February 16, 2017 @01:54AM (#13658185)

I'd love to explore how this data could be used to enhance recommender systems.

[ Parent | on HN ]

Re:Show HN: MovieChat.org – Archive and Replacement for IMDb... by endymi0n on Thursday February 16, 2017 @01:59AM (#13658193)

AFAIK, Jinni is doing exactly that.

[ Parent | on HN ]