News for hackers. Stuff that matters.
Re:Show HN: A Twitter crawler for app ideas by mulhoon on Thursday April 08, 2021 @04:44PM (#26743529)
Yup, It's one simple lambda function that reads the JSON file from S3, searches twitter for new tweets since the latest, appends new ones and writes back to S3. Cron'd every minute.
Re:Show HN: A Twitter crawler for app ideas by tracyhenry on Thursday April 08, 2021 @11:31PM (#26746396)
This is awesome! What is the strategy to identify the idea tweets? It looks like some string matching, but I'm not sure.
Re:Show HN: A Twitter crawler for app ideas by mulhoon on Saturday April 10, 2021 @10:54AM (#26761903)
Yes, nothing too special. There are 6 or 7 string matches e.g. "I need an app that" (minus retweets). But also retrieving referenced tweets.