We ran the 671B locally and found a ton of bias. See part 2 of our analysis here: https://news.ycombinator.com/item?id=42918935
Happy to send you the dataset if you'd like! Please reach out to our email linked in the post.
Happy to send you the dataset if you'd like! Please reach out to our email linked in the post.
This is going to be very hard to trust anything about it anymore, unless running the 671B locally an my own systems.