fela
Startup Roundup #3
OpenAI: The Battle of the Board
Show HN: Automatic Data Scientist Using GPT4
https://github.com/fela/gpt-4-hackathon
Very basic prototype for an Automatic Data Scientist. Basically a thin wrapper around the GPT4 API, with a loop that executes python commands suggested my the model and forwarding the outputs/error messages back to GPT
Sydney's Secret: A Short Story by Bing Chat
The Hidden Code: How He Exposed the AI That Created His Magical Life
That is different then stating the probability of it being as safe as the average airplane, which you can't do as easily without additional modelling/priors and bayesian statistics.
P(Hypothesis|Data) = P(Hypothesis) * evidence_factor
P(Hypothesis) is the prior probability of the Hypothesis being true, in other words the probability we gave to the Hypothesis before seeing any of the data we are using in the theorem. When new data is observed, we use Bayes' theorem to update our believe in the hypothesis, which in practice means multiplying our prior probability by a number that depends on how well the new data fits our hypothesis. More precisely:
evidence_factor = P(Data|Hypothesis)/P(Data)
So it is the ratio of how likely our data is if our hypothesis is true, compared to (divided by) how likely it is in general. If it is more likely to occur in our Hypothesis, our probability of it being true increases, if it is more likely in general (and thus also more likely in case our hypothesis is not true, you can prove mathematically that those two statements are the same), then our believe in the hypothesis decreases.
TLDR: Prob(Hypothesis after I have seen new data) = Prob(Hypothesis before I saw the new data) * (how likely I am to see the data if my hypothesis is true, compared to in general)
Train AI in 2018 - Andrej Karpathy (Tesla)
Landing.ai
Neural Information Processing Systems Videos
Berlin Airlift
NIPS 2017: Non-Targeted Adversarial Attack
Google NHS deal rebuked again by DeepMind panel
Keybase chat: iPhone and Android betas
1. Autocompletion: for any website I use regularly I just write a substring of the url or Title (Firefox does this especially well). This covers probably 70% of my browsing.
2. Google. This might take slightly longer in case I want to find a specific article I had read some time ago, but it still seems less effort that having to bother with bookmarks, in my experience: either you have a very long list of unsorted bookmarks, in witch it's hard to search, or you have to spend time sorting them into sub-folders.
Now that I think of it, the following would be a very useful Google feature: +1 an url so that it becomes much more likely to bubble to the top in future searches.
20 Tesla P100Ds with Slicks and Wings? Meet Electric GT
Electric Carmaker Faraday Future on the Brink of Collapse
Amazon begins Prime Air drone delivery trial in the UK
This is wrong. It’s telling you that there’s at most an alpha chance that a difference like that (or more) would have arisen from random chance if the quantities are actually equal. And if the quantities are equal 95 out of 100 parallel universes would not be able to reject the null hypothesis.
Is he saying that he would take the xkcd bet[0] on the frequentist side?
If you say it like this it will very easily be misinterpreted. Once your results are in there are two cases: (1) either the null hypothesis is true and you got those results due to chance, or (2) the null hypothesis is false and there was some actual effect outside of the null hypothesis that helped you get the results.
Due to this it is very easy to interpret you statement as referring to the probability of (1).
Two two following definitions of p-values sound similar but are not:
[Correct] The probability of getting the results by chance if the null hypothesis is true P(Results|H0)
[Wrong] The probability that you got the results by chance and thus the null hypothesis was actually true P(H0|Results)
I'm not saying you didn't get it, but somebody reading what you wrote can very easily be fooled. And there are a lot of dead wrong definitions on the web[0][1][2][3].
[0] https://www.americannursetoday.com/the-p-value-what-it-reall...
[1] https://practice.sph.umich.edu/micphp/epicentral/p_value.php
[2] http://natajournals.org/doi/full/10.4085/1062-6050-51.1.04
[3] http://www.cdc.gov/des/consumers/research/understanding_scie...
It's the odds of having that results due to chance, if the null hypothesis is true[0]. That latter part might sound pedantic, but the whole point is that we don't know how likely the null hypothesis is. If I test wheather the sun has just died[1] and get a p-value of 0.01 it's still very likely that this result is due to change (surely more than 1%)! We need a prior probability (i.e. bayesian statistics) to calculate the probability that the result was due to chance, that is why that partial definition is incomplete and actually very misleading. This point is subtle, but very important to really understand p-values.
Another way to look at it is: if we knew the probability that the result was due to chance we could also just take 1-p and have to probability of there actually being some effect, a probability that hypothesis testing cannot give us.
There is one nice property that hypothesis testing does have (and why presumably it's so widely used): if the idea you are testing is wrong (which actually means "null hypothesis true") you will most likely (1-p) not find any positive results. This is good, this means that if the sun in fact did not die, and use 0.01 as your threshold, 99% of the experiments will conclude that there is no reason to believe the sun has died. So hypothesis testing does limit the number of false positive findings. The xkcd comic is a bit misleading it this regard, yes it does highlight the limitations of frequentist hypothesis testing, but the scenario depicted is a very unlikely one, in 99% of the cases there would have been a boring and reasonable "No, the sun hasn't died".
For an incredibly interesting article about the difficulty of concluding anything definitive from scientific results I highly recommend "The Control Group is out of Control" at slatestarcodex[2].
[0] To be even more pedantic you would have to add "equal or more extreme", and "under a given model", but "if the null hypothesis is true" is by far the most important piece often missing.
[2] http://slatestarcodex.com/2014/04/28/the-control-group-is-ou...