This assumes that there is indeed no difference between fact and fiction. However, facts need to be consistent among themselves. In such a case where a fact can be disproved by a lack of consistency with directly observable phenomema, no appeal to trust is required. For eg. the earth is not flat, etc.