Usually in situations like that it either goes to a special court or the judge reviews it alone and then instructs the jury to take certain facts for granted. This might sound odd but it's actually very common - if both sides in a case agree about certain facts then they are 'stipulated' and become binding matters of fact that are not subject to challenge or review later.