News for hackers. Stuff that matters.
Re:No human genome has ever been completely sequenced by jessriedel on Monday October 23, 2017 @12:50PM (#15534593)
As usual, the journalist spends many paragraphs painting a picture of human conflict before actually getting on to the interesting claim.

> The reason for these gaps is that DNA sequencing machines don’t read genomes like humans read books, from the first word to the last. Instead, they first randomly chop up copies of the 23 pairs of chromosomes, which total some 3 billion “letters,” so the machines aren’t overwhelmed. The resulting chunks contain from 1,000 letters (during the Human Genome Project) to a few hundred (in today’s more advanced sequencing machines). The chunks overlap. Computers match up the overlaps, assembling the chunks into the correct sequence.

> That’s between difficult and impossible to do if the chunks contain lots of repetitive segments, such as TTAATATTAATATTAATA, or TTAATA three times. “The problem is, when you have the same exact words, it’s hard to assemble,” said Lander, just as if jigsaw puzzle pieces show the same exact blue sky.

> In 2004, the genome project reported that there were 341 gaps in the sequence. Most of the gaps — 250 — are in the main part of each chromosome, where genes make the proteins that life runs on. These gaps are tiny. Only a few gaps — 33 at last count — lie in or near each chromosome’s centromere (where the two parts of a chromosome connect) and telomeres (the caps at the end of chromosomes), but these 33 are 10 times as long in total as the 250 gaps.

I recommend reading HN user eggie's comments on this from last week.

https://news.ycombinator.com/item?id=15482439 https://news.ycombinator.com/item?id=15483462

Re:No human genome has ever been completely sequenced by shpx on Monday October 23, 2017 @01:06PM (#15534731)
https://youtu.be/fCd6B5HRaZ8 is the best visualization of how the most popular type of DNA sequencer works (that I've found).

Imagine you have a string of length 3 billion made by randomly choosing from 4 characters. Like this

    dna = ''.join(random.choices('atgc', weights=[30.9, 29.4, 19.9, 19.8], k=3_234_830_000))
you get to randomly sample 1 billion[3, page 7] overlapping substrings of length 200[3, page 7] with .1% of the characters randomly changed[3, page 8]. Trying to find the original string from this is technically an undecidable problem. If there's a sequence 400 characters long that repeats multiple times, how could you know if it repeats 5 times or 50 times? (this would be unlikely to happen with random.choices() but DNA isn't random). This is called sequence alignment and it's one of the hard problems in bioinformatics[4].

[0] https://docs.python.org/3/library/random.html random.choices() was added in Python 3.6

[1] http://www.biology-pages.info/B/BasePairing.html source for `weights`

[2] https://en.wikipedia.org/wiki/Human_genome source for 3_234_830_000 (python ignores underscores in numbers)

[3] http://sci-hub.io/10.1111/j.1755-0998.2011.03024.x illumina is the most popular producer of genome sequencers

[4] https://news.ycombinator.com/item?id=5123377

Re:No human genome has ever been completely sequenced by bsmrea on Monday October 23, 2017 @03:22PM (#15536158)
This problem is called sequence assembly or genome assembly, not sequence alignment (which is a related problem).
Re:No human genome has ever been completely sequenced by teekert on Tuesday October 24, 2017 @01:58AM (#15539545)
Very nice movie indeed. This Sequencing by Synthesis is indeed the most popular method, the words in this type of DNA sequencing are usually 150 base bairs long, but by using fragments that can be much longer (say 2500 base pairs) and sequencing from both ends (as the movie explains) one can derived information on the position of 2 150 base pair long "words" relative to each other.

The alternative technologies, sometimes called third generation sequencing are nanopore based (PacBio and Oxford Nanopore technologies), they work by pulling long DNA molecules through tiny holes and read the sequence directly, more specifically, they read a couple of base pairs at a time and infer the sequence from the current between the sides of the pores. This is very error prone and the (around 1 in 10?) random errors are corrected by sequencing every part of the genomic area of interest multiple times.

To be clear, most sequencing experiments (in research and in the hospital) are designed to look at variations we can understand and thus the "words" (we call them reads) are aligned against "the" reference genome (as opposed to assembling de novo), which is the genome for as far as we understand it (the last official version is from 2013 but is updated regularly with new parts). Typically, a significant portion of the reads a sequencer produces cannot be mapped to the reference, probably as a results of unmapped regions indeed or perhaps deviations between the patient and the reference genome, this is of course even worse in patients with tumors with unstable genomes. This field still has a lot of challenges to tackle.

Re:No human genome has ever been completely sequenced by cup-of-tea on Tuesday October 24, 2017 @07:18AM (#15540755)
> with .1% of the characters randomly changed

Nope, not randomly. Having a random error profile is the best case. In reality these machines suffer from systematic errors, especially the Illumina ones. That means that they always fail to read through certain pieces of DNA, or make the same error every time.

Re:No human genome has ever been completely sequenced by nether on Monday October 23, 2017 @02:06PM (#15535414)
Side note: your comment is one of the few times I've seen the code tag used for actual code on HN, rather than quotations or just indentation.
Re:No human genome has ever been completely sequenced by Bromskloss on Monday October 23, 2017 @03:11PM (#15536054)
Yeah, why does Hacker News not have a real way to indent things? It wouldn't make loading the page any less light-weight.
Re:No human genome has ever been completely sequenced by labster on Monday October 23, 2017 @03:43PM (#15536334)
Seriously. I can't go a week in HN without reading someone's complaint about not being able to read a quote, probably on mobile. If users keep complaining regularly, it's a problem with the software interface, not the users.
Re:No human genome has ever been completely sequenced by nether on Monday October 23, 2017 @07:52PM (#15537974)
I emailed dang about it a while (years) ago. He said he's added it to the fix list, after initially saying that having a quote tag would mess up the site's "character." You may want to email him too.
[dead]
Re:No human genome has ever been completely sequenced by technofiend on Tuesday October 24, 2017 @02:04AM (#15539573)
You forgot the folks who turn every article on the latest Google phone into a discussion on Apple products. See the latest posting about the Pixel 2 as an example.
Re:No human genome has ever been completely sequenced by sspiff on Tuesday October 24, 2017 @01:24AM (#15539422)
And yet here you are, on the site whose users you are attacking, commenting on an off-topic comment thread. Perhaps you should rethink your life choices?
Re:No human genome has ever been completely sequenced by cup-of-tea on Tuesday October 24, 2017 @07:21AM (#15540768)
Nobody said anything about mobile. Am I missing something?
Re:No human genome has ever been completely sequenced by baxtr on Monday October 23, 2017 @02:20PM (#15535542)
True, and unfortunately it does not render it properly, it‘s cut after 20 chars or so
Re:No human genome has ever been completely sequenced by neikos on Monday October 23, 2017 @02:40PM (#15535744)
You should be able to scroll it.
Re:No human genome has ever been completely sequenced by baxtr on Monday October 23, 2017 @03:54PM (#15536406)
Thanks, you’re right. I wasn’t aware of that. The experience is rather crappy though. Cumbersome to scroll on a smartphone screen and I’d love to see to entire statement not parts of only at a time.
Re:No human genome has ever been completely sequenced by KGIII on Monday October 23, 2017 @04:25PM (#15536666)
> dna = ''.join(random.choices('atgc', weights=[30.9, 29.4, 19.9, 19.8], k=3_234_830_000))

On a tablet, I highlight and pull down. It grabs it all and I can then read it. It is a very awful workaround that impacts the site's usability.

Re:No human genome has ever been completely sequenced by latj on Monday October 23, 2017 @03:21PM (#15536148)
This person also forgot to mention that the original human genome project was not even the sequence of a single individual- it was several people.

The other thing this article doesnt mention is the idea of coverage. Its not like a jigsaw puzzle with one copy of each tile-- every time a whole genome is sequenced it is done so 30 times over to ensure that the pieces are correct.

Finally, Read length varies from technology to technology. This one claims average 10k base pairs.

http://www.pacb.com/smrt-science/smrt-sequencing/read-length...

Re:No human genome has ever been completely sequenced by wahern on Monday October 23, 2017 @05:37PM (#15537141)
My biologist friend isn't patient enough to ELI5, but AFAIU don't genes realign through the natural course of replication? That is, there is no specific, canonical sequence at large scales, neither between two individuals nor even two cells, even if the complete set of base pairs[1] is otherwise identical (i.e. no mutations).

I realize that the magnitude of this natural shuffling, even during meiosis, is nowhere near like what happens when sequencing DNA[2], but (assuming I'm correct) it's helpful to realize that this problem of deciphering the "correct" sequence reflects something intrinsic to the operation of the machinery; that this applies even when the relevant macro sequences are all genes that directly code for phenotypes as traditionally understood; and that gene sequencing works precisely because many (most?) genes are relatively tolerant to being spliced in at random locations in the strand. (Which is different than saying all locations--or even any two locations--produce identical results.)

[1] I refrain from saying "complete set of genes" because I imagine for some genes location at both the micro- and macro-scale is everything. AFAIU the term gene is sometimes better understood as more a description of the result of possibly non-local sequences which maintain reproductive affinity than an identification of a specifically adjoining sequence of base pairs.

[2] Or is it?

Re:No human genome has ever been completely sequenced by jdale27 on Monday October 23, 2017 @05:45PM (#15537187)
there is no specific, canonical sequence at large scales, neither between two individuals nor even two cells

This is correct, and is a reason why genome informatics has been moving away from representing the genome as a single linear "reference" sequence of 3 billion nucleotides, and towards a graph-based model: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5411762/.

Re:No human genome has ever been completely sequenced by x0x0 on Monday October 23, 2017 @06:58PM (#15537625)
I worked on a slab gell dna sequencer contemporaneous to the humane genome project. It's actually worse than described, because the dna isn't cut randomly. Instead, restriction nucleases cut the dna at certain fixed sequences. Of course you can use multiple restriction nucleases, either in the same (subject to their chemistry being compatible) run or over multiple runs. When everything went well, our tech allowed you to read 800-ish bp with good quality and perhaps up to 1.1k if you were willing to to get dodgy quality at the ends.

So you have two problems. The first is, you never read anything longer than say 1k bp ever. The second is say your nuclease cuts at GAATTC. You will have great difficulty counting runs of that sequence.

this is the technique https://en.wikipedia.org/wiki/Polyacrylamide_gel_electrophor...

Re:No human genome has ever been completely sequenced by epistasis on Monday October 23, 2017 @07:03PM (#15537658)
For modern Illumina sequencing the shearing process is typically sonication, or some other method that's far more random than a restriction enzyme.
Re:No human genome has ever been completely sequenced by x0x0 on Monday October 23, 2017 @07:07PM (#15537679)
I think the entire tech that I worked on has been superseded by better technologies. However, I (think?) the limitations are still of interest because they influenced the original sequencing and probably a lot of the early data.

The other takeaway I had, as someone who came to this with a CS and stats background, is that chemistry sucks. None of it is deterministic, and when people say some chemistry does X, what they really mean is it generally does that. Most of the time. Subject to conditions and a reasonable amount of stochasticity. We're built on a pile of random muck hacked together.

Re:No human genome has ever been completely sequenced by epistasis on Monday October 23, 2017 @07:24PM (#15537789)
Older tech stays around quite a while! No sequencing technology is perfect, so even Sanger sequencing is still used quite a bit for various tasks from clinical sequencing to validation studies to anywhere you just want to phase something that's longer than 300bp, etc.

And yes, the chemistry that biology takes advantage of means embracing uncertainty in the world. It's all thermodynamic chances, with lots of non-linearity added on top of it all.

Re:No human genome has ever been completely sequenced by danieltillett on Tuesday October 24, 2017 @02:18AM (#15539627)
Sanger sequencing is still about 1/3rd of the market by dollar value. There is more Sanger sequencing being done today than 10 years ago.
Re:No human genome has ever been completely sequenced by eradicatethots on Monday October 23, 2017 @06:51PM (#15537584)
They do that for the rest of their audience, for whom that is important motivating context, or just informational context. I think It’s a good approach to writing, and it’s he really awkward to their main readership otherwise.

There’s even evidence that this is true, for who knows their audience better than them? You, while making up a a portion of the audience, are not the main portion, or so it seems, unless they don’t understand their audience that well after all... although that seems pretty unlikely