News for hackers. Stuff that matters.
Re:Parallel C++ on AWS Lambda for CRISPR by andrewon on Saturday February 03, 2018 @05:31PM (#16300066)
What's the difference between this CRISPR search problem and DNA sequence alignment? There were extensive development in the latter and is highly optimized. The author seems to be coming up with solution from scratch.

https://en.wikipedia.org/wiki/Sequence_alignment

Re:Parallel C++ on AWS Lambda for CRISPR by vineetg on Saturday February 03, 2018 @06:31PM (#16300319)
Original author here.

You're right - conceptually the CRISPR search problem and DNA sequence alignment are related. In both, you're looking for place where two (or more) sequences are very similar. I would say there are two major differences.

The first is in the goal of the search. Typically, alignment tools try to find the best positional alignment for two (or more) sequences. The CRISPR search problem is to find every possible match above some similarity threshold.

There are also a few constraints on the CRISPR search problem that allow us to make this much faster than a general DNA sequence alignment tool:

1) We know that that guide sizes tend to be very small (~20bp) 2) Part of the guide must match exactly (the PAM site), allowing us to restrict our search even further. 3) We don't need to worry about insertions or deletions in our search.

Using those three constraints, we can do this search a lot faster than a more general DNA alignment tool!

Re:Parallel C++ on AWS Lambda for CRISPR by inciampati on Sunday February 04, 2018 @03:42AM (#16301952)
Honestly you are taking a big risk designing a DNA search algorithm something from scratch. It's akin to the risk people take when they roll their own crypto. There are aspects of this that you may not be considering, and it tends to be best to rest on the extensive work in the field than assume it is a trivial problem.

How do you deal with natural variation in the genome? Can you be sure your gRNA doesn't target an essential locus in some percentage people who carry a particular allele? The data to solve this is out there (1000 Genomes for instance).

Edit: excuse me, I appreciate that you are using a collection of whole genomes as your target. Will this reliably scale to thousands or millions of genomes and likely recombinations between them?

Re:Parallel C++ on AWS Lambda for CRISPR by alangpierce on Saturday February 03, 2018 @06:53PM (#16300399)
(I work at Benchling and worked on the protein alignments tool.)

Adding to Vineet's response, Benchling has both CRISPR search and sequence alignment, and they have different use cases. CRISPR search uses the custom algorithm described in the article (and the "last post" linked at the top), while alignments use the two popular alignment tools Clustal Omega[1] and MAFFT[2]. It's certainly true that the general alignment problem is complex had has undergone plenty of research around performance and producing good results, which is why we used an off-the-shelf tool for computing the alignment itself (but a custom UI for viewing the result).

[1] http://www.clustal.org/omega/

[2] https://mafft.cbrc.jp/alignment/software/