Re:Ask HN: What problem in your industry is a potential star...
by jsingleton18 on Friday December 09, 2016 @04:33PM
(#13142036)
We solved RegEx and can guarantee worst-case linear time matching for any number of expressions. We should talk!
www.watchful.io
Re:Ask HN: What problem in your industry is a potential star...
by jefftk on Friday December 09, 2016 @05:47PM
(#13142549)
guarantee worst-case linear time matching for any
number of expressions
Or you could just use RE2: https://github.com/google/re2/wiki/WhyRE2It's open source, and match time is linear in the length of the input string.
(Disclosure: I work at Google on a different open source project)
Re:Ask HN: What problem in your industry is a potential star...
by alixaxel on Sunday December 11, 2016 @08:44AM
(#13151021)
RE2 is great! I first discovered it while building namegrep.com and after benchmarking it against PCRE I never looked back. :)
Re:Ask HN: What problem in your industry is a potential star...
by glangdale on Sunday December 11, 2016 @04:30PM
(#13153401)
Interesting. We worked in this area for many years, did the 'startup' in this area, now acquired by Intel, open sourced the product (ob plug: https://github.com/01org/hyperscan ) and I would never claim that we are anything near 'solving' regex.
More like "mitigating" or "occasionally getting regex slightly more right than some other solutions". There are many different approaches to regex and all seem to focus on different parts of functionality (RE2 focuses on quick compiles and simplicity, libpcre has 'all the functionality', we're about streaming + large scale + high performance if you can tolerate long compiles and lots of complexity). A number of new projects are trying very interesting approaches, like icgrep and the Rust regex guys.
I would be curious to hear about your approach.
http://www.striim.com/
It's a native streaming platform so your data will be cleansed, processed, scanned for outliers event-by-event rather than in batches. We have dozens of streaming connectors IT/Enterprise/Web data sources. We also support initial load for your firehose data. For unstructured data, we have support for RegEx based parsers.
Shoot me a message if you have any more questions. We have many big name users in Aerospace, Banking, Device manufacturing, and Logistics industries.