Ask HN: Algorithms for text fingerprinting?

Re:Ask HN: Algorithms for text fingerprinting? by vixsomnis on Monday June 15, 2015 @02:06AM (#9717755)

Took only a minute to try:

English -> Filipino (Tagalog) -> Chinese-simplified (Mandarin?) -> English

    I remember reading an article about a year ago (NSA) to identify the
    user, based on how they are written, vocabulary, spelling errors,
    grammar, language, and so on.

    It is interesting to me, because it is difficult to change the written
    and spoken word in use. It can be estimated that there are between two
    characters similar amount of help.

    Recently I can think of now is to check plagiarism (used in schools and
    universities, for example) is proprietary algorithm.

    Are there any public this algorithm? I can find out more information?
    (Academic journals?) I just DDGing wrong search terms?

I have to say, this is a great idea. There was some information lost in transit, but most of my thoughts came through (albeit broken). It's probably worse since I used multiple intermediaries and Mandarin doesn't map onto English (or vice-versa) in grammar or vocabulary.

edit: A site for this exists. http://ackuna.com/badtranslator

[ Parent | on HN ]

Re:Ask HN: Algorithms for text fingerprinting? by kngspook on Monday June 15, 2015 @03:11AM (#9717936)

Google Translate almost holds it together...until the very end...

Original:

  In the beginning God created the heaven and the earth. And the earth was without form, and void; and darkness was upon the face of the deep. And the Spirit of God moved upon the face of the waters.

[a half dozen languages later...]

Result:

  God created heaven and earth in the beginning. And the earth was formless and empty, and darkness was on the face of the abyss, man. Answer the Spirit of God on the water surface.

[ Parent | on HN ]

Re:Ask HN: Algorithms for text fingerprinting? by tokenizerrr on Monday June 15, 2015 @06:21AM (#9718478)

Of course you're sending all this information to Google now. Are there any offline translators that are advanced enough to be used for something like this? I imagine most just naively map words 1:1 which wouldn't do much good here.

[ Parent | on HN ]

Re:Ask HN: Algorithms for text fingerprinting? by giancarlostoro on Monday June 15, 2015 @07:47AM (#9718735)

I was wondering the same. Oddly enough, on your phone you can use Google Translate offline, they let you download language packs. Not sure if they ever "phone home".

[ Parent | on HN ]

Re:Ask HN: Algorithms for text fingerprinting? by nl on Monday June 15, 2015 @05:40AM (#9718364)

Google translate to Tagalog is generally not great.

If you chain through European languages you barely lose anything. Doing English->Dutch->German->English is a good set to use.

[ Parent | on HN ]