mkjmkumar

I have made some progress on this as my home project using same compression and scan. I call it DFA - digital file analytics where data/images/scanned documents are sent remotely using Kafka to Hadoop and then run OCR to extract text and compression. If the document is more then 10MB go to HBase otherwise HDFS. Near real-time streaming using Spark and Flink is done too. Visualization using Banana dashboard is not so cool as it shows word counts, storage location, images and tags. Analytics on top of extracted data using ML would like to do next.

More you can find at https://medium.com/@mukeshkumar_46704/digital-files-ingestio...

I learned how to complete the vision of leaders with persistence and dedication. In my IT career came to know that I can make any vision successful. I am following and think they are doing good to the world. My new leader who wants to convert my idea and his idea into a product. Note: I am an employee working on half of salary what I earn in my last organization. Obviously, money is not always the great thing.

This kind of basic abstraction in place gives us a way of gluing disparate data systems, processing real-time changes, as well as a being an interesting system and application architecture in its own right.