Re:Apache NiFi
by ismail on Monday May 11, 2020 @04:30PM
(#23146646)
From the spec (8gb) it appears that NiFi was not needed. Were you co- locating zookeeper on the same nodes?
Also you say it needed to be run periodically? Itβs supposed to be a long running service. If you need something that you can spin up and shutdown in a container or VM then it is probably not the solution.
Use it if you have high volumes of data you need to transport from A -> B. We run on a cluster with 256gb ram, 128 core per a node.
Also you say it needed to be run periodically? Itβs supposed to be a long running service. If you need something that you can spin up and shutdown in a container or VM then it is probably not the solution.
Use it if you have high volumes of data you need to transport from A -> B. We run on a cluster with 256gb ram, 128 core per a node.