The Java-TF binding is so shallow it is absurd, IMHO. Basically, you loose everything you have when coding TF in Python, but yes - you can import models and weights into your JVM and do inference there. If you want to create a graph, then you will have to code on a very low level - most of the abstractions and tools are gone.