Integrate pemja in java web to call python deep learning model about pemja HOT 8 OPEN

@HuangXingBo

from pemja.

Yes. This is a very typical way of using Pemja.

from pemja.

@zhouyuangan Have you started integration with pemja yet? Do you encounter any problems?

from pemja.

Yes, this is a good project, but we encountered a problem: in a class in python, the init method needs to initialize the inference engine, which is a very time-consuming operation, but the execution of the inference function is fast, so In java, we use a static code block to initialize the python class to get a python object. This step will initialize the python inference engine, so in the java web, each request does not need to initialize the inference engine. But in python, the initialization function and the inference function must be called in the same thread, so in java we can only use "Executors.newSingleThreadExecutor()" to put the initialization method and inference method in the same thread to call python, may i ask is there a better way or optimization?

from pemja.

@285220927 Why not create multiple PythonInterpreters ? Multiple thread (each thread has a PythonInterpreter) or Multiple PythonInterpreter instances in one thread

from pemja.

It takes a lot of GPU resources to initialize an inference engine, so we want to create only one PythonInterpreter, we are looking for a way to use pemja to call python concurrently within the same thread

from pemja.

@285220927 Do you mean that [a Java thread -> a Python Interpreter -> an inference engine -> multiple python threads ] ?

from pemja.

@285220927 Do you mean that [a Java thread -> a Python Interpreter -> an inference engine -> multiple python threads ] ?

We want [multiple Java thread -> a Python Interpreter -> an inference engine -> a python threads ]
We want python to always be inside the same thread no matter how many times it is called with pemja. We found by printing the python thread id: java calls within the same thread => python is always in a thread; java multi-threaded calls => python is not in the same thread

from pemja.