Revision history [back]

NO, this is not possible.

only one single thread can be used for a single network, you can't "share" the net instance between multiple threads.

what you can do is:

• don't send a single image through it, but a whole batch
• try to enable a faster backend / target

NO, this is not possible.

only one single thread can be used for a single network, you can't "share" the net instance between multiple threads.

what you can do is:

• don't send a single image through it, but a whole batch
• try to enable a faster backend / target
• maybe you don't need to run the inference for every frame, but only now & then, and use tracking to follow your objects in the meantime