batch mode and multithread

[arita37]

Hello,

Thx for the package ?
How to setup batch mode and multithread easily ?
(inference on CPU).

2. Think one should be able load some small fine tuner head for quick fine tuning
   and save the model back.

[rom1504]

hi,
batching is already happening by default https://github.com/rom1504/image_embeddings/blob/master/image_embeddings/inference/inference.py

[arita37]

Hi, Sure. Thanks. Thinking of one command to skip or hide (The tfrecords part) folder of images —> emb in numpy on disk with model_path =…. (ie typically eff or some fine tuned eff)… 2) Is reallt tfrecord necessary ? Why not image —> numpy—> TF tensor Anwway, thanks for the package.

…

On Jan 23, 2022, at 1:09, Romain Beaumont ***@***.***> wrote:  hi, batching is already happening by default https://github.com/rom1504/image_embeddings/blob/master/image_embeddings/inference/inference.py — Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android. You are receiving this because you authored the thread.

[Butanium]

Does the package use cuda if it's available or is it CPU inference only @rom1504 ?