florence-tool (https://github.com/bigdata-pw/florence-tool) now supports WebDataset! Check it out for efficient batch inference with Florence-2 models
microsoft/Florence-2-large
microsoft/Florence-2-base
Currently running it myself on A40 with CAPTION task and a streaming WebDataset @ 60k images/hour!
microsoft/Florence-2-large
microsoft/Florence-2-base
Currently running it myself on A40 with CAPTION task and a streaming WebDataset @ 60k images/hour!