florence-tool (https://github.com/bigdata-pw/florence-tool) now supports WebDataset! Check it out for efficient batch inference with Florence-2 models
microsoft/Florence-2-large

microsoft/Florence-2-base


Currently running it myself on A40 with CAPTION task and a streaming WebDataset @ 60k images/hour!

GitHub

GitHub - bigdata-pw/florence-tool: The Florence Tool CLI provides a command-line interface for processing images using the Florence…

The Florence Tool CLI provides a command-line interface for processing images using the Florence-2 model. This tool allows users to apply various visual and text-based tasks, such as object detecti...