[FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models

[Maximilian Kaindl]

Hello Yejun Guo,

yes i can do that and submit it in another patch. Do you also have some feedback for the clip backend? I have already made some small changes (cuda accel and new preprocessing) that i will submit along with the other patch, but i would like to hear your thoughts.

Thanks

________________________________
From: ffmpeg-devel <ffmpeg-devel-bounces at ffmpeg.org> on behalf of Guo, Yejun <yejun.guo-at-intel.com at ffmpeg.org>
Sent: Sunday, February 16, 2025 7:09 AM
To: FFmpeg development discussions and patches <ffmpeg-devel at ffmpeg.org>
Subject: Re: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image classification using CLIP models



> -----Original Message-----
> From: ffmpeg-devel <ffmpeg-devel-bounces at ffmpeg.org> On Behalf Of
> m.kaindl0208 at gmail.com
> Sent: Thursday, January 30, 2025 4:33 AM
> To: ffmpeg-devel at ffmpeg.org
> Subject: [FFmpeg-devel] [PATCH] avfilter/dnn: add zero-shot image
> classification using CLIP models
>
> Add a new filter 'dnn_clip' that performs zero-shot image classification using
> CLIP (Contrastive Language-Image Pre-Training) models. The filter supports:

For image classification with new dnn models, we'd better add the new model
support with dnn_classify at https://ffmpeg.org/ffmpeg-filters.html#dnn_005fclassify


_______________________________________________
ffmpeg-devel mailing list
ffmpeg-devel at ffmpeg.org
https://ffmpeg.org/mailman/listinfo/ffmpeg-devel

To unsubscribe, visit link above, or email
ffmpeg-devel-request at ffmpeg.org with subject "unsubscribe".