[FFmpeg-cvslog] rv40: prevent undefined signed overflow in rv40_loop_filter()

Janne Grunau git at videolan.org
Wed Feb 15 02:14:05 CET 2012


ffmpeg | branch: master | Janne Grunau <janne-libav at jannau.net> | Mon Feb 13 22:12:54 2012 +0100| [b54b40b33cd77fb135ae678c7726a1f8636e4b3e] | committer: Janne Grunau

rv40: prevent undefined signed overflow in rv40_loop_filter()

> http://git.videolan.org/gitweb.cgi/ffmpeg.git/?a=commit;h=b54b40b33cd77fb135ae678c7726a1f8636e4b3e
---

 libavcodec/rv40.c |    5 +++--
 1 files changed, 3 insertions(+), 2 deletions(-)

diff --git a/libavcodec/rv40.c b/libavcodec/rv40.c
index c55a07a..04cc4bc 100644
--- a/libavcodec/rv40.c
+++ b/libavcodec/rv40.c
@@ -357,7 +357,7 @@ static void rv40_loop_filter(RV34DecContext *r, int row)
      * in addition to the coded ones because because they lie at the edge of
      * 8x8 block with different enough motion vectors
      */
-    int mvmasks[4];
+    unsigned mvmasks[4];
 
     mb_pos = row * s->mb_stride;
     for(mb_x = 0; mb_x < s->mb_width; mb_x++, mb_pos++){
@@ -373,7 +373,8 @@ static void rv40_loop_filter(RV34DecContext *r, int row)
         int c_v_deblock[2], c_h_deblock[2];
         int clip_left;
         int avail[4];
-        int y_to_deblock, c_to_deblock[2];
+        unsigned y_to_deblock;
+        int c_to_deblock[2];
 
         q = s->current_picture_ptr->f.qscale_table[mb_pos];
         alpha = rv40_alpha_tab[q];



More information about the ffmpeg-cvslog mailing list