[FFmpeg-devel] [PATCH 10/10] avutil/common: Fix undefined shift

Andreas Rheinhardt andreas.rheinhardt at gmail.com
Wed Sep 18 06:26:07 EEST 2019


av_mod_uintp2_c uses a bitwise AND with (1 << p) - 1 to clear the high
bits of an unsigned int. But this is undefined if p == 31, because 1 is
an int and 2^31 is not representable in an int. So make 1 unsigned.

Signed-off-by: Andreas Rheinhardt <andreas.rheinhardt at gmail.com>
---
 libavutil/common.h | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/libavutil/common.h b/libavutil/common.h
index 8db0291170..af35397eb9 100644
--- a/libavutil/common.h
+++ b/libavutil/common.h
@@ -240,7 +240,7 @@ static av_always_inline av_const unsigned av_clip_uintp2_c(int a, int p)
  */
 static av_always_inline av_const unsigned av_mod_uintp2_c(unsigned a, unsigned p)
 {
-    return a & ((1 << p) - 1);
+    return a & ((1U << p) - 1);
 }
 
 /**
-- 
2.20.1



More information about the ffmpeg-devel mailing list