[FFmpeg-cvslog] avfilter/vf_edgedetect: fix undefined behaviour

[Paul B Mahol]

ffmpeg | branch: master | Paul B Mahol <onemda at gmail.com> | Wed Oct 16 18:06:47 2019 +0200| [932913f0b406814d9c374c5e1a5ab6aa45a53168] | committer: Paul B Mahol

avfilter/vf_edgedetect: fix undefined behaviour

Fixes #8287

> http://git.videolan.org/gitweb.cgi/ffmpeg.git/?a=commit;h=932913f0b406814d9c374c5e1a5ab6aa45a53168
---

 libavfilter/vf_edgedetect.c | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/libavfilter/vf_edgedetect.c b/libavfilter/vf_edgedetect.c
index 25424dbcce..a5614ea63b 100644
--- a/libavfilter/vf_edgedetect.c
+++ b/libavfilter/vf_edgedetect.c
@@ -216,7 +216,7 @@ static int get_rounded_direction(int gx, int gy)
 
         if (gx < 0)
             gx = -gx, gy = -gy;
-        gy <<= 16;
+        gy *= (1 << 16);
         tanpi8gx  =  27146 * gx;
         tan3pi8gx = 158218 * gx;
         if (gy > -tan3pi8gx && gy < -tanpi8gx)  return DIRECTION_45UP;