Optical flow evaluation results: Average interpolation error

Optical flow evaluation results

Statistics: Average SD R2.5 R5.0 R10.0 A90 A95 A99
Error type: angle endpoint interpolation normalized interpolation

Average interpolation error	avg.	Mequon (Hidden texture) im0 GT im1			Schefflera (Hidden texture) im0 GT im1			Urban (Synthetic) im0 GT im1			Teddy (Stereo) im0 GT im1			Backyard (High-speed camera) im0 GT im1			Basketball (High-speed camera) im0 GT im1			Dumptruck (High-speed camera) im0 GT im1			Evergreen (High-speed camera) im0 GT im1
	rank	all	disc	untext	all	disc	untext	all	disc	untext	all	disc	untext	all	disc	untext	all	disc	untext	all	disc	untext	all	disc	untext
CBF [12]	4.6	2.83 1	5.20 1	1.23 9	3.97 8	5.79 7	1.56 8	3.62 1	5.47 1	1.60 2	5.21 1	7.12 1	3.29 9	10.1 1	12.6 1	3.62 11	5.97 4	11.5 4	2.31 4	7.76 4	17.8 4	1.61 4	7.60 4	11.9 4	1.76 16
Aniso. Huber-L1 [25]	6.0	2.95 3	5.44 3	1.24 10	4.42 16	6.27 16	1.67 17	3.79 2	5.70 4	1.50 1	5.31 2	7.42 4	3.24 8	11.1 11	14.0 13	3.61 8	5.91 2	11.4 2	2.24 1	7.60 1	17.3 1	1.51 1	7.62 6	11.9 4	1.73 8
Second-order prior [8]	7.1	2.91 2	5.39 2	1.24 10	4.26 13	6.21 13	1.56 8	3.82 4	6.34 14	1.62 3	5.39 5	7.68 6	3.04 1	11.1 11	13.9 11	3.59 4	6.14 6	11.9 6	2.31 4	7.61 2	17.4 2	1.63 6	7.90 9	12.4 11	1.78 17
Brox et al. [5]	7.5	3.08 8	5.94 11	1.21 3	3.83 4	5.67 5	1.45 3	3.93 5	5.76 6	1.67 4	5.32 3	7.19 2	3.22 6	10.6 3	13.4 4	3.56 1	6.60 18	12.7 15	2.42 15	8.61 14	19.7 16	3.04 28	7.43 3	11.6 3	1.68 1
Spatially variant [19]	7.8	2.95 3	5.60 4	1.21 3	4.25 12	6.22 15	1.64 15	4.40 13	5.82 7	2.52 12	5.67 10	7.60 5	3.89 24	10.9 7	13.7 8	3.64 13	5.93 3	11.4 2	2.28 2	7.89 5	17.9 5	1.64 7	7.40 2	11.5 1	1.73 8
Occlusion bounds [26]	8.8	3.07 7	5.87 8	1.22 6	3.84 5	5.66 4	1.48 5	4.05 7	5.74 5	1.84 7	5.38 4	7.40 3	3.12 3	10.6 3	13.3 3	3.56 1	6.81 26	13.1 21	2.38 12	9.50 25	21.3 22	4.51 30	7.37 1	11.5 1	1.68 1
F-TV-L1 [15]	9.1	3.30 18	6.36 15	1.29 23	4.39 15	6.32 18	1.62 13	3.80 3	5.90 9	1.76 5	5.61 9	7.97 9	3.31 10	10.9 7	13.6 6	3.59 4	5.84 1	11.2 1	2.33 7	7.70 3	17.6 3	1.79 13	7.61 5	11.9 4	1.78 17
Filter Flow [20]	12.2	3.13 10	5.90 10	1.28 21	4.56 22	6.38 19	1.85 24	4.22 10	6.28 12	2.10 11	5.91 14	7.97 9	3.44 15	10.4 2	13.1 2	3.69 14	6.43 10	12.5 11	2.40 13	8.17 9	18.8 10	1.62 5	7.94 11	12.4 11	1.78 17
Fusion [6]	12.7	3.04 6	5.86 7	1.22 6	3.75 3	5.47 3	1.42 2	4.08 8	5.55 2	3.08 14	5.80 12	8.10 11	3.19 4	11.4 16	14.3 16	3.73 17	6.99 28	13.7 28	2.60 26	8.40 13	19.4 14	1.65 9	8.50 17	13.3 18	1.80 24
DPOF [18]	12.7	3.46 22	7.17 26	1.25 13	3.40 1	4.93 1	1.30 1	5.54 17	8.42 27	3.64 17	5.58 8	8.31 14	3.19 4	11.4 16	14.3 16	3.74 18	6.46 11	12.5 11	2.36 8	8.07 7	18.5 8	1.87 15	8.38 15	13.1 16	1.74 12
Black & Anandan [4]	12.9	3.22 15	5.87 8	1.30 24	4.82 27	6.55 23	1.78 22	7.16 22	7.10 21	3.93 18	6.25 18	8.49 17	3.35 11	10.9 7	13.7 8	3.56 1	6.33 8	12.2 8	2.37 11	8.23 10	18.6 9	1.64 7	7.67 7	11.9 4	1.69 3
Horn & Schunck [3]	14.2	3.16 13	5.83 6	1.26 17	4.91 28	6.65 26	1.92 25	6.13 19	6.85 19	3.53 16	6.80 22	9.10 20	3.57 19	10.9 7	13.7 8	3.59 4	6.16 7	11.9 6	2.32 6	8.63 16	19.5 15	1.84 14	7.91 10	12.3 9	1.73 8
2D-CLG [1]	14.2	3.01 5	5.65 5	1.28 21	4.59 24	6.17 11	1.95 27	5.18 14	6.06 10	3.15 15	6.01 17	7.88 7	3.97 25	11.4 16	14.4 18	4.69 31	5.98 5	11.5 4	2.45 18	8.89 19	20.5 20	1.67 10	7.74 8	12.0 8	1.71 4
Multicue MRF [21]	14.8	3.13 10	6.13 14	1.21 3	3.59 2	5.30 2	1.52 7	6.72 21	6.31 13	4.73 24	5.79 11	8.35 15	3.77 23	11.4 16	14.4 18	3.81 19	6.74 24	13.1 21	2.36 8	8.27 11	19.0 12	3.19 29	8.51 18	13.4 20	1.75 13
Classic+Area [31]	15.0	3.29 17	6.69 20	1.20 1	4.37 14	6.31 17	1.63 14	4.24 11	6.34 14	1.87 8	5.47 6	8.12 12	3.37 13	11.5 22	14.5 22	4.43 26	6.71 21	13.1 21	2.40 13	8.70 17	20.1 18	1.56 2	8.68 22	13.6 23	1.72 5
Complementary OF [24]	15.7	3.48 23	7.32 27	1.20 1	3.89 6	5.96 8	1.45 3	8.94 27	6.94 20	5.45 28	6.33 20	10.0 25	3.09 2	11.3 15	14.2 15	4.24 25	6.33 8	12.3 10	2.42 15	8.62 15	19.3 13	1.75 11	9.07 27	14.3 27	1.72 5
Adaptive [23]	15.8	3.24 16	6.44 17	1.25 13	4.57 23	6.61 25	1.72 20	3.94 6	6.12 11	1.81 6	5.86 13	8.66 18	3.47 17	11.6 25	14.6 25	3.59 4	6.55 13	12.7 15	2.51 23	9.03 20	20.6 21	1.59 3	8.13 13	12.7 14	1.78 17
TV-L1-improved [17]	16.0	3.09 9	6.03 12	1.25 13	4.55 21	6.59 24	1.70 19	5.88 18	5.66 3	4.09 20	5.53 7	7.88 7	3.22 6	11.4 16	14.4 18	3.61 8	6.73 22	13.1 21	2.51 23	9.48 24	22.1 25	1.94 17	8.25 14	12.9 15	1.79 23
GraphCuts [14]	16.3	3.65 27	7.01 23	1.27 18	3.89 6	5.71 6	1.59 11	7.54 23	5.84 8	4.31 22	5.98 16	8.42 16	3.45 16	11.4 16	14.4 18	4.09 24	6.56 14	12.8 18	2.30 3	8.70 17	20.2 19	1.98 19	8.59 21	13.5 22	1.73 8
NL-TV-NCC [29]	16.7	3.37 20	6.58 19	1.24 10	4.23 11	6.41 20	1.49 6	4.39 12	6.68 18	2.07 10	7.19 25	11.2 27	3.35 11	10.7 5	13.4 4	4.00 23	6.95 27	13.4 27	2.44 17	9.06 21	20.0 17	2.13 22	8.42 16	13.1 16	1.78 17
TI-DOFE [28]	16.9	3.41 21	6.44 17	1.44 29	5.20 29	6.82 30	2.01 29	4.19 9	6.41 16	1.88 9	6.98 24	9.50 24	3.70 21	10.8 6	13.6 6	3.61 8	6.59 16	12.8 18	2.36 8	8.13 8	18.2 6	1.77 12	8.53 19	12.4 11	2.33 30
Dynamic MRF [7]	18.7	3.19 14	6.41 16	1.22 6	4.11 9	6.21 13	1.56 8	5.37 16	7.35 22	2.70 13	6.74 21	9.18 21	4.19 26	11.1 11	13.9 11	4.48 27	7.02 29	13.7 28	2.62 27	9.26 22	21.4 23	2.23 23	8.57 20	13.3 18	1.80 24
Learning Flow [11]	19.9	3.14 12	6.09 13	1.27 18	4.51 19	6.53 22	1.67 17	11.5 31	12.9 31	7.17 31	6.31 19	8.30 13	3.66 20	11.7 26	14.8 26	3.89 20	6.59 16	12.8 18	2.48 20	8.27 11	18.9 11	1.96 18	8.68 22	13.4 20	1.80 24
FOLKI [16]	20.1	3.64 26	7.12 24	1.65 30	5.22 30	6.72 28	2.36 30	5.20 15	8.08 26	3.96 19	7.93 26	9.33 22	5.52 29	11.2 14	14.0 13	3.70 15	6.56 14	12.6 13	2.74 31	8.00 6	18.2 6	2.88 27	7.96 12	12.3 9	1.78 17
Rannacher [27]	20.2	3.31 19	6.72 21	1.25 13	4.60 25	6.66 27	1.72 20	6.36 20	6.54 17	4.25 21	5.91 14	8.87 19	3.49 18	11.5 22	14.5 22	3.63 12	6.73 22	13.1 21	2.53 25	9.35 23	21.7 24	1.98 19	8.70 24	13.7 24	1.75 13
SegOF [10]	23.0	3.51 24	7.12 24	1.32 25	4.17 10	6.10 9	1.59 11	8.69 26	7.75 24	5.15 25	8.58 29	14.3 30	4.29 27	11.7 26	14.8 26	4.50 28	6.79 25	13.2 26	2.50 21	10.1 28	23.5 28	2.55 25	8.80 25	13.8 25	1.72 5
SPSA-learn [13]	23.0	3.89 28	7.79 28	1.27 18	4.43 17	6.17 11	1.81 23	9.03 28	8.47 28	5.47 29	6.80 22	9.40 23	3.72 22	11.5 22	14.5 22	3.91 21	6.51 12	12.6 13	2.46 19	11.9 31	27.9 31	4.54 31	10.5 30	16.5 30	1.75 13
STOB [22]	24.2	3.51 24	6.96 22	1.41 28	4.72 26	6.10 9	1.98 28	9.84 29	7.59 23	5.20 26	7.98 27	11.0 26	6.14 30	11.8 28	14.9 28	3.71 16	6.60 18	12.7 15	2.50 21	9.87 27	22.8 27	2.08 21	8.94 26	14.0 26	2.03 29
Bipartite [30]	26.8	4.45 30	9.08 30	1.39 27	4.48 18	6.75 29	1.66 16	8.66 24	7.95 25	5.34 27	8.27 28	13.8 29	3.40 14	12.5 29	15.8 29	4.62 30	8.91 31	17.6 31	2.73 30	11.2 30	26.4 30	2.78 26	9.17 28	14.4 28	1.80 24
GroupFlow [9]	27.0	4.94 31	10.2 31	1.36 26	4.51 19	6.50 21	1.92 25	8.67 25	9.13 30	4.38 23	8.83 30	13.0 28	5.40 28	12.9 30	16.3 30	4.53 29	7.89 30	15.5 30	2.65 29	9.85 26	22.6 26	1.91 16	9.52 29	14.9 29	1.88 28
Pyramid LK [2]	28.2	4.16 29	8.44 29	1.74 31	5.83 31	6.82 30	2.76 31	11.4 30	8.60 29	5.89 30	12.4 31	16.7 31	7.03 31	14.3 31	18.1 31	3.92 22	6.69 20	12.2 8	2.63 28	10.3 29	24.0 29	2.45 24	11.1 31	17.4 31	2.55 31

Move the mouse over the numbers in the table to see the corresponding images. Click to compare with the ground truth.

Mequon - Ground-truth interpolation

References

Method	time*	frames	color	Reference and notes
[1] 2D-CLG	844	2	gray	The 2D-CLG method by Bruhn et al. as implemented by Stefan Roth. [A. Bruhn, J. Weickert, and C. Schnörr. Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. IJCV 63(3), 2005.] Parameters were set to match the published performance on Yosemite sequence, which may not be optimal for other sequences.
[2] Pyramid LK	12	2	color	A modification of Bouguet's pyramidal implementation of Lucas-Kanade.
[3] Horn & Schunck	49	2	gray	A modern Matlab implementation of the Horn & Schunck method by Deqing Sun. Parameters set to optimize AAE on all training data.
[4] Black & Anandan	328	2	gray	A modern Matlab implementation of the Black & Anandan method by Deqing Sun.
[5] Brox et al.	18	2	color	T. Brox, A. Bruhn, N. Papenberg, and J. Weickert. High accuracy optical flow estimation based on a theory for warping. ECCV 2004. (Improved using separate robust functions as proposed in A. Bruhn and J. Weickert, Towards ultimate motion estimation, ICCV 2005; improved by training on the training set.)
[6] Fusion	2,666	2	color	V. Lempitsky, S. Roth, and C. Rother. Discrete-continuous optimization for optical flow estimation. CVPR 2008.
[7] Dynamic MRF	366	2	gray	B. Glocker, N. Paragios, N. Komodakis, G. Tziritas, and N. Navab. Optical flow estimation with uncertainties through dynamic MRFs. CVPR 2008. (Method improved since publication.)
[8] Second-order prior	14	2	gray	W. Trobin, T. Pock, D. Cremers, and H. Bischof. An unbiased second-order prior for high-accuracy motion estimation. DAGM 2008. (Method improved since publication; for details see W. Trobin, Ph.D. thesis, 2009.)
[9] GroupFlow	600	2	gray	X. Ren. Local Grouping for Optical Flow. CVPR 2008.
[10] SegOF	60	2	color	L. Xu, J. Chen, and J. Jia. Segmentation based variational model for accurate optical flow estimation. ECCV 2008.
[11] Learning Flow	825	2	gray	D. Sun, S. Roth, J.P. Lewis, and M. Black. Learning optical flow (SRF-LFC). ECCV 2008.
[12] CBF	69	2	color	W. Trobin, T. Pock, D. Cremers, and H. Bischof. Continuous energy minimization via repeated binary fusion. ECCV 2008. (Method improved since publication; for details see W. Trobin, Ph.D. thesis, 2009.)
[13] SPSA-learn	200	2	color	Y. Li and D. Huttenlocher. Learning for optical flow using stochastic optimization. ECCV 2008.
[14] GraphCuts	1,200	2	color	T. Cooke. Two applications of graph-cuts to image processing. DICTA 2008.
[15] F-TV-L1	8	2	gray	A. Wedel, T. Pock, J. Braun, U. Franke, and D. Cremers. Duality TV-L1 flow with fundamental matrix prior. IVCNZ 2008.
[16] FOLKI	1.4	2	gray	G. Le Besnerais and F. Champagnat. Dense optical flow by iterative local window registration. ICIP 2005.
[17] TV-L1-improved	2.9	2	gray	A. Wedel, T. Pock, C. Zach, H. Bischof, and D. Cremers. An improved algorithm for TV-L1 optical flow computation. Proceedings of the Dagstuhl Visual Motion Analysis Workshop 2008. Code at GPU4Vision.
[18] DPOF	261	2	color	C. Lei and Y.-H. Yang. Optical flow estimation on coarse-to-fine region-trees using discrete optimization. ICCV 2009.
[19] Spatially variant	2,100	2	color	Anonymous. Optical flow estimation with spatially-variant smoothness constraint. ICCV 2009 submission 1860.
[20] Filter Flow	34,000	2	color	S. Seitz and S. Baker. Filter flow. ICCV 2009.
[21] Multicue MRF	13,240	2	color	Anonymous. Optical flow estimation using discrete optimization with multi-cue weighted correlation and occlusion handling. ICCV 2009 submission 766.
[22] STOB	1,080	2	gray	Anonymous. Stochastic uncertainty models for motion estimation. ICCV 2009 submission 1000.
[23] Adaptive	9.2	2	gray	A. Wedel, D. Cremers, T. Pock, and H. Bischof. Structure- and motion-adaptive regularization for high accuracy optic flow. ICCV 2009.
[24] Complementary OF	44	2	color	H. Zimmer, A. Bruhn, J. Weickert, L. Valgaerts, A. Salgado, B. Rosenhahn, and H.-P. Seidel. Complementary optic flow. EMMCVPR 2009.
[25] Aniso. Huber-L1	2	2	gray	M. Werlberger, W. Trobin, T. Pock, A. Wedel, D. Cremers, and H. Bischof. Anisotropic Huber-L1 optical flow. BMVC 2009. Code at GPU4Vision.
[26] Occlusion bounds	300	3	color	Anonymous. Occlusion boundaries. NIPS 2009 submission 245.
[27] Rannacher	0.12	2	gray	J. Rannacher. Realtime 3D motion estimation on graphics hardware. Bachelor thesis, Heidelberg University, 2009.
[28] TI-DOFE	260	2	gray	C. Cassisa, S. Simoens, and V. Prinet. Two-frame optical flow formulation in an unwarped multiresolution scheme. CIARP 2009.
[29] NL-TV-NCC	20	2	color	Anonymous. Motion estimation with non-local total variation regularization. CVPR 2010 submission 778.
[30] Bipartite	120	2	gray	Anonymous. Dynamic bipartite matching. CVPR 2010 submission 69.
[31] Classic+Area	791	2	gray	Anonymous. Secrets of optical flow estimation and their principles. CVPR 2010 submission 477.

* The "time" column lists the reported runtime in seconds on the "Urban" sequence. Note that these runtimes are not normalized by processor speed or type.