vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results (numbers changed on 1/8/17 due to a bug fix). See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.44127.93312.14317.84713.72974.55614.03630.33726.34211.04564.45737.94525.83825.33929.34443.744
07/25/142SGBM1Q127.94428.33417.25019.04814.53057.94715.64031.83831.44813.24858.65338.64727.04225.94231.44659.754
07/25/143SGMQ120.83535.5379.573813.84116.53232.12719.04325.83316.7328.954139.83931.13322.63020.72621.33932.236
07/25/144SGBM1F328.44543.5469.093613.63925.94482.05914.43943.44830.3475.983159.35545.85228.54424.93720.13745.946
07/28/146SGBM1H223.83732.93510.84113.63816.23171.25212.62826.63423.0385.832953.85039.24825.63722.83318.83247.449
07/28/147SGMH218.42840.3414.54148.031722.93940.53211.42224.73110.1225.402629.62228.52923.93320.02414.22530.935
07/28/148SGMF325.33845.1494.33106.871432.24950.04213.03248.15218.3347.663529.62136.14031.24924.23624.54050.250
07/28/145Cens5H226.64247.1518.743511.93525.64245.33719.54540.64529.0459.934336.53438.64631.04825.03825.64144.645
08/25/149LPSH219.2296.14155.34249.24237.531796.06312.3269.61169.40205.182392.46327.42824.33423.03410.01525.632
08/27/1410LPSF320.3336.72166.06289.72259.872194.36214.13711.22011.2255.883089.36136.03920.52423.83516.03025.430
08/31/1411BSMQ141.55859.85925.85827.95738.95760.64833.35846.95037.35426.35664.85851.55542.65745.25942.85366.657
09/10/1412LAMC_DSMH226.03955.85611.94214.34418.33544.03618.34239.94429.5466.673231.12734.53628.84526.34330.14535.739
09/18/1413SNCCH221.93648.6526.98319.792625.74346.04012.42736.84116.6317.253323.11734.23526.74021.83119.93628.434
10/07/1414IDRH218.12737.5404.0897.491623.34040.63312.83024.53011.3265.462733.13026.02421.52921.73015.32721.224
11/12/1415LCUQ117.02624.7307.593311.63411.92427.92314.03519.32715.8308.103736.13329.13021.32818.42014.12423.828
01/21/1516TSGOF339.15534.13616.94920.04943.35855.44514.33854.15649.25733.96166.25945.95339.85642.65747.25652.651
04/08/1517REAFH231.44758.35730.96113.13745.36063.84930.95638.74325.3418.603939.33736.84127.04135.55418.23139.742
04/09/1518PFSF332.24865.16129.46012.13650.06170.85128.25244.64923.1397.853637.03537.74327.94336.05619.83535.740
04/17/1519TMAPH216.92520.2274.94208.131912.82630.02511.72327.93520.4365.092231.52823.12120.92619.02118.83318.019
04/19/1520MeshStereoH213.2205.90134.881810.83112.92710.6911.02012.2229.01175.392527.41823.52217.71921.02715.42820.923
08/28/1521MC-CNN-acrtH28.0895.59114.55155.9682.83511.4145.8168.32128.89162.71716.31214.11013.21013.036.40911.110
09/14/1523ELASF332.34950.9539.173711.03233.05088.26118.34147.35126.84311.74641.74137.44223.73228.84663.06142.843
09/14/1522ELASH227.34343.34512.54513.94323.74166.15020.44633.13920.53711.04443.94237.84426.43928.64538.35033.338
09/28/1524R-NCCF348.46126.23114.84730.25830.94772.95541.66277.76164.16127.45959.15471.96150.96133.95278.26380.861
10/13/1525MDPH212.61914.4234.992110.63010.72227.2228.111312.5238.07134.272030.42320.51912.6717.81913.42317.317
11/03/1526MC-CNN+RBSH28.42106.05145.16236.24103.27811.1126.3698.87149.83213.211215.11115.91212.8913.557.04109.996
11/05/1527GCSVRH214.62417.1253.5058.222016.53347.4418.82179.75177.06113.171134.43227.12718.32119.22216.02919.321
11/06/1528SOU4P-netH213.42123.1295.41256.391113.12830.5269.001816.42512.7283.131028.92017.11416.41716.91510.71814.515
12/18/1529INTSH214.52320.2264.52138.622211.62329.52410.71916.42410.3234.692127.61922.52020.72520.52511.51924.929
01/19/1630NTDEH27.4485.72124.36115.9272.83510.475.7155.3085.5492.40413.5814.1912.6813.966.39812.213
01/26/1632MC-CNN-fstH29.47137.35185.07227.18154.711216.8198.47167.37106.97102.82820.71517.41515.41515.1127.901312.614
01/21/1631MCCNN_LayoutH28.94125.53105.63265.0633.591112.6167.23117.53118.86155.792823.01613.6815.01314.7105.85410.47
02/18/1633LS-ELASF336.75253.55410.34015.84637.05483.66024.55049.15334.65013.94944.94345.75134.95229.14764.46262.755
03/15/1634MPSVQ143.55958.85833.96334.26137.95652.44330.85556.85851.05930.66056.95151.55644.65943.45844.25454.252
04/03/1635ICSGF345.66069.76219.15121.35243.65977.65736.95965.36040.45520.35153.64958.76046.56047.16160.75979.160
04/12/1636MeshStereoExtH27.0864.4153.9885.4063.17710.066.2384.6264.7773.491412.7612.4610.4514.597.80128.853
04/13/1637GlstereoH219.83220.7288.253413.94218.63634.62812.93125.43223.2408.614031.12630.63220.32325.44121.13822.727
04/24/1638HLSC_corH226.04026.53215.24821.05020.53735.72923.44933.14035.05111.94739.13634.23425.23632.85128.34322.726
04/27/1639JEMQ137.25335.73827.95930.65933.25143.03531.45749.55447.35626.55849.64546.05435.75330.84837.54955.853
05/12/1640PMSCH26.7143.4612.6816.1992.5426.9224.5433.9634.0442.37313.1712.3512.2616.2135.88510.88
05/28/1641APAP-StereoH27.2675.4374.91195.1145.171321.6216.99104.3144.2363.241314.3109.7837.32213.446.3078.462
07/03/1642LPUH210.41411.4203.1848.10186.081520.9208.24146.9494.0034.041833.93116.91315.21417.8189.121411.611
08/31/1643SEDF363.46254.35522.45672.96464.56371.45342.56380.16267.96249.86479.66074.46265.46455.16286.16491.664
09/13/1644SNP-RSMH28.75115.4694.85176.50123.37910.487.31128.73139.37193.581514.3914.71114.91212.8210.11610.89
09/20/1645LFSIRQ170.16475.76460.36467.16272.46480.85853.76485.46483.86442.56391.26290.46364.16371.36461.56090.363
10/19/1646LW-CNNH27.0454.6563.9565.3052.63311.2135.4144.3254.2252.43512.2413.4713.61114.8114.72112.012
10/23/1647SIGMRFQ164.26360.06033.06267.96363.26299.56439.86184.86382.06335.26295.26491.56458.16265.86355.05888.662
11/06/1648SPSF319.63114.22212.34414.94512.02515.81719.14417.42615.4298.233830.92434.83730.64725.33928.34228.033
11/14/1649PKLSH211.0157.80194.561610.2285.62149.7558.31159.19158.39144.211930.92517.51616.91817.11612.22215.316
11/15/1650MC-CNN-WSH212.11714.8247.203211.1337.621815.91811.82411.5219.01173.891719.71420.51816.31616.31412.12118.320
11/15/1651UCNNH220.53444.8489.773913.63918.23436.53012.82923.42912.4279.224239.53830.53124.83521.22919.13432.337
11/16/1652MCSCF311.31613.3215.962710.6298.69197.22311.32110.6187.48123.0793.10125.22319.02217.21710.31725.531
11/24/1653ADSMQ138.75440.44220.35427.35635.15355.94622.34856.15750.95824.25558.05256.35936.55432.15038.75269.758
01/03/1754SLACH219.33036.1396.53299.892721.93839.13111.82529.03617.9337.643440.24026.52521.12719.42315.02619.522
01/15/1755IGFQ134.05142.74320.15323.75432.24845.63928.65443.04737.25321.45350.94744.75034.75131.94937.44847.148
01/24/17563DMSTH25.9223.7132.7824.7522.7247.3644.2823.4413.7622.35212.6511.548.56314.075.3528.874
03/09/1757SGMEPiF313.9226.92176.71309.47249.722011.81513.63310.91910.6245.262432.82926.92622.73122.73212.02021.725
03/10/1758MC-CNN+TDSRF36.3535.4584.45126.80133.461010.7106.0575.0175.1982.62610.839.6216.59111.416.0167.041
03/22/1759JMRH212.5184.0943.9778.44216.931611.11113.83419.52819.0353.661617.01318.21718.02021.0287.291117.818
03/23/1760DSGCAQ133.85042.94420.95523.65330.24645.53827.65142.04636.05221.05250.24644.24933.35034.65338.45146.847
04/04/1761DDLQ130.14644.34719.45225.85528.34542.13421.14737.14228.74421.75446.84436.03830.34628.44432.74737.541
05/23/1762r200highH240.95670.56314.44621.35137.75572.25438.16053.25531.44818.35052.44852.65744.15845.46050.75766.556
06/14/1763DoGGuidedQ141.45745.45023.65730.66034.65252.54428.35359.15953.86026.45760.65654.75838.35535.55544.55572.059
06/22/1764LocalExpH25.4313.6522.8732.9811.9915.5913.3713.4823.3512.05110.329.7528.57414.485.4039.555

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: January 8 2017 by Daniel Scharstein