vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results (numbers changed on 1/8/17 due to a bug fix). See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.44027.93212.14217.84613.72874.55314.03530.33626.34111.04464.45437.94425.83725.33829.34343.743
07/25/142SGBM1Q127.94328.33317.24819.04714.52957.94515.63931.83731.44713.24758.65138.64627.04125.94131.44559.753
07/25/143SGMQ120.83435.5369.573713.84016.53132.12619.04225.83216.7318.954039.83831.13222.62920.72521.33832.235
07/25/144SGBM1F328.44443.5459.093513.63825.94382.05614.43843.44730.3465.983059.35345.85128.54324.93620.13645.945
07/28/146SGBM1H223.83632.93410.84013.63716.23071.25012.62726.63323.0375.832853.84839.24725.63622.83218.83147.448
07/28/147SGMH218.42740.3404.54138.031622.93840.53111.42124.73010.1215.402529.62128.52823.93220.02314.22430.934
07/28/148SGMF325.33745.1484.3396.871332.24850.04113.03148.15118.3337.663429.62036.13931.24824.23524.53950.249
07/28/145Cens5H226.64147.1498.743411.93425.64145.33619.54440.64429.0449.934236.53338.64531.04725.03725.64044.644
08/25/149LPSH219.2286.14145.34239.24227.531696.06012.3259.61159.40195.182292.46027.42724.33323.03310.01425.631
08/27/1410LPSF320.3326.72156.06279.72249.872094.35914.13611.21911.2245.882989.35836.03820.52323.83416.02925.429
08/31/1411BSMQ141.55559.85725.85527.95538.95460.64633.35646.94937.35226.35464.85551.55442.65545.25742.85266.655
09/10/1412LAMC_DSMH226.03855.85411.94114.34318.33444.03518.34139.94329.5456.673131.12634.53528.84426.34230.14435.738
09/18/1413SNCCH221.93548.6506.98309.792525.74246.03912.42636.84016.6307.253223.11634.23426.73921.83019.93528.433
10/07/1414IDRH218.12637.5394.0887.491523.33940.63212.82924.52911.3255.462633.12926.02321.52821.72915.32621.223
11/12/1415LCUQ117.02524.7297.593211.63311.92327.92214.03419.32615.8298.103636.13229.12921.32718.41914.12323.827
01/21/1516TSGOF339.15434.13516.94720.04843.35555.44314.33754.15449.25533.95866.25645.95239.85442.65547.25452.650
04/08/1517REAFH231.44658.35530.95813.13645.35763.84730.95438.74225.3408.603839.33636.84027.04035.55318.23039.741
04/09/1518PFSF332.24765.15929.45712.13550.05870.84928.25144.64823.1387.853537.03437.74227.94236.05419.83435.739
04/17/1519TMAPH216.92420.2264.94198.131812.82530.02411.72227.93420.4355.092131.52723.12020.92519.02018.83218.018
04/19/1520MeshStereoH213.2195.90124.881710.83012.92610.6811.01912.2219.01165.392427.41723.52117.71821.02615.42720.922
08/28/1521MC-CNN-acrtH28.0885.59104.55145.9672.83411.4135.8158.32118.89152.71616.31114.1913.2913.036.40811.19
09/14/1523ELASF332.34850.9519.173611.03133.04988.25818.34047.35026.84211.74541.74037.44123.73128.84563.05842.842
09/14/1522ELASH227.34243.34412.54413.94223.74066.14820.44533.13820.53611.04343.94137.84326.43828.64438.34933.337
09/28/1524R-NCCF348.45826.23014.84530.25630.94672.95241.65977.75864.15827.45659.15271.95850.95833.95178.26080.858
10/13/1525MDPH212.61814.4224.992010.62910.72127.2218.111212.5228.07124.271930.42220.51812.6617.81813.42217.316
11/03/1526MC-CNN+RBSH28.4296.05135.16226.2493.27711.1116.3688.87139.83203.211115.11015.91112.8813.557.0499.995
11/05/1527GCSVRH214.62317.1243.5048.221916.53247.4408.82169.75167.06103.171034.43127.12618.32019.22116.02819.320
11/06/1528SOU4P-netH213.42023.1285.41246.391013.12730.5259.001716.42412.7273.13928.91917.11316.41616.91410.71714.514
12/18/1529INTSH214.52220.2254.52128.622111.62229.52310.71816.42310.3224.692027.61822.51920.72420.52411.51824.928
01/19/1630NTDEH27.4475.72114.36105.9262.83410.465.7145.3075.5482.40313.5714.1812.6713.966.39712.212
01/26/1632MC-CNN-fstH29.47127.35175.07217.18144.711116.8188.47157.3796.9792.82720.71417.41415.41415.1117.901212.613
01/21/1631MCCNN_LayoutH28.94115.5395.63255.0623.591012.6157.23107.53108.86145.792723.01513.6715.01214.795.85310.46
02/18/1633LS-ELASF336.75153.55210.33915.84537.05283.65724.54949.15234.64813.94844.94245.75034.95129.14664.45962.754
03/15/1634MPSVQ143.55658.85633.96034.25837.95352.44230.85356.85651.05730.65756.94951.55544.65643.45644.25354.251
04/03/1635ICSGF345.65769.76019.14921.35043.65677.65436.95765.35740.45320.34953.64758.75746.55747.15860.75679.157
04/12/1636MeshStereoExtH27.0854.4143.9875.4053.17610.056.2374.6254.7763.491312.7512.4510.4414.587.80118.853
04/13/1637GlstereoH219.83120.7278.253313.94118.63534.62712.93025.43123.2398.613931.12530.63120.32225.44021.13722.726
04/24/1638HLSC_corH226.03926.53115.24621.04920.53635.72823.44833.13935.04911.94639.13534.23325.23532.85028.34222.725
04/27/1639JEMQ137.25235.73727.95630.65733.25043.03431.45549.55347.35426.55549.64446.05335.75230.84737.54855.852
05/12/1640PMSCH26.7133.4612.6816.1982.5416.9214.5423.9624.0432.37213.1612.3412.2516.2125.88410.87
05/28/1641APAP-StereoH27.2665.4364.91185.1135.171221.6206.9994.3134.2353.241214.399.7827.32213.446.3068.462
07/03/1642LPUH210.41311.4193.1838.10176.081420.9198.24136.9484.0024.041733.93016.91215.21317.8179.121311.610
08/31/1643SEDF363.45954.35322.45472.96164.56071.45142.56080.15967.95949.86179.65774.45965.46155.15986.16191.661
09/13/1644SNP-RSMH28.75105.4684.85166.50113.37810.477.31118.73129.37183.581414.3814.71014.91112.8210.11510.88
09/20/1645LFSIRQ170.16175.76160.36167.15972.46180.85553.76185.46183.86142.56091.25990.46064.16071.36161.55790.360
10/19/1646LW-CNNH27.0444.6553.9555.3042.63211.2125.4134.3244.2242.43412.2313.4613.61014.8104.72112.011
10/23/1647SIGMRFQ164.26060.05833.05967.96063.25999.56139.85884.86082.06035.25995.26191.56158.15965.86055.05588.659
11/06/1648SPSF319.63014.22112.34314.94412.02415.81619.14317.42515.4288.233730.92334.83630.64625.33828.34128.032
11/14/1649PKLSH211.0147.80184.561510.2275.62139.7548.31149.19148.39134.211830.92417.51516.91717.11512.22115.315
11/15/1650MC-CNN-SSH212.11614.8237.203111.1327.621715.91711.82311.5209.01163.891619.71320.51716.31516.31312.12018.319
11/15/1651UCNNH220.53344.8479.773813.63818.23336.52912.82823.42812.4269.224139.53730.53024.83421.22819.13332.336
11/16/1652MCSCF311.31513.3205.962610.6288.69187.22211.32010.6177.48113.0783.10125.22219.02117.21610.31625.530
11/24/1653ADSMQ138.75340.44120.35227.35435.15155.94422.34756.15550.95624.25358.05056.35636.55332.14938.75169.756
01/03/1754SLACH219.32936.1386.53289.892621.93739.13011.82429.03517.9327.643340.23926.52421.12619.42215.02519.521
01/15/1755IGFQ134.05042.74220.15123.75232.24745.63828.65243.04637.25121.45150.94644.74934.75031.94837.44747.147
01/24/17563DMSTH25.9213.7122.7824.7512.7237.3634.2813.4413.7612.35112.6411.538.56314.075.3528.874
03/09/1757SGMEPiF313.9216.92166.71299.47239.721911.81413.63210.91810.6235.262332.82826.92522.73022.73112.01921.724
03/10/1758MC-CNN+TDSRF36.3525.4574.45116.80123.46910.796.0565.0165.1972.62510.829.6216.59111.416.0157.041
03/22/1759JMRH212.5174.0933.9768.44206.931511.11013.83319.52719.0343.661517.01218.21618.01921.0277.291017.817
03/23/1760DSGCAQ133.84942.94320.95323.65130.24545.53727.65042.04536.05021.05050.24544.24833.34934.65238.45046.846
04/04/1761DDLQ130.14544.34619.45025.85328.34442.13321.14637.14128.74321.75246.84336.03730.34528.44332.74637.540

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: January 8 2017 by Daniel Scharstein