vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.44827.93912.15017.85413.73574.56914.04230.34426.34911.05264.46937.95225.84525.34629.35143.752
07/25/142SGBM1Q127.95128.34017.25719.05514.53757.95915.64731.84531.45513.25558.66538.65427.04925.94931.45359.764
07/25/143SGMQ120.84235.5439.574513.84816.53932.13419.05025.84016.7388.954839.84731.14022.63620.73221.34632.243
07/25/144SGBM1F328.45243.5569.094313.64625.95182.07214.44643.45630.3545.983859.36745.86228.55124.94420.14445.954
07/28/146SGBM1H223.84432.94110.84813.64516.23871.26512.63426.64123.0445.833653.86239.25525.64422.84018.83947.457
07/28/147SGMH218.43440.3484.54198.032322.94640.53911.42824.73710.1275.403329.62828.53523.93920.03014.23130.942
07/28/148SGMF325.34545.1594.33156.871932.26050.05313.03848.16118.3407.664229.62736.14731.25624.24324.54750.259
07/28/145Cens5H226.64947.1618.744211.94225.64945.34619.55240.65329.0529.935036.54138.65331.05525.04525.64844.653
08/25/149LPSH219.2366.14215.34309.24317.532396.07612.3329.61199.40235.182992.47627.43424.34023.04110.02025.638
08/27/1410LPSF320.3406.72226.06349.72339.872794.37514.14311.22511.2305.883789.37436.04620.53023.84216.03625.436
08/31/1411BSMQ141.57059.87225.86927.96738.96960.66033.36946.95937.36326.36864.87051.56642.66945.27142.86566.668
09/10/1412LAMC_DSMH226.04655.86911.94914.35118.34244.04418.34939.95229.5536.673931.13234.54328.85226.35030.15235.746
09/18/1413SNCCH221.94348.6646.98379.793425.75046.04912.43336.84916.6377.254023.12334.24226.74721.83719.94328.441
10/07/1414IDRH218.13337.5474.08127.492223.34740.64012.83624.53511.3315.463433.13626.03021.53521.73615.33321.230
11/12/1415LCUQ117.03224.7367.594011.64111.93027.92914.04119.33215.8368.104436.14029.13621.33418.42614.13023.834
01/21/1516TSGOF339.16634.14216.95620.05643.37055.45714.34454.16649.26733.97366.27145.96339.86842.66947.26852.661
04/08/1517REAFH231.45458.37030.97413.14445.37263.86230.96738.75125.3488.604639.34536.84827.04835.56618.23739.749
04/09/1518PFSF332.25565.17429.47312.14350.07470.86428.26344.65823.1457.854337.04237.75127.95036.06819.84235.747
04/17/1519TMAPH216.93120.2334.94248.132612.83230.03111.72927.94220.4425.092831.53323.12720.93219.02718.84018.025
04/19/1520MeshStereoH213.2255.90184.882210.83812.93310.61111.02612.2279.01205.393227.42423.52817.72521.03315.43420.929
08/28/1521MC-CNN-acrtH28.08135.59164.55205.96132.83711.4175.8198.32168.89192.71916.31614.11313.21213.046.401311.111
09/14/1522ELASF332.35650.9669.174411.03933.06188.27418.34847.36026.85011.75341.75037.44923.73828.85363.07342.851
09/28/1523R-NCCF348.47326.23714.85430.26930.95872.96841.67477.77464.17327.47159.16671.97450.97333.96378.27680.873
10/13/1524MDPH212.62414.4294.992510.63710.72827.2288.111812.5288.07174.272430.42920.52512.6817.82513.42917.323
11/03/1525MC-CNN+RBSH28.42146.05195.16276.24153.271211.1146.36138.87189.83253.211715.11515.91812.81013.567.04159.996
11/05/1526GCSVRH214.63017.1313.5068.222716.54047.4518.82219.75207.06153.171534.43927.13318.32719.22816.03519.327
11/06/1527SOU4P-netH213.42623.1355.41316.391613.13430.5329.002216.43012.7343.131328.92617.12016.42316.92110.72414.521
12/18/1528INTSH214.52920.2324.52188.622911.62929.53010.72516.42910.3284.692527.62522.52620.73120.53111.52524.935
01/19/1629NTDEH27.44115.72174.36165.92122.83710.495.7185.30105.54112.40513.51114.11112.6913.986.391212.215
01/26/1631MC-CNN-fstH29.47187.35245.07267.18204.711716.8248.47207.37146.97142.821020.72117.42115.42115.1157.901812.616
01/21/1630MCCNN_LayoutH28.94175.53155.63325.0673.591512.6197.23167.53158.86185.793523.02213.61015.01914.7125.85810.48
02/18/1632LS-ELASF336.76253.56710.34715.85337.06683.67324.55949.16234.65813.95644.95245.76134.96229.15464.47462.765
03/15/1633MPSVQ143.57158.87133.97634.27237.96852.45430.86656.86951.06930.67256.96351.56744.67143.47044.26654.262
04/03/1634ICSGF345.67269.77519.15921.35943.67177.67036.97165.37240.46420.35953.66158.77246.57247.17360.77179.172
04/12/1635MeshStereoExtH27.0874.4163.98115.40103.171010.076.23124.6274.7783.491912.7912.4710.4614.5117.80178.853
04/13/1636GlstereoH219.83920.7348.254113.94918.64334.63512.93725.43923.2468.614731.13130.63920.32925.44821.14522.733
04/24/1637HLSC_corH226.04726.53815.25521.05720.54435.73623.45633.14735.05911.95439.14434.24125.24332.86028.35022.732
04/27/1638JEMQ137.26335.74427.97230.67033.26243.04231.46849.56347.36626.57049.65646.06435.76330.85537.55855.863
05/12/1639PMSCH26.7153.4612.6816.19142.5436.9234.5443.9644.0452.37413.11012.3612.2716.2185.88910.89
05/28/1640APAP-StereoH27.2695.43124.91235.1185.171921.6276.99154.3154.2373.241814.3139.7847.32313.456.30118.462
07/03/1641LPUH210.41911.4263.1858.10256.082120.9268.24196.94134.0044.042333.93816.91915.22017.8249.121911.613
08/31/1642SEDF363.47554.36822.46772.97764.57671.46642.57580.17567.97449.87779.67274.47565.47755.17586.17791.676
09/13/1643SNP-RSMH28.75155.46144.85216.50173.371310.4107.31178.73179.37223.582014.31214.71414.91812.8310.12210.810
09/20/1644LFSIRQ170.17775.77760.37767.17572.47780.87153.77785.47783.87742.57691.27590.47664.17671.37761.57290.375
10/19/1645LW-CNNH27.0464.6573.9595.3092.63411.2165.4174.3264.2262.43612.2713.4913.61514.8134.72112.014
10/23/1646SIGMRFQ164.27660.07333.07567.97663.27599.57939.87384.87682.07635.27495.27791.57758.17565.87655.07088.674
11/06/1647SPSF319.63814.22812.35114.95212.03115.82219.15117.43115.4358.234530.93034.84430.65425.34628.34928.039
11/15/1648MC-CNN-WSH212.12214.8307.203811.1407.622415.92311.83011.5269.01203.892219.72020.52416.32216.31912.12718.326
11/15/1649UCNNH220.54144.8589.774613.64618.24136.53712.83523.43412.4329.224939.54630.53824.84121.23519.14132.344
11/16/1650MCSCF311.32113.3275.963310.6368.69257.22411.32710.6227.48163.07113.10125.22919.02817.22310.32325.537
11/24/1651ADSMQ138.76540.44920.36227.36535.16455.95822.35556.16750.96824.26658.06456.37136.56432.15838.76269.769
01/03/1752SLACH219.33736.1456.53359.893521.94539.13811.83129.04317.9397.644140.24826.53121.13319.42915.03219.528
01/15/1753IGFQ134.06042.75220.16123.76332.25945.64828.66543.05537.26121.46350.95844.76034.76131.95637.45747.156
01/24/17543DMSTH25.9233.7142.7824.7542.7257.3654.2833.4423.7632.35312.6811.558.56414.095.3558.874
03/09/1755SGMEPiF313.9286.92236.71369.47329.722611.81813.63910.92410.6295.263032.83526.93222.73722.73912.02621.731
03/10/1756MC-CNN+TDSRF36.3545.45134.45176.80183.461410.7126.05105.0195.1992.62710.849.6226.59111.416.01107.041
03/22/1757JMRH212.5234.0953.97108.44286.932211.11313.84019.53319.0413.662117.01818.22218.02621.0347.291617.824
03/23/1758DSGCAQ133.85942.95320.96323.66230.25645.54727.66242.05436.06021.06250.25744.25933.35734.66438.46046.855
04/04/1759DDLQ130.15344.35719.46025.86428.35342.14121.15437.15028.75121.76446.85336.04530.35328.45132.75437.548
05/23/1760r200highH240.96870.57614.45321.35837.76772.26738.17253.26531.45518.35752.46052.66944.17045.47250.76966.567
06/14/1761DoGGuidedQ141.46945.46023.66830.67134.66352.55528.36459.17153.87226.46960.66854.77038.36635.56744.56772.070
06/22/1762LocalExpH25.4323.6532.8742.9811.9925.5923.3723.4833.3522.05110.339.7538.57514.4105.4069.555
08/25/1763SSRQ137.36450.06521.06528.56830.25753.85624.56057.87052.47022.06540.84948.56536.96532.75937.95952.260
10/12/1764FEN-D2DRRH27.2384.6884.11135.0363.0398.4266.05104.9085.32103.201611.5614.11113.41413.975.06214.319
11/13/1765CBMVH211.1206.07205.22288.09244.051618.7259.312310.7239.61243.111233.73715.61717.52417.12210.12114.420
11/17/1766CGPTQ132.85743.45520.96423.26129.45543.44323.65743.85737.26220.76048.75440.95634.05832.15736.05642.450
12/11/1767OVODH28.87164.74103.6475.51114.821812.8206.51149.91219.96263.131316.61714.81514.11615.4166.921413.218
01/24/1868SMSSRQ134.86147.46222.46627.36628.85446.75023.65849.56443.46520.96137.74344.15834.66033.06139.16449.858
02/07/1869DFQ156.17447.76327.97136.17446.77362.56150.27672.47369.97537.87588.27370.07352.87450.27477.57591.877
02/28/1870FDRH27.69125.41114.22144.2032.73610.285.4066.40125.76124.722611.2515.41613.41316.5205.22413.017
03/06/1871NOSSH25.0413.5722.8433.9921.9315.1513.3413.3213.1512.3228.5527.4517.06212.525.20310.07
03/09/1872DCNNQ132.95841.05018.25823.16026.65247.95227.56136.74831.75719.85849.25543.95734.55935.36535.25563.066
03/09/1873SGM_ROBH218.43537.4465.31299.033014.23631.73314.34524.73812.6335.273131.83429.73724.94222.03818.63828.240
03/11/1874SGM-ForestH27.37104.7193.6984.9353.181111.1145.3755.57115.81132.65814.51413.2813.11114.8145.63711.212
03/14/1875DTSH213.4278.45257.54397.46215.502014.92110.22424.53625.1474.932719.21918.72314.61715.91713.02817.222
03/23/1876MEDIAN_ROBH297.87996.17895.67899.07998.47998.47899.27998.47998.17899.07999.07999.67999.97994.77995.17898.378
03/23/1877AVERAGE_ROBH297.67896.27996.57996.87897.87897.87798.27897.97898.27998.97898.97899.17899.77893.17897.97998.979
03/26/1878ELAS_ROBH227.35043.45412.45213.95023.84866.46320.45333.04620.74311.05143.95137.55026.34628.75238.46133.345
04/17/1879ISMQ140.86742.55126.47034.87336.16544.54534.47056.26852.77125.26751.05952.46839.76733.36238.86375.371

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: October 13 2017 by Daniel Scharstein