vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.47027.95912.17317.87913.75074.510014.05930.36326.36911.07164.49937.97425.86425.36829.37143.772
07/25/142SGBM1Q127.97428.36017.28319.08014.55257.98815.66631.86531.47613.27758.69238.67627.07025.97131.47459.789
07/25/143SGMQ120.85635.5689.576313.86516.55432.15019.07225.85416.7528.956239.86131.15722.65320.74621.36132.255
07/25/144SGBM1F328.47543.5849.095713.66325.97582.010314.46443.47730.3755.985159.39545.88828.57424.96520.15945.974
07/28/146SGBM1H223.86132.96410.87013.66116.25371.29612.64826.65623.0635.834753.88739.27825.66322.85718.85247.477
07/28/147SGMH218.44840.3764.54258.033222.97040.56111.44124.75110.1365.404429.64028.55123.95620.04414.24230.954
07/28/148SGMF325.36645.1874.33216.872632.28750.07813.05348.18618.3587.665629.63936.16831.28224.26224.56550.281
07/28/145Cens5H226.67247.1898.745611.95525.67345.37119.57640.67429.0739.936736.55438.67531.08125.06725.66644.673
08/25/149LPSH219.2506.14285.34409.24417.533496.010912.3469.61279.40325.184092.410927.44724.35823.05810.02725.650
08/27/1410LPSF320.3546.72306.06459.72439.873994.310814.16011.23411.2415.884889.310736.06720.54423.86116.04825.448
08/31/1411BSMQ141.59859.810225.810027.99338.99860.68933.39846.98337.38426.39664.810051.59242.69845.210042.89066.694
09/10/1412LAMC_DSMH226.06755.89911.97214.37018.35944.06818.37139.97229.5746.675331.14434.56428.87526.37230.17235.761
09/18/1413SNCCH221.95748.6936.98499.794425.77446.07412.44736.86916.6517.255423.13134.26326.76821.85419.95728.453
10/07/1414IDRH218.14737.5754.08167.493023.37140.66212.85024.54911.3425.464533.14926.04321.55221.75315.34521.240
11/12/1415LCUQ117.04524.7527.595411.65311.94327.94514.05719.34615.8508.105836.15329.15321.35018.43914.14123.846
01/21/1516TSGOF339.19334.16616.98220.08143.310155.48514.36254.19549.29633.910366.210245.98939.89742.69847.29452.685
04/08/1517REAFH231.47958.310030.910613.15845.310363.89230.99638.77125.3688.606039.35936.87027.06935.59318.25039.764
04/09/1518PFSF332.28165.110629.410412.15750.010570.89528.29044.68123.1647.855737.05537.77327.97236.09519.85635.762
04/17/1519TMAPH216.94420.2484.94318.133512.84730.04711.74227.95920.4605.093931.54523.13920.94719.04118.85318.035
04/19/1520MeshStereoH213.2375.90254.882910.85012.94810.61811.03712.2369.01295.394327.43623.54017.73621.04715.44620.939
08/28/1521MC-CNN-acrtH28.08195.59214.55275.96182.831011.4245.81148.32238.89272.711516.32114.12013.21913.066.401711.117
09/14/1522ELASF332.38250.9959.175811.05133.08988.210718.37047.38426.87011.77541.76837.47123.75528.87863.010342.869
09/28/1523R-NCCF348.410226.25514.88030.29830.98472.99941.610777.710764.110427.49959.19471.910550.910533.99178.210780.8104
10/13/1524MDPH212.63514.4424.993310.64910.74127.2438.112612.5378.07244.273530.44120.53512.61317.83813.44017.333
11/03/1525MC-CNN+RBSH28.42206.05265.16366.24213.271611.1216.36198.87269.83343.212515.11915.92612.81513.5107.04199.999
11/05/1526GCSVRH214.64317.1453.50108.223616.55547.4768.82309.75287.06213.172334.45227.14618.33919.24216.04719.337
11/06/1527SOU4P-netH213.43823.1515.41416.392213.14930.5489.003116.44412.7453.132128.93817.12816.43216.93310.73214.530
12/18/1528INTSH214.54220.2474.52248.623811.64229.54610.73616.44310.3374.693627.63722.53820.74520.54511.53524.947
01/19/1629NTDEH27.44145.72244.36225.92172.831010.4155.71125.30155.54172.40913.51514.11812.61413.9136.391612.222
01/26/1631MC-CNN-fstH29.47247.35325.07347.18284.712416.8358.47287.37206.97202.821620.72717.43015.42915.1217.902312.623
01/21/1630MCCNN_LayoutH28.94235.53205.63425.06113.592012.6287.23237.53218.86265.794623.03013.61615.02714.7185.851010.411
02/18/1632LS-ELASF336.78953.59610.36815.87737.09583.610424.58549.18834.67813.97844.97345.78734.98929.17964.410562.792
03/15/1633MPSVQ143.510058.810133.910834.210237.99752.48030.89556.89851.09930.610256.98951.59344.610043.49944.29154.286
04/03/1634ICSGF345.610169.710819.18621.38543.610277.610136.910265.310340.48820.38553.68658.710246.510147.110360.710179.1102
04/12/1635MeshStereoExtH27.08104.41113.98155.40143.171410.0136.23174.62114.77133.492712.71312.41210.41014.5177.80228.854
04/13/1636GlstereoH219.85320.7498.255513.96618.66034.65312.95225.45323.2658.616131.14330.65620.34325.47021.16022.744
04/24/1637HLSC_corH226.06926.55615.28121.08320.56735.75523.48233.16735.08011.97639.15834.26225.26232.88828.37022.743
04/27/1638JEMQ137.29035.76927.910330.69933.29043.06631.49749.58947.39426.59849.68046.09035.79030.88137.58155.888
05/12/1639PMSCH26.7183.4622.6816.19202.5456.9274.5473.9684.04102.37813.11412.31112.21216.2295.881210.814
05/28/1640APAP-StereoH27.26125.43174.91305.11125.172621.6406.99224.3194.23123.242614.3179.7877.32513.496.30148.462
07/03/1641LPUH210.42811.4373.1878.10346.083020.9398.24276.94194.0094.043333.95116.92715.22817.8379.122511.620
08/31/1642SEDF363.410854.39822.49572.911064.510971.49742.510880.110867.910549.810979.610474.410865.411055.110886.111091.6109
09/13/1643SNP-RSMH28.75215.46194.85286.50243.371710.4177.31248.73259.37313.582814.31614.72214.92612.8510.12910.815
09/20/1644LFSIRQ170.111075.711060.310967.110872.411080.810253.711085.411083.811042.510791.210890.410964.110971.311061.510290.3108
10/19/1645LW-CNNH27.0494.65123.95135.30132.63611.2235.41114.32104.22112.431012.21113.41513.62214.8194.72112.021
10/23/1646SIGMRFQ164.210960.010333.010767.910963.210899.511239.810484.810982.010935.210495.211091.511058.110865.810955.09988.6107
11/06/1647SPSF319.65214.24112.37514.97412.04415.83219.17317.44515.4498.235930.94234.86530.68025.36828.36928.051
11/15/1648MC-CNN-WSH212.13214.8447.205111.1527.623515.93311.84311.5359.01293.893119.72620.53416.33116.33012.13818.336
11/15/1649UCNNH220.55544.8869.776513.66318.25836.55712.84923.44812.4439.226439.56030.55524.85921.24919.15532.356
11/16/1650MCSCF311.33113.3405.964410.6488.69367.22811.33910.6307.48223.07183.10125.24219.04017.23510.33025.549
11/24/1651ADSMQ138.79240.47720.38927.39135.19355.98622.38056.19650.99824.29358.09156.39936.59132.18638.78669.796
01/03/1752SLACH219.35136.1706.53469.894621.96839.16011.84429.06217.9557.645540.26226.54421.14819.44315.04419.538
01/15/1753IGFQ134.08742.78020.18823.78932.28645.67328.69243.07637.28221.49050.98244.78534.78831.98337.47947.176
01/24/17543DMSTH25.9263.7172.7824.7572.7277.3694.2863.4443.7662.35712.61211.5108.56614.0145.3568.875
03/09/1755SGMEPiF313.9406.92316.71489.47429.723811.82613.65510.93210.6385.264132.84826.94522.75422.75612.03721.742
03/10/1756MC-CNN+TDSRF36.3575.45184.45236.80253.461810.7196.05155.01145.19152.621110.889.6256.59211.416.01137.041
03/22/1757JMRH212.5334.0993.97148.44376.933311.12013.85619.54719.0593.662917.02318.23118.03721.0487.292017.834
03/23/1758DSGCAQ133.88542.98120.99023.68830.28245.57227.68842.07536.08121.08850.28144.28433.38534.69238.48446.875
04/04/1759DDLQ130.17744.38519.48725.89028.37842.16521.17937.17028.77221.79146.87636.06630.37928.47632.77737.563
05/23/1760r200highH240.99670.510914.47821.38437.79672.29838.110353.29431.47618.38252.48552.69544.19945.410150.79666.593
06/14/1761DoGGuidedQ141.49745.48823.69830.610034.69252.58128.39159.110253.810226.49760.69654.79838.39435.59444.59272.0100
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5953.3753.4863.3552.05210.369.7568.57714.4165.4079.557
08/25/1763SSRQ137.39150.09421.09228.59530.28353.88224.58657.810052.410022.09240.86548.59136.99232.78737.98352.284
10/12/1764FEN-D2DRRH27.23114.68134.11175.03103.03138.42116.05154.90135.32163.202411.51014.11813.42113.9125.06214.328
11/13/1765CBMVH211.1306.07275.22378.09334.052218.7389.313210.7319.61333.112033.75015.62517.53517.13410.12814.429
11/17/1766CGPTQ132.88343.48320.99123.28729.48143.46723.68343.87837.28320.78648.77840.98134.08632.18536.07842.468
12/11/1767OVODH28.87224.74153.64115.51154.822512.8296.51209.91299.96353.132116.62214.82314.12415.4236.921813.225
01/24/1868SMSSRQ134.88847.49022.49427.39228.87946.77523.68449.59043.48920.98737.75644.18334.68733.08939.18849.880
02/07/1869DFQ156.110747.79127.910236.110446.710462.59050.210972.410469.910737.810588.210670.010452.810750.210677.510691.8110
02/28/1870FDRH27.69165.41164.22184.2062.73810.2145.40106.40175.76184.723711.2915.42413.42016.5315.22513.024
03/06/1871NOSSH25.0423.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.20310.010
03/09/1872SGM_ROBH218.44937.4745.31389.034014.25131.74914.36324.75212.6445.274231.84629.75424.96022.05518.65128.252
03/11/1873SGM-ForestH27.37134.71143.69124.9393.181511.1215.3795.57165.81192.651314.51813.21313.11714.8205.63911.219
03/14/1874DTSH213.4398.45347.54537.46295.502714.93010.23524.55025.1674.933819.22518.73214.62515.92713.03917.232
03/23/1875MEDIAN_ROBH297.811296.111195.611199.011298.411298.411199.211298.411298.111199.011299.011299.611299.911294.711295.111198.3111
03/23/1876AVERAGE_ROBH297.611196.211296.511296.811197.811197.811098.211197.911198.211298.911198.911199.111199.711193.111197.911298.9112
03/26/1877ELAS_ROBH227.37343.48212.47613.96723.87266.49320.47833.06620.76111.07043.97037.57226.36628.77738.48533.357
04/17/1878ISMQ140.89542.57926.410134.810336.19444.57034.410056.29752.710125.29451.08452.49439.79533.39038.88775.3101
05/01/1879PSMNet_ROBQ142.19933.06523.19730.19731.48554.88430.79448.78748.39528.310080.810553.59736.99338.69763.910471.297
05/05/1880WCMA_ROBQ132.98430.96218.78532.110129.28037.25823.18140.17334.97926.29557.59045.08629.37631.98439.88941.167
05/18/1881PDSH214.24114.4425.804310.54710.54022.14114.05814.5398.97285.934924.23321.53718.23818.94011.93633.658
05/22/1882DN-CSS_ROBH222.85931.4639.286013.56012.44644.36912.14528.16117.6549.116350.98340.07921.24925.06631.97643.270
05/24/1883LALA_ROBH226.06825.6549.546213.66218.76237.45916.86746.48245.69311.37340.76431.65826.36521.55121.66351.983
05/25/1884ETED_ROBH226.67125.65310.97114.87319.06333.35117.66944.58045.39116.18143.97233.66128.37321.65222.26448.879
05/25/1885XPNet_ROBH224.66319.94610.76912.15617.15627.84415.56547.58545.5929.736637.95728.45024.96017.43619.05461.490
05/26/1886NOSS_ROBH25.0113.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.2039.066
05/28/1887PWCDC_ROBF353.310548.59230.510551.610761.410783.810530.09350.59144.99044.510873.610358.810348.310349.310481.910981.1105
05/30/1888DLCB_ROBH212.53410.0366.70479.81455.762916.8369.983411.13311.2405.965024.73421.03616.83416.53214.34323.145
05/31/1889FBW_ROBH232.28036.3719.376114.26919.16469.39413.25451.09239.18610.86943.97041.58233.08429.98051.39771.498
05/31/1890iResNet_ROBH224.86523.05010.26714.77112.44525.94212.95128.06024.96611.57446.67538.97721.45127.87445.69366.795
05/31/1891CBMV_ROBH27.65153.4833.3584.8083.57196.3266.88214.84123.9171.97125.43511.1913.11615.8267.342113.827
06/01/1892DPSimNet_ROBF349.410360.110422.99628.39433.79163.19134.39974.710670.110829.310164.910172.210648.210255.010750.59579.6103
06/01/1893NaN_ROBH25.7353.4112.9063.6932.3345.3243.3543.4973.3142.31410.3710.889.64915.3225.4589.898
06/01/1894PDISCO_ROBH254.310662.510521.99338.610538.99884.010640.310674.510569.110639.410660.79773.610749.910446.910278.610881.2106
06/05/1895CBMBNetH210.2278.30335.10356.87264.522311.5257.702513.93813.2463.041721.92813.31413.62315.42411.23411.016
06/14/1896MSMD_ROBQ130.97826.95814.67920.08222.66933.75227.88943.97938.48521.18949.57940.88031.88331.68237.58243.671
06/27/1897DCNNH210.9295.66234.98326.49235.732812.5278.512915.64210.9393.081924.13220.23316.83315.52510.33113.826
07/31/1898MotionStereoH240.49467.610725.09929.29640.910057.38735.510157.59940.48719.98442.86952.69639.89637.19651.79834.960
10/10/1899DISCOH224.56235.0677.345211.75418.76148.67717.16831.46422.4629.336546.07433.56027.57124.66327.56855.087
10/29/18101iResNetH222.96028.3609.195915.87619.36635.15411.34027.75816.85315.27954.78827.64819.54221.55031.97551.682
10/29/18100Dense-CNNH27.98185.59214.54255.83162.79910.4165.78138.26228.84252.661415.62014.22113.21813.286.301411.117
11/07/18102IEBIMstH233.88636.77312.17416.97832.58851.07925.38758.110149.89711.27248.67756.910030.27826.87326.96771.799
11/08/18103HSMF310.22612.0385.32397.50316.723115.6319.89336.83185.14144.173422.72917.12815.63014.31510.83314.631
11/11/18104MBMH222.85836.4729.956615.37519.36536.55619.97727.55718.15610.16841.56732.75926.36723.35921.46239.965
11/15/18106VNH218.14612.73912.87714.2689.543718.43719.47514.64014.4476.085240.66328.04924.35723.46020.15834.859
11/13/18105WDMCH213.1369.47357.04508.70396.813216.73411.13814.74115.0483.773032.44724.34119.44115.9289.592621.341
11/28/18107MSFNetAH27.96176.21294.26196.02193.66218.95126.28188.41248.06232.621117.92413.91711.91111.528.002410.613
01/12/19109EHCI_netH29.47253.7584.272013.15827.6775.3033.2313.4753.1833.90329.2049.5849.26813.91117.34910.612
01/16/191103DFMRH25.4444.10103.3792.9922.95127.63104.5583.2613.9582.16310.258.2836.37113.275.86118.462
01/17/19111FASWQ128.67641.77818.18423.18627.27640.66219.17434.96828.17118.58340.86636.46929.37728.47531.17341.066
12/18/18108MCV-MFCH224.86426.8579.636414.87217.45754.18314.26126.55518.25716.08062.69828.75220.94624.66437.48048.178
02/05/19112AMNetQ153.310454.39763.711051.210651.310640.66439.910551.69355.910355.411058.99357.510152.710649.510558.110061.691

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: July 31 2018 by Daniel Scharstein