vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.46927.96212.17317.88113.75074.510614.06030.36626.37111.07464.410637.97825.86625.36829.37143.772
07/25/142SGBM1Q127.97428.36317.28819.08214.55257.99215.66831.86831.48013.28058.69538.68027.07425.97031.47659.794
07/25/143SGMQ120.85635.5739.576513.86616.55632.15219.07225.85516.7538.956339.86231.15822.65020.74521.35932.253
07/25/144SGBM1F328.47543.5909.096013.66525.98082.011014.46543.48430.3795.985259.39845.89328.57824.96520.15645.976
07/28/146SGBM1H223.86232.96810.87113.66416.25471.210112.64626.65823.0655.834953.89039.28225.66522.85518.85047.479
07/28/147SGMH218.44840.3824.54238.033222.97040.56211.44024.75210.1365.404629.64628.55223.95620.04114.24030.951
07/28/148SGMF325.36645.1944.33196.872432.29350.08113.05048.19018.3587.665829.64536.17031.28624.26124.56350.282
07/28/145Cens5H226.67047.1988.745811.95825.67845.37419.57540.68029.0779.936936.55738.67931.08525.06725.66444.674
08/25/149LPSH219.2536.14275.34409.24407.533296.011512.3449.61279.40325.184292.411627.45024.35723.05710.02525.646
08/27/1410LPSF320.3556.72296.06459.72429.874094.311414.16111.23311.2415.885089.311536.06920.54223.86016.04525.444
08/31/1411BSMQ141.510659.811225.810927.910138.910660.69433.310146.98837.38926.310364.810751.59842.610745.211042.89566.6102
09/10/1412LAMC_DSMH226.06755.810811.97214.36918.35844.06918.37139.97929.5786.675431.14934.56628.87926.37130.17435.757
09/18/1413SNCCH221.95748.61026.98499.794325.77946.07712.44536.87516.6527.255723.13534.26526.77221.85119.95428.450
10/07/1414IDRH218.14737.5804.08147.492923.37140.66312.84724.54911.3435.464733.15426.04621.54821.75015.34321.239
01/21/1515TSGOF339.110034.17016.98720.08343.310855.48814.36354.110049.210133.911166.210845.99439.810542.610747.210052.684
04/08/1516REAFH231.48358.310930.911413.16045.311063.89630.99938.77825.3698.606139.36136.87327.07335.59918.24839.765
04/09/1517PFSF332.28865.111429.411312.15950.011270.810028.29444.68623.1667.855937.05837.77627.97636.010119.85335.758
04/17/1518TMAPH216.94520.2484.94298.133512.84830.05011.74127.96120.4615.094131.55023.13920.94519.03918.85118.034
04/19/1519MeshStereoH213.2365.90244.882710.85112.94910.61911.03712.2369.01295.394527.44123.54117.73621.04615.44420.938
08/28/1520MC-CNN-acrtH28.08185.59204.55255.96172.831011.4255.81148.32238.89272.711516.32314.11813.21813.056.401611.115
09/14/1521ELASF332.38950.91039.176111.05433.09688.211218.37047.38926.87211.77741.76537.47423.75528.87963.011042.869
09/28/1522R-NCCF348.411126.25714.88230.210430.99072.910441.611177.711564.111427.410659.19771.911550.911233.99778.211580.8112
10/13/1523MDPH212.63414.4434.993210.65010.74227.2488.112512.5378.07254.273530.44720.53512.61217.83513.43917.331
11/03/1524MC-CNN+RBSH28.42196.05255.16356.24203.271611.1226.36188.87269.83343.212315.12015.92412.81413.5107.04189.999
12/18/1525INTSH214.54120.2474.52228.623711.64329.54910.73616.44210.3374.693727.64322.53820.74320.54311.53424.943
01/19/1626NTDEH27.44135.72234.36205.92152.831010.4165.71125.30145.54172.40813.51614.11612.61313.9136.391512.220
01/26/1627MC-CNN-fstH29.47227.35315.07337.18264.712316.8378.47297.37206.97212.821620.73117.42815.42715.1207.902112.621
02/18/1628LS-ELASF336.79553.510510.37015.87637.010383.611124.58749.19234.68413.98144.97045.79234.99629.18064.411262.7100
03/15/1629MPSVQ143.510858.811033.911634.210937.910552.48430.89856.810651.010530.610856.99351.59944.610943.410844.29654.287
04/03/1630ICSGF345.611069.711619.19221.38943.610977.610936.910665.311140.49320.39453.68958.711146.511147.111260.710979.1110
04/24/1631HLSC_corH226.06826.55815.28321.08720.56635.75823.48533.17035.08511.97839.16034.26425.26432.89128.36922.741
04/27/1632JEMQ137.29735.77427.911230.610533.29743.06831.410049.59347.39826.510549.68146.09535.79830.88637.58655.891
05/12/1633PMSCH26.7183.4612.6816.19192.5456.9284.5463.9684.04102.37713.11512.31112.21116.2275.881110.812
05/28/1634APAP-StereoH27.26115.43174.91285.11105.172521.6436.99214.3194.23123.242414.3189.7877.32413.486.30138.462
07/03/1635LPUH210.42711.4373.1878.10346.082820.9418.24266.94194.0094.043133.95616.92615.22617.8349.122311.618
08/31/1636SEDF363.411654.310722.410372.911764.511771.410242.511280.111667.911549.811679.611174.411665.411755.111686.111791.6116
09/13/1637SNP-RSMH28.75205.46194.85266.50223.371710.4187.31228.73259.37313.582714.31714.72014.92512.8410.12710.813
10/19/1638LW-CNNH27.0494.65113.95125.30112.63611.2245.41114.32104.22112.43912.21313.41413.62114.8174.72112.019
10/23/1639SIGMRFQ164.211760.011333.011567.911663.211699.511939.810984.811782.011735.211395.211791.511758.111565.811755.010688.6115
11/06/1640SPSF319.65414.24212.37514.97212.04515.83419.17317.44315.4488.236030.94834.86730.68425.36828.36828.047
11/15/1641MC-CNN-WSH212.13214.8457.205111.1557.623315.93511.84211.5359.01293.892919.73020.53416.33116.32812.13718.335
11/16/1642MCSCF311.33113.3415.964410.6488.69367.22911.33810.6307.48223.07183.10125.24419.04017.23110.32925.545
11/24/1643ADSMQ138.79940.48320.39627.39935.110055.98922.38356.110350.910424.210158.09456.310736.59932.19038.79069.7104
01/15/1744IGFQ134.09242.78720.19523.79432.29245.67628.69643.08337.28821.49950.98444.79134.79531.98937.48447.178
01/24/17453DMSTH25.9253.7162.7824.7562.7277.36104.2853.4443.7662.35612.61411.598.56614.0145.3558.873
03/09/1746SGMEPiF313.9386.92306.71479.47419.723811.82713.65410.93210.6395.264332.85326.94822.75122.75412.03621.740
03/10/1747MC-CNN+TDSRF36.3575.45184.45216.80233.461810.7206.05155.01135.19142.621110.899.6246.59211.416.01127.041
03/22/1748JMRH212.5334.0993.97138.44366.933011.12113.85619.54619.0603.662817.02518.22918.03721.0477.291917.833
03/23/1749DSGCAQ133.89042.98820.99823.69330.28745.57527.69242.08236.08621.09750.28344.29033.39334.69838.48846.877
04/04/1750DDLQ130.18044.39319.49325.89828.38542.16721.18037.17628.77621.710046.87436.06830.38328.47632.78037.561
05/23/1751r200highH240.910370.511714.48021.38837.710472.210338.110853.29831.48018.38552.48752.610144.110845.411150.710266.5101
06/14/1752DoGGuidedQ141.410445.49623.610530.610634.69852.58528.39559.111053.810826.410460.610254.710638.310235.510044.59772.0108
06/22/1753LocalExpH25.4323.6542.8742.9811.9935.5933.3733.4863.3532.05210.389.7568.57714.4165.4069.557
10/12/1754FEN-D2DRRH27.23104.68124.11155.0393.03138.42126.05154.90125.32153.202211.51114.11613.42013.9125.06214.326
11/13/1755CBMVH211.1306.07265.22368.09334.052118.7409.313110.7319.61333.112033.75515.62317.53517.13010.12614.427
12/11/1756OVODH28.87214.74143.64105.51124.822412.8296.51199.91289.96353.132116.62414.82114.12315.4226.921713.223
01/24/1857SMSSRQ134.89447.410022.410227.310028.88646.77823.68649.59443.49620.99637.75944.18934.69433.09339.19249.881
02/07/1858DFQ156.111447.710127.911136.111146.711162.59550.211672.411469.911637.811488.211470.011352.811450.211577.511491.8117
02/28/1859SDRH27.69155.41164.22164.2052.73810.2155.40106.40175.76184.723811.21015.42213.41916.5295.22413.022
03/09/1860SGM_ROBH218.44937.4795.31379.033914.25131.75114.36424.75312.6465.274431.85129.75524.96222.05218.64928.248
03/11/1861SGM-ForestH27.37124.71133.69114.9383.181411.1225.3795.57165.81192.651314.51913.21213.11614.8185.63911.217
03/14/1862DTSH213.4378.45337.54537.46285.502614.93110.23524.55025.1684.933919.22918.73014.62415.92613.03817.230
03/23/1863MEDIAN_ROBH297.811996.111895.611899.011998.411998.411899.211998.411998.111899.011999.011999.611999.911994.711995.111898.3118
03/23/1864AVERAGE_ROBH297.611896.211996.511996.811897.811897.811798.211897.911898.211998.911898.911899.111899.711893.111897.911998.9119
03/26/1865ELAS_ROBH227.37143.48912.47613.96723.87266.49720.47833.06920.76211.07343.96737.57526.36728.77838.48933.354
04/17/1866ISMQ140.810242.58626.411034.811036.110144.57234.410256.210452.710725.210251.08652.410039.710333.39438.89175.3109
05/01/1867PSMNet_ROBQ142.110733.06923.110430.110331.49154.88730.79748.79148.39928.310780.811253.510536.910038.610563.911171.2105
05/18/1868PDSH214.23914.4435.804310.54710.54122.14414.05914.5408.97285.935124.23821.53618.23918.93811.93533.655
05/22/1869DN-CSS_ROBH222.86031.4669.286313.56312.44744.37112.14328.16317.6559.116550.98540.08321.24625.06631.97843.270
05/26/1870NOSS_ROBH25.0113.5732.8433.9941.9325.1513.3423.3223.1512.3248.5527.4517.06312.535.2039.064
05/31/1871FBW_ROBH232.28736.3759.376414.26819.16169.39913.25251.09639.19110.87243.96741.58733.09229.98451.310371.4106
05/31/1872iResNet_ROBH224.86523.05110.26914.77012.44625.94712.94828.06224.96711.57646.67338.98121.44727.87345.69866.7103
05/31/1873CBMV_ROBH27.65143.4823.3584.8073.57196.3276.88204.84113.9171.97125.43911.1813.11515.8257.342013.825
06/05/1874CBMBNetH210.2268.30325.10346.87244.522211.5267.702313.93913.2473.041721.93213.31313.62215.42311.23211.014
06/14/1875MSMD_ROBQ130.98226.96014.68120.08422.66933.75327.89343.98538.49021.19849.57940.88631.88731.68737.58743.671
06/27/1876DCNNH210.9295.66224.98306.49215.732712.5288.513015.64110.9403.081924.13720.23216.83215.52410.33013.824
07/31/1877MotionStereoH240.410167.611525.010729.210240.910757.39135.510457.510740.49219.99142.86652.610239.810437.110351.710434.956
10/10/1878DISCOH224.56335.0727.345211.75718.76048.68017.16931.46722.4639.336746.07233.56227.57524.66327.56655.089
10/29/1880iResNetH222.96128.3639.196215.87519.36435.15411.33927.76016.85415.28254.79127.65119.54121.54931.97751.683
10/29/1879Dense-CNNH27.98175.59204.54235.83142.79910.4175.78138.26218.84262.661415.62214.21913.21713.276.301311.115
11/07/1881IEBIMstH233.89136.77712.17416.97932.59451.08325.38958.110849.810311.27548.67656.910930.28226.87226.96571.7107
11/08/1882HSMF310.22512.0405.32387.50306.722915.6339.89346.83185.14134.173422.73417.12715.62814.31510.83114.628
11/11/1883MBMH222.85936.4769.956815.37419.36336.55919.97627.55918.15610.17041.56432.76026.36823.35821.46039.966
11/28/1884MSFNetAH27.96166.21284.26176.02183.66208.95136.28178.41248.06242.621117.92613.91511.91011.528.002210.611
01/12/1986EHCI_netH29.47233.7574.271813.16027.6825.3023.2313.4753.1823.90309.2039.5839.26813.91117.34710.610
01/17/1987FASWQ128.67641.78418.18923.19227.28140.66319.17434.97228.17518.58740.86336.47129.38028.47531.17541.067
12/18/1885MCV-MFCH224.86426.8599.636714.87117.45754.18614.26226.55718.25716.08362.610528.75420.94424.66437.48548.180
02/05/1988AMNetQ153.311254.310663.711751.211551.311340.66539.911051.69755.911155.411758.99657.511052.711349.511458.110861.697
02/15/1989DAWA-FH227.47247.29913.67813.16219.26266.49720.47930.36533.9828.736248.97737.87726.77129.98328.06736.559
03/06/1990SM-AWPQ138.19830.76524.010625.29730.38844.97338.110756.010255.811019.99260.110051.29732.18830.28540.09461.798
03/09/19913DMST-CMH25.4734.10103.3792.9922.95127.63114.5573.2613.9582.16310.268.2826.37113.265.86109.356
04/12/1992TCSCSMH219.15245.2955.764211.05322.16841.16613.45324.85411.4457.175529.54426.64726.66920.54416.54617.432
05/10/1993tMGM-16F317.3468.70356.49469.824420.76713.73013.95821.84716.0505.574826.94025.44528.37722.15314.64139.664
05/13/1994VNH214.2409.69369.586610.9527.33319.541413.85711.33411.3447.175527.44223.34024.86122.85614.64218.436
05/15/1995PSMNet_2000H228.97720.4498.235515.17327.78435.25515.26750.89551.81069.296661.910331.15725.26327.87329.37152.985
05/28/1996PWCA_SGMQ130.98143.99218.99122.99124.47450.98222.28235.77327.57420.69553.48840.68532.49133.39532.37942.168
06/26/1997DeepPruner_ROBQ130.17834.27119.99424.39523.87247.27926.19026.15622.86418.48659.89936.57223.25331.78848.310144.875
07/26/1998EdgeStereoF318.75025.3556.794810.64925.17722.1448.312724.54816.5516.63539.20332.05924.66020.24219.25254.388
11/01/1999NVstereo2DH215.44211.5385.33397.21279.503718.03913.75512.93810.6384.413618.02724.44222.04921.24822.46153.686
11/07/19100LBPSH29.68245.05154.98305.57133.24156.03612.9495.44155.50163.552615.22115.92517.53417.3329.842428.349
11/11/19101SACA-NetQ131.78521.85016.08421.59024.57538.06034.610338.67736.38719.09049.47840.28432.18933.69636.08158.293
11/14/19102HSM-Smooth-OccF310.82811.7395.62418.75388.393515.4329.60328.29226.11204.093223.63620.43317.03313.4910.22816.629
11/15/19103SPPSMNetF341.410532.56720.69734.010833.09555.99036.310553.89948.610035.011271.610952.810337.110138.110446.79956.992
12/19/19104CRLEH25.7543.6653.1165.92152.1446.0153.3943.4973.6852.34510.269.6358.04514.9195.4589.265
12/30/19105F-GDGIFH231.68437.3787.725416.17734.99935.25620.17755.310146.6979.016447.67552.910429.48129.78229.47361.096
01/02/20106PPEP-GFQ134.69342.48521.710024.89630.88944.07025.18845.78742.19420.19344.16943.68835.29732.89239.39355.090
01/05/20107MTS2F353.811351.710421.59938.811352.711497.511643.011366.411260.811232.010985.711369.011246.311045.110971.211385.2113
01/07/20108ADSR_GIFQ137.19643.69118.69036.711224.67658.69322.88456.310549.710218.78956.09248.59632.29024.56236.38279.1111
02/07/20109CasStereoH218.85123.9539.015910.54611.74474.010513.15110.1297.86234.093245.47125.24324.45917.33320.55844.373
02/20/20110CRARH222.05823.25213.57716.47816.35521.04221.88128.56426.97310.57132.55232.96123.35423.65920.35737.460
02/24/20111SGBMPF327.87337.58116.38617.18027.68375.710814.66633.47125.87012.27960.310134.06323.15229.38128.77031.252
03/02/20112AdaStereoF316.04425.7568.575711.55615.75317.2388.312724.75111.3429.48689.99522.53716.02919.94024.36224.342
03/13/20113MTSF359.711558.811125.210851.111460.411591.311348.311570.311363.411344.411579.311071.711460.911647.411379.611688.4114
04/19/20114PVStereoH26.0263.7682.8853.7731.9215.6944.9683.3633.4642.531011.71211.61010.6915.2215.4279.638
05/14/20115SRMH213.1358.50347.04507.86317.733416.1367.902418.44518.5595.034022.33320.03118.13818.53711.33319.337
05/19/20116SUWNetQ130.17924.55413.97920.38520.06535.75726.19140.98143.29517.98449.88228.65324.45828.57752.510537.963
05/20/20117AANet++H215.44317.5468.375610.2459.863923.9469.823317.74415.9493.252518.12827.14916.23018.43620.05537.762
05/23/20118CCNetQ131.98627.06116.08520.38618.65938.86152.011735.97434.08318.68849.68030.55626.77036.210237.18362.099
05/25/20119RTSMNetH245.610947.09721.910131.910736.410275.110743.911458.910955.310932.711062.210456.410842.210639.110658.010759.995

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein