vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.46527.95612.16917.87713.74774.510014.05630.36226.36711.07064.49937.97225.86125.36429.36743.767
07/25/142SGBM1Q127.97028.35717.28219.07814.54957.98615.66431.86431.47613.27658.68938.67427.06825.96631.47259.789
07/25/143SGMQ120.85235.5679.576113.86216.55232.14819.06825.85116.7508.956039.85831.15222.64620.74121.35632.250
07/25/144SGBM1F328.47143.5849.095613.66125.97482.010314.46143.47830.3755.984959.39245.88728.57224.96120.15345.971
07/28/146SGBM1H223.85832.96210.86713.66016.25071.29512.64226.65423.0615.834653.88439.27625.66022.85118.84847.474
07/28/147SGMH218.44440.3764.54228.033022.96440.55611.43624.74810.1355.404329.64228.54823.95220.03714.23830.948
07/28/148SGMF325.36245.1884.33186.872332.28750.07513.04648.18418.3557.665529.64136.16431.28024.25724.55950.277
07/28/145Cens5H226.66647.1918.745411.95425.67245.36819.57140.67529.0739.936536.55338.67331.07925.06325.66044.669
08/25/149LPSH219.2496.14265.34399.24387.533196.010712.3409.61269.40315.183992.410827.44624.35323.05310.02425.643
08/27/1410LPSF320.3516.72286.06449.72409.873794.310614.15711.23211.2405.884789.310736.06320.53823.85616.04325.441
08/31/1411BSMQ141.510059.810425.810127.99538.99960.68833.39646.98237.38426.39764.810051.59242.610045.210342.89066.695
09/10/1412LAMC_DSMH226.06355.810111.96814.36518.35444.06318.36739.97429.5746.675131.14534.56028.87326.36730.17035.754
09/18/1413SNCCH221.95348.6956.98489.794125.77346.07112.44136.87016.6497.255423.13134.25926.76621.84719.95228.447
10/07/1414IDRH218.14337.5744.08137.492823.36540.65712.84324.54611.3415.464433.15026.04321.54421.74615.34121.237
01/21/1515TSGOF339.19434.16416.98120.07943.310155.48214.35954.19449.29533.910466.210145.98839.89942.610047.29552.679
04/08/1516REAFH231.47858.310230.910613.15645.310363.89030.99438.77325.3658.605839.35736.86727.06735.59418.24639.760
04/09/1517PFSF332.28265.110629.410512.15550.010570.89428.28944.68023.1627.855637.05437.77027.97036.09619.85135.755
04/17/1518TMAPH216.94120.2454.94288.133312.84530.04611.73727.95720.4575.093831.54623.13620.94119.03618.84918.033
04/19/1519MeshStereoH213.2345.90234.882610.84812.94610.61811.03312.2359.01285.394227.43723.53817.73321.04215.44220.936
08/28/1520MC-CNN-acrtH28.08175.59194.55245.96162.83911.4245.81138.32228.89262.711416.32114.11713.21713.056.401511.114
09/14/1521ELASF332.38350.9969.175711.05133.09088.210518.36647.38326.86811.77341.76137.46823.75128.87463.010342.864
09/28/1522R-NCCF348.410426.25214.87730.29830.98472.99841.610677.710764.110627.410059.19171.910750.910533.99278.210880.8105
10/13/1523MDPH212.63314.4414.993110.64710.73927.2448.112312.5368.07244.273330.44320.53312.61117.83413.43717.330
11/03/1524MC-CNN+RBSH28.42186.05245.16346.24193.271511.1216.36178.87259.83333.212215.11815.92312.81313.5107.04179.998
12/18/1525INTSH214.53920.2444.52218.623511.64029.54510.73216.44110.3364.693527.63922.53520.73920.53911.53224.940
01/19/1626NTDEH27.44125.72224.36195.92142.83910.4155.71115.30135.54162.40813.51414.11512.61213.9136.391412.219
01/26/1627MC-CNN-fstH29.47217.35305.07327.18254.712216.8358.47267.37196.97202.821520.72817.42715.42615.1207.902012.620
02/18/1628LS-ELASF336.78953.59810.36615.87237.09683.610424.58349.18634.67913.97744.96645.78634.99029.17564.410562.793
03/15/1629MPSVQ143.510258.810333.910834.210237.99852.47830.89356.810051.09930.610256.98751.59344.610243.410144.29154.282
04/03/1630ICSGF345.610369.710819.18621.38343.610277.610236.910165.310440.48820.38853.68358.710446.510447.110560.710279.1103
04/24/1631HLSC_corH226.06426.55315.27821.08120.56035.75323.48133.16635.08011.97439.15634.25825.25932.88628.36522.739
04/27/1632JEMQ137.29135.76827.910430.69933.29143.06231.49549.58747.39226.59949.67646.08935.79230.88137.58155.886
05/12/1633PMSCH26.7173.4612.6816.19182.5446.9274.5463.9674.0492.37713.11312.31012.21016.2265.881010.811
05/28/1634APAP-StereoH27.26105.43164.91275.1195.172421.6406.99204.3184.23113.242314.3169.7877.32413.486.30128.462
07/03/1635LPUH210.42611.4353.1868.10326.082720.9388.24246.94184.0084.042933.95216.92515.22517.8339.122211.617
08/31/1636SEDF363.410854.310022.49672.910964.510971.49642.510780.110867.910749.810879.610374.410865.410955.110886.110991.6108
09/13/1637SNP-RSMH28.75195.46184.85256.50213.371610.4177.31218.73249.37303.582514.31514.71914.92412.8410.12610.812
10/19/1638LW-CNNH27.0484.65103.95115.30102.63511.2235.41104.3294.22102.43912.21113.41313.62014.8174.72112.018
10/23/1639SIGMRFQ164.210960.010533.010767.910863.210899.511139.810484.810982.010935.210695.210991.510958.110865.810955.010088.6107
11/06/1640SPSF319.65014.24012.37114.96812.04215.83319.16917.44215.4468.235730.94434.86130.67825.36428.36428.044
11/15/1641MC-CNN-WSH212.13114.8437.204911.1527.623215.93411.83811.5349.01283.892719.72720.53216.32816.32712.13518.334
11/16/1642MCSCF311.33013.3395.964310.6458.69347.22811.33410.6297.48213.07173.10125.24119.03617.23010.32825.542
11/24/1643ADSMQ138.79340.47720.39027.39335.19455.98322.37956.19750.99824.29558.08856.310136.59332.18538.78569.797
01/15/1744IGFQ134.08642.78120.18923.78832.28645.67028.69143.07737.28321.49350.97844.78534.78931.98437.47947.173
01/24/17453DMSTH25.9253.7162.7824.7552.7267.3694.2853.4433.7652.35612.61211.598.56614.0145.3558.873
03/09/1746SGMEPiF313.9366.92296.71469.47399.723611.82613.65010.93110.6385.264032.84926.94522.74722.75012.03421.738
03/10/1747MC-CNN+TDSRF36.3565.45174.45206.80223.461710.7196.05145.01125.19132.621010.889.6246.59211.416.01117.041
03/22/1748JMRH212.5324.0983.97128.44346.932911.12013.85219.54319.0563.662617.02318.22818.03421.0437.291817.832
03/23/1749DSGCAQ133.88442.98220.99223.68730.28145.56927.68742.07636.08121.09150.27744.28433.38734.69338.48346.872
04/04/1750DDLQ130.17544.38719.48725.89228.37942.16121.17637.17128.77221.79446.87036.06230.37728.47232.77637.558
05/23/1751r200highH240.99770.510914.47521.38237.79772.29738.110353.29231.47618.38052.48152.69544.110145.410450.79766.594
06/14/1752DoGGuidedQ141.49845.49023.69830.610034.69252.57928.39059.110353.810226.49860.69654.710038.39635.59544.59272.0101
06/22/1753LocalExpH25.4323.6542.8742.9811.9925.5933.3733.4853.3532.05210.379.7568.57714.4165.4069.557
10/12/1754FEN-D2DRRH27.2394.68114.11145.0383.03128.42116.05144.90115.32143.202111.51014.11513.41913.9125.06214.325
11/13/1755CBMVH211.1296.07255.22358.09314.052018.7379.312810.7309.61323.111933.75115.62217.53217.12910.12514.426
12/11/1756OVODH28.87204.74133.6495.51114.822312.8286.51189.91279.96343.132016.62214.82014.12215.4216.921613.222
01/24/1857SMSSRQ134.88847.49322.49527.39428.88046.77223.68249.58843.49020.99037.75544.18334.68833.08839.18749.876
02/07/1858DFQ156.110747.79427.910336.110446.710462.58950.210972.410669.910837.810788.210670.010652.810750.210777.510791.8109
02/28/1859SDRH27.69145.41154.22154.2042.73710.2145.4096.40165.76174.723611.2915.42113.41816.5285.22413.021
03/09/1860SGM_ROBH218.44537.4735.31369.033714.24831.74714.36024.74912.6445.274131.84729.75024.95722.04818.64728.245
03/11/1861SGM-ForestH27.37114.71123.69104.9373.181311.1215.3785.57155.81182.651214.51713.21113.11514.8185.63811.216
03/14/1862DTSH213.4358.45327.54517.46275.502514.93010.23124.54725.1644.933719.22618.72914.62315.92513.03617.229
03/23/1863MEDIAN_ROBH297.811196.111095.611099.011198.411198.411099.211198.411198.111099.011199.011199.611199.911194.711195.111098.3110
03/23/1864AVERAGE_ROBH297.611096.211196.511196.811097.811097.810998.211097.911098.211198.911098.911099.111099.711093.111097.911198.9111
03/26/1865ELAS_ROBH227.36743.48312.47213.96323.86666.49120.47433.06520.75811.06943.96337.56926.36228.77338.48433.351
04/17/1866ISMQ140.89642.58026.410234.810336.19544.56634.49756.29852.710125.29651.08052.49439.79733.38938.88675.3102
05/01/1867PSMNet_ROBQ142.110133.06323.19730.19731.48554.88130.79248.78548.39328.310180.810453.59936.99438.69963.910471.298
05/18/1868PDSH214.23714.4415.804210.54410.53822.14114.05514.5398.97275.934824.23421.53418.23518.93511.93333.652
05/22/1869DN-CSS_ROBH222.85631.4609.285913.55912.44444.36512.13928.15917.6529.116250.97940.07721.24225.06231.97443.265
05/26/1870NOSS_ROBH25.0113.5732.8433.9931.9315.1513.3423.3223.1512.3248.5527.4517.06312.535.2039.064
05/31/1871FBW_ROBH232.28136.3699.376014.26419.15669.39313.24851.09039.18610.86843.96341.58133.08629.97951.39871.499
05/31/1872iResNet_ROBH224.86123.04810.26514.76612.44325.94312.94428.05824.96311.57246.66938.97521.44327.86945.69366.796
05/31/1873CBMV_ROBH27.65133.4823.3574.8063.57186.3266.88194.84103.9161.97125.43511.1813.11415.8247.341913.824
06/05/1874CBMBNetH210.2258.30315.10336.87234.522111.5257.702213.93813.2453.041621.92913.31213.62115.42211.23111.013
06/14/1875MSMD_ROBQ130.97726.95514.67620.08022.66333.74927.88843.97938.48521.19249.57540.88031.88131.68237.58243.666
06/27/1876DCNNH210.9285.66214.98296.49205.732612.5278.512715.64010.9393.081824.13320.23016.82915.52310.32913.823
07/31/1877MotionStereoH240.49567.610725.010029.29640.910057.38535.59957.510140.48719.98542.86252.69639.89837.19751.79934.953
10/10/1878DISCOH224.55935.0667.345011.75318.75548.67417.16531.46322.4599.336446.06833.55627.56924.65927.56255.084
10/29/1880iResNetH222.95728.3579.195815.87119.35935.15011.33527.75616.85115.27854.78527.64719.53721.54531.97351.678
10/29/1879Dense-CNNH27.98165.59194.54225.83132.79810.4165.78128.26208.84252.661315.62014.21813.21613.276.301211.114
11/07/1881IEBIMstH233.88536.77112.17016.97532.58851.07725.38558.110249.89711.27148.67256.910230.27626.86826.96171.7100
11/08/1882HSMF310.22412.0385.32377.50296.722815.6329.89306.83175.14124.173222.73017.12615.62714.31510.83014.627
11/11/1883MBMH222.85536.4709.956415.37019.35836.55419.97227.55518.15310.16641.56032.75426.36323.35421.45739.961
11/28/1884MSFNetAH27.96156.21274.26166.02173.66198.95126.28168.41238.06232.621017.92413.91411.9911.528.002110.610
01/12/1986EHCI_netH29.47223.7574.271713.15627.6765.3023.2313.4743.1823.90289.2039.5839.26813.91117.34510.69
01/17/1987FASWQ128.67241.77818.18323.18627.27540.65719.17034.96828.17118.58240.85936.46529.37428.47131.17141.062
12/18/1885MCV-MFCH224.86026.8549.636314.86717.45354.18014.25826.55318.25416.07962.69828.74920.94024.66037.48048.175
02/05/1988AMNetQ153.310554.39963.710951.210751.310640.65939.910551.69155.910455.410958.99057.510352.710649.510658.110161.691
02/15/1989DAWA-FH227.46847.29213.67413.15819.25766.49120.47530.36133.9788.735948.97337.87126.76529.97828.06336.556
03/06/1990SM-AWPQ138.19230.75924.09925.29130.38244.96738.110256.09655.810319.98660.19451.29132.18230.28040.08961.792
03/09/19913DMST-CMH25.4734.1093.3782.9922.95117.63104.5573.2613.9572.16310.258.2826.37113.265.8699.356
04/12/1992TCSCSMH219.14845.2895.764111.05022.16241.16013.44924.85011.4437.175229.54026.64426.66420.54016.54417.431
05/10/1993tMGM-16F317.3428.70336.49459.824220.76113.72913.95421.84416.0475.574526.93625.44228.37122.14914.63939.659
05/13/1994VNH214.2389.69349.586210.9497.33309.541313.85311.33311.3427.175227.43823.33724.85622.85214.64018.435
05/15/1995PSMNet_2000H228.97320.4468.235315.16927.77835.25115.26350.88951.81009.296361.99731.15125.25827.86929.36752.980
05/28/1996PWCA_SGMQ130.97643.98618.98522.98524.46850.97622.27835.76927.57020.68953.48240.67932.48533.39032.37542.163
06/26/1997DeepPruner_ROBQ130.17434.26519.98824.38923.86647.27326.18626.15222.86018.48159.89336.56623.24931.78348.39644.870
07/26/1998EdgeStereoF318.74625.3516.794710.64625.17122.1418.312524.54516.5486.63509.20332.05324.65520.23819.25054.383
11/01/1999NVstereo2DH215.44011.5365.33387.21269.503518.03613.75112.93710.6374.413418.02524.43922.04521.24422.45853.681
11/07/19100LBPSH29.68235.05144.98295.57123.24146.03512.9455.44145.50153.552415.21915.92417.53117.3319.842328.346
11/11/19101SACA-NetQ131.78021.84716.07921.58424.56938.05534.69838.67236.38219.08449.47440.27832.18333.69136.07758.288
11/14/19102HSM-Smooth-OccF310.82711.7375.62408.75368.393315.4319.60298.29216.11194.093023.63220.43117.03013.4910.22716.628
11/15/19103SPPSMNetF341.49932.56120.69134.010133.08955.98436.310053.89348.69435.010571.610252.89737.19538.19846.79456.987
12/19/19104CRLEH25.7543.6653.1155.92142.1436.0143.3943.4963.6842.34510.259.6358.04514.9195.4579.265
12/30/19105F-GDGIFH231.67937.3727.725216.17334.99335.25220.17355.39546.6919.016147.67152.99829.47529.77729.46961.090
01/02/20106PPEP-GFQ134.68742.47921.79424.89030.88344.06425.18445.78142.18920.18744.16543.68235.29132.88739.38855.085
01/05/20107MTSF353.810651.79721.59338.810652.710797.510843.010866.410560.810532.010385.710569.010546.310345.110271.210685.2106
01/07/20108ADSR_GIFQ137.19043.68518.68436.710524.67058.68722.88056.39949.79618.78356.08648.59032.28424.55836.37879.1104
02/07/20109CasStereoH218.84723.9509.015510.54311.74174.09913.14710.1287.86224.093045.46725.24024.45417.33220.55544.368
02/20/20110CRARH222.05423.24913.57316.47416.35121.03921.87728.56026.96910.56732.54832.95523.35023.65520.35437.457
02/24/20111SGBMPF327.86937.57516.38017.17627.67775.710114.66233.46725.86612.27560.39534.05723.14829.37628.76631.249

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein