vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.46627.95712.17017.87813.74774.510114.05730.36326.36811.07164.410037.97325.86225.36529.36843.768
07/25/142SGBM1Q127.97128.35817.28319.07914.54957.98715.66531.86531.47713.27758.69038.67527.06925.96731.47359.790
07/25/143SGMQ120.85335.5689.576213.86316.55332.14919.06925.85216.7518.956039.85931.15322.64720.74221.35632.251
07/25/144SGBM1F328.47243.5859.095713.66225.97582.010414.46243.47930.3765.984959.39345.88828.57324.96220.15345.972
07/28/146SGBM1H223.85932.96310.86813.66116.25171.29612.64326.65523.0625.834653.88539.27725.66122.85218.84847.475
07/28/147SGMH218.44540.3774.54228.033022.96540.55711.43724.74910.1355.404329.64328.54923.95320.03814.23830.949
07/28/148SGMF325.36345.1894.33186.872332.28850.07613.04748.18518.3567.665529.64236.16531.28124.25824.56050.278
07/28/145Cens5H226.66747.1928.745511.95525.67345.36919.57240.67629.0749.936636.55438.67431.08025.06425.66144.670
08/25/149LPSH219.2506.14265.34399.24387.533196.010912.3419.61269.40315.183992.411027.44724.35423.05410.02425.644
08/27/1410LPSF320.3526.72286.06449.72409.873794.310814.15811.23211.2405.884789.310936.06420.53923.85716.04325.442
08/31/1411BSMQ141.510159.810625.810327.99638.910060.68933.39746.98337.38526.39864.810151.59342.610145.210442.89166.696
09/10/1412LAMC_DSMH226.06455.810211.96914.36618.35544.06418.36839.97529.5756.675131.14634.56128.87426.36830.17135.755
09/18/1413SNCCH221.95448.6966.98489.794125.77446.07212.44236.87116.6507.255423.13234.26026.76721.84819.95228.448
10/07/1414IDRH218.14437.5754.08137.492823.36640.65812.84424.54611.3425.464433.15126.04421.54521.74715.34121.237
01/21/1515TSGOF339.19534.16516.98220.08043.310255.48314.36054.19549.29633.910566.210245.98939.810042.610147.29652.680
04/08/1516REAFH231.47958.310330.910813.15745.310463.89130.99538.77425.3668.605839.35836.86827.06835.59518.24639.761
04/09/1517PFSF332.28365.110829.410712.15650.010670.89528.29044.68123.1637.855637.05537.77127.97136.09719.85135.756
04/17/1518TMAPH216.94220.2454.94288.133312.84530.04711.73827.95820.4585.093831.54723.13720.94219.03618.84918.033
04/19/1519MeshStereoH213.2345.90234.882610.84812.94610.61811.03412.2359.01285.394227.43823.53917.73421.04315.44220.936
08/28/1520MC-CNN-acrtH28.08175.59194.55245.96162.83911.4245.81138.32228.89262.711416.32214.11713.21713.056.401511.114
09/14/1521ELASF332.38450.9979.175811.05133.09188.210618.36747.38426.86911.77441.76237.46923.75228.87563.010442.865
09/28/1522R-NCCF348.410526.25314.87830.29930.98572.99941.610777.710964.110827.410159.19271.910950.910633.99378.210980.8106
10/13/1523MDPH212.63314.4414.993110.64710.73927.2458.112312.5368.07244.273330.44420.53312.61117.83413.43717.330
11/03/1524MC-CNN+RBSH28.42186.05245.16346.24193.271511.1216.36178.87259.83333.212215.11915.92312.81313.5107.04179.998
12/18/1525INTSH214.53920.2444.52218.623511.64029.54610.73316.44110.3364.693527.64022.53620.74020.54011.53224.941
01/19/1626NTDEH27.44125.72224.36195.92142.83910.4155.71115.30135.54162.40813.51514.11512.61213.9136.391412.219
01/26/1627MC-CNN-fstH29.47217.35305.07327.18254.712216.8358.47277.37196.97202.821520.72917.42715.42615.1207.902012.620
02/18/1628LS-ELASF336.79053.59910.36715.87337.09783.610524.58449.18734.68013.97844.96745.78734.99129.17664.410662.794
03/15/1629MPSVQ143.510358.810433.911034.210337.99952.47930.89456.810151.010030.610356.98851.59444.610343.410244.29254.283
04/03/1630ICSGF345.610469.711019.18721.38443.610377.610336.910265.310540.48920.38953.68458.710546.510547.110660.710379.1104
04/24/1631HLSC_corH226.06526.55415.27921.08220.56135.75423.48233.16735.08111.97539.15734.25925.26032.88728.36622.739
04/27/1632JEMQ137.29235.76927.910630.610033.29243.06331.49649.58847.39326.510049.67746.09035.79330.88237.58255.887
05/12/1633PMSCH26.7173.4612.6816.19182.5446.9274.5463.9674.0492.37713.11412.31012.21016.2265.881010.811
05/28/1634APAP-StereoH27.26105.43164.91275.1195.172421.6416.99204.3184.23113.242314.3179.7877.32413.486.30128.462
07/03/1635LPUH210.42611.4353.1868.10326.082720.9398.24246.94184.0084.042933.95316.92515.22517.8339.122211.617
08/31/1636SEDF363.411054.310122.49772.911164.511171.49742.510880.111067.910949.811079.610574.411065.411155.111086.111191.6110
09/13/1637SNP-RSMH28.75195.46184.85256.50213.371610.4177.31218.73249.37303.582514.31614.71914.92412.8410.12610.812
10/19/1638LW-CNNH27.0484.65103.95115.30102.63511.2235.41104.3294.22102.43912.21213.41313.62014.8174.72112.018
10/23/1639SIGMRFQ164.211160.010733.010967.911063.211099.511339.810584.811182.011135.210795.211191.511158.110965.811155.010188.6109
11/06/1640SPSF319.65114.24012.37214.96912.04215.83319.17017.44215.4478.235730.94534.86230.67925.36528.36528.045
11/15/1641MC-CNN-WSH212.13114.8437.204911.1527.623215.93411.83911.5349.01283.892719.72820.53216.32916.32712.13518.334
11/16/1642MCSCF311.33013.3395.964310.6458.69347.22811.33510.6297.48213.07173.10125.24219.03717.23010.32825.543
11/24/1643ADSMQ138.79440.47820.39127.39435.19555.98422.38056.19850.99924.29658.08956.310236.59432.18638.78669.798
01/15/1744IGFQ134.08742.78220.19023.78932.28745.67128.69243.07837.28421.49450.97944.78634.79031.98537.48047.174
01/24/17453DMSTH25.9253.7162.7824.7552.7267.3694.2853.4433.7652.35612.61311.598.56614.0145.3558.873
03/09/1746SGMEPiF313.9366.92296.71469.47399.723611.82613.65110.93110.6385.264032.85026.94622.74822.75112.03421.738
03/10/1747MC-CNN+TDSRF36.3565.45174.45206.80223.461710.7196.05145.01125.19132.621010.899.6246.59211.416.01117.041
03/22/1748JMRH212.5324.0983.97128.44346.932911.12013.85319.54319.0573.662617.02418.22818.03521.0447.291817.832
03/23/1749DSGCAQ133.88542.98320.99323.68830.28245.57027.68842.07736.08221.09250.27844.28533.38834.69438.48446.873
04/04/1750DDLQ130.17644.38819.48825.89328.38042.16221.17737.17228.77321.79546.87136.06330.37828.47332.77737.559
05/23/1751r200highH240.99870.511114.47621.38337.79872.29838.110453.29331.47718.38152.48252.69644.110245.410550.79866.595
06/14/1752DoGGuidedQ141.49945.49123.69930.610134.69352.58028.39159.110453.810326.49960.69754.710138.39735.59644.59372.0102
06/22/1753LocalExpH25.4323.6542.8742.9811.9925.5933.3733.4853.3532.05210.389.7568.57714.4165.4069.557
10/12/1754FEN-D2DRRH27.2394.68114.11145.0383.03128.42116.05144.90115.32143.202111.51114.11513.41913.9125.06214.325
11/13/1755CBMVH211.1296.07255.22358.09314.052018.7389.312910.7309.61323.111933.75215.62217.53317.12910.12514.426
12/11/1756OVODH28.87204.74133.6495.51114.822312.8286.51189.91279.96343.132016.62314.82014.12215.4216.921613.222
01/24/1857SMSSRQ134.88947.49422.49627.39528.88146.77323.68349.58943.49120.99137.75644.18434.68933.08939.18849.877
02/07/1858DFQ156.110847.79527.910536.110546.710562.59050.211172.410869.911037.810888.210870.010752.810850.210977.510891.8111
02/28/1859SDRH27.69145.41154.22154.2042.73710.2145.4096.40165.76174.723611.21015.42113.41816.5285.22413.021
03/09/1860SGM_ROBH218.44637.4745.31369.033714.24831.74814.36124.75012.6455.274131.84829.75124.95822.04918.64728.246
03/11/1861SGM-ForestH27.37114.71123.69104.9373.181311.1215.3785.57155.81182.651214.51813.21113.11514.8185.63811.216
03/14/1862DTSH213.4358.45327.54517.46275.502514.93010.23224.54725.1654.933719.22718.72914.62315.92513.03617.229
03/23/1863MEDIAN_ROBH297.811396.111295.611299.011398.411398.411299.211398.411398.111299.011399.011399.611399.911394.711395.111298.3112
03/23/1864AVERAGE_ROBH297.611296.211396.511396.811297.811297.811198.211297.911298.211398.911298.911299.111299.711293.111297.911398.9113
03/26/1865ELAS_ROBH227.36843.48412.47313.96423.86766.49220.47533.06620.75911.07043.96437.57026.36328.77438.48533.352
04/17/1866ISMQ140.89742.58126.410434.810436.19644.56734.49856.29952.710225.29751.08152.49539.79833.39038.88775.3103
05/01/1867PSMNet_ROBQ142.110233.06423.19830.19831.48654.88230.79348.78648.39428.310280.810653.510036.99538.610063.910571.299
05/18/1868PDSH214.23714.4415.804210.54410.53822.14214.05614.5398.97275.934824.23521.53418.23618.93511.93333.653
05/22/1869DN-CSS_ROBH222.85731.4619.286013.56012.44444.36612.14028.16017.6539.116250.98040.07821.24325.06331.97543.266
05/26/1870NOSS_ROBH25.0113.5732.8433.9931.9315.1513.3423.3223.1512.3248.5527.4517.06312.535.2039.064
05/31/1871FBW_ROBH232.28236.3709.376114.26519.15769.39413.24951.09139.18710.86943.96441.58233.08729.98051.39971.4100
05/31/1872iResNet_ROBH224.86223.04810.26614.76712.44325.94412.94528.05924.96411.57346.67038.97621.44427.87045.69466.797
05/31/1873CBMV_ROBH27.65133.4823.3574.8063.57186.3266.88194.84103.9161.97125.43611.1813.11415.8247.341913.824
06/05/1874CBMBNetH210.2258.30315.10336.87234.522111.5257.702213.93813.2463.041621.93013.31213.62115.42211.23111.013
06/14/1875MSMD_ROBQ130.97826.95614.67720.08122.66433.75027.88943.98038.48621.19349.57640.88131.88231.68337.58343.667
06/27/1876DCNNH210.9285.66214.98296.49205.732612.5278.512815.64010.9393.081824.13420.23016.83015.52310.32913.823
07/31/1877MotionStereoH240.49667.610925.010129.29740.910157.38635.510057.510240.48819.98642.86352.69739.89937.19851.710034.954
10/10/1878DISCOH224.56035.0677.345011.75418.75648.67517.16631.46422.4609.336446.06933.55727.57024.66027.56355.085
10/29/1880iResNetH222.95828.3589.195915.87219.36035.15111.33627.75716.85215.27954.78627.64819.53821.54631.97451.679
10/29/1879Dense-CNNH27.98165.59194.54225.83132.79810.4165.78128.26208.84252.661315.62114.21813.21613.276.301211.114
11/07/1881IEBIMstH233.88636.77212.17116.97632.58951.07825.38658.110349.89811.27248.67356.910330.27726.86926.96271.7101
11/08/1882HSMF310.22412.0385.32377.50296.722815.6329.89316.83175.14124.173222.73117.12615.62714.31510.83014.627
11/11/1883MBMH222.85636.4719.956515.37119.35936.55519.97327.55618.15410.16741.56132.75526.36423.35521.45739.962
11/28/1884MSFNetAH27.96156.21274.26166.02173.66198.95126.28168.41238.06232.621017.92513.91411.9911.528.002110.610
01/12/1986EHCI_netH29.47223.7574.271713.15727.6775.3023.2313.4743.1823.90289.2039.5839.26813.91117.34510.69
01/17/1987FASWQ128.67341.77918.18423.18727.27640.65819.17134.96928.17218.58340.86036.46629.37528.47231.17241.063
12/18/1885MCV-MFCH224.86126.8559.636414.86817.45454.18114.25926.55418.25516.08062.69928.75020.94124.66137.48148.176
02/05/1988AMNetQ153.310654.310063.711151.210951.310740.66039.910651.69255.910555.411158.99157.510452.710749.510858.110261.692
02/15/1989DAWA-FH227.46947.29313.67513.15919.25866.49220.47630.36233.9798.735948.97437.87226.76629.97928.06436.557
03/06/1990SM-AWPQ138.19330.76024.010025.29230.38344.96838.110356.09755.810419.98760.19551.29232.18330.28140.09061.793
03/09/19913DMST-CMH25.4734.1093.3782.9922.95117.63104.5573.2613.9572.16310.268.2826.37113.265.8699.356
04/12/1992TCSCSMH219.14945.2905.764111.05022.16341.16113.45024.85111.4447.175229.54126.64526.66520.54116.54417.431
05/10/1993tMGM-16F317.3438.70336.49459.824220.76213.72913.95521.84416.0485.574526.93725.44328.37222.15014.63939.660
05/13/1994VNH214.2389.69349.586310.9497.33309.541313.85411.33311.3437.175227.43923.33824.85722.85314.64018.435
05/15/1995PSMNet_2000H228.97420.4468.235315.17027.77935.25215.26450.89051.81019.296361.99831.15225.25927.87029.36852.981
05/28/1996PWCA_SGMQ130.97743.98718.98622.98624.46950.97722.27935.77027.57120.69053.48340.68032.48633.39132.37642.164
06/26/1997DeepPruner_ROBQ130.17534.26619.98924.39023.86747.27426.18726.15322.86118.48259.89436.56723.25031.78448.39744.871
07/26/1998EdgeStereoF318.74725.3516.794710.64625.17222.1428.312524.54516.5496.63509.20332.05424.65620.23919.25054.384
11/01/1999NVstereo2DH215.44011.5365.33387.21269.503518.03713.75212.93710.6374.413418.02624.44022.04621.24522.45853.682
11/07/19100LBPSH29.68235.05144.98295.57123.24146.03512.9465.44145.50153.552415.22015.92417.53217.3319.842328.347
11/11/19101SACA-NetQ131.78121.84716.08021.58524.57038.05634.69938.67336.38319.08549.47540.27932.18433.69236.07858.289
11/14/19102HSM-Smooth-OccF310.82711.7375.62408.75368.393315.4319.60308.29216.11194.093023.63320.43117.03113.4910.22716.628
11/15/19103SPPSMNetF341.410032.56220.69234.010233.09055.98536.310153.89448.69535.010671.610352.89837.19638.19946.79556.988
12/19/19104CRLEH25.7543.6653.1155.92142.1436.0143.3943.4963.6842.34510.269.6358.04514.9195.4579.265
12/30/19105F-GDGIFH231.68037.3737.725216.17434.99435.25320.17455.39646.6929.016147.67252.99929.47629.77829.47061.091
01/02/20106PPEP-GFQ134.68842.48021.79524.89130.88444.06525.18545.78242.19020.18844.16643.68335.29232.88839.38955.086
01/05/20107MTS2F353.810751.79821.59438.810752.710897.511043.010966.410660.810632.010485.710769.010646.310445.110371.210785.2107
01/07/20108ADSR_GIFQ137.19143.68618.68536.710624.67158.68822.88156.310049.79718.78456.08748.59132.28524.55936.37979.1105
02/07/20109CasStereoH218.84823.9509.015610.54311.74174.010013.14810.1287.86224.093045.46825.24124.45517.33220.55544.369
02/20/20110CRARH222.05523.24913.57416.47516.35221.04021.87828.56126.97010.56832.54932.95623.35123.65620.35437.458
02/24/20111SGBMPF327.87037.57616.38117.17727.67875.710214.66333.46825.86712.27660.39634.05823.14929.37728.76731.250
03/02/20112AdaStereoF316.04125.7528.575411.55315.75017.2368.312524.74811.3419.48659.99522.53516.02819.93724.35924.340
03/13/20113MTSF359.710958.810525.210251.110860.410991.310748.311070.310763.410744.410979.310471.710860.911047.410779.611088.4108

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein