vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.46227.95312.16617.87213.74574.59414.05430.35926.36411.06664.49237.96825.85725.36029.36343.764
07/25/142SGBM1Q127.96628.35417.27719.07314.54757.98215.66131.86131.47213.27158.68338.67027.06425.96231.46759.784
07/25/143SGMQ120.85035.5649.575813.86016.54932.14619.06525.84916.7488.955839.85631.15022.64520.73921.35332.248
07/25/144SGBM1F328.46743.5789.095313.65925.97082.09614.45943.47430.3715.984759.38645.88228.56824.95720.15245.967
07/28/146SGBM1H223.85532.95910.86413.65816.24871.29012.64126.65223.0595.834453.87939.27225.65622.84918.84747.470
07/28/147SGMH218.44340.3714.54218.032922.96140.55311.43524.74610.1335.404129.64128.54623.94920.03514.23730.947
07/28/148SGMF325.35945.1814.33176.872232.28150.07113.04548.17918.3537.665329.64036.16031.27524.25424.55650.273
07/28/145Cens5H226.66347.1848.745211.95225.66845.36419.56840.67129.0699.936236.55138.66931.07425.05925.65744.665
08/25/149LPSH219.2476.14255.34389.24377.533096.010012.3399.61259.40295.183792.410027.44424.35023.05110.02325.642
08/27/1410LPSF320.3496.72276.06439.72399.873694.39914.15511.23011.2385.884589.39936.05920.53723.85316.04225.440
08/31/1411BSMQ141.59359.89625.89327.98938.99260.68333.38946.97737.38026.39064.89351.58642.69345.29542.88366.689
09/10/1412LAMC_DSMH226.06055.89311.96514.36318.35144.06018.36439.97029.5706.674931.14434.55628.86926.36330.16535.752
09/18/1413SNCCH221.95148.6886.98479.794025.76946.06712.44036.86616.6477.255223.13034.25526.76221.84519.95128.446
10/07/1414IDRH218.14237.5704.08127.492723.36240.65412.84224.54411.3395.464233.14826.04121.54321.74415.34021.236
01/21/1516TSGOF339.18734.16116.97620.07443.39455.47814.35754.18949.28933.99666.29445.98339.89242.69347.28852.675
04/08/1517REAFH231.47458.39430.99813.15445.39663.88530.98738.76925.3638.605639.35536.86327.06335.58718.24539.757
04/09/1518PFSF332.27765.19829.49712.15350.09870.88928.28244.67623.1607.855437.05237.76627.96636.08919.85035.753
04/17/1519TMAPH216.94020.2444.94278.133212.84330.04411.73627.95520.4555.093631.54523.13520.94019.03418.84818.032
04/19/1520MeshStereoH213.2335.90224.882510.84612.94410.61711.03212.2339.01265.394027.43623.53717.73221.04015.44120.935
08/28/1521MC-CNN-acrtH28.08165.59184.55235.96152.83811.4235.81128.32218.89242.711316.32014.11613.21613.056.401411.113
09/14/1522ELASF332.37850.9899.175411.04933.08488.29818.36347.37826.86511.76941.75937.46423.74828.87063.09642.861
09/28/1523R-NCCF348.49726.24914.87330.29230.97872.99341.69977.79964.19827.49359.18571.99950.99733.98578.210080.898
10/13/1524MDPH212.63214.4404.993010.64510.73827.2428.112212.5348.07224.273130.44220.53212.61017.83213.43617.329
11/03/1525MC-CNN+RBSH28.42176.05235.16336.24183.271411.1206.36168.87249.83313.212115.11715.92212.81213.5107.04169.997
12/18/1528INTSH214.53820.2434.52208.623411.63929.54310.73116.43910.3344.693327.63822.53420.73820.53711.53124.939
01/19/1629NTDEH27.44115.72214.36185.92142.83810.4145.71105.30125.54152.40713.51314.11412.61113.9136.391312.218
01/26/1631MC-CNN-fstH29.47207.35295.07317.18244.712116.8348.47257.37186.97192.821420.72717.42615.42515.1197.901912.619
02/18/1632LS-ELASF336.78353.59010.36315.87037.08983.69724.57749.18134.67513.97244.96345.78134.98429.17164.49862.787
03/15/1633MPSVQ143.59558.89533.910034.29637.99152.47430.88656.89351.09230.69556.98151.58744.69543.49444.28454.278
04/03/1634ICSGF345.69669.710019.18021.37843.69577.69536.99465.39740.48420.38153.67858.79746.59647.19760.79579.197
04/24/1637HLSC_corH226.06126.55015.27421.07620.55735.75023.47533.16335.07611.97039.15434.25425.25532.88028.36222.738
04/27/1638JEMQ137.28435.76527.99630.69333.28543.05931.48849.58247.38626.59249.67146.08435.78530.87537.57555.881
05/12/1639PMSCH26.7163.4612.6816.19172.5436.9264.5453.9664.0482.37613.11212.3912.2916.2255.88910.810
05/28/1640APAP-StereoH27.2695.43154.91265.1195.172321.6386.99194.3174.23103.242214.3159.7867.32413.486.30118.462
07/03/1641LPUH210.42511.4343.1858.10316.082620.9378.24236.94174.0074.042833.95016.92415.22417.8319.122111.616
08/31/1642SEDF363.410054.39222.48872.910164.510171.49142.510080.110067.99949.810079.69674.410065.410155.110086.110191.6100
09/13/1643SNP-RSMH28.75185.46174.85246.50203.371510.4167.31208.73239.37283.582414.31414.71814.92312.8410.12510.811
10/19/1645LW-CNNH27.0474.6593.95105.30102.63411.2225.4194.3284.2292.43812.21013.41213.61914.8174.72112.017
10/23/1646SIGMRFQ164.210160.09733.09967.910063.210099.510339.89784.810182.010135.29895.210191.510158.110065.810155.09388.699
11/06/1647SPSF319.64814.23912.36814.96612.04015.83219.16617.44015.4448.235530.94334.85730.67325.36028.36128.043
11/15/1648MC-CNN-WSH212.13014.8427.204811.1507.623115.93311.83711.5329.01263.892619.72620.53116.32716.32612.13418.333
11/16/1650MCSCF311.32913.3385.964210.6438.69337.22711.33310.6277.48203.07163.10125.23919.03517.22910.32725.541
11/24/1651ADSMQ138.78640.47220.38427.38735.18755.97922.37456.19150.99124.28858.08256.39436.58632.17938.77969.791
01/15/1753IGFQ134.08142.77520.18323.78332.28045.66628.68443.07337.27921.48650.97344.78034.78331.97837.47347.169
01/24/17543DMSTH25.9243.7152.7824.7552.7257.3684.2843.4433.7642.35512.61111.588.56514.0145.3558.873
03/09/1755SGMEPiF313.9356.92286.71459.47389.723511.82513.64810.92910.6365.263832.84726.94322.74622.74812.03321.737
03/10/1756MC-CNN+TDSRF36.3555.45164.45196.80213.461610.7186.05135.01115.19122.62910.879.6246.59211.416.01107.041
03/22/1757JMRH212.5314.0973.97118.44336.932811.11913.85019.54119.0543.662517.02218.22718.03321.0417.291717.831
03/23/1758DSGCAQ133.87942.97620.98623.68230.27645.56527.68042.07236.07721.08450.27244.27933.38134.68638.47746.868
04/04/1759DDLQ130.17144.38019.48125.88628.37442.15821.17237.16728.76821.78746.86636.05830.37228.46832.77137.555
05/23/1760r200highH240.99070.510114.47121.37737.79072.29238.19653.28731.47218.37552.47652.68944.19445.49650.79066.588
06/14/1761DoGGuidedQ141.49145.48323.69030.69434.68652.57528.38359.19653.89526.49160.68954.79338.38935.58844.58572.095
06/22/1762LocalExpH25.4323.6542.8742.9811.9925.5933.3733.4853.3532.05210.369.7558.57614.4165.4069.556
10/12/1764FEN-D2DRRH27.2384.68104.11135.0383.03118.42106.05134.90105.32133.202011.5914.11413.41813.9125.06214.324
11/13/1765CBMVH211.1286.07245.22348.09304.051918.7369.312710.7289.61303.111833.74915.62117.53117.12810.12414.425
12/11/1767OVODH28.87194.74123.6485.51114.822212.8276.51179.91269.96323.131916.62114.81914.12115.4206.921513.221
01/24/1868SMSSRQ134.88247.48622.48727.38828.87546.76823.67649.58343.48520.98337.75344.17834.68233.08139.18149.872
02/07/1869DFQ156.19947.78727.99536.19846.79762.58450.210172.49869.910037.89988.29870.09852.89950.29977.59991.8101
02/28/1870SDRH27.69135.41144.22144.2042.73610.2135.4086.40155.76164.723411.2815.42013.41716.5275.22413.020
03/09/1871SGM_ROBH218.44437.4695.31359.033614.24631.74514.35824.74712.6425.273931.84629.74824.95322.04618.64628.244
03/11/1872SGM-ForestH27.37104.71113.6994.9373.181211.1205.3775.57145.81172.651114.51613.21013.11414.8185.63711.215
03/14/1873DTSH213.4348.45317.54507.46265.502414.92910.23024.54525.1624.933519.22518.72814.62215.92413.03517.228
03/23/1874MEDIAN_ROBH297.810396.110295.610299.010398.410398.410299.210398.410398.110299.010399.010399.610399.910394.710395.110298.3102
03/23/1875AVERAGE_ROBH297.610296.210396.510396.810297.810297.810198.210297.910298.210398.910298.910299.110299.710293.110297.910398.9103
03/26/1876ELAS_ROBH227.36443.47712.46913.96123.86366.48620.47033.06220.75611.06543.96137.56526.35828.76938.47833.349
04/17/1877ISMQ140.88942.57426.49434.89736.18844.56234.49056.29252.79425.28951.07552.48839.79033.38238.88075.396
05/01/1878PSMNet_ROBQ142.19433.06023.18930.19131.47954.87730.78548.78048.38728.39480.89753.59236.98738.69263.99771.292
05/18/1880PDSH214.23614.4405.804110.54210.53722.13914.05314.5378.97255.934624.23321.53318.23418.93311.93233.650
05/22/1881DN-CSS_ROBH222.85331.4579.285613.55712.44244.36112.13828.15717.6509.115950.97440.07321.24125.05831.96943.262
05/26/1885NOSS_ROBH25.0113.5732.8433.9931.9315.1513.3423.3223.1512.3248.5527.4517.06312.535.2039.064
05/31/1888FBW_ROBH232.27636.3669.375714.26219.15369.38813.24651.08539.18210.86443.96141.57733.08029.97351.39171.493
05/31/1889iResNet_ROBH224.85823.04710.26214.76412.44125.94112.94328.05624.96111.56846.66538.97121.44227.86545.68666.790
05/31/1890CBMV_ROBH27.65123.4823.3564.8063.57176.3256.88184.8493.9151.97125.43411.1713.11315.8237.341813.823
06/05/1894CBMBNetH210.2248.30305.10326.87224.522011.5247.702113.93613.2433.041521.92813.31113.62015.42111.23011.012
06/14/1895MSMD_ROBQ130.97326.95214.67220.07522.66033.74727.88143.97538.48121.18549.57040.87631.87631.67637.57643.663
06/27/1896DCNNH210.9275.66204.98286.49195.732512.5268.512615.63810.9373.081724.13220.22916.82815.52210.32813.822
07/31/1897MotionStereoH240.48867.69925.09229.29040.99357.38135.59257.59440.48319.97942.86052.69039.89137.19051.79234.951
10/10/1898DISCOH224.55635.0637.344911.75118.75248.67017.16231.46022.4579.336146.06433.55327.56524.65527.55955.080
10/29/18100iResNetH222.95428.3549.195515.86919.35635.14811.33427.75416.84915.27354.78027.64519.53621.54331.96851.674
10/29/1899Dense-CNNH27.98155.59184.54215.83132.79710.4155.78118.26198.84232.661215.61914.21713.21513.276.301111.113
11/07/18101IEBIMstH233.88036.76812.16716.97132.58251.07325.37858.19549.89011.26748.66756.99530.27126.86426.95871.794
11/08/18102HSMF310.22312.0375.32367.50286.722715.6319.89296.83165.14114.173022.72917.12515.62614.31510.82914.626
11/11/18103MBMH222.85236.4679.956115.36819.35536.55119.96927.55318.15110.16341.55832.75226.35923.35221.45439.958
11/28/18104MSFNetAH27.96146.21264.26156.02163.66188.95116.28158.41228.06212.62917.92313.91311.9811.528.002010.69
01/12/19106EHCI_netH29.47213.7564.271613.15427.6725.3023.2313.4743.1823.90279.2039.5839.26713.91117.34410.68
01/17/19107FASWQ128.66841.77318.17823.18127.27140.65419.16734.96428.16718.57740.85736.46129.37028.46731.16641.059
12/18/18105MCV-MFCH224.85726.8519.636014.86517.45054.17614.25626.55118.25216.07462.69128.74720.93924.65637.47448.171
02/05/19108AMNetQ153.39854.39163.710151.29951.39940.65639.99851.68655.99755.410158.98457.59652.79849.59858.19461.685
02/15/19109DAWA-FH227.46547.28513.67013.15619.25466.48620.47130.35833.9748.735748.96837.86726.76129.97228.06036.554
03/06/19111SM-AWPQ138.18530.75624.09125.28530.37744.96338.19556.09055.89619.98060.18851.28532.17730.27440.08261.786
03/09/191123DMST-CMH25.4734.1083.3772.9922.95107.6394.5563.2613.9562.16310.258.2826.37113.265.8689.355
04/12/19113TCSCSMH219.14645.2825.764011.04822.15941.15713.44724.84811.4417.175029.53926.64226.66020.53816.54317.430
05/10/19114tMGM-16F317.3418.70326.49449.824120.75813.72813.95221.84216.0455.574326.93525.44028.36722.14714.63839.656
05/13/19115VNH214.2379.69339.585910.9477.33299.541213.85111.33111.3407.175027.43723.33624.85222.85014.63918.434
05/15/19116PSMNet_2000H228.96920.4458.235115.16727.77335.24915.26050.88451.8939.296061.99031.14925.25427.86529.36352.976
05/28/19117PWCA_SGMQ130.97243.97918.97922.98024.46550.97222.27335.76527.56620.68253.47740.67532.47933.38332.37042.160
06/26/19118DeepPruner_ROBQ130.17034.26219.98224.38423.86347.26926.17926.15022.85818.47659.88736.56223.24731.77748.38944.866
07/26/19119EdgeStereoF318.74525.3486.794610.64425.16722.1398.312424.54316.5466.63489.20332.05124.65120.23619.24954.379
11/01/19120NVstereo2DH215.43911.5355.33377.21259.503418.03513.74912.93510.6354.413218.02424.43822.04421.24222.45553.677
11/07/19121LBPSH29.68225.05134.98285.57123.24136.03412.9445.44135.50143.552315.21815.92317.53017.3309.842228.345
11/11/19122SACA-NetQ131.77521.84616.07521.57924.56638.05234.69138.66836.37819.07849.46940.27432.17833.68436.07258.283
11/14/19123HSM-Smooth-OccF310.82611.7365.62398.75358.393215.4309.60288.29206.11184.092923.63120.43017.02913.4910.22616.627
11/15/19124SPPSMNetF341.49232.55820.68534.09533.08355.98036.39353.88848.68835.09771.69552.89137.18838.19146.78756.982

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein