vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.47427.96312.17917.88513.75174.510914.06430.36926.37411.07764.410837.98125.86825.37229.37643.777
07/25/142SGBM1Q127.97928.36417.28919.08614.55357.99615.67231.87131.48213.28358.69838.68327.07625.97531.48059.797
07/25/143SGMQ120.86035.5749.576813.87116.55532.15319.07825.85816.7568.956739.86631.16122.65420.74921.36532.258
07/25/144SGBM1F328.48043.5909.096213.66925.98282.011214.46943.48430.3815.985359.310145.89628.58124.96920.16345.980
07/28/146SGBM1H223.86532.96910.87613.66716.25471.210512.65026.66123.0685.834953.89339.28525.66722.86118.85647.483
07/28/147SGMH218.45040.3824.54268.033322.97440.56511.44224.75410.1385.404529.64528.55423.95820.04514.24330.957
07/28/148SGMF325.37045.1944.33216.872732.29650.08513.05548.19318.3627.666029.64436.17331.28924.26624.56950.287
07/28/145Cens5H226.67647.1978.746111.96025.68045.37719.58140.68129.0799.937336.55938.68231.08825.07125.67044.678
08/25/149LPSH219.2546.14295.34419.24417.533596.011812.3479.61289.40335.184192.411827.45124.35923.06310.02825.653
08/27/1410LPSF320.3586.72316.06479.72439.874094.311714.16511.23611.2435.885089.311636.07220.54523.86516.05125.451
08/31/1411BSMQ141.510759.811125.810927.910238.910760.69733.310646.99037.39126.310564.810951.510142.610745.210942.89866.6103
09/10/1412LAMC_DSMH226.07155.810811.97814.37518.36044.07318.37739.97929.5806.675531.14934.56928.88226.37630.17835.763
09/18/1413SNCCH221.96148.61026.98539.794425.78146.08012.44836.87616.6557.255823.13334.26826.77421.85719.96228.456
10/07/1414IDRH218.14937.5814.08167.493123.37540.66612.85224.55211.3445.464633.15426.04621.55321.75615.34821.243
11/12/1415LCUQ117.04724.7557.595711.65811.94427.94814.06219.34715.8528.106236.15829.15621.35118.44014.14223.848
01/21/1516TSGOF339.110234.17116.98820.08743.311055.49314.36754.110349.210333.911266.211145.99739.810642.610747.210252.691
04/08/1517REAFH231.48758.310930.911513.16345.311263.810030.910438.77825.3738.606439.36436.87627.07535.510218.25439.768
04/09/1518PFSF332.28965.111529.411312.16250.011470.810428.29844.68823.1697.856137.06037.77927.97836.010419.86135.764
04/17/1519TMAPH216.94620.2504.94328.133612.84830.05011.74327.96420.4645.094031.55023.14020.94819.04218.85718.037
04/19/1520MeshStereoH213.2375.90264.883010.85312.94910.61911.03912.2399.01305.394427.43923.54217.73721.05015.44920.942
08/28/1521MC-CNN-acrtH28.08205.59224.55285.96192.831111.4265.81158.32248.89282.711616.32214.12113.22013.066.401811.118
09/14/1522ELASF332.39050.91049.176311.05633.09888.211618.37647.39126.87511.78141.77237.47723.75728.88363.011242.874
09/28/1523R-NCCF348.411126.25914.88630.210730.99372.910841.611677.711664.111327.410859.110071.911450.911433.910078.211680.8113
10/13/1524MDPH212.63614.4444.993410.65210.74227.2468.112712.5408.07254.273630.44620.53612.61417.83913.44117.334
11/03/1525MC-CNN+RBSH28.42216.05275.16376.24223.271711.1236.36208.87279.83363.212615.12015.92712.81613.5107.04209.9910
11/05/1526GCSVRH214.64517.1473.50108.223716.55647.4838.82329.75297.06223.172434.45727.15018.34019.24316.05019.340
11/06/1527SOU4P-netH213.43923.1545.41426.392313.15030.5519.003316.44512.7493.132228.94217.12916.43316.93310.73314.531
12/18/1528INTSH214.54420.2494.52248.623911.64329.54910.73816.44410.3394.693727.64122.53920.74620.54711.53624.949
01/19/1629NTDEH27.44155.72254.36225.92182.831110.4165.71135.30165.54182.401013.51614.11912.61513.9146.391712.223
01/26/1631MC-CNN-fstH29.47257.35335.07357.18294.712516.8378.47307.37216.97212.821720.72817.43115.43015.1227.902412.624
01/21/1630MCCNN_LayoutH28.94245.53215.63435.06113.592112.6307.23247.53228.86275.794823.03213.61715.02814.7195.851110.412
02/18/1632LS-ELASF336.79753.510510.37415.88337.010483.611324.59249.19534.68513.98444.97745.79534.99829.18464.411462.7101
03/15/1633MPSVQ143.510958.811033.911734.211137.910652.48830.810356.810751.010630.611156.99551.510244.610943.410844.29954.293
04/03/1634ICSGF345.611069.711719.19321.39143.611177.611036.911065.311240.49520.39353.69258.711146.511047.111260.711079.1111
04/12/1635MeshStereoExtH27.08114.41123.98155.40143.171510.0146.23184.62124.77143.492812.71412.41210.41114.5187.80238.853
04/13/1636GlstereoH219.85720.7528.256013.97218.66134.65612.95425.45723.2708.616531.14830.65920.34425.47421.16422.746
04/24/1637HLSC_corH226.07326.56015.28721.08920.56935.75923.48933.17335.08711.98239.16334.26725.26632.89628.37522.745
04/27/1638JEMQ137.29835.77527.911230.610833.29943.07131.410549.59647.310126.510749.68546.09835.79930.88837.58855.896
05/12/1639PMSCH26.7183.4622.6816.19212.5456.9274.5483.9694.04102.37913.11512.31112.21316.2295.881310.815
05/28/1640APAP-StereoH27.26135.43184.91315.11125.172721.6426.99234.31104.23123.242714.3189.7877.32513.496.30158.462
07/03/1641LPUH210.42911.4403.1878.10356.083120.9418.24286.94204.0094.043433.95616.92815.22917.8389.122611.621
08/31/1642SEDF363.411754.310722.410372.911964.511871.410642.511780.111767.911449.811879.611374.411765.411955.111786.111991.6118
09/13/1643SNP-RSMH28.75225.46204.85296.50253.371810.4187.31258.73269.37323.582914.31714.72314.92712.8510.13010.816
09/20/1644LFSIRQ170.111975.711960.311867.111772.411980.811153.711985.411983.811942.511691.211790.411864.111871.311961.511190.3117
10/19/1645LW-CNNH27.04104.65133.95135.30132.63611.2255.41124.32114.22112.431112.21213.41613.62314.8204.72112.022
10/23/1646SIGMRFQ164.211860.011233.011667.911863.211799.512139.811384.811882.011835.211395.211991.511958.111765.811855.010888.6116
11/06/1647SPSF319.65614.24312.38114.97912.04515.83519.17917.44615.4518.236330.94734.87030.68725.37228.37428.054
11/15/1648MC-CNN-WSH212.13314.8467.205411.1577.623615.93611.84411.5389.01303.893119.72720.53516.33216.33012.13918.338
11/15/1649UCNNH220.55944.8939.777113.66918.25936.56112.85123.45012.4479.226939.56530.55824.86221.25219.15932.359
11/16/1650MCSCF311.33213.3425.964610.6508.69387.22811.34010.6327.48233.07193.10125.24419.04117.23510.33125.552
11/24/1651ADSMQ138.710140.48320.39727.310035.110255.99422.38756.110550.910524.210258.09756.310836.510032.19438.79369.7105
01/03/1752SLACH219.35536.1766.53499.894821.97139.16411.84529.06717.9597.645940.26726.54721.14919.44415.04719.541
01/15/1753IGFQ134.09542.78620.19623.79632.29545.67928.610043.08337.28921.49950.98744.79334.79731.99137.48647.182
01/24/17543DMSTH25.9263.7182.7824.7572.7277.3694.2873.4443.7662.35812.61311.5108.56614.0155.3578.874
03/09/1755SGMEPiF313.9416.92326.71519.47429.723911.82813.65810.93410.6405.264232.85226.94922.75522.76012.03821.744
03/10/1756MC-CNN+TDSRF36.3575.45194.45236.80263.461910.7206.05165.01155.19162.621210.899.6256.59211.416.01147.041
03/22/1757JMRH212.5344.09103.97148.44386.933311.12213.85919.54819.0633.663017.02418.23218.03821.0517.292117.836
03/23/1758DSGCAQ133.89342.98720.99823.69530.29045.57827.69642.08236.08821.09750.28644.29233.39434.610138.49146.881
04/04/1759DDLQ130.18444.39219.49425.89928.38642.17021.18537.17728.77821.710046.88036.07130.38628.48132.78437.566
05/23/1760r200highH240.910570.511814.48421.39037.710572.210738.111253.210231.48218.38852.49052.610444.110845.411050.710566.5102
06/14/1761DoGGuidedQ141.410645.49623.610630.610934.610152.58928.39959.111153.811026.410660.610454.710738.310335.510344.510072.0109
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5953.3753.4863.3552.05210.379.7568.57714.4175.4089.558
08/25/1763SSRQ137.39950.010321.010028.510430.29153.89024.59357.810952.410822.010140.86948.59936.910132.79537.99052.290
10/12/1764FEN-D2DRRH27.23124.68144.11175.03103.03148.42116.05164.90145.32173.202511.51114.11913.42213.9135.06214.329
11/13/1765CBMVH211.1316.07285.22388.09344.052318.7409.313410.7339.61343.112133.75515.62617.53617.13410.12914.430
11/17/1766CGPTQ132.89143.48920.99923.29429.48943.47223.69043.88537.29020.79548.78240.98934.09532.19336.08542.473
12/11/1767OVODH28.87234.74163.64115.51164.822612.8316.51219.91309.96373.132216.62314.82414.12515.4246.921913.226
01/24/1868SMSSRQ134.89647.49922.410227.310128.88746.78123.69149.59743.49620.99637.76144.19134.69633.09739.19549.886
02/07/1869DFQ156.111647.710027.911136.111346.711362.59850.211872.411369.911637.811488.211570.011352.811650.211577.511591.8119
02/28/1870SDRH27.69175.41174.22184.2062.73810.2155.40116.40185.76194.723811.21015.42513.42116.5315.22513.025
03/06/1871NOSSH25.0423.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.20310.011
03/09/1872SGM_ROBH218.45137.4805.31399.034014.25231.75214.36824.75512.6485.274331.85129.75724.96322.05818.65528.255
03/11/1873SGM-ForestH27.37144.71153.69124.9393.181611.1235.37105.57175.81202.651414.51913.21413.11814.8215.631011.220
03/14/1874DTSH213.4408.45357.54567.46305.502814.93310.23724.55325.1724.933919.22618.73314.62615.92813.04017.233
03/23/1875MEDIAN_ROBH297.812196.112095.612099.012198.412198.412099.212198.412198.112099.012199.012199.612199.912194.712195.112098.3120
03/23/1876AVERAGE_ROBH297.612096.212196.512196.812097.812097.811998.212097.912098.212198.912098.912099.112099.712093.112097.912198.9121
03/26/1877ELAS_ROBH227.37743.48812.48213.97323.87666.410120.48333.07220.76511.07643.97437.57826.37028.78238.49233.360
04/17/1878ISMQ140.810442.58526.411034.811236.110344.57534.410856.210652.710925.210351.08952.410339.710433.39838.89475.3110
05/01/1879PSMNet_ROBQ142.110833.07023.110530.110631.49454.89230.710248.79448.310228.310980.811453.510636.910238.610663.911371.2106
05/05/1880WCMA_ROBQ132.99230.96718.79132.111029.28837.26223.18840.18034.98626.210457.59645.09429.38331.99239.89641.171
05/18/1881PDSH214.24214.4445.804510.54910.54122.14314.06314.5428.97295.935124.23521.53818.23918.94111.93733.661
05/22/1882DN-CSS_ROBH222.86331.4689.286513.56612.44744.37412.14628.16617.6589.116850.98840.08621.25025.07031.98243.275
05/24/1883LALA_ROBH226.07225.6589.546713.66818.76337.46316.87346.48945.610011.37940.76831.66226.36921.55421.66751.989
05/25/1884ETED_ROBH226.67525.65710.97714.87819.06433.35417.67544.58745.39816.18743.97633.66628.37921.65522.26848.885
05/25/1885XPNet_ROBH224.66719.94810.77512.16117.15727.84715.57147.59245.5999.737237.96228.45324.96317.43619.05861.498
05/26/1886NOSS_ROBH25.0113.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.2039.065
05/28/1887PWCDC_ROBF353.311448.510130.511451.611661.411683.811430.010150.59844.99744.511773.611258.811248.311249.311381.911881.1114
05/30/1888DLCB_ROBH212.53510.0386.70509.81455.763016.8389.983611.13511.2425.965224.73621.03716.83516.53214.34423.147
05/31/1889FBW_ROBH232.28836.3779.376614.27419.16569.310313.25651.010039.19310.87543.97441.59033.09329.98651.310671.4107
05/31/1890iResNet_ROBH224.86923.05310.27314.77612.44625.94512.95328.06524.97111.58046.67938.98421.45227.87845.610166.7104
05/31/1891CBMV_ROBH27.65163.4833.3584.8083.57206.3266.88224.84133.9171.97125.43711.1913.11715.8277.342213.828
06/01/1892DPSimNet_ROBF349.411260.111322.910428.310333.710063.19934.310774.711570.111729.311064.911072.211548.211155.011650.510479.6112
06/01/1893NaN_ROBH25.7353.4112.9063.6932.3345.3243.3543.4973.3142.31410.3810.889.641015.3235.4599.899
06/01/1894PDISCO_ROBH254.311562.511421.910138.611438.910784.011540.311574.511469.111539.411560.710573.611649.911346.911178.611781.2115
06/05/1895CBMBNetH210.2288.30345.10366.87274.522411.5277.702613.94113.2503.041821.93013.31513.62415.42511.23511.017
06/14/1896MSMD_ROBQ130.98626.96214.68520.08822.67333.75527.89743.98638.49221.19849.58440.88831.89031.68937.58943.676
06/27/1897DCNNH210.9305.66244.98336.49245.732912.5298.513115.64310.9413.082024.13420.23416.83415.52610.33213.827
07/31/1898MotionStereoH240.410367.611625.010829.210540.910957.39535.510957.510840.49419.99142.87352.610539.810537.110551.710734.962
10/10/1899DISCOH224.56635.0737.345511.75918.76248.68417.17431.47022.4669.337146.07833.56527.57724.66727.57255.095
10/29/18101iResNetH222.96428.3649.196415.88219.36835.15711.34127.76316.85715.28554.79427.65219.54221.55331.98151.688
10/29/18100Dense-CNNH27.98195.59224.54265.83172.79910.4175.78148.26238.84262.661515.62114.22213.21913.286.301511.118
11/07/18102IEBIMstH233.89436.77912.18016.98432.59751.08725.39458.111049.810411.27848.68156.910930.28526.87726.97171.7108
11/08/18103HSMF310.22712.0415.32407.50326.723215.6349.89356.83195.14154.173522.73117.12915.63114.31610.83414.632
11/11/18104MBMH222.86236.4789.957215.38119.36736.56019.98227.56218.16010.17441.57132.76426.37123.36421.46639.969
11/28/18105MSFNetAH27.96186.21304.26196.02203.66228.95126.28198.41258.06242.621217.92513.91811.91211.528.002510.614
01/12/19107EHCI_netH29.47263.7594.272013.16327.6845.3033.2313.4753.1833.90329.2049.5849.26913.91217.35310.613
01/17/19108FASWQ128.68141.78418.19023.19327.28340.66619.18034.97428.17718.59040.87036.47429.38428.48031.17941.070
12/18/18106MCV-MFCH224.86826.8619.637014.87717.45854.19114.26626.56018.26116.08662.610728.75520.94724.66837.48748.184
02/05/19109AMNetQ153.311354.310663.711951.211551.311540.66839.911451.610155.911255.411958.99957.511052.711549.511458.110961.699
02/15/19110DAWA-FH227.47847.29813.68313.16519.26666.410120.48430.36833.9848.736648.98337.88026.77329.98528.07336.565
02/26/19111FFEH26.7293.6874.52245.43152.79911.0213.9363.5784.42132.34721.52912.9138.65813.8115.3369.356
03/06/19112SM-AWPQ138.110030.76624.010725.29830.39244.97638.111156.010455.811119.99260.110351.210032.19130.28740.09761.7100
03/09/191133DMST-CMH25.4744.10113.3792.9922.95137.63104.5593.2613.9582.16310.268.2836.37113.275.86129.356
03/13/19114WDMCH213.23810.6397.93589.83478.143718.73912.54910.4319.80353.903232.85323.64319.54317.63710.02724.949
04/12/19115TCSCSMH219.15345.2955.764411.05522.17241.16913.45724.85611.4467.175629.54326.64826.67220.54816.55217.435
05/10/19116tMGM-16F317.3488.70366.49489.824620.77013.73213.96121.84916.0535.574726.93825.44528.37922.15914.64539.667
05/13/19117VNH214.2439.69379.586910.9547.33349.541313.86011.33711.3457.175627.44023.34124.86122.86214.64618.439
05/15/19118PSMNet_2000H228.98220.4518.235915.18027.78535.25815.27050.89951.81079.297061.910631.16025.26527.87829.37652.992
05/28/19119PWCA_SGMQ130.98543.99118.99222.99224.47850.98622.28635.77527.57620.69453.49140.68732.49233.39932.38342.172
06/26/19120DeepPruner_ROBQ130.18334.27219.99524.39723.87647.28226.19526.15922.86718.48959.810236.57523.25631.79048.310344.879
07/26/19121EdgeStereoF318.75225.3566.795210.65125.17922.1438.312924.55116.5546.63549.20432.06324.66020.24619.26054.394

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein