vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.47327.96212.17817.88413.75174.510614.06330.36726.37211.07664.410537.97925.86625.37129.37543.776
07/25/142SGBM1Q127.97828.36317.28819.08514.55357.99315.67131.86931.47913.28258.69638.68127.07425.97431.47959.794
07/25/143SGMQ120.85935.5729.576713.87016.55532.15219.07725.85716.7558.956639.86531.16122.65420.74821.36432.258
07/25/144SGBM1F328.47943.5889.096113.66825.97982.010914.46843.48130.3785.985359.39945.89328.57924.96820.16245.978
07/28/146SGBM1H223.86432.96810.87513.66616.25471.210212.64926.65923.0665.834953.89139.28325.66522.86018.85647.481
07/28/147SGMH218.45040.3804.54268.033322.97440.56411.44124.75310.1385.404529.64428.55423.95720.04514.24330.957
07/28/148SGMF325.36945.1914.33216.872732.29350.08313.05448.19018.3617.665929.64336.17231.28724.26524.56850.285
07/28/145Cens5H226.67547.1948.746011.95925.67745.37619.58040.67829.0769.937236.55838.68031.08625.07025.66944.677
08/25/149LPSH219.2536.14295.34419.24417.533596.011512.3469.61289.40335.184192.411527.45124.35823.06210.02825.653
08/27/1410LPSF320.3576.72316.06479.72439.874094.311414.16411.23611.2435.885089.311336.07120.54523.86416.05125.451
08/31/1411BSMQ141.510459.810825.810627.99938.910460.69433.310346.98737.38826.310264.810651.59842.610445.210642.89666.6100
09/10/1412LAMC_DSMH226.07055.810511.97714.37418.36044.07218.37639.97629.5776.675431.14834.56828.88026.37530.17735.763
09/18/1413SNCCH221.96048.6996.98529.794425.77846.07912.44736.87316.6547.255723.13234.26726.77221.85619.96128.456
10/07/1414IDRH218.14937.5794.08167.493123.37540.66512.85124.55111.3445.464633.15326.04621.55321.75515.34821.243
11/12/1415LCUQ117.04724.7557.595611.65711.94427.94714.06119.34715.8528.106136.15729.15621.35118.44014.14223.848
01/21/1516TSGOF339.19934.17016.98720.08643.310755.49014.36654.110049.210033.910966.210845.99439.810342.610447.210052.689
04/08/1517REAFH231.48458.310630.911213.16245.310963.89730.910138.77525.3718.606339.36336.87427.07335.59918.25439.768
04/09/1518PFSF332.28665.111229.411012.16150.011170.810128.29544.68523.1677.856037.05937.77727.97636.010119.86035.764
04/17/1519TMAPH216.94620.2504.94328.133612.84830.04911.74227.96220.4635.094031.54923.14020.94819.04218.85718.037
04/19/1520MeshStereoH213.2375.90264.883010.85212.94910.61911.03812.2399.01305.394427.43823.54217.73721.04915.44920.942
08/28/1521MC-CNN-acrtH28.08205.59224.55285.96192.831111.4265.81158.32248.89282.711616.32114.12113.22013.066.401811.118
09/14/1522ELASF332.38750.91019.176211.05533.09588.211318.37547.38826.87311.78041.77137.47523.75628.88263.010942.873
09/28/1523R-NCCF348.410826.25814.88530.210430.99072.910541.611377.711364.111027.410559.19871.911150.911133.99778.211380.8110
10/13/1524MDPH212.63614.4444.993410.65110.74227.2458.112712.5408.07254.273630.44520.53612.61417.83913.44117.334
11/03/1525MC-CNN+RBSH28.42216.05275.16376.24223.271711.1236.36208.87279.83363.212615.11915.92712.81613.5107.04209.9910
11/05/1526GCSVRH214.64517.1473.50108.223716.55647.4818.82319.75297.06223.172434.45627.15018.34019.24316.05019.340
11/06/1527SOU4P-netH213.43923.1545.41426.392313.15030.5509.003216.44512.7493.132228.94117.12916.43316.93310.73314.531
12/18/1528INTSH214.54420.2494.52248.623911.64329.54810.73716.44410.3394.693727.64022.53920.74620.54611.53624.949
01/19/1629NTDEH27.44155.72254.36225.92182.831110.4165.71135.30165.54182.401013.51514.11912.61513.9146.391712.223
01/26/1631MC-CNN-fstH29.47257.35335.07357.18294.712516.8378.47297.37216.97212.821720.72717.43115.43015.1227.902412.624
01/21/1630MCCNN_LayoutH28.94245.53215.63435.06113.592112.6307.23247.53228.86275.794823.03113.61715.02814.7195.851110.412
02/18/1632LS-ELASF336.79453.510210.37315.88237.010183.611024.59049.19234.68213.98344.97645.79234.99529.18364.411162.798
03/15/1633MPSVQ143.510658.810733.911434.210837.910352.48530.810056.810451.010330.610856.99351.59944.610643.410544.29754.291
04/03/1634ICSGF345.610769.711419.19121.39043.610877.610736.910765.310940.49220.39153.69058.710846.510747.110960.710779.1108
04/12/1635MeshStereoExtH27.08114.41123.98155.40143.171510.0146.23184.62124.77143.492812.71312.41210.41114.5187.80238.853
04/13/1636GlstereoH219.85620.7528.255913.97118.66134.65512.95325.45623.2688.616431.14730.65920.34425.47321.16322.746
04/24/1637HLSC_corH226.07226.55915.28621.08820.56935.75823.48733.17135.08411.98139.16234.26625.26432.89428.37422.745
04/27/1638JEMQ137.29535.77327.910930.610533.29643.07031.410249.59347.39826.510449.68446.09535.79630.88737.58655.893
05/12/1639PMSCH26.7183.4622.6816.19212.5456.9274.5483.9694.04102.37913.11412.31112.21316.2295.881310.815
05/28/1640APAP-StereoH27.26135.43184.91315.11125.172721.6426.99234.31104.23123.242714.3179.7877.32513.496.30158.462
07/03/1641LPUH210.42911.4403.1878.10356.083120.9418.24286.94204.0094.043433.95516.92815.22917.8389.122611.621
08/31/1642SEDF363.411454.310422.410072.911664.511571.410342.511480.111467.911149.811579.611074.411465.411655.111486.111691.6115
09/13/1643SNP-RSMH28.75225.46204.85296.50253.371810.4187.31258.73269.37323.582914.31614.72314.92712.8510.13010.816
09/20/1644LFSIRQ170.111675.711660.311567.111472.411680.810853.711685.411683.811642.511391.211490.411564.111571.311661.510890.3114
10/19/1645LW-CNNH27.04104.65133.95135.30132.63611.2255.41124.32114.22112.431112.21113.41613.62314.8204.72112.022
10/23/1646SIGMRFQ164.211560.010933.011367.911563.211499.511839.811084.811582.011535.211095.211691.511658.111465.811555.010588.6113
11/06/1647SPSF319.65514.24312.38014.97812.04515.83519.17817.44615.4518.236230.94634.86930.68525.37128.37328.054
11/15/1648MC-CNN-WSH212.13314.8467.205311.1567.623615.93611.84311.5389.01303.893119.72620.53516.33216.33012.13918.338
11/15/1649UCNNH220.55844.8909.777013.66818.25936.56012.85023.45012.4479.226839.56430.55824.86021.25119.15932.359
11/16/1650MCSCF311.33213.3425.964610.6508.69387.22811.33910.6327.48233.07193.10125.24419.04117.23510.33125.552
11/24/1651ADSMQ138.79840.48120.39427.39735.19955.99122.38556.110250.910224.29958.09556.310536.59732.19238.79169.7102
01/03/1752SLACH219.35436.1746.53499.894821.97139.16311.84429.06517.9587.645840.26626.54721.14919.44415.04719.541
01/15/1753IGFQ134.09242.78420.19323.79432.29245.67828.69743.08037.28621.49650.98644.79034.79431.98937.48447.180
01/24/17543DMSTH25.9263.7182.7824.7572.7277.3694.2873.4443.7662.35812.61211.5108.56614.0155.3578.874
03/09/1755SGMEPiF313.9416.92326.71519.47429.723911.82813.65710.93410.6405.264232.85126.94922.75522.75912.03821.744
03/10/1756MC-CNN+TDSRF36.3575.45194.45236.80263.461910.7206.05165.01155.19162.621210.889.6256.59211.416.01147.041
03/22/1757JMRH212.5344.09103.97148.44386.933311.12213.85819.54819.0623.663017.02318.23218.03821.0507.292117.836
03/23/1758DSGCAQ133.89042.98520.99523.69330.28745.57727.69342.07936.08521.09450.28544.28933.39134.69838.48946.879
04/04/1759DDLQ130.18244.38919.49225.89628.38342.16921.18437.17428.77521.79746.87936.07030.38428.48032.78237.566
05/23/1760r200highH240.910270.511514.48321.38937.710272.210438.110953.29931.47918.38752.48952.610144.110545.410750.710266.599
06/14/1761DoGGuidedQ141.410345.49323.610330.610634.69852.58628.39659.110853.810726.410360.610154.710438.310035.510044.59872.0106
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5953.3753.4863.3552.05210.369.7568.57714.4175.4089.558
08/25/1763SSRQ137.39650.010021.09728.510130.28853.88724.59157.810652.410522.09840.86848.59636.99832.79337.98852.288
10/12/1764FEN-D2DRRH27.23124.68144.11175.03103.03148.42116.05164.90145.32173.202511.51014.11913.42213.9135.06214.329
11/13/1765CBMVH211.1316.07285.22388.09344.052318.7409.313310.7339.61343.112133.75415.62617.53617.13410.12914.430
11/17/1766CGPTQ132.88843.48720.99623.29229.48643.47123.68843.88237.28720.79248.78140.98634.09232.19136.08342.472
12/11/1767OVODH28.87234.74163.64115.51164.822612.8316.51219.91309.96373.132216.62214.82414.12515.4246.921913.226
01/24/1868SMSSRQ134.89347.49622.49927.39828.88446.78023.68949.59443.49320.99337.76044.18834.69333.09539.19349.884
02/07/1869DFQ156.111347.79727.910836.111046.711062.59550.211572.411069.911337.811188.211270.011052.811350.211277.511291.8116
02/28/1870SDRH27.69175.41174.22184.2062.73810.2155.40116.40185.76194.723811.2915.42513.42116.5315.22513.025
03/06/1871NOSSH25.0423.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.20310.011
03/09/1872SGM_ROBH218.45137.4785.31399.034014.25231.75114.36724.75412.6485.274331.85029.75724.96122.05718.65528.255
03/11/1873SGM-ForestH27.37144.71153.69124.9393.181611.1235.37105.57175.81202.651414.51813.21413.11814.8215.631011.220
03/14/1874DTSH213.4408.45357.54557.46305.502814.93310.23624.55225.1704.933919.22518.73314.62615.92813.04017.233
03/23/1875MEDIAN_ROBH297.811896.111795.611799.011898.411898.411799.211898.411898.111799.011899.011899.611899.911894.711895.111798.3117
03/23/1876AVERAGE_ROBH297.611796.211896.511896.811797.811797.811698.211797.911798.211898.911798.911799.111799.711793.111797.911898.9118
03/26/1877ELAS_ROBH227.37643.48612.48113.97223.87666.49820.48233.07020.76411.07543.97337.57626.36828.78138.49033.360
04/17/1878ISMQ140.810142.58326.410734.810936.110044.57434.410556.210352.710625.210051.08852.410039.710133.39638.89275.3107
05/01/1879PSMNet_ROBQ142.110533.06923.110230.110331.49154.88930.79948.79148.39928.310680.811153.510336.99938.610363.911071.2103
05/05/1880WCMA_ROBQ132.98930.96618.79032.110729.28537.26123.18640.17734.98326.210157.59445.09129.38131.99039.89441.171
05/18/1881PDSH214.24214.4445.804510.54910.54122.14314.06214.5428.97295.935124.23421.53818.23918.94111.93733.661
05/22/1882DN-CSS_ROBH222.86231.4679.286413.56512.44744.37312.14528.16417.6579.116750.98740.08421.25025.06931.98143.274
05/24/1883LALA_ROBH226.07125.6579.546613.66718.76337.46216.87246.48645.69711.37840.76731.66226.36721.55321.66651.987
05/25/1884ETED_ROBH226.67425.65610.97614.87719.06433.35317.67444.58445.39516.18643.97533.66528.37721.65422.26748.883
05/25/1885XPNet_ROBH224.66619.94810.77412.16017.15727.84615.57047.58945.5969.737137.96128.45324.96117.43619.05861.495
05/26/1886NOSS_ROBH25.0113.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.2039.065
05/28/1887PWCDC_ROBF353.311148.59830.511151.611361.411383.811130.09850.59544.99444.511473.610958.810948.310949.311081.911581.1111
05/30/1888DLCB_ROBH212.53510.0386.70509.81455.763016.8389.983511.13511.2425.965224.73521.03716.83516.53214.34423.147
05/31/1889FBW_ROBH232.28536.3759.376514.27319.16569.310013.25551.09739.19010.87443.97341.58733.09029.98551.310371.4104
05/31/1890iResNet_ROBH224.86823.05310.27214.77512.44625.94412.95228.06324.96911.57946.67838.98221.45227.87745.69966.7101
05/31/1891CBMV_ROBH27.65163.4833.3584.8083.57206.3266.88224.84133.9171.97125.43611.1913.11715.8277.342213.828
06/01/1892DPSimNet_ROBF349.410960.111022.910128.310033.79763.19634.310474.711270.111429.310764.910772.211248.210855.011350.510179.6109
06/01/1893NaN_ROBH25.7353.4112.9063.6932.3345.3243.3543.4973.3142.31410.3710.889.641015.3235.4599.899
06/01/1894PDISCO_ROBH254.311262.511121.99838.611138.910484.011240.311274.511169.111239.411260.710273.611349.911046.910878.611481.2112
06/05/1895CBMBNetH210.2288.30345.10366.87274.522411.5277.702613.94113.2503.041821.92913.31513.62415.42511.23511.017
06/14/1896MSMD_ROBQ130.98326.96114.68420.08722.67333.75427.89443.98338.48921.19549.58340.88531.88831.68837.58743.675
06/27/1897DCNNH210.9305.66244.98336.49245.732912.5298.513015.64310.9413.082024.13320.23416.83415.52610.33213.827
07/31/1898MotionStereoH240.410067.611325.010529.210240.910657.39235.510657.510540.49119.98942.87252.610239.810237.110251.710434.962
10/10/1899DISCOH224.56535.0717.345411.75818.76248.68217.17331.46822.4659.337046.07733.56427.57524.66627.57155.092
10/29/18101iResNetH222.96328.3639.196315.88119.36835.15611.34027.76116.85615.28454.79227.65219.54221.55231.98051.686
10/29/18100Dense-CNNH27.98195.59224.54265.83172.79910.4175.78148.26238.84262.661515.62014.22213.21913.286.301511.118
11/07/18102IEBIMstH233.89136.77712.17916.98332.59451.08425.39258.110749.810111.27748.68056.910630.28326.87626.97071.7105
11/08/18103HSMF310.22712.0415.32407.50326.723215.6349.89346.83195.14154.173522.73017.12915.63114.31610.83414.632
11/11/18104MBMH222.86136.4769.957115.38019.36736.55919.98127.56018.15910.17341.57032.76326.36923.36321.46539.969
11/28/18105MSFNetAH27.96186.21304.26196.02203.66228.95126.28198.41258.06242.621217.92413.91811.91211.528.002510.614
01/12/19107EHCI_netH29.47263.7594.272013.16227.6815.3033.2313.4753.1833.90329.2049.5849.26913.91217.35310.613
01/17/19108FASWQ128.68041.78218.18923.19127.28040.66519.17934.97228.17418.58840.86936.47329.38228.47931.17841.070
12/18/18106MCV-MFCH224.86726.8609.636914.87617.45854.18814.26526.55818.26016.08562.610428.75520.94724.66737.48548.182
02/05/19109AMNetQ153.311054.310363.711651.211251.311240.66739.911151.69855.910955.411658.99757.510752.711249.511158.110661.696
02/15/19110DAWA-FH227.47747.29513.68213.16419.26666.49820.48330.36633.9818.736548.98237.87826.77129.98428.07236.565
02/26/19111FFEH26.7293.6874.52245.43152.79911.0213.9363.5784.42132.34721.52812.9138.65813.8115.3369.356
03/06/19112SM-AWPQ138.19730.76524.010425.29530.38944.97538.110856.010155.810819.99060.110051.29732.18930.28640.09561.797
03/09/191133DMST-CMH25.4744.10113.3792.9922.95137.63104.5593.2613.9582.16310.258.2836.37113.275.86129.356
03/13/19114WDMCH213.23810.6397.93579.83478.143718.73912.54810.4319.80353.903232.85223.64319.54317.63710.02724.949
04/12/19115TCSCSMH219.15245.2925.764411.05422.17241.16813.45624.85511.4467.175529.54226.64826.67020.54716.55217.435
05/10/19116tMGM-16F317.3488.70366.49489.824620.77013.73213.96021.84916.0535.574726.93725.44528.37722.15814.64539.667
05/13/19117VNH214.2439.69379.586810.9537.33349.541313.85911.33711.3457.175527.43923.34124.85922.86114.64618.439
05/15/19118PSMNet_2000H228.98120.4518.235815.17927.78235.25715.26950.89651.81049.296961.910331.16025.26327.87729.37552.990

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein