vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.47227.96012.17517.88213.75174.510414.06130.36626.37111.07464.410337.97725.86525.37029.37443.775
07/25/142SGBM1Q127.97728.36117.28619.08314.55357.99115.66831.86831.47813.28058.69538.67927.07325.97331.47759.792
07/25/143SGMQ120.85835.5709.576513.86816.55532.15119.07425.85616.7548.956539.86331.15922.65420.74821.36332.257
07/25/144SGBM1F328.47843.5869.095913.66625.97882.010714.46643.48030.3775.985259.39845.89128.57724.96720.16145.977
07/28/146SGBM1H223.86332.96610.87213.66416.25471.210012.64926.65823.0655.834853.89039.28125.66422.85918.85447.480
07/28/147SGMH218.44940.3784.54268.033322.97340.56211.44124.75210.1385.404529.64228.55323.95720.04514.24330.956
07/28/148SGMF325.36845.1894.33216.872732.29150.08113.05448.18918.3607.665829.64136.17031.28524.26424.56750.284
07/28/145Cens5H226.67447.1928.745811.95725.67645.37419.57840.67729.0759.937036.55638.67831.08425.06925.66844.676
08/25/149LPSH219.2526.14295.34419.24417.533496.011312.3469.61289.40335.184192.411327.44924.35923.06010.02825.652
08/27/1410LPSF320.3566.72316.06479.72439.874094.311214.16211.23611.2435.884989.311136.06920.54523.86316.04925.450
08/31/1411BSMQ141.510259.810625.810427.99738.910260.69233.310146.98637.38726.310064.810451.59642.610245.210442.89466.698
09/10/1412LAMC_DSMH226.06955.810311.97414.37318.36044.07018.37339.97529.5766.675431.14634.56628.87826.37430.17535.763
09/18/1413SNCCH221.95948.6976.98519.794425.77746.07712.44736.87216.6537.255623.13234.26526.77121.85619.95928.455
10/07/1414IDRH218.14837.5774.08167.493123.37440.66312.85124.55011.3445.464633.15126.04421.55321.75515.34621.242
11/12/1415LCUQ117.04624.7537.595511.65511.94427.94614.05919.34715.8528.106036.15529.15521.35118.44014.14223.847
01/21/1516TSGOF339.19734.16816.98520.08443.310555.48814.36454.19849.29933.910766.210645.99239.810142.610247.29852.688
04/08/1517REAFH231.48258.310430.911013.16045.310763.89530.99938.77425.3708.606239.36136.87227.07235.59718.25239.767
04/09/1518PFSF332.28465.111029.410812.15950.010970.89928.29344.68423.1667.855937.05737.77527.97536.09919.85835.764
04/17/1519TMAPH216.94520.2494.94328.133612.84830.04811.74227.96120.4625.094031.54723.14020.94819.04218.85518.037
04/19/1520MeshStereoH213.2375.90264.883010.85112.94910.61811.03812.2389.01305.394427.43723.54117.73721.04915.44720.941
08/28/1521MC-CNN-acrtH28.08205.59224.55285.96192.831111.4255.81158.32248.89282.711616.32114.12113.22013.066.401811.118
09/14/1522ELASF332.38550.9999.176011.05333.09388.211118.37247.38726.87211.77841.77037.47323.75628.88063.010742.872
09/28/1523R-NCCF348.410626.25614.88330.210230.98872.910341.611177.711164.110827.410359.19771.910950.910933.99578.211180.8108
10/13/1524MDPH212.63614.4434.993410.65010.74227.2448.112712.5398.07254.273630.44320.53612.61417.83913.44117.334
11/03/1525MC-CNN+RBSH28.42216.05275.16376.24223.271711.1226.36208.87279.83363.212615.11915.92712.81613.5107.04209.9910
11/05/1526GCSVRH214.64417.1463.50108.223716.55647.4798.82319.75297.06223.172434.45427.14818.34019.24316.04819.339
11/06/1527SOU4P-netH213.43923.1525.41426.392313.15030.5499.003216.44512.7483.132228.93917.12916.43316.93310.73314.531
12/18/1528INTSH214.54320.2484.52248.623911.64329.54710.73716.44410.3394.693727.63822.53920.74620.54611.53624.948
01/19/1629NTDEH27.44155.72254.36225.92182.831110.4155.71135.30165.54182.401013.51514.11912.61513.9146.391712.223
01/26/1631MC-CNN-fstH29.47257.35335.07357.18294.712516.8358.47297.37216.97212.821720.72717.43115.43015.1227.902412.624
01/21/1630MCCNN_LayoutH28.94245.53215.63435.06113.592112.6297.23247.53228.86275.794723.03113.61715.02814.7195.851110.412
02/18/1632LS-ELASF336.79253.510010.37015.88037.09983.610824.58849.19134.68113.98144.97545.79034.99329.18164.410962.796
03/15/1633MPSVQ143.510458.810533.911234.210637.910152.48330.89856.810251.010230.610656.99251.59744.610443.410344.29554.289
04/03/1634ICSGF345.610569.711219.18921.38843.610677.610536.910565.310740.49120.38953.68958.710646.510547.110760.710579.1106
04/12/1635MeshStereoExtH27.08114.41123.98155.40143.171510.0136.23184.62124.77143.492812.71312.41210.41114.5187.80238.853
04/13/1636GlstereoH219.85520.7508.255713.96918.66134.65412.95325.45523.2678.616331.14530.65820.34425.47221.16222.745
04/24/1637HLSC_corH226.07126.55715.28421.08620.56935.75623.48533.17035.08311.97939.16034.26425.26332.89228.37322.744
04/27/1638JEMQ137.29335.77127.910730.610333.29443.06831.410049.59247.39726.510249.68346.09335.79430.88537.58455.891
05/12/1639PMSCH26.7183.4622.6816.19212.5456.9274.5483.9694.04102.37913.11412.31112.21316.2295.881310.815
05/28/1640APAP-StereoH27.26135.43184.91315.11125.172721.6416.99234.31104.23123.242714.3179.7877.32513.496.30158.462
07/03/1641LPUH210.42911.4383.1878.10356.083120.9408.24286.94204.0094.043433.95316.92815.22917.8389.122611.621
08/31/1642SEDF363.411254.310222.49872.911464.511371.410142.511280.111267.910949.811379.610874.411265.411455.111286.111491.6113
09/13/1643SNP-RSMH28.75225.46204.85296.50253.371810.4177.31258.73269.37323.582914.31614.72314.92712.8510.13010.816
09/20/1644LFSIRQ170.111475.711460.311367.111272.411480.810653.711485.411483.811442.511191.211290.411364.111371.311461.510690.3112
10/19/1645LW-CNNH27.04104.65133.95135.30132.63611.2245.41124.32114.22112.431112.21113.41613.62314.8204.72112.022
10/23/1646SIGMRFQ164.211360.010733.011167.911363.211299.511639.810884.811382.011335.210895.211491.511458.111265.811355.010388.6111
11/06/1647SPSF319.65414.24212.37714.97712.04515.83319.17517.44615.4518.236130.94434.86730.68325.37028.37228.053
11/15/1648MC-CNN-WSH212.13314.8457.205211.1547.623515.93411.84311.5379.01303.893119.72620.53516.33216.33012.13918.338
11/15/1649UCNNH220.55744.8889.776713.66618.25936.55812.85023.44912.4469.226739.56230.55724.86021.25119.15732.358
11/16/1650MCSCF311.33213.3415.964610.6498.69377.22811.33910.6327.48233.07193.10125.24319.04117.23510.33125.551
11/24/1651ADSMQ138.79640.47920.39227.39535.19755.98922.38356.110050.910124.29758.09456.310336.59532.19038.78969.7100
01/03/1752SLACH219.35336.1726.53489.894721.97039.16111.84429.06417.9577.645740.26426.54521.14919.44415.04519.540
01/15/1753IGFQ134.09042.78220.19123.79232.29045.67628.69543.07937.28521.49450.98544.78834.79231.98737.48247.179
01/24/17543DMSTH25.9263.7182.7824.7572.7277.3694.2873.4443.7662.35812.61211.5108.56614.0155.3578.874
03/09/1755SGMEPiF313.9416.92326.71509.47429.723911.82713.65710.93410.6405.264232.84926.94722.75522.75812.03821.743
03/10/1756MC-CNN+TDSRF36.3575.45194.45236.80263.461910.7196.05165.01155.19162.621210.889.6256.59211.416.01147.041
03/22/1757JMRH212.5344.09103.97148.44386.933311.12113.85819.54819.0613.663017.02318.23218.03821.0507.292117.836
03/23/1758DSGCAQ133.88842.98320.99323.69130.28545.57527.69142.07836.08421.09250.28444.28733.38934.69638.48746.878
04/04/1759DDLQ130.18044.38719.49025.89428.38142.16721.18237.17328.77421.79546.87836.06830.38228.47832.78037.566
05/23/1760r200highH240.910070.511314.48121.38737.710072.210238.110753.29731.47818.38552.48852.69944.110345.410550.710066.597
06/14/1761DoGGuidedQ141.410145.49123.610130.610434.69652.58428.39459.110653.810526.410160.610054.710238.39835.59844.59672.0104
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5953.3753.4863.3552.05210.369.7568.57714.4175.4089.558
08/25/1763SSRQ137.39450.09821.09528.59930.28653.88524.58957.810452.410322.09640.86748.59436.99632.79137.98652.287
10/12/1764FEN-D2DRRH27.23124.68144.11175.03103.03148.42116.05164.90145.32173.202511.51014.11913.42213.9135.06214.329
11/13/1765CBMVH211.1316.07285.22388.09344.052318.7399.313310.7339.61343.112133.75215.62617.53617.13410.12914.430
11/17/1766CGPTQ132.88643.48520.99423.29029.48443.46923.68643.88137.28620.79048.78040.98434.09032.18936.08142.471
12/11/1767OVODH28.87234.74163.64115.51164.822612.8306.51219.91309.96373.132216.62214.82414.12515.4246.921913.226
01/24/1868SMSSRQ134.89147.49422.49727.39628.88246.77823.68749.59343.49220.99137.75844.18634.69133.09339.19149.883
02/07/1869DFQ156.111147.79527.910636.110846.710862.59350.211372.410869.911137.810988.211070.010852.811150.211077.511091.8114
02/28/1870FDRH27.69175.41174.22184.2062.73810.2145.40116.40185.76194.723811.2915.42513.42116.5315.22513.025
03/06/1871NOSSH25.0423.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.20310.011
03/09/1872SGM_ROBH218.45037.4765.31399.034014.25231.75014.36524.75312.6475.274331.84829.75624.96122.05718.65328.254
03/11/1873SGM-ForestH27.37144.71153.69124.9393.181611.1225.37105.57175.81202.651414.51813.21413.11814.8215.631011.220
03/14/1874DTSH213.4408.45357.54547.46305.502814.93110.23624.55125.1694.933919.22518.73314.62615.92813.04017.233
03/23/1875MEDIAN_ROBH297.811696.111595.611599.011698.411698.411599.211698.411698.111599.011699.011699.611699.911694.711695.111598.3115
03/23/1876AVERAGE_ROBH297.611596.211696.511696.811597.811597.811498.211597.911598.211698.911598.911599.111599.711593.111597.911698.9116
03/26/1877ELAS_ROBH227.37543.48412.47813.97023.87566.49620.48033.06920.76311.07343.97237.57426.36728.77938.48833.359
04/17/1878ISMQ140.89942.58126.410534.810736.19844.57234.410356.210152.710425.29851.08752.49839.79933.39438.89075.3105
05/01/1879PSMNet_ROBQ142.110333.06723.110030.110131.48954.88730.79748.79048.39828.310480.810953.510136.99738.610163.910871.2101
05/05/1880WCMA_ROBQ132.98730.96418.78832.110529.28337.25923.18440.17634.98226.29957.59345.08929.37931.98839.89241.170
05/18/1881PDSH214.24214.4435.804510.54810.54122.14214.06014.5418.97295.935024.23421.53818.23918.94111.93733.660
05/22/1882DN-CSS_ROBH222.86131.4659.286213.56312.44744.37112.14528.16317.6569.116650.98640.08221.25025.06831.97943.273
05/24/1883LALA_ROBH226.07025.6559.546413.66518.76337.46016.86946.48545.69611.37640.76631.66026.36621.55321.66551.986
05/25/1884ETED_ROBH226.67325.65410.97314.87619.06433.35217.67144.58345.39416.18443.97433.66328.37621.65422.26648.882
05/25/1885XPNet_ROBH224.66519.94710.77112.15817.15727.84515.56747.58845.5959.736937.95928.45224.96117.43619.05661.493
05/26/1886NOSS_ROBH25.0113.5742.8433.9941.9315.1513.3423.3223.1512.3258.5527.4517.06312.535.2039.065
05/28/1887PWCDC_ROBF353.310948.59630.510951.611161.411183.810930.09650.59444.99344.511273.610758.810748.310749.310881.911381.1109
05/30/1888DLCB_ROBH212.53510.0366.70499.81455.763016.8369.983511.13511.2425.965124.73521.03716.83516.53214.34423.146
05/31/1889FBW_ROBH232.28336.3739.376314.27219.16569.39813.25551.09539.18910.87243.97241.58533.08829.98351.310171.4102
05/31/1890iResNet_ROBH224.86723.05110.26914.77412.44625.94312.95228.06224.96811.57746.67738.98021.45227.87645.69766.799
05/31/1891CBMV_ROBH27.65163.4833.3584.8083.57206.3266.88224.84133.9171.97125.43611.1913.11715.8277.342213.828
06/01/1892DPSimNet_ROBF349.410760.110822.99928.39833.79563.19434.310274.711070.111229.310564.910572.211048.210655.011150.59979.6107
06/01/1893NaN_ROBH25.7353.4112.9063.6932.3345.3243.3543.4973.3142.31410.3710.889.641015.3235.4599.899
06/01/1894PDISCO_ROBH254.311062.510921.99638.610938.910284.011040.311074.510969.111039.411060.710173.611149.910846.910678.611281.2110
06/05/1895CBMBNetH210.2288.30345.10366.87274.522411.5267.702613.94013.2493.041821.92913.31513.62415.42511.23511.017
06/14/1896MSMD_ROBQ130.98126.95914.68220.08522.67233.75327.89243.98238.48821.19349.58240.88331.88631.68637.58543.674
06/27/1897DCNNH210.9305.66244.98336.49245.732912.5288.513015.64310.9413.082024.13320.23416.83415.52610.33213.827
07/31/1898MotionStereoH240.49867.611125.010329.210040.910457.39035.510457.510340.49019.98742.87152.610039.810037.110051.710234.962
10/10/1899DISCOH224.56435.0697.345311.75618.76248.68017.17031.46722.4649.336846.07633.56227.57424.66527.57055.090
10/29/18101iResNetH222.96228.3619.196115.87919.36835.15511.34027.76016.85515.28254.79127.65019.54221.55231.97851.685
10/29/18100Dense-CNNH27.98195.59224.54265.83172.79910.4165.78148.26238.84262.661515.62014.22213.21913.286.301511.118
11/07/18102IEBIMstH233.88936.77512.17616.98132.59251.08225.39058.110549.810011.27548.67956.910430.28126.87526.96971.7103
11/08/18103HSMF310.22712.0395.32407.50326.723215.6329.89346.83195.14154.173522.73017.12915.63114.31610.83414.632
11/11/18104MBMH222.86036.4749.956815.37819.36736.55719.97927.55918.15810.17141.56932.76126.36823.36121.46439.968
11/15/18105VNH218.14712.74012.87914.2719.543818.43719.47714.64214.4506.085340.66528.05124.35823.46220.16034.861
11/28/18106MSFNetAH27.96186.21304.26196.02203.66228.95126.28198.41258.06242.621217.92413.91811.91211.528.002510.614
01/12/19108EHCI_netH29.47263.7594.272013.16027.6805.3033.2313.4753.1833.90329.2049.5849.26913.91217.35110.613
01/17/19109FASWQ128.67941.78018.18723.18927.27940.66319.17634.97128.17318.58640.86836.47129.38028.47731.17641.069
12/18/18107MCV-MFCH224.86626.8589.636614.87517.45854.18614.26326.55718.25916.08362.610228.75420.94724.66637.48348.181
02/05/19110AMNetQ153.310854.310163.711451.211051.311040.66539.910951.69655.910755.411458.99657.510552.711049.510958.110461.694
02/15/19111DAWA-FH227.47647.29313.68013.16219.26666.49620.48130.36533.9808.736448.98137.87626.77029.98228.07136.565
02/26/19112FFEH26.7293.6874.52245.43152.79911.0203.9363.5784.42132.34721.52812.9138.65813.8115.3369.356
03/06/19113SM-AWPQ138.19530.76324.010225.29330.38744.97338.110656.09955.810619.98860.19951.29532.18730.28440.09361.795
03/09/191143DMST-CMH25.4744.10113.3792.9922.95137.63104.5593.2613.9582.16310.258.2836.37113.275.86129.356
03/13/19115WDMCH213.23810.6377.93569.83468.143618.73812.54810.4319.80353.903232.85023.64219.54317.63710.02724.948
04/12/19116TCSCSMH219.15145.2905.764411.05222.17141.16613.45624.85411.4457.175529.54026.64626.66920.54716.55017.435

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein