vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.44427.93612.14617.85013.73274.56314.03930.34026.34511.04864.46337.94825.84125.34229.34743.748
07/25/142SGBM1Q127.94728.33717.25319.05114.53357.95315.64331.84131.45113.25158.65938.65027.04525.94531.44959.760
07/25/143SGMQ120.83835.5409.574113.84416.53532.13019.04625.83616.7358.954439.84331.13622.63320.72921.34232.239
07/25/144SGBM1F328.44843.5509.093913.64225.94782.06614.44243.45130.3505.983459.36145.85728.54724.94020.14045.950
07/28/146SGBM1H223.84032.93810.84413.64116.23471.25912.63126.63723.0415.833253.85639.25125.64022.83618.83547.453
07/28/147SGMH218.43140.3444.54168.031922.94240.53511.42524.73410.1255.402929.62428.53223.93620.02714.22830.938
07/28/148SGMF325.34145.1534.33126.871632.25550.04713.03548.15618.3377.663829.62336.14331.25224.23924.54350.255
07/28/145Cens5H226.64547.1558.743811.93825.64545.34119.54840.64829.0489.934636.53738.64931.05125.04125.64444.649
08/25/149LPSH219.2326.14185.34279.24267.532096.07012.3299.61179.40215.182692.47027.43124.33723.03710.01725.635
08/27/1410LPSF320.3366.72196.06319.72289.872494.36914.14011.22311.2285.883389.36836.04220.52723.83816.03325.433
08/31/1411BSMQ141.56459.86625.86427.96238.96360.65433.36446.95437.35826.36264.86451.56142.66345.26542.85966.663
09/10/1412LAMC_DSMH226.04255.86311.94514.34718.33844.04018.34539.94729.5496.673531.12934.53928.84826.34630.14835.742
09/18/1413SNCCH221.93948.6586.98349.792925.74646.04412.43036.84416.6347.253623.11934.23826.74321.83419.93928.437
10/07/1414IDRH218.13037.5434.08107.491823.34340.63612.83324.53311.3295.463033.13226.02721.53221.73315.33021.227
11/12/1415LCUQ117.02924.7337.593611.63711.92727.92614.03819.33015.8338.104036.13629.13321.33118.42314.12723.831
01/21/1516TSGOF339.16134.13916.95220.05243.36455.45114.34154.16149.26233.96766.26545.95839.86242.66347.26252.657
04/08/1517REAFH231.45058.36430.96813.14045.36663.85630.96238.74625.3448.604239.34136.84427.04435.56018.23439.745
04/09/1518PFSF332.25165.16829.46712.13950.06870.85828.25844.65323.1427.853937.03837.74627.94636.06219.83835.743
04/17/1519TMAPH216.92820.2304.94228.132212.82930.02811.72627.93820.4395.092531.53023.12420.92919.02418.83618.022
04/19/1520MeshStereoH213.2235.90154.882010.83412.93010.61011.02312.2259.01185.392827.42023.52517.72221.03015.43120.926
08/28/1521MC-CNN-acrtH28.08105.59134.55175.96102.83511.4155.8168.32138.89172.71716.31314.11113.21013.036.401011.110
09/14/1523ELASF332.35250.9609.174011.03533.05688.26818.34447.35526.84611.74941.74637.44523.73528.84963.06742.847
09/14/1522ELASH227.34643.34812.54813.94623.74466.15720.44933.14220.54011.04743.94737.84726.44228.64838.35533.341
09/28/1524R-NCCF348.46726.23414.85030.26430.95372.96241.66877.76864.16727.46559.16071.96850.96733.95878.27080.867
10/13/1525MDPH212.62214.4264.992310.63310.72527.2258.111512.5268.07144.272330.42520.52212.6717.82213.42617.320
11/03/1526MC-CNN+RBSH28.42116.05165.16256.24123.27911.1136.36108.87159.83233.211515.11215.91512.8913.557.04129.996
11/05/1527GCSVRH214.62717.1283.5058.222316.53647.4468.82199.75187.06123.171334.43527.13018.32419.22516.03219.324
11/06/1528SOU4P-netH213.42423.1325.41286.391313.13130.5299.002016.42812.7313.131128.92217.11716.41916.91710.72114.518
12/18/1529INTSH214.52620.2294.52158.622511.62629.52710.72216.42710.3264.692427.62122.52320.72820.52811.52224.932
01/19/1630NTDEH27.4495.72144.36135.9292.83510.485.7155.3095.54102.40413.5914.1912.6813.976.39912.213
01/26/1632MC-CNN-fstH29.47157.35215.07247.18174.711416.8218.47187.37116.97112.82820.71717.41815.41715.1137.901512.614
01/21/1631MCCNN_LayoutH28.94145.53125.63295.0643.591212.6177.23137.53128.86165.793123.01813.6815.01514.7115.85510.47
02/18/1633LS-ELASF336.75753.56110.34315.84937.06083.66724.55549.15734.65313.95244.94845.75634.95729.15064.46862.761
03/15/1634MPSVQ143.56558.86533.97034.26737.96252.44830.86156.86351.06430.66656.95751.56244.66543.46444.26054.258
04/03/1635ICSGF345.66669.76919.15421.35543.66577.66436.96565.36640.45920.35453.65558.76646.56647.16760.76579.166
04/12/1636MeshStereoExtH27.0864.4153.9895.4073.17810.076.2394.6264.7773.491712.7712.4610.4514.5107.80148.853
04/13/1637GlstereoH219.83520.7318.253713.94518.63934.63112.93425.43523.2438.614331.12830.63520.32625.44421.14122.730
04/24/1638HLSC_corH226.04326.53515.25121.05320.54035.73223.45233.14335.05411.95039.14034.23725.23932.85628.34622.729
04/27/1639JEMQ137.25835.74127.96630.66533.25743.03831.46349.55847.36126.56449.65146.05935.75830.85137.55355.859
05/12/1640PMSCH26.7143.4612.6816.19112.5426.9224.5433.9634.0442.37313.1812.3512.2616.2155.88610.88
05/28/1641APAP-StereoH27.2685.4394.91215.1155.171621.6246.99124.3144.2363.241614.3119.7837.32213.446.3088.462
07/03/1642LPUH210.41611.4233.1848.10216.081820.9238.24166.94104.0034.042133.93416.91615.21617.8219.121611.611
08/31/1643SEDF363.46954.36222.46272.97164.57071.46042.56980.16967.96849.87179.66674.46965.47155.16986.17191.670
09/13/1644SNP-RSMH28.75125.46114.85196.50143.371010.497.31148.73149.37203.581814.31014.71214.91412.8210.11910.89
09/20/1645LFSIRQ170.17175.77160.37167.16972.47180.86553.77185.47183.87142.57091.26990.47064.17071.37161.56690.369
10/19/1646LW-CNNH27.0454.6563.9575.3062.63311.2145.4144.3254.2252.43512.2513.4713.61214.8124.72112.012
10/23/1647SIGMRFQ164.27060.06733.06967.97063.26999.57139.86784.87082.07035.26895.27191.57158.16965.87055.06488.668
11/06/1648SPSF319.63414.22512.34714.94812.02815.81919.14717.42915.4328.234130.92634.84030.65025.34228.34528.036
11/14/1649PKLSH211.0177.80224.561810.2315.62179.7568.31179.19168.39154.212230.92717.51916.92017.11812.22515.319
11/15/1650MC-CNN-WSH212.12014.8277.203511.1367.622115.92011.82711.5249.01183.892019.71620.52116.31816.31612.12418.323
11/15/1651UCNNH220.53744.8529.774213.64218.23736.53312.83223.43212.4309.224539.54230.53424.83821.23219.13732.340
11/16/1652MCSCF311.31913.3245.963010.6328.69227.22311.32410.6207.48133.0793.10125.22619.02517.22010.32025.534
11/24/1653ADSMQ138.76040.44520.35727.36035.15955.95222.35156.16250.96324.26158.05856.36536.55932.15438.75769.764
01/03/1754SLACH219.33336.1426.53329.893021.94139.13411.82829.03917.9367.643740.24426.52821.13019.42615.02919.525
01/15/1755IGFQ134.05542.74620.15623.75832.25445.64328.66043.05037.25621.45850.95344.75534.75631.95237.45247.152
01/24/17563DMSTH25.9223.7132.7824.7522.7247.3644.2823.4413.7622.35212.6611.548.56314.085.3538.874
03/09/1757SGMEPiF313.9256.92206.71339.47279.722311.81613.63610.92210.6275.262732.83126.92922.73422.73512.02321.728
03/10/1758MC-CNN+TDSRF36.3535.45104.45146.80153.461110.7116.0575.0185.1982.62610.839.6216.59111.416.0177.041
03/22/1759JMRH212.5214.0943.9788.44246.931911.11213.83719.53119.0383.661917.01518.22018.02321.0317.291317.821
03/23/1760DSGCAQ133.85442.94720.95823.65730.25145.54227.65742.04936.05521.05750.25244.25433.35334.65938.45646.851
04/04/1761DDLQ130.14944.35119.45525.85928.34842.13721.15037.14528.74721.75946.84936.04130.34928.44732.75037.544
05/23/1762r200highH240.96270.57014.44921.35437.76172.26138.16653.26031.45118.35352.45452.66344.16445.46650.76366.562
06/14/1763DoGGuidedQ141.46345.45423.66330.66634.65852.54928.35959.16553.86626.46360.66254.76438.36135.56144.56172.065
06/22/1764LocalExpH25.4313.6522.8732.9811.9915.5913.3713.4823.3512.05110.329.7528.57414.495.4049.555
08/25/1765SSRQ137.35950.05921.06028.56330.25253.85024.55657.86452.46522.06040.84548.56036.96032.75537.95452.256
10/12/1766FEN-D2DRRH27.2374.6874.11115.0333.0378.4256.0574.9075.3293.201411.5414.1913.41113.965.06214.316
11/13/1767CBMVH211.1186.07175.22268.09204.051318.7229.312110.7219.61223.111033.73315.61417.52117.11910.11814.417
11/17/1768CGPTQ132.85343.44920.95923.25629.45043.43923.65343.85237.25720.75548.75040.95234.05432.15336.05142.446
12/11/1769OVODH28.87134.7483.6465.5184.821512.8186.51119.91199.96243.131116.61414.81314.11315.4146.921113.215
01/24/1870SMSSRQ134.85647.45622.46127.36128.84946.74523.65449.55943.46020.95637.73944.15334.65533.05739.15849.854
02/07/1871DFQ156.16847.75727.96536.16846.76762.55550.27072.46769.96937.86988.26770.06752.86850.26877.56991.871

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: October 13 2017 by Daniel Scharstein