vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.44227.93412.14417.84813.73074.55814.03730.33826.34311.04664.45937.94625.83925.34029.34543.745
07/25/142SGBM1Q127.94528.33517.25119.04914.53157.94915.64131.83931.44913.24958.65538.64827.04325.94331.44759.756
07/25/143SGMQ120.83635.5389.573913.84216.53332.12819.04425.83416.7338.954239.84031.13422.63120.72721.34032.237
07/25/144SGBM1F328.44643.5479.093713.64025.94582.06114.44043.44930.3485.983259.35745.85328.54524.93820.13845.947
07/28/146SGBM1H223.83832.93610.84213.63916.23271.25412.62926.63523.0395.833053.85239.24925.63822.83418.83347.450
07/28/147SGMH218.42940.3424.54158.031822.94040.53311.42324.73210.1235.402729.62328.53023.93420.02514.22630.936
07/28/148SGMF325.33945.1504.33116.871532.25150.04313.03348.15318.3357.663629.62236.14131.25024.23724.54150.251
07/28/145Cens5H226.64347.1528.743611.93625.64345.33819.54640.64629.0469.934436.53538.64731.04925.03925.64244.646
08/25/149LPSH219.2306.14165.34259.24247.531896.06512.3279.61179.40215.182492.46527.42924.33523.03510.01625.633
08/27/1410LPSF320.3346.72176.06299.72269.872294.36414.13811.22111.2265.883189.36336.04020.52523.83616.03125.431
08/31/1411BSMQ141.56059.86125.86027.95838.95960.65033.36046.95137.35526.35864.86051.55742.65945.26142.85566.659
09/10/1412LAMC_DSMH226.04055.85811.94314.34518.33644.03718.34339.94529.5476.673331.12834.53728.84626.34430.14635.740
09/18/1413SNCCH221.93748.6536.98329.792725.74446.04112.42836.84216.6327.253423.11834.23626.74121.83219.93728.435
10/07/1414IDRH218.12837.5414.0897.491723.34140.63412.83124.53111.3275.462833.13126.02521.53021.73115.32821.225
11/12/1415LCUQ117.02724.7317.593411.63511.92527.92414.03619.32815.8318.103836.13429.13121.32918.42114.12523.829
01/21/1516TSGOF339.15734.13716.95020.05043.36055.44714.33954.15749.25833.96366.26145.95439.85842.65947.25852.653
04/08/1517REAFH231.44858.35930.96313.13845.36263.85130.95838.74425.3428.604039.33836.84227.04235.55618.23239.743
04/09/1518PFSF332.24965.16329.46212.13750.06370.85328.25444.65023.1407.853737.03637.74427.94436.05819.83635.741
04/17/1519TMAPH216.92620.2284.94218.132012.82730.02611.72427.93620.4375.092331.52923.12220.92719.02218.83418.020
04/19/1520MeshStereoH213.2215.90144.881910.83212.92810.61011.02112.2239.01185.392627.41923.52317.72021.02815.42920.924
08/28/1521MC-CNN-acrtH28.08105.59124.55165.9692.83511.4155.8168.32138.89172.71716.31314.11113.21013.036.401011.110
09/14/1523ELASF332.35050.9559.173811.03333.05288.26318.34247.35226.84411.74741.74337.44323.73328.84763.06342.844
09/14/1522ELASH227.34443.34612.54613.94423.74266.15220.44733.14020.53811.04543.94437.84526.44028.64638.35233.339
09/28/1524R-NCCF348.46326.23214.84830.26030.94972.95741.66477.76364.16327.46159.15671.96350.96333.95478.26580.863
10/13/1525MDPH212.62014.4244.992210.63110.72327.2238.111412.5248.07144.272130.42420.52012.6717.82013.42417.318
11/03/1526MC-CNN+RBSH28.42116.05155.16246.24113.27911.1136.36108.87159.83223.211315.11215.91312.8913.557.04119.996
11/05/1527GCSVRH214.62517.1263.5058.222116.53447.4428.82189.75187.06123.171134.43327.12818.32219.22316.03019.322
11/06/1528SOU4P-netH213.42223.1305.41266.391213.12930.5279.001916.42612.7293.131028.92117.11516.41816.91610.71914.516
12/18/1529INTSH214.52420.2274.52148.622311.62429.52510.72016.42510.3244.692227.62022.52120.72620.52611.52024.930
01/19/1630NTDEH27.4495.72134.36125.9282.83510.485.7155.3095.54102.40413.5914.1912.6813.976.39912.213
01/26/1632MC-CNN-fstH29.47147.35195.07237.18164.711316.8208.47177.37116.97112.82820.71617.41615.41615.1137.901412.614
01/21/1631MCCNN_LayoutH28.94135.53115.63275.0643.591212.6177.23127.53128.86165.792923.01713.6815.01414.7115.85510.47
02/18/1633LS-ELASF336.75353.55610.34115.84737.05683.66224.55149.15434.65113.95044.94545.75234.95329.14864.46462.757
03/15/1634MPSVQ143.56158.86033.96534.26337.95852.44430.85756.85951.06030.66256.95351.55844.66143.46044.25654.254
04/03/1635ICSGF345.66269.76419.15221.35343.66177.65936.96165.36240.45620.35253.65158.76246.56247.16360.76179.162
04/12/1636MeshStereoExtH27.0864.4153.9885.4073.17810.076.2394.6264.7773.491512.7712.4610.4514.5107.80138.853
04/13/1637GlstereoH219.83320.7298.253513.94318.63734.62912.93225.43323.2418.614131.12730.63320.32425.44221.13922.728
04/24/1638HLSC_corH226.04126.53315.24921.05120.53835.73023.45033.14135.05211.94839.13734.23525.23732.85328.34422.727
04/27/1639JEMQ137.25435.73927.96130.66133.25343.03631.45949.55547.35726.56049.64746.05535.75430.84937.55055.855
05/12/1640PMSCH26.7143.4612.6816.19102.5426.9224.5433.9634.0442.37313.1812.3512.2616.2145.88610.88
05/28/1641APAP-StereoH27.2685.4384.91205.1155.171421.6226.99114.3144.2363.241414.3119.7837.32213.446.3088.462
07/03/1642LPUH210.41511.4213.1848.10196.081620.9218.24156.94104.0034.041933.93216.91415.21517.8199.121511.611
08/31/1643SEDF363.46454.35722.45872.96664.56571.45542.56580.16467.96449.86679.66274.46465.46655.16486.16691.666
09/13/1644SNP-RSMH28.75125.46104.85186.50133.371010.497.31138.73149.37203.581614.31014.71214.91312.8210.11710.89
09/20/1645LFSIRQ170.16675.76660.36667.16472.46680.86053.76685.46683.86642.56591.26490.46564.16571.36661.56290.365
10/19/1646LW-CNNH27.0454.6563.9565.3062.63311.2145.4144.3254.2252.43512.2513.4713.61214.8124.72112.012
10/23/1647SIGMRFQ164.26560.06233.06467.96563.26499.56639.86384.86582.06535.26495.26691.56658.16465.86555.06088.664
11/06/1648SPSF319.63214.22312.34514.94612.02615.81819.14517.42715.4308.233930.92534.83830.64825.34028.34328.034
11/14/1649PKLSH211.0167.80204.561710.2295.62159.7568.31169.19168.39154.212030.92617.51716.91917.11712.22315.317
11/15/1650MC-CNN-WSH212.11814.8257.203311.1347.621915.91911.82511.5229.01183.891819.71520.51916.31716.31512.12218.321
11/15/1651UCNNH220.53544.8499.774013.64018.23536.53112.83023.43012.4289.224339.53930.53224.83621.23019.13532.338
11/16/1652MCSCF311.31713.3225.962810.6308.69207.22311.32210.6197.48133.0793.10125.22419.02317.21810.31825.532
11/24/1653ADSMQ138.75640.44320.35527.35735.15555.94822.34956.15850.95924.25758.05456.36136.55532.15138.75469.760
01/03/1754SLACH219.33136.1406.53309.892821.93939.13211.82629.03717.9347.643540.24126.52621.12819.42415.02719.523
01/15/1755IGFQ134.05242.74420.15423.75532.25045.64028.65643.04837.25421.45450.94944.75134.75231.95037.44947.149
01/24/17563DMSTH25.9223.7132.7824.7522.7247.3644.2823.4413.7622.35212.6611.548.56314.085.3538.874
03/09/1757SGMEPiF313.9236.92186.71319.47259.722111.81613.63410.92010.6255.262532.83026.92722.73222.73312.02121.726
03/10/1758MC-CNN+TDSRF36.3535.4594.45136.80143.461110.7116.0575.0185.1982.62610.839.6216.59111.416.0177.041
03/22/1759JMRH212.5194.0943.9778.44226.931711.11213.83519.52919.0363.661717.01418.21818.02121.0297.291217.819
03/23/1760DSGCAQ133.85142.94520.95623.65430.24745.53927.65342.04736.05321.05350.24844.25033.35134.65538.45346.848
04/04/1761DDLQ130.14744.34819.45325.85628.34642.13521.14837.14328.74521.75546.84636.03930.34728.44532.74837.542
05/23/1762r200highH240.95870.56514.44721.35237.75772.25638.16253.25631.44918.35152.45052.65944.16045.46250.75966.558
06/14/1763DoGGuidedQ141.45945.45123.65930.66234.65452.54528.35559.16153.86226.45960.65854.76038.35735.55744.55772.061
06/22/1764LocalExpH25.4313.6522.8732.9811.9915.5913.3713.4823.3512.05110.329.7528.57414.495.4049.555
08/25/1765SSRQ137.35550.05421.05728.55930.24853.84624.55257.86052.46122.05640.84248.55636.95632.75237.95152.252
10/12/1766FEN-D2DRRH27.2374.6874.11105.0333.0378.4256.0574.9075.3293.201211.5414.1913.41113.965.06214.315

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: October 13 2017 by Daniel Scharstein