vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.44327.93512.14517.84913.73174.56014.03830.33926.34411.04764.46137.94725.84025.34129.34643.747
07/25/142SGBM1Q127.94628.33617.25219.05014.53257.95115.64231.84031.45013.25058.65738.64927.04425.94431.44859.758
07/25/143SGMQ120.83735.5399.574013.84316.53432.12919.04525.83516.7348.954339.84131.13522.63220.72821.34132.238
07/25/144SGBM1F328.44743.5499.093813.64125.94682.06314.44143.45030.3495.983359.35945.85528.54624.93920.13945.949
07/28/146SGBM1H223.83932.93710.84313.64016.23371.25612.63026.63623.0405.833153.85439.25025.63922.83518.83447.452
07/28/147SGMH218.43040.3434.54158.031822.94140.53411.42424.73310.1245.402829.62328.53123.93520.02614.22730.937
07/28/148SGMF325.34045.1524.33116.871532.25350.04513.03448.15518.3367.663729.62236.14231.25124.23824.54250.253
07/28/145Cens5H226.64447.1548.743711.93725.64445.34019.54740.64729.0479.934536.53638.64831.05025.04025.64344.648
08/25/149LPSH219.2316.14175.34269.24257.531996.06712.3289.61179.40215.182592.46727.43024.33623.03610.01625.634
08/27/1410LPSF320.3356.72186.06309.72279.872394.36614.13911.22211.2275.883289.36536.04120.52623.83716.03225.432
08/31/1411BSMQ141.56259.86425.86227.96038.96160.65233.36246.95337.35726.36064.86251.55942.66145.26342.85766.661
09/10/1412LAMC_DSMH226.04155.86111.94414.34618.33744.03918.34439.94629.5486.673431.12834.53828.84726.34530.14735.741
09/18/1413SNCCH221.93848.6566.98339.792825.74546.04312.42936.84316.6337.253523.11834.23726.74221.83319.93828.436
10/07/1414IDRH218.12937.5424.0897.491723.34240.63512.83224.53211.3285.462933.13126.02621.53121.73215.32921.226
11/12/1415LCUQ117.02824.7327.593511.63611.92627.92514.03719.32915.8328.103936.13529.13221.33018.42214.12623.830
01/21/1516TSGOF339.15934.13816.95120.05143.36255.44914.34054.15949.26033.96566.26345.95639.86042.66147.26052.655
04/08/1517REAFH231.44958.36230.96613.13945.36463.85330.96038.74525.3438.604139.33936.84327.04335.55818.23339.744
04/09/1518PFSF332.25065.16629.46412.13850.06570.85528.25644.65223.1417.853837.03737.74527.94536.06019.83735.742
04/17/1519TMAPH216.92720.2294.94218.132112.82830.02711.72527.93720.4385.092431.52923.12320.92819.02318.83518.021
04/19/1520MeshStereoH213.2225.90144.881910.83312.92910.61011.02212.2249.01185.392727.41923.52417.72121.02915.43020.925
08/28/1521MC-CNN-acrtH28.08105.59124.55165.9692.83511.4155.8168.32138.89172.71716.31314.11113.21013.036.401011.110
09/14/1523ELASF332.35150.9589.173911.03433.05488.26518.34347.35426.84511.74841.74437.44423.73428.84863.06642.846
09/14/1522ELASH227.34543.34712.54713.94523.74366.15420.44833.14120.53911.04643.94537.84626.44128.64738.35433.340
09/28/1524R-NCCF348.46526.23314.84930.26230.95172.95941.66677.76664.16527.46359.15871.96550.96533.95678.26880.865
10/13/1525MDPH212.62114.4254.992210.63210.72427.2248.111412.5258.07144.272230.42420.52112.6717.82113.42517.319
11/03/1526MC-CNN+RBSH28.42116.05155.16246.24113.27911.1136.36108.87159.83233.211415.11215.91412.8913.557.04119.996
11/05/1527GCSVRH214.62617.1273.5058.222216.53547.4448.82189.75187.06123.171234.43427.12918.32319.22416.03119.323
11/06/1528SOU4P-netH213.42323.1315.41276.391213.13030.5289.001916.42712.7303.131128.92117.11616.41816.91610.72014.517
12/18/1529INTSH214.52520.2284.52148.622411.62529.52610.72116.42610.3254.692327.62022.52220.72720.52711.52124.931
01/19/1630NTDEH27.4495.72134.36125.9282.83510.485.7155.3095.54102.40413.5914.1912.6813.976.39912.213
01/26/1632MC-CNN-fstH29.47147.35205.07237.18164.711416.8208.47177.37116.97112.82820.71617.41715.41615.1137.901412.614
01/21/1631MCCNN_LayoutH28.94135.53115.63285.0643.591212.6177.23127.53128.86165.793023.01713.6815.01414.7115.85510.47
02/18/1633LS-ELASF336.75553.55910.34215.84837.05883.66424.55349.15634.65213.95144.94645.75434.95529.14964.46762.759
03/15/1634MPSVQ143.56358.86333.96834.26537.96052.44630.85956.86151.06230.66456.95551.56044.66343.46244.25854.256
04/03/1635ICSGF345.66469.76719.15321.35443.66377.66136.96365.36440.45820.35353.65358.76446.56447.16560.76479.164
04/12/1636MeshStereoExtH27.0864.4153.9885.4073.17810.076.2394.6264.7773.491612.7712.4610.4514.5107.80138.853
04/13/1637GlstereoH219.83420.7308.253613.94418.63834.63012.93325.43423.2428.614231.12730.63420.32525.44321.14022.729
04/24/1638HLSC_corH226.04226.53415.25021.05220.53935.73123.45133.14235.05311.94939.13834.23625.23832.85528.34522.728
04/27/1639JEMQ137.25635.74027.96330.66333.25543.03731.46149.55747.35926.56249.64946.05735.75630.85037.55255.857
05/12/1640PMSCH26.7143.4612.6816.19102.5426.9224.5433.9634.0442.37313.1812.3512.2616.2145.88610.88
05/28/1641APAP-StereoH27.2685.4384.91205.1155.171521.6236.99114.3144.2363.241514.3119.7837.32213.446.3088.462
07/03/1642LPUH210.41511.4223.1848.10206.081720.9228.24156.94104.0034.042033.93316.91515.21517.8209.121511.611
08/31/1643SEDF363.46754.36022.46072.96964.56871.45742.56780.16767.96749.86979.66474.46665.46955.16786.16991.669
09/13/1644SNP-RSMH28.75125.46104.85186.50133.371010.497.31138.73149.37203.581714.31014.71214.91312.8210.11810.89
09/20/1645LFSIRQ170.16975.76960.36967.16772.46980.86253.76985.46983.86942.56891.26690.46864.16871.36961.56590.368
10/19/1646LW-CNNH27.0454.6563.9565.3062.63311.2145.4144.3254.2252.43512.2513.4713.61214.8124.72112.012
10/23/1647SIGMRFQ164.26860.06533.06767.96863.26799.56939.86584.86882.06835.26695.26991.56958.16765.86855.06288.666
11/06/1648SPSF319.63314.22412.34614.94712.02715.81819.14617.42815.4318.234030.92534.83930.64925.34128.34428.035
11/14/1649PKLSH211.0167.80214.561710.2305.62169.7568.31169.19168.39154.212130.92617.51816.91917.11712.22415.318
11/15/1650MC-CNN-WSH212.11914.8267.203411.1357.622015.91911.82611.5239.01183.891919.71520.52016.31716.31512.12318.322
11/15/1651UCNNH220.53644.8519.774113.64118.23636.53212.83123.43112.4299.224439.54030.53324.83721.23119.13632.339
11/16/1652MCSCF311.31813.3235.962910.6318.69217.22311.32310.6197.48133.0793.10125.22519.02417.21910.31925.533
11/24/1653ADSMQ138.75840.44420.35627.35935.15755.95022.35056.16050.96124.25958.05656.36336.55732.15338.75669.762
01/03/1754SLACH219.33236.1416.53319.892921.94039.13311.82729.03817.9357.643640.24226.52721.12919.42515.02819.524
01/15/1755IGFQ134.05442.74520.15523.75732.25245.64228.65843.04937.25521.45650.95144.75334.75431.95137.45147.151
01/24/17563DMSTH25.9223.7132.7824.7522.7247.3644.2823.4413.7622.35212.6611.548.56314.085.3538.874
03/09/1757SGMEPiF313.9246.92196.71329.47269.722211.81613.63510.92110.6265.262632.83026.92822.73322.73412.02221.727
03/10/1758MC-CNN+TDSRF36.3535.4594.45136.80143.461110.7116.0575.0185.1982.62610.839.6216.59111.416.0177.041
03/22/1759JMRH212.5204.0943.9778.44236.931811.11213.83619.53019.0373.661817.01418.21918.02221.0307.291217.820
03/23/1760DSGCAQ133.85342.94620.95723.65630.24945.54127.65542.04836.05421.05550.25044.25233.35234.65738.45546.850
04/04/1761DDLQ130.14844.35019.45425.85828.34742.13621.14937.14428.74621.75746.84736.04030.34828.44632.74937.543
05/23/1762r200highH240.96070.56814.44821.35337.75972.25838.16453.25831.45018.35252.45252.66144.16245.46450.76166.560
06/14/1763DoGGuidedQ141.46145.45323.66130.66434.65652.54728.35759.16353.86426.46160.66054.76238.35935.55944.55972.063
06/22/1764LocalExpH25.4313.6522.8732.9811.9915.5913.3713.4823.3512.05110.329.7528.57414.495.4049.555
08/25/1765SSRQ137.35750.05721.05928.56130.25053.84824.55457.86252.46322.05840.84348.55836.95832.75437.95352.254
10/12/1766FEN-D2DRRH27.2374.6874.11105.0333.0378.4256.0574.9075.3293.201311.5414.1913.41113.965.06214.315
11/13/1767DFQ158.46647.45530.26553.86655.46698.26849.86867.96565.06638.96793.66878.46754.36654.26656.36390.067
11/13/1768CBMVH211.1176.07165.22258.09194.051318.7219.312010.7209.61223.111033.73215.61317.52017.11810.11714.416
11/17/1769CGPTQ132.85243.44820.95823.25529.44843.43823.65243.85137.25620.75448.74840.95134.05332.15236.05042.445

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: October 13 2017 by Daniel Scharstein