vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.45827.95012.16217.86613.74374.58514.05130.35226.35711.06164.48437.96125.85425.35629.36043.761
07/25/142SGBM1Q127.96228.35117.27019.06714.54557.97315.65731.85331.46313.26658.67938.66327.05925.95931.46259.775
07/25/143SGMQ120.84835.5579.575413.85716.54732.14219.06225.84616.7448.955439.85431.14722.64420.73921.35332.248
07/25/144SGBM1F328.46343.5719.094913.65525.96482.08814.45543.46530.3625.984459.38145.87628.56224.95320.15145.963
07/28/146SGBM1H223.85132.95410.85913.65316.24671.28112.64026.64723.0515.834053.87539.26525.65322.84918.84547.466
07/28/147SGMH218.44040.3634.54228.032722.95940.55111.43324.74310.1315.403729.63428.54223.94720.03714.23630.947
07/28/148SGMF325.35445.1744.33186.872232.27550.06613.04548.17418.3477.664829.63336.15631.26824.25224.55650.269
07/28/145Cens5H226.66047.1768.744811.94825.66245.35919.56440.66229.0609.935836.54738.66231.06725.05525.65744.662
08/25/149LPSH219.2426.14245.34349.24357.532896.09412.3389.61229.40275.183392.49427.44024.34823.05010.02325.643
08/27/1410LPSF320.3466.72256.06399.72379.873294.39314.15211.22911.2355.884189.39236.05520.53623.85116.04225.441
08/31/1411BSMQ141.58459.88825.88627.98038.98560.67433.38546.97137.37226.38264.88551.58042.68445.28642.87766.680
09/10/1412LAMC_DSMH226.05555.88511.96114.36118.35144.05618.36139.96029.5616.674531.13834.55228.86326.36030.16135.752
09/18/1413SNCCH221.94948.6806.98439.793825.76346.06212.43936.85716.6437.254623.12634.25126.75721.84619.95028.446
10/07/1414IDRH218.13937.5624.08157.492623.36040.65212.84224.54111.3365.463833.14226.03621.54321.74515.33921.234
11/12/1415LCUQ117.03824.7447.594611.64711.93627.93714.04919.33815.8428.105036.14629.14321.34118.43214.13523.839
01/21/1516TSGOF339.18034.15616.96920.06843.38755.47114.35354.18249.28333.98966.28745.97739.88342.68447.28152.672
04/08/1517REAFH231.46658.38630.99213.15145.38963.87730.98338.75925.3568.605239.35236.85727.05835.58018.24339.755
04/09/1518PFSF332.26865.19229.49012.15050.09170.88028.27744.66923.1527.854937.04837.76027.96036.08219.84935.753
04/17/1519TMAPH216.93720.2404.94278.133012.84030.03911.73427.94820.4495.093231.53923.13320.93819.03418.84618.029
04/19/1520MeshStereoH213.2305.90214.882510.84412.94110.61411.03112.2319.01245.393627.43023.53417.73021.04015.44020.933
08/28/1521MC-CNN-acrtH28.08165.59194.55235.96162.83911.4205.81118.32198.89222.711216.31814.11713.21513.056.401511.114
09/14/1522ELASF332.36950.9829.175011.04533.07688.29218.36047.37226.85811.76441.75837.45823.74628.86463.08842.858
09/28/1523R-NCCF348.48826.24714.86730.28430.97272.98441.69277.79264.18927.48559.18071.99050.99133.97778.29280.889
10/13/1524MDPH212.62914.4344.992810.64310.73427.2358.112212.5328.07204.272830.43520.52912.61017.83113.43417.327
11/03/1525MC-CNN+RBSH28.42176.05225.16316.24183.271411.1176.36158.87219.83293.212115.11715.92212.81213.577.04179.998
11/05/1526GCSVRH214.63617.1373.5098.223116.54847.4648.82259.75237.06183.171934.44527.13918.33319.23516.04119.331
11/06/1527SOU4P-netH213.43123.1435.41356.391913.14230.5409.002616.43612.7393.131728.93217.12416.42716.92610.72714.525
12/18/1528INTSH214.53520.2394.52218.623311.63529.53810.73016.43510.3324.692927.63122.53220.73720.53811.52924.940
01/19/1629NTDEH27.44135.72204.36195.92152.83910.4125.71105.30135.54142.40813.51314.11512.61113.996.391412.218
01/26/1631MC-CNN-fstH29.47217.35275.07297.18244.712116.8288.47247.37176.97172.821320.72317.42515.42515.1167.902112.619
01/21/1630MCCNN_LayoutH28.94205.53185.63365.06103.591812.6237.23197.53188.86215.793923.02513.61415.02314.7135.851010.410
02/18/1632LS-ELASF336.77653.58310.35715.86537.08283.68924.57249.17634.66613.96744.96245.77534.97629.16564.49062.777
03/15/1633MPSVQ143.58658.88733.99434.28837.98452.46730.88256.88551.08530.68856.97651.58144.68643.48544.27854.273
04/03/1634ICSGF345.68769.79319.17321.37243.68877.68636.98865.38840.47520.37153.67458.78746.58747.18960.78679.187
04/12/1635MeshStereoExtH27.0894.4193.98145.40133.171210.0106.23144.6294.77113.492312.71112.41010.4814.5127.80208.853
04/13/1636GlstereoH219.84520.7418.254713.95818.65234.64512.94425.44523.2538.615331.13730.64620.33525.45821.15222.737
04/24/1637HLSC_corH226.05726.54815.26821.07020.55635.74623.46933.15535.06811.96539.15134.25025.25232.87428.35922.736
04/27/1638JEMQ137.27735.75827.98930.68533.27743.05431.48449.57747.38126.58449.66846.07835.77730.86737.56855.874
05/12/1639PMSCH26.7173.4622.6816.19172.5456.9264.5463.9664.0482.37713.11212.3912.2916.2225.881110.811
05/28/1640APAP-StereoH27.26115.43154.91265.11115.172321.6326.99184.3174.23103.242214.3159.7857.32413.466.30138.462
07/03/1641LPUH210.42311.4313.1878.10296.082620.9318.24236.94164.0074.042733.94416.92315.22417.8309.122211.616
08/31/1642SEDF363.49354.38422.48272.99564.59471.48242.59380.19367.99049.89579.68974.49365.49555.19386.19591.694
09/13/1643SNP-RSMH28.75185.46174.85246.50203.371510.4137.31208.73209.37263.582414.31414.71814.92212.8410.12510.812
09/20/1644LFSIRQ170.19575.79560.39567.19372.49580.88753.79585.49583.89542.59391.29390.49464.19471.39561.58790.393
10/19/1645LW-CNNH27.0484.65103.95125.30122.63611.2195.4194.3284.2292.43912.2913.41313.61814.8144.72112.017
10/23/1646SIGMRFQ164.29460.08933.09367.99463.29399.59739.89084.89482.09435.29095.29591.59558.19365.89455.08588.692
11/06/1647SPSF319.64414.23312.36314.96412.03715.82619.16317.43715.4418.235130.93634.85330.66625.35628.35828.044
11/15/1648MC-CNN-WSH212.12614.8367.204411.1467.622915.92711.83511.5309.01243.892619.72220.52816.32616.32312.13218.330
11/15/1649UCNNH220.54744.8739.775513.65518.25036.54712.84123.44012.4379.225639.55330.54524.84921.24219.14832.349
11/16/1650MCSCF311.32513.3325.963810.6428.69307.22711.33210.6257.48193.07153.10125.23519.03417.22810.32625.542
11/24/1651ADSMQ138.77940.46420.37627.37835.18055.97222.36756.18350.98424.27958.07856.38636.57832.17238.77369.782
01/03/1752SLACH219.34336.1596.53409.894021.95739.15011.83629.05117.9467.644740.25526.53721.13919.43615.03819.532
01/15/1753IGFQ134.07442.76720.17523.77632.27445.66128.67943.06437.27021.47650.97044.77334.77531.96937.46747.165
01/24/17543DMSTH25.9253.7172.7824.7562.7277.3684.2853.4433.7652.35612.61011.588.56514.0105.3568.874
03/09/1755SGMEPiF313.9336.92266.71429.47369.723111.82213.64710.92710.6335.263432.84126.93822.74522.74812.03121.735
03/10/1756MC-CNN+TDSRF36.3565.45164.45206.80213.461610.7156.05125.01125.19122.621010.869.6236.59111.416.01127.041
03/22/1757JMRH212.5274.0983.97138.44326.932711.11613.84819.53919.0483.662517.02018.22618.03121.0417.291817.828
03/23/1758DSGCAQ133.87342.96820.97723.67530.27045.56027.67542.06336.06921.07450.26944.27233.37134.67838.47146.864
04/04/1759DDLQ130.16444.37219.47425.87728.36642.15321.16637.15828.75921.77746.86436.05430.36528.46232.76437.554
05/23/1760r200highH240.98270.59414.46521.37137.78372.28338.18953.28131.46318.36952.47352.68344.18545.48750.78366.579
06/14/1761DoGGuidedQ141.48345.47523.68530.68634.67952.56828.37859.18753.88826.48360.68254.78538.38135.58144.57972.085
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5943.3743.4843.3542.05210.349.7548.57614.4115.4079.556
08/25/1763SSRQ137.37850.08121.07928.58230.27153.86924.57357.88652.48622.07840.85748.57936.97932.77337.97052.271
10/12/1764FEN-D2DRRH27.23104.68114.11165.0393.03118.4296.05124.90115.32133.202011.5814.11513.41713.985.06214.323
11/13/1765CBMVH211.1246.07235.22328.09284.051918.7309.312710.7269.61283.111633.74315.62117.52917.12710.12414.424
11/17/1766CGPTQ132.87043.47020.97823.27429.46943.45523.67043.86637.27120.77248.76540.96834.07232.17136.06642.457
12/11/1767OVODH28.87194.74133.64105.51144.822212.8246.51169.91249.96303.131716.61914.81914.12015.4186.921613.221
01/24/1868SMSSRQ134.87547.47722.48127.37928.86746.76323.67149.57843.47620.97337.74944.17134.67433.07539.17549.868
02/07/1869DFQ156.19247.77827.98836.19046.79062.57550.29472.48969.99237.89188.29170.08952.89250.29177.59191.895
02/28/1870FDRH27.69155.41144.22174.2052.73810.2115.4086.40155.76154.723011.2715.42013.41616.5245.22513.020
03/06/1871NOSSH25.0423.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.525.20310.09
03/09/1872DCNNQ132.97241.06518.27123.17326.66547.96527.57436.75631.76519.87049.26643.97034.57335.37935.26563.078
03/09/1873SGM_ROBH218.44137.4615.31339.033414.24431.74114.35424.74412.6385.273531.84029.74424.95022.04718.64428.245
03/11/1874SGM-ForestH27.37124.71123.69114.9383.181311.1175.3775.57145.81162.651114.51613.21113.11414.8155.63911.215
03/14/1875DTSH213.4328.45297.54457.46255.502414.92510.22924.54225.1554.933119.22118.72714.62115.92113.03317.226
03/23/1876MEDIAN_ROBH297.89796.19695.69699.09798.49798.49699.29798.49798.19699.09799.09799.69799.99794.79795.19698.396
03/23/1877AVERAGE_ROBH297.69696.29796.59796.89697.89697.89598.29697.99698.29798.99698.99699.19699.79693.19697.99798.997
03/26/1878ELAS_ROBH227.36143.46912.46413.95923.86166.47820.46533.05420.75011.06043.95937.55926.35628.76338.47233.350
04/17/1879ISMQ140.88142.56626.48734.88936.18144.55834.48756.28452.78725.28051.07252.48239.78233.37638.87475.386
05/01/1880PSMNet_ROBQ142.18533.05523.18430.18331.47354.87030.78148.77548.38228.38680.89053.58436.98038.68363.98971.283
05/05/1881WCMA_ROBQ132.97130.95218.77232.18729.26837.24823.16840.16134.96726.28157.57745.07429.36431.97039.87641.156
05/18/1883PDSH214.23414.4345.803710.54110.53322.13314.05014.5348.97235.934224.22721.53118.23218.93311.93033.651
05/22/1884DN-CSS_ROBH222.85031.4539.285113.55212.43944.35712.13728.15017.6459.115550.97140.06621.24025.05431.96343.259
05/24/1885LALA_ROBH226.05625.6469.545313.65418.75337.44916.85846.47045.68011.36240.75631.64826.35521.54321.65451.970
05/25/1886ETED_ROBH226.65925.64510.96014.86319.05433.34317.65944.56845.37816.16843.96133.64928.36121.64422.25548.867
05/25/1887XPNet_ROBH224.65219.93810.75812.14917.14927.83615.55647.57345.5799.735737.95028.44124.95017.42919.04761.476
05/26/1888NOSS_ROBH25.0113.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.525.2039.065
05/28/1889PWCDC_ROBF353.39048.57930.59151.69261.49283.89030.08050.57944.97744.59473.68858.88848.38949.39081.99481.190
05/30/1890DLCB_ROBH212.52810.0306.70419.81395.762516.8299.982811.12811.2345.964324.72821.03016.82816.52514.33723.138
05/31/1891FBW_ROBH232.26736.3609.375214.26019.15569.37913.24651.08039.17410.85943.95941.56933.07029.96651.38471.484
05/31/1892iResNet_ROBH224.85323.04210.25614.76212.43825.93412.94328.04924.95411.56346.66338.96421.44227.86145.68066.781
05/31/1893CBMV_ROBH27.65143.4833.3584.8073.57176.3256.88174.84103.9161.97125.42911.1713.11315.8207.341913.822
06/01/1894DPSimNet_ROBF349.48960.19022.98328.38133.77863.17634.38674.79170.19329.38764.98672.29148.28855.09250.58279.688
06/01/1895NaN_ROBH25.7343.4112.9063.6922.3345.3233.3533.4953.3132.31310.3510.869.64715.3175.4589.897
06/01/1896PDISCO_ROBH254.39162.59121.98038.69138.98584.09140.39174.59069.19139.49260.78373.69249.99046.98878.69381.291
06/05/1897CBMBNetH210.2228.30285.10306.87224.522011.5217.702113.93313.2403.041421.92413.31213.61915.41911.22811.013
06/14/1898MSMD_ROBQ130.96526.94914.66620.06922.65833.74427.87643.96738.47321.17549.56740.86731.86931.66837.56943.660

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: October 13 2017 by Daniel Scharstein