vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.45927.95112.16317.86713.74474.58614.05230.35326.35811.06264.48537.96225.85525.35729.36143.763
07/25/142SGBM1Q127.96328.35217.27119.06814.54657.97415.65831.85431.46413.26758.68038.66427.06025.96031.46359.777
07/25/143SGMQ120.84935.5589.575513.85816.54832.14319.06325.84716.7458.955539.85531.14822.64520.74021.35432.249
07/25/144SGBM1F328.46443.5719.095013.65625.96582.08914.45643.46530.3635.984559.38245.87628.56324.95420.15245.965
07/28/146SGBM1H223.85232.95510.86013.65416.24771.28212.64126.64823.0525.834153.87639.26625.65422.85018.84647.468
07/28/147SGMH218.44140.3644.54228.032822.96040.55211.43424.74410.1315.403829.63528.54323.94820.03814.23730.948
07/28/148SGMF325.35545.1744.33186.872332.27550.06613.04648.17418.3487.664929.63436.15731.26924.25324.55750.271
07/28/145Cens5H226.66147.1768.744911.94925.66345.36019.56540.66229.0619.935936.54838.66331.06825.05625.65844.664
08/25/149LPSH219.2436.14255.34359.24367.532996.09512.3399.61229.40275.183492.49527.44124.34923.05110.02325.644
08/27/1410LPSF320.3476.72266.06409.72389.873394.39414.15311.22911.2365.884289.39336.05620.53723.85216.04325.442
08/31/1411BSMQ141.58559.88825.88727.98038.98560.67533.38546.97137.37226.38364.88651.58042.68545.28742.87766.681
09/10/1412LAMC_DSMH226.05655.88511.96214.36218.35244.05718.36239.96029.5626.674631.13934.55328.86426.36130.16235.754
09/18/1413SNCCH221.95048.6806.98449.793925.76446.06312.44036.85716.6447.254723.12634.25226.75821.84719.95128.447
10/07/1414IDRH218.14037.5634.08157.492723.36140.65312.84324.54211.3375.463933.14326.03721.54421.74615.34021.235
11/12/1415LCUQ117.03924.7457.594711.64811.93727.93814.05019.33915.8438.105136.14729.14421.34218.43314.13623.840
01/21/1516TSGOF339.18034.15716.97020.06943.38855.47114.35454.18249.28433.99066.28845.97739.88442.68547.28152.674
04/08/1517REAFH231.46758.38630.99313.15245.39063.87830.98338.75925.3578.605339.35336.85827.05935.58018.24439.757
04/09/1518PFSF332.26965.19229.49112.15150.09270.88128.27744.66923.1537.855037.04937.76127.96136.08219.85035.755
04/17/1519TMAPH216.93820.2414.94278.133112.84130.04011.73527.94920.4505.093331.54023.13420.93919.03518.84718.030
04/19/1520MeshStereoH213.2315.90224.882510.84512.94210.61411.03212.2319.01245.393727.43123.53517.73121.04115.44120.934
08/28/1521MC-CNN-acrtH28.08165.59194.55235.96162.83911.4205.81118.32198.89222.711216.31814.11713.21513.056.401511.114
09/14/1522ELASF332.37050.9829.175111.04633.07688.29318.36147.37226.85911.76541.75937.45923.74728.86563.08942.860
09/28/1523R-NCCF348.48926.24814.86830.28530.97272.98541.69377.79364.19027.48659.18171.99150.99233.97878.29380.890
10/13/1524MDPH212.63014.4354.992910.64410.73527.2368.112212.5328.07204.272930.43620.53012.61017.83213.43517.328
11/03/1525MC-CNN+RBSH28.42176.05235.16326.24183.271411.1176.36158.87219.83293.212215.11715.92212.81213.577.04179.998
11/05/1526GCSVRH214.63717.1383.5098.223216.54947.4658.82269.75237.06183.172034.44627.14018.33419.23616.04219.332
11/06/1527SOU4P-netH213.43223.1445.41366.391913.14330.5419.002716.43712.7403.131828.93317.12416.42716.92710.72814.526
12/18/1528INTSH214.53620.2404.52218.623411.63629.53910.73116.43610.3324.693027.63222.53320.73820.53911.53024.941
01/19/1629NTDEH27.44135.72214.36195.92152.83910.4125.71105.30135.54142.40813.51314.11512.61113.996.391412.218
01/26/1631MC-CNN-fstH29.47217.35285.07307.18254.712116.8298.47247.37176.97172.821320.72317.42515.42515.1167.902112.619
01/21/1630MCCNN_LayoutH28.94205.53185.63375.06103.591812.6247.23197.53188.86215.794023.02513.61415.02314.7135.851010.410
02/18/1632LS-ELASF336.77653.58310.35815.86637.08283.69024.57349.17634.66613.96844.96445.77534.97629.16664.49162.779
03/15/1633MPSVQ143.58758.88733.99534.28937.98452.46730.88256.88551.08630.68956.97751.58144.68743.48644.27854.275
04/03/1634ICSGF345.68869.79419.17321.37343.68977.68736.98965.38940.47620.37253.67558.78846.58847.19060.78779.188
04/12/1635MeshStereoExtH27.0894.4193.98145.40133.171210.0106.23144.6294.77113.492412.71112.41010.4814.5127.80208.853
04/13/1636GlstereoH219.84620.7428.254813.95918.65334.64612.94525.44623.2548.615431.13830.64720.33625.45921.15322.738
04/24/1637HLSC_corH226.05826.54915.26921.07120.55735.74723.47033.15635.06811.96639.15234.25125.25332.87528.36022.737
04/27/1638JEMQ137.27735.75927.99030.68633.27743.05531.48449.57747.38226.58549.66946.07835.77730.86837.56855.876
05/12/1639PMSCH26.7173.4622.6816.19172.5456.9264.5463.9664.0482.37713.11212.3912.2916.2235.881110.811
05/28/1640APAP-StereoH27.26115.43154.91265.11115.172321.6336.99184.3174.23103.242314.3159.7857.32413.466.30138.462
07/03/1641LPUH210.42311.4323.1878.10306.082720.9328.24236.94164.0074.042833.94516.92315.22417.8319.122211.616
08/31/1642SEDF363.49454.38422.48272.99664.59571.48342.59480.19467.99149.89679.69074.49465.49655.19486.19691.695
09/13/1643SNP-RSMH28.75185.46174.85246.50213.371510.4137.31208.73209.37263.582514.31414.71814.92212.8410.12510.812
09/20/1644LFSIRQ170.19675.79660.39667.19472.49680.88853.79685.49683.89642.59491.29490.49564.19571.39661.58890.394
10/19/1645LW-CNNH27.0484.65103.95125.30122.63611.2195.4194.3284.2292.43912.2913.41313.61814.8144.72112.017
10/23/1646SIGMRFQ164.29560.08933.09467.99563.29499.59839.89184.89582.09535.29195.29691.59658.19465.89555.08688.693
11/06/1647SPSF319.64514.23412.36414.96512.03815.82719.16417.43815.4428.235230.93734.85430.66725.35728.35928.045
11/15/1648MC-CNN-WSH212.12714.8377.204511.1477.623015.92811.83611.5309.01243.892719.72220.52916.32616.32412.13318.331
11/15/1649UCNNH220.54844.8739.775613.65618.25136.54812.84223.44112.4389.225739.55430.54624.85021.24319.14932.350
11/16/1650MCSCF311.32613.3335.963910.6438.69317.22711.33310.6257.48193.07153.10125.23619.03517.22910.32625.543
11/24/1651ADSMQ138.77940.46520.37627.37835.18055.97222.36856.18350.98524.28058.07956.38736.57832.17338.77369.783
01/03/1752SLACH219.34436.1606.53419.894121.95839.15111.83729.05217.9477.644840.25626.53821.14019.43715.03919.533
01/15/1753IGFQ134.07442.76720.17523.77632.27445.66228.67943.06437.27021.47750.97144.77334.77531.97037.46747.167
01/24/17543DMSTH25.9253.7172.7824.7562.7277.3684.2853.4433.7652.35612.61011.588.56514.0105.3568.874
03/09/1755SGMEPiF313.9346.92276.71439.47379.723211.82213.64810.92710.6335.263532.84226.93922.74622.74912.03221.736
03/10/1756MC-CNN+TDSRF36.3565.45164.45206.80223.461610.7156.05125.01125.19122.621010.869.6236.59111.416.01127.041
03/22/1757JMRH212.5284.0983.97138.44336.932811.11613.84919.54019.0493.662617.02018.22618.03221.0427.291817.829
03/23/1758DSGCAQ133.87342.96820.97723.67530.27045.56127.67542.06336.06921.07550.27044.27233.37234.67938.47146.866
04/04/1759DDLQ130.16544.37219.47425.87728.36642.15421.16737.15828.76021.77846.86636.05530.36628.46332.76537.556
05/23/1760r200highH240.98370.59514.46621.37237.78372.28438.19053.28131.46418.37052.47452.68344.18645.48850.78366.580
06/14/1761DoGGuidedQ141.48445.47523.68530.68734.67952.56828.37859.18853.88926.48460.68354.78638.38135.58144.57972.086
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5943.3743.4843.3542.05210.349.7548.57614.4115.4079.556
08/25/1763SSRQ137.37850.08121.07928.58230.27153.86924.57457.88752.48722.07940.85848.57936.97932.77437.97052.273
10/12/1764FEN-D2DRRH27.23104.68114.11165.0393.03118.4296.05124.90115.32133.202111.5814.11513.41713.985.06214.324
11/13/1765CBMVH211.1256.07245.22338.09294.051918.7319.312810.7269.61283.111733.74415.62117.53017.12810.12414.425
11/17/1766CGPTQ132.87143.47020.97823.27429.46943.45623.67143.86637.27120.77348.76740.96934.07332.17236.06642.459
12/11/1767OVODH28.87194.74133.64105.51144.822212.8256.51169.91249.96303.131816.61914.81914.12015.4186.921613.221
01/24/1868SMSSRQ134.87547.47722.48127.37928.86746.76423.67249.57843.47720.97437.75044.17134.67433.07639.17549.870
02/07/1869DFQ156.19347.77827.98936.19146.79162.57650.29572.49069.99337.89288.29270.09052.89350.29277.59291.896
02/28/1870FDRH27.69155.41144.22174.2052.73810.2115.4086.40155.76154.723111.2715.42013.41616.5255.22513.020
03/06/1871NOSSH25.0423.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.525.20310.09
03/09/1872SGM_ROBH218.44237.4625.31349.033514.24531.74214.35524.74512.6395.273631.84129.74524.95122.04818.64528.246
03/11/1873SGM-ForestH27.37124.71123.69114.9383.181311.1175.3775.57145.81162.651114.51613.21113.11414.8155.63911.215
03/14/1874DTSH213.4338.45307.54467.46265.502414.92610.23024.54325.1564.933219.22118.72714.62115.92213.03417.227
03/23/1875MEDIAN_ROBH297.89896.19795.69799.09898.49898.49799.29898.49898.19799.09899.09899.69899.99894.79895.19798.397
03/23/1876AVERAGE_ROBH297.69796.29896.59896.89797.89797.89698.29797.99798.29898.99798.99799.19799.79793.19797.99898.998
03/26/1877ELAS_ROBH227.36243.46912.46513.96023.86266.47920.46633.05520.75111.06143.96137.56026.35728.76438.47233.351
04/17/1878ISMQ140.88242.56626.48834.89036.18144.55934.48756.28452.78825.28151.07352.48239.78233.37738.87475.387
05/01/1879PSMNet_ROBQ142.18633.05623.18430.18431.47354.87030.78148.77548.38328.38780.89153.58536.98038.68463.99071.284
05/05/1880WCMA_ROBQ132.97230.95318.77232.18829.26837.24923.16940.16134.96726.28257.57845.07429.36531.97139.87641.158
05/18/1881PDSH214.23514.4355.803810.54210.53422.13414.05114.5348.97235.934324.22821.53218.23318.93411.93133.652
05/22/1882DN-CSS_ROBH222.85131.4549.285213.55312.44044.35812.13828.15117.6469.115650.97240.06721.24125.05531.96443.261
05/24/1883LALA_ROBH226.05725.6479.545413.65518.75437.45016.85946.47045.68111.36340.75731.64926.35621.54421.65551.972
05/25/1884ETED_ROBH226.66025.64610.96114.86419.05533.34417.66044.56845.37916.16943.96333.65028.36221.64522.25648.869
05/25/1885XPNet_ROBH224.65319.93910.75912.15017.15027.83715.55747.57345.5809.735837.95128.44224.95117.43019.04861.478
05/26/1886NOSS_ROBH25.0113.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.525.2039.065
05/28/1887PWCDC_ROBF353.39148.57930.59251.69361.49383.89130.08050.57944.97844.59573.68958.88948.39049.39181.99581.191
05/30/1888DLCB_ROBH212.52910.0316.70429.81405.762616.8309.982911.12811.2355.964424.72921.03116.82916.52614.33823.139
05/31/1889FBW_ROBH232.26836.3619.375314.26119.15669.38013.24751.08039.17410.86043.96141.57033.07129.96751.38471.485
05/31/1890iResNet_ROBH224.85423.04310.25714.76312.43925.93512.94428.05024.95511.56446.66538.96521.44327.86245.68066.782
05/31/1891CBMV_ROBH27.65143.4833.3584.8073.57176.3256.88174.84103.9161.97125.43011.1713.11315.8217.341913.823
06/01/1892DPSimNet_ROBF349.49060.19022.98328.38133.77863.17734.38674.79270.19429.38864.98772.29248.28955.09350.58279.689
06/01/1893NaN_ROBH25.7343.4112.9063.6922.3345.3233.3533.4953.3132.31310.3510.869.64715.3175.4589.897
06/01/1894PDISCO_ROBH254.39262.59121.98038.69238.98584.09240.39274.59169.19239.49360.78473.69349.99146.98978.69481.292
06/05/1895CBMBNetH210.2228.30295.10316.87234.522011.5217.702113.93313.2413.041421.92413.31213.61915.41911.22911.013
06/14/1896MSMD_ROBQ130.96626.95014.66720.07022.65933.74527.87643.96738.47321.17649.56840.86831.87031.66937.56943.662
06/27/1897DCNNH210.9245.66204.98286.49205.732512.5238.512515.63510.9343.081624.12720.22816.82815.52010.32713.822
07/31/1898MotionStereoH240.48167.69325.08629.28340.98757.37335.58857.58640.47519.97142.86052.68439.88337.18351.78534.953

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: July 31 2018 by Daniel Scharstein