vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.46027.95112.16417.86813.74474.58714.05230.35326.35911.06364.48637.96325.85525.35829.36243.763
07/25/142SGBM1Q127.96428.35217.27219.06914.54657.97515.65831.85531.46513.26858.68138.66527.06025.96131.46459.778
07/25/143SGMQ120.84935.5599.575613.85916.54832.14319.06425.84716.7458.955539.85531.14822.64520.74021.35432.249
07/25/144SGBM1F328.46543.5729.095113.65725.96682.09014.45643.46630.3645.984559.38345.87728.56424.95520.15245.965
07/28/146SGBM1H223.85232.95510.86113.65516.24771.28312.64126.64823.0535.834153.87739.26725.65422.85018.84647.468
07/28/147SGMH218.44140.3654.54228.032822.96140.55211.43424.74410.1315.403829.63528.54323.94820.03814.23730.948
07/28/148SGMF325.35645.1754.33186.872332.27650.06713.04648.17518.3487.664929.63436.15831.27024.25324.55750.271
07/28/145Cens5H226.66247.1778.745011.95025.66445.36019.56640.66329.0629.936036.54838.66431.06925.05725.65844.664
08/25/149LPSH219.2436.14255.34359.24367.532996.09612.3399.61229.40275.183492.49627.44124.34923.05110.02325.644
08/27/1410LPSF320.3476.72266.06409.72389.873394.39514.15311.22911.2365.884289.39436.05720.53723.85216.04325.442
08/31/1411BSMQ141.58659.88925.88827.98138.98660.67633.38646.97237.37326.38464.88751.58142.68645.28842.87866.682
09/10/1412LAMC_DSMH226.05755.88611.96314.36318.35244.05718.36339.96129.5636.674631.13934.55428.86526.36230.16335.754
09/18/1413SNCCH221.95048.6816.98449.793925.76546.06312.44036.85816.6447.254723.12634.25326.75821.84719.95128.447
10/07/1414IDRH218.14037.5644.08157.492723.36240.65312.84324.54211.3375.463933.14326.03721.54421.74615.34021.235
11/12/1415LCUQ117.03924.7457.594811.64811.93727.93814.05019.33915.8438.105136.14729.14421.34218.43314.13623.840
01/21/1516TSGOF339.18134.15716.97120.07043.38955.47214.35454.18349.28533.99166.28945.97839.88542.68647.28252.674
04/08/1517REAFH231.46858.38730.99413.15345.39163.87930.98438.76025.3588.605339.35336.85927.05935.58118.24439.757
04/09/1518PFSF332.27065.19329.49212.15250.09370.88228.27844.67023.1547.855037.04937.76227.96236.08319.85035.755
04/17/1519TMAPH216.93820.2414.94278.133112.84130.04011.73527.94920.4505.093331.54023.13420.93919.03518.84718.030
04/19/1520MeshStereoH213.2315.90224.882510.84512.94210.61411.03212.2319.01245.393727.43123.53517.73121.04115.44120.934
08/28/1521MC-CNN-acrtH28.08165.59194.55235.96162.83911.4205.81118.32198.89222.711216.31814.11713.21513.056.401511.114
09/14/1522ELASF332.37150.9839.175211.04633.07788.29418.36247.37326.86011.76641.75937.46023.74728.86663.09042.860
09/28/1523R-NCCF348.49026.24814.86930.28630.97372.98641.69477.79464.19127.48759.18271.99250.99333.97978.29480.891
10/13/1524MDPH212.63014.4354.992910.64410.73527.2368.112212.5328.07204.272930.43620.53012.61017.83213.43517.328
11/03/1525MC-CNN+RBSH28.42176.05235.16326.24183.271411.1176.36158.87219.83293.212215.11715.92212.81213.577.04179.998
11/05/1526GCSVRH214.63717.1383.5098.223216.54947.4658.82269.75237.06183.172034.44627.14018.33419.23616.04219.332
11/06/1527SOU4P-netH213.43223.1445.41366.391913.14330.5419.002716.43712.7403.131828.93317.12416.42716.92710.72814.526
12/18/1528INTSH214.53620.2404.52218.623411.63629.53910.73116.43610.3324.693027.63222.53320.73820.53911.53024.941
01/19/1629NTDEH27.44135.72214.36195.92152.83910.4125.71105.30135.54142.40813.51314.11512.61113.996.391412.218
01/26/1631MC-CNN-fstH29.47217.35285.07307.18254.712116.8298.47247.37176.97172.821320.72317.42515.42515.1167.902112.619
01/21/1630MCCNN_LayoutH28.94205.53185.63375.06103.591812.6247.23197.53188.86215.794023.02513.61415.02314.7135.851010.410
02/18/1632LS-ELASF336.77753.58410.35915.86737.08383.69124.57449.17734.66713.96944.96445.77634.97729.16764.49262.780
03/15/1633MPSVQ143.58858.88833.99634.29037.98552.46830.88356.88651.08730.69056.97851.58244.68843.48744.27954.275
04/03/1634ICSGF345.68969.79519.17421.37443.69077.68836.99065.39040.47720.37353.67658.78946.58947.19160.78879.189
04/12/1635MeshStereoExtH27.0894.4193.98145.40133.171210.0106.23144.6294.77113.492412.71112.41010.4814.5127.80208.853
04/13/1636GlstereoH219.84620.7428.254913.96018.65334.64612.94525.44623.2558.615431.13830.64720.33625.46021.15322.738
04/24/1637HLSC_corH226.05926.54915.27021.07220.55835.74723.47133.15735.06911.96739.15234.25225.25332.87628.36122.737
04/27/1638JEMQ137.27835.76027.99130.68733.27843.05531.48549.57847.38326.58649.67046.07935.77830.86937.56955.877
05/12/1639PMSCH26.7173.4622.6816.19172.5456.9264.5463.9664.0482.37713.11212.3912.2916.2235.881110.811
05/28/1640APAP-StereoH27.26115.43154.91265.11115.172321.6336.99184.3174.23103.242314.3159.7857.32413.466.30138.462
07/03/1641LPUH210.42311.4323.1878.10306.082720.9328.24236.94164.0074.042833.94516.92315.22417.8319.122211.616
08/31/1642SEDF363.49554.38522.48372.99764.59671.48442.59580.19567.99249.89779.69174.49565.49755.19586.19791.696
09/13/1643SNP-RSMH28.75185.46174.85246.50213.371510.4137.31208.73209.37263.582514.31414.71814.92212.8410.12510.812
09/20/1644LFSIRQ170.19775.79760.39767.19572.49780.88953.79785.49783.89742.59591.29590.49664.19671.39761.58990.395
10/19/1645LW-CNNH27.0484.65103.95125.30122.63611.2195.4194.3284.2292.43912.2913.41313.61814.8144.72112.017
10/23/1646SIGMRFQ164.29660.09033.09567.99663.29599.59939.89284.89682.09635.29295.29791.59758.19565.89655.08788.694
11/06/1647SPSF319.64514.23412.36514.96612.03815.82719.16517.43815.4428.235230.93734.85530.66825.35828.36028.045
11/15/1648MC-CNN-WSH212.12714.8377.204511.1477.623015.92811.83611.5309.01243.892719.72220.52916.32616.32412.13318.331
11/15/1649UCNNH220.54844.8749.775713.65718.25136.54812.84223.44112.4389.225739.55430.54624.85021.24319.14932.350
11/16/1650MCSCF311.32613.3335.963910.6438.69317.22711.33310.6257.48193.07153.10125.23619.03517.22910.32625.543
11/24/1651ADSMQ138.78040.46620.37727.37935.18155.97322.36956.18450.98624.28158.08056.38836.57932.17438.77469.784
01/03/1752SLACH219.34436.1616.53419.894121.95939.15111.83729.05217.9477.644840.25626.53821.14019.43715.03919.533
01/15/1753IGFQ134.07542.76820.17623.77732.27545.66228.68043.06537.27121.47850.97244.77434.77631.97137.46847.167
01/24/17543DMSTH25.9253.7172.7824.7562.7277.3684.2853.4433.7652.35612.61011.588.56514.0105.3568.874
03/09/1755SGMEPiF313.9346.92276.71439.47379.723211.82213.64810.92710.6335.263532.84226.93922.74622.74912.03221.736
03/10/1756MC-CNN+TDSRF36.3565.45164.45206.80223.461610.7156.05125.01125.19122.621010.869.6236.59111.416.01127.041
03/22/1757JMRH212.5284.0983.97138.44336.932811.11613.84919.54019.0493.662617.02018.22618.03221.0427.291817.829
03/23/1758DSGCAQ133.87442.96920.97823.67630.27145.56127.67642.06436.07021.07650.27144.27333.37334.68038.47246.866
04/04/1759DDLQ130.16644.37319.47525.87828.36742.15421.16837.15928.76121.77946.86736.05630.36728.46432.76637.556
05/23/1760r200highH240.98470.59614.46721.37337.78472.28538.19153.28231.46518.37152.47552.68444.18745.48950.78466.581
06/14/1761DoGGuidedQ141.48545.47623.68630.68834.68052.56928.37959.18953.89026.48560.68454.78738.38235.58244.58072.087
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5943.3743.4843.3542.05210.349.7548.57614.4115.4079.556
08/25/1763SSRQ137.37950.08221.08028.58330.27253.87024.57557.88852.48822.08040.85848.58036.98032.77537.97152.273
10/12/1764FEN-D2DRRH27.23104.68114.11165.0393.03118.4296.05124.90115.32133.202111.5814.11513.41713.985.06214.324
11/13/1765CBMVH211.1256.07245.22338.09294.051918.7319.312810.7269.61283.111733.74415.62117.53017.12810.12414.425
11/17/1766CGPTQ132.87243.47120.97923.27529.47043.45623.67243.86737.27220.77448.76840.97034.07432.17336.06742.459
12/11/1767OVODH28.87194.74133.64105.51144.822212.8256.51169.91249.96303.131816.61914.81914.12015.4186.921613.221
01/24/1868SMSSRQ134.87647.47822.48227.38028.86846.76423.67349.57943.47820.97537.75044.17234.67533.07739.17649.870
02/07/1869DFQ156.19447.77927.99036.19246.79262.57750.29672.49169.99437.89388.29370.09152.89450.29377.59391.897
02/28/1870FDRH27.69155.41144.22174.2052.73810.2115.4086.40155.76154.723111.2715.42013.41616.5255.22513.020
03/06/1871NOSSH25.0423.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.525.20310.09
03/09/1872SGM_ROBH218.44237.4635.31349.033514.24531.74214.35524.74512.6395.273631.84129.74524.95122.04818.64528.246
03/11/1873SGM-ForestH27.37124.71123.69114.9383.181311.1175.3775.57145.81162.651114.51613.21113.11414.8155.63911.215
03/14/1874DTSH213.4338.45307.54477.46265.502414.92610.23024.54325.1574.933219.22118.72714.62115.92213.03417.227
03/23/1875MEDIAN_ROBH297.89996.19895.69899.09998.49998.49899.29998.49998.19899.09999.09999.69999.99994.79995.19898.398
03/23/1876AVERAGE_ROBH297.69896.29996.59996.89897.89897.89798.29897.99898.29998.99898.99899.19899.79893.19897.99998.999
03/26/1877ELAS_ROBH227.36343.47012.46613.96123.86366.48020.46733.05620.75111.06243.96137.56126.35728.76538.47333.351
04/17/1878ISMQ140.88342.56726.48934.89136.18244.55934.48856.28552.78925.28251.07452.48339.78333.37838.87575.388
05/01/1879PSMNet_ROBQ142.18733.05623.18530.18531.47454.87130.78248.77648.38428.38880.89253.58636.98138.68563.99171.285
05/05/1880WCMA_ROBQ132.97330.95318.77332.18929.26937.24923.17040.16234.96826.28357.57945.07529.36631.97239.87741.158
05/18/1881PDSH214.23514.4355.803810.54210.53422.13414.05114.5348.97235.934324.22821.53218.23318.93411.93133.652
05/22/1882DN-CSS_ROBH222.85131.4549.285313.55412.44044.35812.13828.15117.6469.115650.97340.06821.24125.05631.96543.261
05/24/1883LALA_ROBH226.05825.6479.545513.65618.75537.45016.85946.47145.68211.36440.75731.64926.35621.54421.65551.972
05/25/1884ETED_ROBH226.66125.64610.96214.86519.05633.34417.66144.56945.38016.17043.96333.65128.36321.64522.25648.869
05/25/1885XPNet_ROBH224.65419.93910.76012.15117.15027.83715.55747.57445.5819.735937.95128.44224.95117.43019.04861.479
05/26/1886NOSS_ROBH25.0113.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.525.2039.065
05/28/1887PWCDC_ROBF353.39248.58030.59351.69461.49483.89230.08150.58044.97944.59673.69058.89048.39149.39281.99681.192
05/30/1888DLCB_ROBH212.52910.0316.70429.81405.762616.8309.982911.12811.2355.964424.72921.03116.82916.52614.33823.139
05/31/1889FBW_ROBH232.26936.3629.375414.26219.15769.38113.24751.08139.17510.86143.96141.57133.07229.96851.38571.486
05/31/1890iResNet_ROBH224.85523.04310.25814.76412.43925.93512.94428.05024.95611.56546.66638.96621.44327.86345.68166.783
05/31/1891CBMV_ROBH27.65143.4833.3584.8073.57176.3256.88174.84103.9161.97125.43011.1713.11315.8217.341913.823
06/01/1892DPSimNet_ROBF349.49160.19122.98428.38233.77963.17834.38774.79370.19529.38964.98872.29348.29055.09450.58379.690
06/01/1893NaN_ROBH25.7343.4112.9063.6922.3345.3233.3533.4953.3132.31310.3510.869.64715.3175.4589.897
06/01/1894PDISCO_ROBH254.39362.59221.98138.69338.98684.09340.39374.59269.19339.49460.78573.69449.99246.99078.69581.293
06/05/1895CBMBNetH210.2228.30295.10316.87234.522011.5217.702113.93313.2413.041421.92413.31213.61915.41911.22911.013
06/14/1896MSMD_ROBQ130.96726.95014.66820.07122.66033.74527.87743.96838.47421.17749.56940.86931.87131.67037.57043.662
06/27/1897DCNNH210.9245.66204.98286.49205.732512.5238.512515.63510.9343.081624.12720.22816.82815.52010.32713.822
07/31/1898MotionStereoH240.48267.69425.08729.28440.98857.37435.58957.58740.47619.97242.86052.68539.88437.18451.78634.953
10/10/1899DISCOH224.55335.0587.344611.74918.75448.66617.16031.45422.4529.335846.06533.55027.56124.65427.55955.076

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: July 31 2018 by Daniel Scharstein