vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.46727.95612.17017.87613.74974.59514.05730.36026.36611.06964.49437.97025.86125.36529.36943.769
07/25/142SGBM1Q127.97128.35717.28019.07714.55157.98315.66331.86231.47213.27558.68938.67227.06725.96831.47159.785
07/25/143SGMQ120.85435.5659.576113.86316.55332.14819.06925.85216.7508.956039.85931.15422.65020.74421.35932.253
07/25/144SGBM1F328.47243.5809.095513.66125.97382.09814.46143.47330.3715.984959.39145.88428.57124.96220.15745.971
07/28/146SGBM1H223.85932.96110.86713.65916.25271.29112.64626.65323.0605.834553.88439.27425.66022.85518.85047.474
07/28/147SGMH218.44640.3734.54238.033122.96840.55911.43924.74910.1345.404229.63828.54923.95320.04214.24130.952
07/28/148SGMF325.36345.1834.33196.872532.28350.07413.05148.18218.3557.665429.63736.16531.27824.26024.56350.277
07/28/145Cens5H226.66947.1858.745411.95425.67145.36719.57240.67029.0699.936536.55238.67131.07725.06425.66444.670
08/25/149LPSH219.2486.14265.34389.24407.533396.010412.3449.61259.40305.183892.410427.44524.35523.05610.02625.648
08/27/1410LPSF320.3526.72286.06439.72429.873894.310314.15811.23211.2395.884689.310236.06420.54223.85916.04725.446
08/31/1411BSMQ141.59459.89725.89627.98938.99460.68433.39446.97937.38026.39264.89551.58842.69445.29642.88666.689
09/10/1412LAMC_DSMH226.06455.89411.96914.36818.35744.06418.36839.96829.5706.675131.14234.56128.87226.36930.17035.759
09/18/1413SNCCH221.95548.6896.98479.794325.77246.07012.44536.86516.6497.255223.12934.26026.76521.85219.95528.451
10/07/1414IDRH218.14537.5724.08157.492923.36940.66012.84824.54711.3405.464333.14726.04121.54921.75115.34421.238
11/12/1415LCUQ117.04324.7507.595211.65211.94227.94314.05519.34415.8488.105636.15129.15021.34718.43714.14023.844
01/21/1516TSGOF339.18934.16316.97920.07843.39755.48014.35954.19049.29233.99966.29745.98539.89342.69447.29052.681
04/08/1517REAFH231.47558.39530.910213.15745.39963.88730.99238.76725.3658.605839.35736.86627.06635.58918.24839.762
04/09/1518PFSF332.27765.110129.410012.15650.010170.89028.28644.67723.1617.855537.05337.76927.96936.09119.85435.760
04/17/1519TMAPH216.94220.2464.94298.133412.84630.04511.74027.95620.4575.093731.54323.13720.94419.03918.85118.033
04/19/1520MeshStereoH213.2355.90234.882710.84912.94710.61611.03512.2349.01275.394127.43423.53817.73421.04515.44520.937
08/28/1521MC-CNN-acrtH28.08185.59194.55255.96172.831011.4225.81128.32218.89252.711416.31914.11813.21713.066.401611.115
09/14/1522ELASF332.37850.9919.175611.05033.08588.210218.36747.38026.86711.77341.76537.46723.75228.87463.09842.866
09/28/1523R-NCCF348.49826.25314.87730.29430.98072.99441.610277.710264.19927.49559.19071.910050.910133.98778.210280.899
10/13/1524MDPH212.63314.4404.993110.64810.74027.2418.112412.5358.07224.273330.43920.53312.61117.83613.43917.331
11/03/1525MC-CNN+RBSH28.42196.05245.16346.24203.271511.1196.36178.87249.83323.212415.11715.92412.81313.597.04189.998
11/05/1526GCSVRH214.64117.1433.5098.223516.55447.4728.82289.75267.06193.172234.45027.14418.33719.24016.04619.335
11/06/1527SOU4P-netH213.43623.1495.41396.392113.14830.5469.002916.44212.7433.132028.93617.12616.43016.93110.73114.528
12/18/1528INTSH214.54020.2454.52228.623711.64129.54410.73416.44110.3354.693427.63522.53620.74320.54311.53424.945
01/19/1629NTDEH27.44135.72224.36205.92162.831010.4135.71105.30135.54152.40813.51314.11612.61213.9116.391512.220
01/26/1631MC-CNN-fstH29.47237.35305.07327.18274.712316.8338.47267.37186.97182.821520.72517.42815.42715.1197.902212.621
01/21/1630MCCNN_LayoutH28.94225.53185.63405.06103.591912.6267.23217.53198.86245.794423.02813.61415.02514.7165.851010.410
02/18/1632LS-ELASF336.78553.59210.36515.87437.09183.69924.58149.18434.67413.97644.97045.78334.98529.17564.410062.787
03/15/1633MPSVQ143.59658.89633.910434.29837.99352.47630.89156.89351.09530.69856.98651.58944.69643.49544.28754.282
04/03/1634ICSGF345.69769.710319.18221.38243.69877.69636.99865.39840.48420.38153.68358.79746.59747.19960.79679.197
04/12/1635MeshStereoExtH27.0894.4193.98145.40133.171310.0116.23154.6294.77113.492612.71112.41010.4814.5157.80218.853
04/13/1636GlstereoH219.85120.7478.255313.96418.65834.65112.95025.45123.2628.615931.14130.65320.34125.46721.15822.742
04/24/1637HLSC_corH226.06626.55415.27821.08020.56535.75323.47833.16435.07611.97439.15634.25925.25932.88428.36822.741
04/27/1638JEMQ137.28635.76627.99930.69533.28643.06231.49349.58547.39026.59449.67746.08635.78630.87737.57755.884
05/12/1639PMSCH26.7173.4622.6816.19192.5456.9264.5463.9664.0482.37713.11212.3912.21016.2275.881110.812
05/28/1640APAP-StereoH27.26115.43154.91285.11115.172521.6386.99204.3174.23103.242514.3159.7857.32413.486.30138.462
07/03/1641LPUH210.42611.4353.1878.10336.082920.9378.24256.94174.0074.043133.94916.92515.22617.8359.122411.618
08/31/1642SEDF363.410354.39322.49172.910564.510471.49242.510380.110367.910049.810579.69974.410365.410555.110386.110591.6104
09/13/1643SNP-RSMH28.75205.46174.85266.50233.371610.4157.31228.73239.37293.582714.31414.72014.92412.8510.12810.813
09/20/1644LFSIRQ170.110575.710560.310567.110372.410580.89753.710585.410583.810542.510391.210390.410464.110471.310561.59790.3103
10/19/1645LW-CNNH27.0484.65103.95125.30122.63611.2215.4194.3284.2292.43912.2913.41313.62014.8174.72112.019
10/23/1646SIGMRFQ164.210460.09833.010367.910463.210399.510739.810084.810482.010435.210095.210591.510558.110365.810455.09588.6102
11/06/1647SPSF319.65014.23912.37214.97112.04315.83019.17017.44315.4478.235730.94034.86230.67625.36528.36728.049
11/15/1648MC-CNN-WSH212.13014.8427.204911.1517.623415.93111.84111.5339.01273.893019.72420.53216.32916.32812.13718.334
11/15/1649UCNNH220.55344.8829.776213.66118.25636.55512.84723.44612.4419.226239.55830.55224.85621.24719.15332.354
11/16/1650MCSCF311.32913.3385.964210.6478.69357.22711.33710.6287.48203.07173.10125.24019.03817.23310.32925.547
11/24/1651ADSMQ138.78840.47420.38527.38735.18955.98122.37656.19150.99424.28958.08856.39536.58732.18238.78269.791
01/03/1752SLACH219.34936.1676.53449.894521.96639.15811.84229.05917.9537.645340.26026.54221.14519.44115.04319.536
01/15/1753IGFQ134.08342.77620.18423.78532.28245.66928.68843.07237.27821.48650.97944.78134.78431.97937.47647.173
01/24/17543DMSTH25.9253.7172.7824.7562.7277.3684.2853.4433.7652.35612.61011.588.56514.0125.3568.874
03/09/1755SGMEPiF313.9386.92296.71469.47419.723711.82413.65310.93010.6365.263932.84626.94322.75122.75412.03621.740
03/10/1756MC-CNN+TDSRF36.3565.45164.45216.80243.461710.7176.05135.01125.19132.621010.869.6236.59111.416.01127.041
03/22/1757JMRH212.5314.0983.97138.44366.933211.11813.85419.54519.0563.662817.02118.22918.03521.0467.291917.832
03/23/1758DSGCAQ133.88142.97720.98623.68430.27845.56827.68442.07136.07721.08450.27844.28033.38134.68838.48046.872
04/04/1759DDLQ130.17344.38119.48325.88628.37442.16121.17537.16628.76821.78746.87336.06330.37528.47232.77437.561
05/23/1760r200highH240.99270.510414.47521.38137.79272.29338.19953.28931.47218.37952.48252.69144.19545.49750.79266.588
06/14/1761DoGGuidedQ141.49345.48423.69430.69634.68852.57728.38759.19753.89826.49360.69254.79438.39035.59044.58872.095
06/22/1762LocalExpH25.4333.6562.8752.9811.9935.5943.3743.4843.3542.05210.349.7548.57614.4145.4079.556
08/25/1763SSRQ137.38750.09021.08828.59130.27953.87824.58257.89552.49622.08840.86348.58736.98832.78337.97952.280
10/12/1764FEN-D2DRRH27.23104.68114.11165.0393.03128.4296.05134.90115.32143.202311.5814.11613.41913.9105.06214.326
11/13/1765CBMVH211.1286.07255.22358.09324.052118.7369.313010.7299.61313.111933.74815.62317.53317.13210.12714.427
11/17/1766CGPTQ132.87943.47920.98723.28329.47743.46323.67943.87437.27920.78248.77540.97734.08232.18136.07542.465
12/11/1767OVODH28.87214.74133.64105.51144.822412.8276.51189.91279.96333.132016.62014.82114.12215.4216.921713.223
01/24/1868SMSSRQ134.88447.48622.49027.38828.87546.77123.68049.58643.48520.98337.75444.17934.68333.08539.18449.876
02/07/1869DFQ156.110247.78727.99836.110046.710062.58550.210472.49969.910237.810188.210170.09952.810250.210177.510191.8105
02/28/1870FDRH27.69155.41144.22174.2052.73810.2125.4086.40155.76164.723511.2715.42213.41816.5295.22513.022
03/06/1871NOSSH25.0423.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.535.20310.09
03/09/1872SGM_ROBH218.44737.4715.31369.033914.25031.74714.36024.75012.6425.274031.84429.75124.95722.05318.64928.250
03/11/1873SGM-ForestH27.37124.71123.69114.9383.181411.1195.3775.57145.81172.651214.51613.21113.11514.8185.63911.217
03/14/1874DTSH213.4378.45327.54517.46285.502614.92810.23324.54825.1644.933619.22318.73014.62315.92513.03817.230
03/23/1875MEDIAN_ROBH297.810796.110695.610699.010798.410798.410699.210798.410798.110699.010799.010799.610799.910794.710795.110698.3106
03/23/1876AVERAGE_ROBH297.610696.210796.510796.810697.810697.810598.210697.910698.210798.910698.910699.110699.710693.110697.910798.9107
03/26/1877ELAS_ROBH227.37043.47812.47313.96523.87066.48820.47433.06320.75811.06843.96737.56826.36328.77338.48133.355
04/17/1878ISMQ140.89142.57526.49734.89936.19044.56634.49656.29252.79725.29051.08152.49039.79133.38638.88375.396
05/01/1879PSMNet_ROBQ142.19533.06223.19330.19331.48154.87930.79048.78348.39128.39680.810053.59336.98938.69363.99971.292
05/05/1880WCMA_ROBQ132.98030.95918.78132.19729.27637.25623.17740.16934.97526.29157.58745.08229.37331.98039.88541.164
05/18/1881PDSH214.23914.4405.804110.54610.53922.13914.05614.5378.97265.934724.23121.53518.23618.93811.93533.656
05/22/1882DN-CSS_ROBH222.85731.4609.285813.55812.44544.36512.14328.15817.6529.116150.98040.07521.24625.06331.97343.267
05/24/1883LALA_ROBH226.06525.6529.546013.66018.76037.45716.86446.47845.68911.37140.76231.65526.36221.54921.66151.979
05/25/1884ETED_ROBH226.66825.65110.96814.87019.06133.34917.66644.57645.38716.17843.96933.65828.37021.65022.26248.875
05/25/1885XPNet_ROBH224.66119.94410.76612.15517.15527.84215.56247.58145.5889.736437.95528.44824.95717.43419.05261.486
05/26/1886NOSS_ROBH25.0113.5742.8433.9931.9315.1513.3413.3213.1512.3248.5527.4517.06212.535.2039.065
05/28/1887PWCDC_ROBF353.310048.58830.510151.610261.410283.810030.08950.58744.98644.510473.69858.89848.39949.310081.910481.1100
05/30/1888DLCB_ROBH212.53210.0346.70459.81445.762816.8349.983211.13111.2385.964824.73221.03416.83216.53014.34223.143
05/31/1889FBW_ROBH232.27636.3689.375914.26719.16269.38913.25251.08839.18210.86743.96741.57833.08029.97651.39371.493
05/31/1890iResNet_ROBH224.86223.04810.26414.76912.44425.94012.94928.05724.96311.57246.67238.97321.44827.87145.68966.790
05/31/1891CBMV_ROBH27.65143.4833.3584.8073.57186.3256.88194.84103.9161.97125.43311.1713.11415.8247.342013.825
06/01/1892DPSimNet_ROBF349.49960.19922.99228.39033.78763.18634.39574.710170.110329.39764.99672.210148.29855.010250.59179.698
06/01/1893NaN_ROBH25.7343.4112.9063.6922.3345.3233.3533.4953.3132.31310.3510.869.64715.3205.4589.897
06/01/1894PDISCO_ROBH254.310162.510021.98938.610138.99484.010140.310174.510069.110139.410260.79373.610249.910046.99878.610381.2101
06/05/1895CBMBNetH210.2258.30315.10336.87254.522211.5237.702313.93613.2443.041621.92613.31213.62115.42211.23311.014
06/14/1896MSMD_ROBQ130.97426.95514.67620.07922.66733.75027.88543.97538.48121.18549.57640.87631.87931.67837.57843.668
06/27/1897DCNNH210.9275.66214.98306.49225.732712.5258.512715.64010.9373.081824.13020.23116.83115.52310.33013.824
07/31/1898MotionStereoH240.49067.610225.09529.29240.99657.38235.59757.59440.48319.98042.86652.69239.89237.19251.79434.958
10/10/1899DISCOH224.56035.0647.345011.75318.75948.67317.16531.46122.4599.336346.07133.55727.56824.66127.56655.083
10/29/18101iResNetH222.95828.3579.195715.87319.36435.15211.33827.75516.85115.27754.78527.64619.54021.54831.97251.678
10/29/18100Dense-CNNH27.98175.59194.54235.83152.79910.4145.78118.26208.84232.661315.61814.21913.21613.276.301311.115
11/07/18102IEBIMstH233.88236.77012.17116.97532.58451.07525.38358.19649.89311.27048.67456.99630.27426.87026.96571.794
11/08/18103HSMF310.22412.0365.32377.50306.723015.6299.89316.83165.14124.173222.72717.12615.62814.31310.83214.629
11/11/18104MBMH222.85636.4699.956315.37219.36336.55419.97327.55418.15410.16641.56432.75626.36423.35721.46039.963
11/15/18106VNH218.14412.73712.87414.2669.543618.43519.47114.63814.4456.085040.66128.04724.35423.45820.15634.857
11/13/18105WDMCH213.1349.47337.04488.70386.813116.73211.13614.73915.0463.772932.44524.33919.43915.9269.592521.339
11/28/18107MSFNetAH27.96166.21274.26186.02183.66208.95106.28168.41228.06212.621017.92213.91511.9911.528.002310.611

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: July 31 2018 by Daniel Scharstein