vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.47427.96812.17917.88713.75474.511314.06430.36926.37411.07964.411337.98325.87225.37229.37543.777
07/25/142SGBM1Q127.97928.36917.29519.08814.55657.99915.67231.87131.48413.28658.610238.68527.08025.97431.48059.7100
07/25/143SGMQ120.86035.5799.576913.87116.56132.15719.07725.85816.7568.956839.86731.16322.65420.74921.36332.256
07/25/144SGBM1F328.48043.5969.096413.67025.98682.011714.46943.48930.3825.985659.310545.810028.58424.96920.16045.981
07/28/146SGBM1H223.86632.97410.87513.66916.25971.210812.65026.66123.0685.835353.89739.28725.67122.85918.85447.484
07/28/147SGMH218.45140.3884.54258.033622.97640.56811.44324.75510.1385.405029.65028.55623.96020.04414.24330.954
07/28/148SGMF325.37145.11004.33206.872632.210050.08713.05448.19718.3617.666329.64936.17531.29224.26524.56750.288
07/28/145Cens5H226.67547.11048.746211.96225.68445.38019.58040.68529.0809.937436.56238.68431.09125.07125.66844.679
08/25/149LPSH219.2576.14285.34429.24447.533596.012212.3489.61299.40345.184692.412327.45424.36123.06110.02825.649
08/27/1410LPSF320.3596.72306.06479.72469.874394.312114.16511.23511.2435.885489.312236.07420.54623.86416.04925.447
08/31/1411BSMQ141.511359.811925.811627.910838.911360.610133.310846.99537.39526.311064.811451.510542.611445.211742.810166.6108
09/10/1412LAMC_DSMH226.07255.811511.97814.37418.36344.07518.37639.98429.5816.675931.15334.57128.88526.37530.17835.760
09/18/1413SNCCH221.96148.61086.98529.794725.78546.08312.44936.88016.6557.256223.13834.27026.77821.85519.95828.453
10/07/1414IDRH218.15037.5864.08157.493323.37740.66912.85124.55211.3455.465133.15826.05021.55221.75415.34721.242
01/21/1515TSGOF339.110734.17616.99420.08943.311555.49514.36754.110749.210833.911866.211545.910139.811242.611447.210652.690
04/08/1516REAFH231.48958.311630.912113.16545.311763.810330.910638.78325.3728.606639.36636.87827.07935.510618.25239.768
04/09/1517PFSF332.29565.112129.412012.16350.011970.810728.210044.69123.1697.856437.06337.78127.98236.010819.85735.761
04/17/1518TMAPH216.94820.2524.94318.133912.85230.05411.74427.96420.4645.094531.55423.14320.94919.04218.85518.037
04/19/1519MeshStereoH213.2395.90254.882910.85512.95310.62111.04012.2389.01315.394927.44423.54517.74021.05015.44820.941
08/28/1520MC-CNN-acrtH28.08205.59214.55275.96192.831111.4275.81168.32258.89292.711616.32614.12013.22113.066.401711.118
09/14/1521ELASF332.39650.91099.176511.05833.010388.211918.37547.39626.87511.78341.77037.47923.75928.88463.011742.873
09/28/1522R-NCCF348.411826.26314.88930.211130.99772.911141.611877.712264.112127.411359.110471.912250.911933.910478.212280.8119
10/13/1523MDPH212.63714.4454.993410.65410.74627.2528.112812.5398.07274.273930.45120.53912.61517.83813.44217.334
11/03/1524MC-CNN+RBSH28.42216.05265.16376.24223.271711.1246.36208.87289.83363.212515.12315.92612.81713.5117.04199.9911
12/18/1525INTSH214.54420.2514.52238.624111.64729.55310.73916.44510.3394.694127.64622.54220.74720.54711.53724.946
01/19/1626NTDEH27.44155.72244.36215.92172.831110.4185.71145.30155.54182.40913.51914.11812.61613.9146.391612.223
01/26/1627MC-CNN-fstH29.47247.35325.07357.18294.712516.8408.47327.37226.97232.821720.73417.43115.43015.1237.902312.624
02/18/1628LS-ELASF336.710253.511110.37415.88237.011083.611824.59249.19934.68913.98744.97645.79934.910329.18564.411962.7106
03/15/1629MPSVQ143.511558.811733.912334.211637.911252.49030.810556.811351.011230.611556.910051.510644.611643.411544.210254.293
04/03/1630ICSGF345.611769.712319.19921.39543.611677.611636.911365.311840.49920.310153.69658.711846.511847.111960.711679.1117
04/24/1631HLSC_corH226.07326.56415.29021.09320.57135.76323.49033.17335.09011.98439.16534.26925.26932.89828.37322.744
04/27/1632JEMQ137.210435.78027.911930.611233.210443.07431.410749.510047.310526.511249.68746.010235.710530.89237.59255.897
05/12/1633PMSCH26.7193.4612.6816.19212.5466.9284.5473.9694.04112.37813.11712.31312.21416.2305.881210.815
05/28/1634APAP-StereoH27.26135.43184.91305.11125.172721.6466.99244.31104.23133.242614.3219.7877.32413.496.30148.462
07/03/1635LPUH210.43011.4393.1888.10386.083020.9448.24296.94214.00104.043433.96116.92815.22917.8379.122511.621
08/31/1636SEDF363.412354.311322.411072.912464.512471.410942.511980.112367.912249.812379.611874.412365.412455.112386.112491.6123
09/13/1637SNP-RSMH28.75225.46204.85286.50243.371810.4207.31258.73279.37333.583014.32014.72214.92812.8510.13010.816
10/19/1638LW-CNNH27.04104.65123.95135.30132.63711.2265.41124.32114.22122.431012.21513.41613.62414.8204.72112.022
10/23/1639SIGMRFQ164.212460.012033.012267.912363.212399.512639.811684.812482.012435.212095.212491.512458.112265.812455.011388.6122
11/06/1640SPSF319.65814.24412.38114.97812.04915.83619.17817.44615.4518.236530.95234.87230.69025.37228.37228.050
11/15/1641MC-CNN-WSH212.13514.8487.205411.1597.623615.93711.84511.5379.01313.893219.73320.53816.33416.33112.14018.338
11/16/1642MCSCF311.33413.3435.964610.6528.69397.22911.34110.6327.48243.07203.10125.24819.04417.23410.33225.548
11/24/1643ADSMQ138.710640.48920.310327.310635.110755.99622.38856.111050.911124.210858.010156.311436.510632.19738.79669.7110
01/15/1744IGFQ134.09942.79320.110223.710132.29945.68228.610343.08837.29421.410650.99144.79834.710231.99637.49047.183
01/24/17453DMSTH25.9263.7172.7824.7582.7287.36104.2863.4443.7672.35712.61611.5118.56614.0155.3568.873
03/09/1746SGMEPiF313.9416.92316.71509.47459.724111.82913.65810.93410.6415.264732.85726.95222.75522.75812.03921.743
03/10/1747MC-CNN+TDSRF36.3585.45194.45226.80253.461910.7226.05175.01145.19152.621210.8119.6246.59211.416.01137.041
03/22/1748JMRH212.5364.09103.97148.44406.933211.12313.86019.54919.0633.663117.02818.23218.04121.0517.292117.836
03/23/1749DSGCAQ133.89742.99420.910523.610030.29445.58127.69842.08736.09221.010450.28944.29733.310034.610538.49446.882
04/04/1750DDLQ130.18544.39919.410025.810528.39142.17321.18537.18128.77921.710746.88036.07330.38928.48132.78437.564
05/23/1751r200highH240.911070.512414.48621.39437.711172.211038.111553.210531.48418.39152.49452.610844.111545.411850.710866.5107
06/14/1752DoGGuidedQ141.411145.410223.611230.611334.610552.59128.310159.111753.811526.411160.610954.711338.310935.510744.510372.0115
06/22/1753LocalExpH25.4323.6542.8742.9811.9935.5933.3733.4863.3532.05210.3109.7568.57714.4185.4079.557
10/12/1754FEN-D2DRRH27.23124.68134.11165.03113.03148.42136.05174.90135.32163.202411.51314.11813.42313.9135.06214.329
11/13/1755CBMVH211.1336.07275.22388.09374.052218.7439.313410.7339.61353.112233.75915.62517.53917.13310.12914.430
12/11/1756OVODH28.87234.74153.64115.51144.822612.8316.51219.91309.96373.132316.62714.82314.12615.4256.921813.226
01/24/1857SMSSRQ134.810147.410622.410927.310728.89246.78423.69149.510143.410220.910337.76444.19634.610133.010039.19849.887
02/07/1858DFQ156.112147.710727.911836.111846.711862.510250.212372.412169.912337.812188.212170.012052.812150.212277.512191.8124
02/28/1859SDRH27.69175.41174.22174.2062.73910.2175.40116.40195.76194.724211.21215.42413.42216.5325.22513.025
03/09/1860SGM_RVCH218.45237.4855.31399.034314.25531.75614.36824.75612.6495.274831.85529.75924.96722.05618.65328.251
03/11/1861SGM-ForestH27.37144.71143.69124.93103.181511.1245.37105.57175.81202.651414.52213.21413.11914.8215.631011.220
03/14/1862DTSH213.4408.45357.54567.46325.502814.93310.23824.55325.1714.934319.23218.73314.62715.92913.04117.233
03/23/1863MEDIAN_ROBH297.812696.112595.612599.012698.412698.412599.212698.412698.112599.012699.012699.612699.912694.712695.112598.3125
03/23/1864AVERAGE_ROBH297.612596.212696.512696.812597.812597.812498.212597.912598.212698.912598.912599.112599.712593.112597.912698.9126
03/26/1865ELAS_RVCH227.37643.49512.48213.97223.87866.410420.48333.07220.76511.07843.97337.58026.37328.78338.49533.357
04/17/1866ISMQ140.810942.59226.411734.811736.110844.57834.410956.211152.711425.210951.09352.410739.711033.310138.89775.3116
05/01/1867PSMNet_ROBQ142.111433.07523.111130.111031.49854.89430.710448.79848.310628.311480.811953.511236.910738.611263.911871.2112
05/18/1868PDSH214.24214.4455.804510.55110.54422.14714.06314.5438.97305.935524.24121.54018.24318.94111.93833.658
05/22/1869DN-CSS_ROBH222.86431.4729.286713.56812.45144.37712.14628.16617.6589.117050.99240.08821.25025.07031.98243.274
05/26/1870NOSS_ROBH25.0113.5732.8433.9951.9325.1513.3423.3223.1512.3258.5527.4517.06312.545.2049.064
05/31/1871FBW_ROBH232.29436.3819.376814.27319.16669.310613.25651.010339.19710.87743.97341.59233.09829.99051.310971.4113
05/31/1872iResNet_ROBH224.86923.05610.27314.77612.45025.95112.95228.06524.97011.58146.67938.98621.45127.87845.610466.7109
05/31/1873CBMV_ROBH27.65163.4823.3594.8093.57206.3276.88234.84123.9181.97125.44211.1913.11815.8287.342213.828
06/05/1874CBMBNetH210.2298.30345.10366.87264.522311.5287.702613.94213.2503.041921.93513.31513.62515.42611.23511.017
06/14/1875MSMD_ROBQ130.98726.96614.68720.09022.67533.75827.89943.99038.49621.110549.58540.89131.89331.69337.59343.676
06/27/1876DCNNH210.9325.66234.98326.49235.732912.5308.513315.64410.9423.082124.14020.23616.83615.52710.33313.827
07/31/1877MotionStereoH240.410867.612225.011429.210940.911457.39835.511157.511440.49819.99842.87252.610939.811137.111051.711034.959
10/10/1878DISCOH224.56735.0787.345511.76118.76548.68617.17331.47022.4669.337246.07833.56727.58124.66727.57055.095
10/29/1880iResNetH222.96528.3699.196615.88119.36935.15911.34227.76316.85715.28854.79827.65519.54521.55331.98151.689
10/29/1879Dense-CNNH27.98195.59214.54255.83162.791010.4195.78158.26238.84282.661515.62514.22113.22013.286.301411.118
11/07/1881IEBIMstH233.89836.78312.18016.98532.510151.08925.39458.111549.811011.28048.68256.911630.28826.87726.96971.7114
11/08/1882HSMF310.22812.0425.32407.50346.723115.6359.89376.83205.14144.173822.73717.12915.63114.31710.83414.631
11/11/1883MBMH222.86336.4829.957215.38019.36836.56419.98127.56218.15910.17541.56932.76526.37423.36221.46439.969
11/28/1884MSFNetAH27.96186.21294.26186.02203.66218.95156.28198.41268.06262.621217.92913.91711.91311.528.002410.614
01/12/1986EHCI_netH29.47253.7584.271913.16527.6885.3023.2313.4753.1823.90339.2039.5839.26913.91217.35110.612
01/17/1987FASWQ128.68141.79018.19623.19927.28740.66919.17934.97628.17818.59340.86836.47629.38628.48031.17941.070
12/18/1885MCV-MFCH224.86826.8659.637114.87717.46254.19314.26626.56018.26016.08962.611228.75820.94824.66837.49148.185
02/05/1988AMNetQ153.311954.311263.712451.212251.312040.67139.911751.610455.911855.412458.910357.511752.712049.512158.111561.6103
02/15/1989DAWA-FH227.47747.210513.68413.16719.26766.410420.48430.36833.9878.736748.98337.88226.77729.98928.07136.562
03/06/1990SM-AWPQ138.110530.77124.011325.210430.39544.97938.111456.010955.811719.99960.110751.210432.19430.29140.010061.7104
03/09/19913DMST-CMH25.4734.10113.37102.9922.95137.63114.5583.2613.9592.16310.278.2826.37113.275.86119.356
04/12/1992TCSCSMH219.15645.21015.764411.05722.17441.17213.45724.85711.4477.176029.54826.65126.67520.54816.55017.435
05/10/1993tMGM-16F317.3498.70376.49499.824820.77213.73213.96221.85016.0535.575226.94325.44928.38322.15714.64539.667
05/13/1994VNH214.2439.69389.587010.9567.33349.541613.86111.33611.3467.176027.44523.34424.86622.86014.64618.439
05/15/1995PSMNet_2000H228.98220.4538.235915.17927.79035.26015.27150.810251.81139.297161.911031.16225.26827.87829.37552.991
05/28/1996PWCA_SGMQ130.98643.99818.99822.99824.48050.98822.28735.77727.57720.610253.49540.69032.49733.310232.38342.172
06/26/1997DeepPruner_ROBQ130.18334.27719.910124.310223.87847.28526.19526.15922.86718.49259.810636.57723.25731.79548.310744.880
07/26/1998EdgeStereoF318.75325.3606.795110.65325.18322.1478.313024.55116.5546.63589.20332.06424.66420.24519.25654.394
11/01/1999NVstereo2DH215.44511.5405.33417.21309.504018.04213.75912.94010.6404.414018.03024.44622.05321.25222.46553.692
11/07/19100LBPSH29.68265.05164.98325.57153.24166.03612.9535.44165.50173.552915.22415.92717.53817.3359.842628.352
11/11/19101SACA-NetQ131.79121.85416.09121.59624.58138.06534.611038.68236.39319.09649.48440.28932.19533.610336.08658.299
11/14/19102HSM-Smooth-OccF310.83111.7415.62438.75428.393815.4349.60358.29246.11224.093523.63920.43717.03713.41010.23116.632
11/15/19103SPPSMNetF341.411232.57320.610434.011533.010255.99736.311253.810648.610735.011971.611652.811037.110838.111146.710556.998
12/19/19104CRLEH25.7553.6653.1175.92172.1446.0153.3943.4973.6862.34610.279.6358.04514.9225.4599.265
12/30/19105F-GDGIFH231.69037.3847.725716.18334.910635.26120.18255.310846.61039.016947.68152.911129.48729.78829.47761.0102
01/02/20106PPEP-GFQ134.610042.49121.710724.810330.89644.07625.19345.79442.110020.110044.17543.69535.210432.89939.39955.096
01/05/20107MTS2F353.812051.711021.510638.812052.712197.512343.012066.411960.811932.011685.712069.011946.311745.111671.212085.2120
01/07/20108ADSR_GIFQ137.110343.69718.69736.711924.68258.610022.88956.311249.710918.79556.09948.510332.29624.56636.38779.1118
02/07/20109CasStereoH218.85423.9589.016310.55011.74874.011213.15510.1317.86254.093545.47725.24724.46317.33620.56244.378
02/20/20110CRARH222.06223.25713.58316.48416.36021.04521.88628.56726.97610.57632.55632.96623.35823.66320.36137.463
02/24/20111SGBMPF327.87837.58716.39317.18627.68975.711514.67033.47525.87312.28560.310834.06823.15629.38628.77431.255
03/02/20112AdaStereoF316.04725.7628.576111.56015.75717.2418.313024.75411.3449.48739.99522.54116.03219.94324.36624.345
03/13/20113MTSF359.712258.811825.211551.112160.412291.312048.312270.312063.412044.412279.311771.712160.912347.412079.612388.4121
04/19/20114PVStereoH26.0273.7692.8853.7731.9215.6944.9693.3633.4642.531111.71411.61210.61215.2245.4289.639
05/14/20115SRMH213.1388.50367.04537.86357.733716.1387.902718.44818.5625.034422.33620.03418.14218.54011.33619.340
05/19/20116SUWNetQ130.18424.55913.98520.39120.07035.76226.19640.98643.210117.99049.88828.65724.46228.58252.511237.966
05/20/20117AANet++H215.44617.5508.376010.2499.864223.9499.823617.74715.9523.252718.13127.15316.23318.43920.05937.765
05/23/20118CCNetQ131.99327.06716.09220.39218.66438.86652.012435.97834.08818.69449.68630.56126.77636.210937.18962.0105
05/28/20120RTSMNetH245.611647.010321.910831.911436.410975.111443.912158.911655.311632.711762.211156.411542.211339.111358.011459.9101
05/28/20119LEAStereoH27.15117.56334.52234.6274.64248.83145.66135.86186.03213.302813.11811.31010.31112.137.06209.9010
06/08/20121MANEH230.98854.711411.57714.67529.49352.69226.49745.19331.58611.58142.57141.89333.19931.69434.28543.575
07/16/20122HLocalExp-CMH25.6843.6862.9563.9242.4558.12123.4153.7483.5352.17410.2710.088.75814.1165.1239.618
07/17/20123GANetREF_RVCH218.95516.6496.42487.403110.64525.85012.24736.57935.5914.103733.86020.13516.43520.24614.34448.186
07/21/20124AANet_RVCH225.27022.65511.37612.96415.95830.55517.97433.47430.9836.345728.84743.49425.37026.77637.08869.8111
08/09/20125UCNetH210.12714.6477.91587.10286.983316.3396.822213.44112.3482.821710.1617.4309.481014.6199.852710.612
08/10/20126CVANet_RVCQ131.89225.66114.68821.79722.17339.86728.410244.79247.010419.19750.69030.46024.76529.38752.111141.671

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: June 24 2020 by Daniel Scharstein