vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.46327.95412.16817.87413.74674.59814.05530.36026.36511.06864.49637.96925.85825.36229.36443.765
07/25/142SGBM1Q127.96728.35517.27919.07514.54857.98515.66231.86231.47313.27358.68738.67127.06525.96431.46959.786
07/25/143SGMQ120.85135.5659.576013.86116.55032.14719.06625.85016.7498.955939.85731.15122.64620.74021.35432.249
07/25/144SGBM1F328.46843.5819.095513.66025.97282.010014.46043.47530.3725.984859.39045.88428.56924.95920.15345.968
07/28/146SGBM1H223.85632.96010.86613.65916.24971.29412.64226.65323.0605.834553.88239.27325.65722.85018.84847.471
07/28/147SGMH218.44440.3734.54228.033022.96240.55511.43624.74710.1345.404229.64228.54723.95020.03614.23830.948
07/28/148SGMF325.36045.1854.33186.872332.28450.07413.04648.18118.3547.665429.64136.16131.27724.25524.55750.274
07/28/145Cens5H226.66447.1888.745411.95325.67045.36719.56940.67229.0709.936436.55238.67031.07625.06125.65844.666
08/25/149LPSH219.2486.14265.34399.24387.533196.010412.3409.61269.40305.183892.410527.44524.35123.05210.02425.643
08/27/1410LPSF320.3506.72286.06449.72409.873794.310314.15611.23111.2395.884689.310436.06020.53823.85416.04325.441
08/31/1411BSMQ141.59759.810125.89827.99238.99660.68733.39346.97937.38126.39464.89751.58942.69745.210042.88766.692
09/10/1412LAMC_DSMH226.06155.89811.96714.36418.35244.06218.36539.97129.5716.675031.14534.55728.87026.36530.16735.753
09/18/1413SNCCH221.95248.6926.98489.794125.77146.07012.44136.86716.6487.255323.13134.25626.76321.84619.95228.447
10/07/1414IDRH218.14337.5724.08137.492823.36340.65612.84324.54511.3405.464333.14926.04221.54421.74515.34121.237
01/21/1515TSGOF339.19134.16216.97820.07643.39855.48114.35854.19149.29233.910166.29845.98539.89642.69747.29252.676
04/08/1516REAFH231.47558.39930.910313.15545.310063.88930.99138.77025.3648.605739.35636.86427.06435.59118.24639.758
04/09/1517PFSF332.27965.110329.410212.15450.010270.89328.28644.67723.1617.855537.05337.76727.96736.09319.85135.754
04/17/1518TMAPH216.94120.2454.94288.133312.84430.04511.73727.95620.4565.093731.54623.13620.94119.03518.84918.033
04/19/1519MeshStereoH213.2345.90234.882610.84712.94510.61811.03312.2349.01275.394127.43723.53817.73321.04115.44220.936
08/28/1520MC-CNN-acrtH28.08175.59194.55245.96162.83911.4245.81138.32228.89252.711416.32114.11713.21713.056.401511.114
09/14/1521ELASF332.38050.9939.175611.05033.08788.210218.36447.38026.86611.77141.76037.46523.74928.87263.010042.862
09/28/1522R-NCCF348.410126.25014.87530.29530.98172.99741.610377.710464.110327.49759.18971.910450.910233.98978.210580.8102
10/13/1523MDPH212.63314.4414.993110.64610.73927.2438.112312.5358.07234.273230.44320.53312.61117.83313.43717.330
11/03/1524MC-CNN+RBSH28.42186.05245.16346.24193.271511.1216.36178.87259.83323.212215.11815.92312.81313.5107.04179.998
12/18/1525INTSH214.53920.2444.52218.623511.64029.54410.73216.44010.3354.693427.63922.53520.73920.53811.53224.940
01/19/1626NTDEH27.44125.72224.36195.92142.83910.4155.71115.30135.54162.40813.51414.11512.61213.9136.391412.219
01/26/1627MC-CNN-fstH29.47217.35305.07327.18254.712216.8358.47267.37196.97202.821520.72817.42715.42615.1207.902012.620
02/18/1628LS-ELASF336.78653.59510.36515.87137.09383.610124.58049.18334.67613.97444.96545.78334.98729.17364.410262.790
03/15/1629MPSVQ143.59958.810033.910534.29937.99552.47730.89056.89751.09630.69956.98551.59044.69943.49844.28854.279
04/03/1630ICSGF345.610069.710519.18321.38043.69977.69936.99865.310140.48520.38553.68158.710146.510147.110260.79979.1100
04/24/1631HLSC_corH226.06226.55115.27621.07820.55835.75223.47833.16435.07711.97239.15534.25525.25632.88328.36322.739
04/27/1632JEMQ137.28835.76627.910130.69633.28843.06131.49249.58447.38926.59649.67446.08635.78930.87837.57855.883
05/12/1633PMSCH26.7173.4612.6816.19182.5446.9274.5463.9674.0492.37713.11312.31012.21016.2265.881010.811
05/28/1634APAP-StereoH27.26105.43164.91275.1195.172421.6396.99204.3184.23113.242314.3169.7877.32413.486.30128.462
07/03/1635LPUH210.42611.4353.1868.10326.082720.9388.24246.94184.0084.042933.95116.92515.22517.8329.122211.617
08/31/1636SEDF363.410554.39722.49372.910664.510671.49542.510480.110567.910449.810579.610074.410565.410655.110586.110691.6105
09/13/1637SNP-RSMH28.75195.46184.85256.50213.371610.4177.31218.73249.37293.582514.31514.71914.92412.8410.12610.812
10/19/1638LW-CNNH27.0484.65103.95115.30102.63511.2235.41104.3294.22102.43912.21113.41313.62014.8174.72112.018
10/23/1639SIGMRFQ164.210660.010233.010467.910563.210599.510839.810184.810682.010635.210395.210691.510658.110565.810655.09788.6104
11/06/1640SPSF319.64914.24012.37014.96712.04115.83319.16717.44115.4458.235630.94434.85830.67525.36228.36228.044
11/15/1641MC-CNN-WSH212.13114.8437.204911.1517.623215.93411.83811.5339.01273.892719.72720.53216.32816.32712.13518.334
11/16/1642MCSCF311.33013.3395.964310.6448.69347.22811.33410.6287.48213.07173.10125.24019.03617.23010.32825.542
11/24/1643ADSMQ138.79040.47420.38727.39035.19155.98222.37656.19450.99524.29258.08656.39836.59032.18238.78269.794
01/15/1744IGFQ134.08342.77820.18623.78532.28345.66928.68843.07437.28021.49050.97644.78234.78631.98137.47647.170
01/24/17453DMSTH25.9253.7162.7824.7552.7267.3694.2853.4433.7652.35612.61211.598.56614.0145.3558.873
03/09/1746SGMEPiF313.9366.92296.71469.47399.723611.82613.64910.93010.6375.263932.84826.94422.74722.74912.03421.738
03/10/1747MC-CNN+TDSRF36.3565.45174.45206.80223.461710.7196.05145.01125.19132.621010.889.6246.59211.416.01117.041
03/22/1748JMRH212.5324.0983.97128.44346.932911.12013.85119.54219.0553.662617.02318.22818.03421.0427.291817.832
03/23/1749DSGCAQ133.88142.97920.98923.68430.27845.56827.68442.07336.07821.08850.27544.28133.38434.69038.48046.869
04/04/1750DDLQ130.17244.38419.48425.88928.37642.16021.17437.16828.76921.79146.86836.05930.37428.47032.77337.556
05/23/1751r200highH240.99470.510614.47321.37937.79472.29638.110053.28931.47318.37752.47952.69244.19845.410150.79466.591
06/14/1752DoGGuidedQ141.49545.48723.69530.69734.68952.57828.38759.110053.89926.49560.69354.79738.39335.59244.58972.098
06/22/1753LocalExpH25.4323.6542.8742.9811.9925.5933.3733.4853.3532.05210.379.7568.57714.4165.4069.557
10/12/1754FEN-D2DRRH27.2394.68114.11145.0383.03128.42116.05144.90115.32143.202111.51014.11513.41913.9125.06214.325
11/13/1755CBMVH211.1296.07255.22358.09314.052018.7379.312810.7299.61313.111933.75015.62217.53217.12910.12514.426
12/11/1756OVODH28.87204.74133.6495.51114.822312.8286.51189.91279.96333.132016.62214.82014.12215.4216.921613.222
01/24/1857SMSSRQ134.88547.49022.49227.39128.87746.77123.67949.58543.48720.98737.75444.18034.68533.08539.18449.873
02/07/1858DFQ156.110447.79127.910036.110146.710162.58850.210672.410369.910537.810488.210370.010352.810450.210477.510491.8106
02/28/1859SDRH27.69145.41154.22154.2042.73710.2145.4096.40165.76174.723511.2915.42113.41816.5285.22413.021
03/09/1860SGM_ROBH218.44537.4715.31369.033714.24731.74614.35924.74812.6435.274031.84729.74924.95422.04718.64728.245
03/11/1861SGM-ForestH27.37114.71123.69104.9373.181311.1215.3785.57155.81182.651214.51713.21113.11514.8185.63811.216
03/14/1862DTSH213.4358.45327.54517.46275.502514.93010.23124.54625.1634.933619.22618.72914.62315.92513.03617.229
03/23/1863MEDIAN_ROBH297.810896.110795.610799.010898.410898.410799.210898.410898.110799.010899.010899.610899.910894.710895.110798.3107
03/23/1864AVERAGE_ROBH297.610796.210896.510896.810797.810797.810698.210797.910798.210898.910798.910799.110799.710793.110797.910898.9108
03/26/1865ELAS_ROBH227.36543.48012.47113.96223.86466.49020.47233.06320.75711.06743.96237.56626.35928.77138.48133.350
04/17/1866ISMQ140.89342.57726.49934.810036.19244.56534.49456.29552.79825.29351.07852.49139.79433.38638.88375.399
05/01/1867PSMNet_ROBQ142.19833.06123.19430.19431.48254.88030.78948.78248.39028.39880.810153.59636.99138.69663.910171.295
05/18/1868PDSH214.23714.4415.804210.54310.53822.14014.05414.5388.97265.934724.23421.53418.23518.93411.93333.651
05/22/1869DN-CSS_ROBH222.85431.4589.285813.55812.44344.36412.13928.15817.6519.116150.97740.07421.24225.06031.97143.263
05/26/1870NOSS_ROBH25.0113.5732.8433.9931.9315.1513.3423.3223.1512.3248.5527.4517.06312.535.2039.064
05/31/1871FBW_ROBH232.27836.3679.375914.26319.15469.39213.24751.08739.18310.86643.96241.57833.08329.97651.39571.496
05/31/1872iResNet_ROBH224.85923.04810.26414.76512.44225.94212.94428.05724.96211.57046.66738.97221.44327.86745.69066.793
05/31/1873CBMV_ROBH27.65133.4823.3574.8063.57186.3266.88194.84103.9161.97125.43511.1813.11415.8247.341913.824
06/05/1874CBMBNetH210.2258.30315.10336.87234.522111.5257.702213.93713.2443.041621.92913.31213.62115.42211.23111.013
06/14/1875MSMD_ROBQ130.97426.95314.67420.07722.66133.74827.88543.97638.48221.18949.57340.87731.87831.67937.57943.664
06/27/1876DCNNH210.9285.66214.98296.49205.732612.5278.512715.63910.9383.081824.13320.23016.82915.52310.32913.823
07/31/1877MotionStereoH240.49267.610425.09729.29340.99757.38435.59657.59840.48419.98242.86152.69339.89537.19451.79634.952
10/10/1878DISCOH224.55735.0647.345011.75218.75348.67317.16331.46122.4589.336346.06633.55427.56624.65727.56055.081
10/29/1880iResNetH222.95528.3559.195715.87019.35735.14911.33527.75516.85015.27554.78327.64619.53721.54431.97051.675
10/29/1879Dense-CNNH27.98165.59194.54225.83132.79810.4165.78128.26208.84242.661315.62014.21813.21613.276.301211.114
11/07/1881IEBIMstH233.88236.76912.16916.97332.58551.07625.38258.19949.89411.26948.67056.99930.27326.86626.95971.797
11/08/1882HSMF310.22412.0385.32377.50296.722815.6329.89306.83175.14124.173122.73017.12615.62714.31510.83014.627
11/11/1883MBMH222.85336.4689.956315.36919.35636.55319.97027.55418.15210.16541.55932.75326.36023.35321.45539.959
11/28/1884MSFNetAH27.96156.21274.26166.02173.66198.95126.28168.41238.06222.621017.92413.91411.9911.528.002110.610
01/12/1986EHCI_netH29.47223.7574.271713.15527.6745.3023.2313.4743.1823.90289.2039.5839.26813.91117.34510.69
01/17/1987FASWQ128.66941.77518.18023.18327.27340.65619.16834.96528.16818.57940.85836.46229.37128.46931.16841.060
12/18/1885MCV-MFCH224.85826.8529.636214.86617.45154.17914.25726.55218.25316.07662.69528.74820.94024.65837.47748.172
02/05/1988AMNetQ153.310254.39663.710651.210451.310340.65839.910251.68855.910155.410658.98857.510052.710349.510358.19861.688
02/15/1989DAWA-FH227.46647.28913.67213.15719.25566.49020.47330.35933.9758.735848.97137.86826.76229.97528.06136.555
03/06/1990SM-AWPQ138.18930.75724.09625.28830.37944.96638.19956.09355.810019.98360.19251.28832.17930.27740.08661.789
03/09/19913DMST-CMH25.4734.1093.3782.9922.95117.63104.5573.2613.9572.16310.258.2826.37113.265.8699.356
04/12/1992TCSCSMH219.14745.2865.764111.04922.16041.15913.44824.84911.4427.175129.54026.64326.66120.53916.54417.431
05/10/1993tMGM-16F317.3428.70336.49459.824220.75913.72913.95321.84316.0465.574426.93625.44128.36822.14814.63939.657
05/13/1994VNH214.2389.69349.586110.9487.33309.541313.85211.33211.3417.175127.43823.33724.85322.85114.64018.435
05/15/1995PSMNet_2000H228.97020.4468.235315.16827.77535.25015.26150.88651.8979.296261.99431.15025.25527.86729.36452.977
05/28/1996PWCA_SGMQ130.97343.98318.98222.98224.46650.97522.27535.76627.56720.68653.48040.67632.48233.38732.37242.161
06/26/1997DeepPruner_ROBQ130.17134.26319.98524.38623.86447.27226.18326.15122.85918.47859.89136.56323.24831.78048.39344.867
07/26/1998EdgeStereoF318.74625.3496.794710.64525.16922.1408.312524.54416.5476.63499.20332.05224.65220.23719.25054.380
11/01/1999NVstereo2DH215.44011.5365.33387.21269.503518.03613.75012.93610.6364.413318.02524.43922.04521.24322.45653.678
11/07/19100LBPSH29.68235.05144.98295.57123.24146.03512.9455.44145.50153.552415.21915.92417.53117.3319.842328.346
11/11/19101SACA-NetQ131.77721.84716.07721.58124.56738.05434.69538.66936.37919.08149.47240.27532.18033.68836.07458.285
11/14/19102HSM-Smooth-OccF310.82711.7375.62408.75368.393315.4319.60298.29216.11194.093023.63220.43117.03013.4910.22716.628
11/15/19103SPPSMNetF341.49632.55920.68834.09833.08655.98336.39753.89048.69135.010271.69952.89437.19238.19546.79156.984
12/19/19104CRLEH25.7543.6653.1155.92142.1436.0143.3943.4963.6842.34510.259.6358.04514.9195.4579.265
12/30/19105F-GDGIFH231.67637.3707.725216.17234.99035.25120.17155.39246.6889.016047.66952.99529.47229.77429.46661.087
01/02/20106PPEP-GFQ134.68442.47621.79124.88730.88044.06325.18145.77842.18620.18444.16443.67935.28832.88439.38555.082
01/05/20107MTSF353.810351.79421.59038.810352.710497.510543.010566.410260.810232.010085.710269.010246.310045.19971.210385.2103
01/07/20108ADSR_GIFQ137.18743.68218.68136.710224.66858.68622.87756.39649.79318.78056.08448.58732.28124.55636.37579.1101

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: February 24 2019 by Daniel Scharstein