vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.48927.98412.19617.810513.76474.513814.07530.38326.39011.09464.413537.910325.88725.38929.38943.794
07/25/142SGBM1Q127.99428.38517.211619.010714.56857.912315.68431.88531.410213.210458.612338.610527.09825.99231.49459.7121
07/25/143SGMQ120.87335.5989.578113.88316.57432.16819.09125.87116.7688.958439.88031.17522.66620.76021.37632.270
07/25/144SGBM1F328.49643.51209.097513.68225.910682.014214.48143.411130.31005.986859.312645.812028.510424.98620.17345.999
07/28/146SGBM1H223.87932.99110.89013.68116.27271.213312.65926.67423.0815.836453.811739.210725.68622.87018.86647.4102
07/28/147SGMH218.46240.31114.54308.034422.99440.58211.45224.76810.1465.406029.65928.56723.97320.05414.25230.968
07/28/148SGMF325.38645.11244.33256.873332.212350.010713.06548.112018.3737.667829.65836.19231.211324.28124.58050.2106
07/28/145Cens5H226.69047.11288.747311.97325.610445.39819.59440.610529.0989.938936.57238.610431.011225.08825.68144.696
08/25/149LPSH219.2696.14325.34499.24547.534296.014712.3579.61359.40425.185692.414827.46524.37523.07210.03525.660
08/27/1410LPSF320.3726.72356.06569.72579.875194.314614.17611.24111.2525.886589.314736.09120.55723.87916.05925.458
08/31/1411BSMQ141.513759.814425.814027.912938.913760.612533.313046.911837.311426.313464.813651.512942.613945.214142.811966.6130
09/10/1412LAMC_DSMH226.08755.814011.99414.38718.37844.09218.39039.910429.5996.677131.16234.58628.810626.39330.19235.774
09/18/1413SNCCH221.97448.61326.98629.795825.710546.010112.45836.89716.6677.257523.14434.28526.79521.86619.97128.467
10/07/1414IDRH218.16137.51074.08187.494123.39640.68312.86024.56611.3535.466133.16726.06021.56421.76515.35721.251
01/21/1515TSGOF339.112934.19416.911520.010843.314055.411914.37954.113049.213133.914266.213745.912139.813542.613847.212752.6108
04/08/1516REAFH231.410858.314130.914613.17645.314263.812830.912838.710025.3888.608239.37936.89527.09735.512618.26439.785
04/09/1517PFSF332.211565.114629.414512.17450.014470.813228.212144.611323.1827.857937.07637.79927.910036.012819.87035.775
04/17/1518TMAPH216.95820.2654.94388.134712.86130.06411.75327.97820.4775.095531.56323.15320.96019.05218.86718.045
04/19/1519MeshStereoH213.2475.90294.883510.86712.96210.62511.04912.2449.01385.395927.45223.55517.74921.06115.45820.950
08/28/1520MC-CNN-acrtH28.08235.59254.55325.96242.831311.4315.81208.32308.89362.711916.33014.12313.22713.076.402011.122
09/14/1521ELASF332.311650.91349.177611.07033.012688.214418.38947.311926.89111.79941.78437.49723.77228.810363.014142.890
09/28/1522R-NCCF348.414326.27814.810730.213430.912072.913641.614377.714764.114627.413759.112571.914750.914433.912478.214780.8144
10/13/1523MDPH212.64414.4534.994110.66610.75427.2628.113512.5468.07344.274730.46020.54812.62117.84513.45117.341
11/03/1524MC-CNN+RBSH28.42246.05305.16446.24283.271911.1286.36248.87339.83443.213115.12715.93012.82313.5127.04249.9914
12/18/1525INTSH214.55320.2644.52288.625011.65529.56310.74716.45410.3474.694927.65422.55120.75820.55811.54524.957
01/19/1626NTDEH27.44185.72284.36265.92222.831310.4225.71185.30185.54242.401213.52314.12112.62213.9156.391912.228
01/26/1627MC-CNN-fstH29.47287.35385.07427.18374.712916.8478.47407.37276.97302.822120.73917.43815.43815.1257.902912.630
02/18/1628LS-ELASF336.712453.513610.38815.89737.013483.614324.511049.112234.610713.910544.99145.711934.912629.110464.414362.7127
03/15/1629MPSVQ143.514058.814233.914834.214037.913652.411330.812756.813751.013530.613956.912051.513044.614143.413944.212154.2112
04/03/1630ICSGF345.614269.714819.112021.311443.614177.614136.913865.314340.411920.312253.611658.714246.514347.114360.713979.1141
04/24/1631HLSC_corH226.08826.57915.210921.011220.58835.77523.410633.18735.010911.910039.17834.28425.28432.811728.38722.754
04/27/1632JEMQ137.212635.79927.914330.613533.212743.09131.412949.512347.312826.513649.610446.012235.712830.811137.510655.8117
05/12/1633PMSCH26.71113.4612.6816.19272.5486.92104.54103.96114.04132.371013.12112.31512.22016.2335.881510.819
05/28/1634APAP-StereoH27.26165.43224.91375.11155.173121.6536.99284.31124.23153.243214.3259.7897.32613.4106.30178.462
07/03/1635LPUH210.43611.4453.18108.10466.083420.9518.24376.94254.00124.044233.97016.93415.23717.8449.123111.626
08/31/1636SEDF363.414854.313822.413472.914964.514971.413442.514480.114867.914749.814879.614374.414865.414955.114886.114991.6148
09/13/1637SNP-RSMH28.75255.46244.85346.50313.372110.4247.31298.73329.37413.583714.32414.72614.93612.8610.13710.820
10/19/1638LW-CNNH27.04134.65153.95165.30162.63911.2305.41164.32134.22142.431312.21813.41913.63014.8224.72212.027
10/23/1639SIGMRFQ164.214960.014533.014767.914863.214899.515139.814184.814982.014935.214495.214991.514958.114765.814955.013688.6147
11/06/1640SPSF319.67014.25212.39814.99112.05715.84219.19217.45615.4628.238030.96134.88730.611125.38928.38628.062
11/15/1641MC-CNN-WSH212.14214.8577.206411.1717.624315.94311.85411.5439.01383.893919.73720.54716.34216.33412.14818.347
11/16/1642MCSCF311.34113.3515.965510.6638.69477.221111.35010.6387.48313.07263.10125.25819.05417.23810.33925.559
11/24/1643ADSMQ138.712840.411220.312427.312735.113155.912022.310356.113350.913424.213158.012256.313836.512932.111638.711169.7133
01/15/1744IGFQ134.012042.711720.112323.712232.212245.610028.612443.010937.211321.412750.910944.711834.712531.911537.410447.1101
01/24/17453DMSTH25.9283.7182.7824.75112.72107.36124.2893.4453.7692.35912.61911.5148.56914.0165.3598.873
03/09/1746SGMEPiF313.9506.92366.71609.47559.724911.83313.66910.94010.6505.265732.86626.96322.76722.76912.04721.753
03/10/1747MC-CNN+TDSRF36.3595.45234.45276.80323.462210.7266.05215.01175.19192.621510.8149.6266.59311.426.01167.041
03/22/1748JMRH212.5434.09133.97178.44496.933911.12713.87119.56119.0753.663817.03218.24018.05121.0627.292717.844
03/23/1749DSGCAQ133.811842.911820.912823.612130.211645.59927.611942.010736.011121.012550.210644.211733.312234.612538.410946.8100
04/04/1750DDLQ130.110444.312319.412125.812628.311242.18821.19937.19828.79621.712846.89636.09030.311028.410032.79837.579
05/23/1751r200highH240.913470.514914.410421.311337.713572.213538.114053.212831.410218.311252.411452.613244.114045.414250.713166.5129
06/14/1752DoGGuidedQ141.413545.412623.613630.613634.612952.511428.312259.114153.813926.413560.613054.713738.313235.512744.512272.0139
06/22/1753LocalExpH25.4323.6552.8742.9811.9935.5943.3733.4873.3542.05310.3119.7588.571014.4195.40109.5511
10/12/1754FEN-D2DRRH27.23154.68164.11195.03143.03168.42156.05214.90165.32223.203011.51614.12113.42913.9145.06414.335
11/13/1755CBMVH211.1406.07315.22458.09454.052518.7499.314210.7399.61433.112833.76815.62917.54717.13710.13614.436
12/11/1756OVODH28.87274.74183.64145.51184.823012.8356.51259.91369.96453.132916.63114.82714.13315.4266.922213.232
01/24/1857SMSSRQ134.812247.413022.413327.312828.811346.710323.610849.512443.412320.912437.77744.111634.612433.011939.111449.8105
02/07/1858DFQ156.114647.713127.914236.114346.714362.512750.214872.414669.914837.814588.214670.014552.814650.214777.514691.8149
02/28/1859SDRH27.69205.41214.22214.2072.731110.2215.40156.40235.76254.725011.21515.42813.42816.5355.22813.031
03/09/1860SGM_RVCH218.46337.41055.31469.035214.26631.76614.38024.76912.6585.275831.86429.77024.98222.06718.66528.264
03/11/1861SGM-ForestH27.37174.71173.69154.93133.181711.1285.37145.57205.81262.651714.52613.21713.12514.8235.631311.224
03/14/1862DTSH213.4488.45417.54677.46405.503214.93710.24624.56725.1864.935219.23618.74114.63515.93113.05017.240
03/23/1863MEDIAN_ROBH297.815196.115095.615099.015198.415198.415099.215198.415198.115099.015199.015199.615199.915194.715195.115098.3150
03/23/1864AVERAGE_ROBH297.615096.215196.515196.815097.815097.814998.215097.915098.215198.915098.915099.115099.715093.115097.915198.9151
03/26/1865ELAS_RVCH227.39143.411912.410013.98523.89766.412920.49733.08620.77811.09343.98837.59826.38828.710238.411033.371
04/17/1866ISMQ140.813342.511626.414134.814136.113244.59534.413256.213452.713825.213351.011252.413139.713333.312138.811275.3140
05/01/1867PSMNet_ROBQ142.113933.09223.113530.113331.412154.811830.712648.712148.312928.313880.814453.513636.913038.613563.914271.2135
05/18/1868PDSH214.25114.4535.805410.56210.55222.15414.07414.5518.97375.936624.24721.54918.25318.95111.94633.672
05/22/1869DN-CSS_ROBH222.87731.4899.287813.58012.45944.39412.15528.18017.6709.118650.911140.010821.26125.08731.99643.291
05/26/1870NOSS_ROBH25.0113.5742.8433.9961.9325.1513.3423.3243.1522.3278.5537.4527.06412.555.2079.065
05/31/1871FBW_ROBH232.211436.31019.377914.28619.18269.313113.26751.012639.111610.89243.98841.511233.012029.910951.313271.4136
05/31/1872iResNet_ROBH224.88423.07110.28714.78912.45825.96112.96128.07924.98511.59746.69538.910621.46227.89745.612466.7131
05/31/1873CBMV_ROBH27.65193.4823.35114.80123.57236.3286.88274.84153.91101.97225.44911.11213.12415.8307.342813.834
06/05/1874CBMBNetH210.2348.30405.10436.87334.522711.5327.703113.95013.2593.042521.94113.31813.63115.42711.24311.021
06/14/1875MSMD_ROBQ130.910626.98214.610520.010922.69333.76927.812043.911238.411521.112649.510240.811131.811431.611237.510743.693
06/27/1876DCNNH210.9395.66274.98396.49305.733312.5348.514115.65310.9513.082724.14620.24516.84415.52910.34013.833
07/31/1877MotionStereoH240.413267.614725.013829.213240.913857.312235.513457.513840.411819.911942.88752.613339.813437.113151.713334.973
10/10/1878DISCOH224.58135.0977.346511.77218.78148.610617.18531.48422.4799.338846.09433.58127.59924.68327.58455.0115
10/29/1880iResNetH222.97828.3859.197715.89619.38535.17111.35127.77716.86915.210654.711827.66619.55521.56431.99551.6107
10/29/1879Dense-CNNH27.98225.59254.54305.83212.791210.4235.78198.26288.84352.661815.62914.22413.22613.296.301711.122
11/07/1881IEBIMstH233.811936.710312.19716.910232.512451.010925.311258.113949.813311.29548.69956.914030.210926.89626.98271.7137
11/08/1882HSM-Net_RVCF310.23312.0505.32477.50426.723815.6409.89456.83245.14174.174622.74317.13515.63914.31810.84114.637
11/11/1883MBMH222.87636.41029.958515.39319.38436.57719.99527.57618.17110.19041.58332.77826.39023.37421.47739.986
11/28/1884MSFNetAH27.96216.21334.26236.02253.66248.95186.28238.41318.06332.621517.93313.92011.91911.538.003010.618
01/12/1986EHCI_netH29.47293.75104.272413.17627.61095.3023.2313.4763.1833.90409.2049.5859.261213.91317.36110.616
01/17/1987FASWQ128.69941.711318.111723.111827.210840.68319.19334.99128.19518.511440.88236.49329.310728.49931.19341.087
12/18/1885MCV-MFCH224.88326.8819.638314.89017.47554.111714.27726.57318.27216.011062.613328.76920.95924.68437.410548.1103
02/05/1988AMNetQ153.314454.313763.714951.214751.314540.68539.914251.612755.914255.414958.912457.514152.714549.514658.113861.6124
02/15/1989DAWA-FH227.49247.212913.610213.17819.28366.412920.49830.38233.91058.738348.910037.810026.79429.910828.08536.576
03/06/1990SM-AWPQ138.112730.78824.013725.212530.311744.99638.113956.013255.814119.912060.112851.212832.111530.211040.011761.7125
03/09/19913DMST-CMH25.4734.10143.37122.9922.95157.63134.55113.2633.95112.16410.288.2836.37213.285.86149.358
04/12/1992TCSCSMH219.16845.21255.765311.06922.19241.18713.46824.87011.4557.177329.55726.66126.69120.55916.56017.442
05/10/1993tMGM-16F317.3598.70436.49589.825920.78913.73613.97321.86216.0655.576226.95125.45928.310122.16814.65439.684
05/13/1994VNH214.2529.69449.588210.9687.33419.542013.87211.34211.3547.177327.45323.35424.88022.87114.65518.448
05/15/1995PSMNet_2000H228.910120.4668.237115.19227.711135.27215.28350.812551.81369.298761.913131.17425.28327.89729.38952.9109
05/28/1996PWCA_SGMQ130.910543.912218.911922.911724.49950.910822.210235.79327.59420.612353.411540.611032.411933.312232.39742.189
06/26/1997DeepPruner_ROBQ130.110234.29519.912224.312323.89747.210426.111326.17222.88018.411359.812736.59423.26931.711448.312944.897
07/26/1998EdgeStereoF318.76425.3766.796110.66425.110322.1548.313824.56516.5666.63709.20432.07624.67820.25619.26854.3113
11/01/1999NVstereo2DH215.45511.5465.33487.21389.504818.04813.77012.94710.6494.414818.03424.45622.06521.26322.47853.6111
11/07/19100LBPSH29.68305.05194.98395.57193.24186.03712.9625.44195.50233.553615.22815.93117.54617.3399.843328.365
11/11/19101SACA-NetQ131.711021.86916.011121.511524.510038.07934.613338.69936.311219.011749.410140.210932.111633.612336.010058.2119
11/14/19102HSM-Smooth-OccF310.83811.7475.62508.75518.394615.4389.60438.29296.11284.094323.64520.44617.04513.41110.23816.639
11/15/19103SPPSMNetF341.413632.59020.612534.013933.012555.912136.313753.812948.613035.014371.613852.813437.113138.113446.712656.9118
12/19/19104CRLEH25.7573.6663.1195.92222.1456.0163.3943.4983.6872.34810.289.6378.04814.9245.45119.267
12/30/19105F-GDGIFH231.610937.31047.726816.19834.913035.27320.19655.313146.61259.018547.69752.913529.410829.710729.49161.0123
01/02/20106PPEP-GFQ134.612142.411521.713024.812430.811944.09325.111145.711642.112020.112144.19043.611535.212732.811839.311655.0116
01/05/20107MTS2F353.814551.713521.512938.814552.714697.514843.014566.414460.814432.014085.714569.014446.314245.114071.214585.2145
01/07/20108ADSR_GIFQ137.112543.612118.611836.714424.610158.612422.810556.313549.713218.711656.011948.512532.211724.58236.310179.1142
02/07/20109CasStereoH218.86523.9739.017410.56111.75674.013713.16610.1377.86324.094345.49325.25724.47717.34020.57544.395
02/20/20110CRARH222.07523.27213.510116.410016.37321.05221.810028.58126.99210.59132.56532.97923.37023.67820.37437.478
02/24/20111SGBMPF327.89337.510816.311317.110327.611075.714014.68233.48925.88912.210160.312934.08323.16829.310528.78831.269
03/13/20112MTSF359.714758.814325.213951.114660.414791.314548.314770.314563.414544.414779.314271.714660.914847.414479.614888.4146
05/14/20113SRMH213.1458.50427.04637.86437.734416.1447.903418.45918.5745.035422.34220.04318.15218.54911.34419.349
05/19/20114SUWNetQ130.110324.57413.910320.311020.08735.77426.111440.910643.212117.911149.810528.66824.47628.510152.513537.981
05/20/20115AANet++H215.45617.5598.377210.2609.865023.9579.824417.75715.9643.253318.13527.16416.24118.44820.07237.780
05/23/20116CCNetQ131.911327.08316.011220.311118.68038.88052.014935.99434.010618.611549.610330.57326.79336.212937.110362.0126
05/28/20118RTSMNetH245.614147.012721.913131.913736.413375.113943.914658.914055.314032.714162.213256.413942.213839.113658.013759.9122
05/28/20117LEAStereoH27.15147.56394.52284.62104.64288.83165.66175.86216.03273.303513.12211.31310.31612.147.06259.9013
06/08/20119MANEH230.910754.713911.59314.68829.411552.611526.411645.111531.510411.59742.58541.811333.112131.611334.29943.592
07/16/20120HLocalExp-CMH25.6863.6872.9563.9252.4578.12143.4153.74103.5352.17510.2810.0118.751114.1175.1259.6112
07/17/20121GANetREF_RVCH218.96616.6586.42577.403910.65325.86012.25636.59635.51104.104533.86920.14416.44320.25714.35348.1104
07/21/20122AANet_RVCH225.28522.67011.39212.97515.97030.56517.98733.48830.91016.346928.85643.411425.38526.79537.010269.8134
08/09/20123UCNetH210.13114.6567.91707.10356.984016.3456.822613.44912.3572.822110.1717.4379.481314.6219.853410.616
08/10/20124CVANet_RVCQ131.811125.67714.610621.711622.19139.88128.412344.711447.012719.111850.610830.47224.77929.310652.113441.688
08/11/20125NLCA_NET_v2_RVCH210.43511.8484.12206.39296.443619.75010.94814.55113.2603.263421.24014.72510.11414.5207.172611.525
08/12/20126CFNet_RVCH210.13214.4557.81697.12366.613715.5397.533012.34511.5563.022410.71316.63310.71715.42810.9429.014
08/14/20127STTRV1_RVCQ141.813826.88029.114436.014230.711846.110235.813539.210239.711742.114674.714149.412734.412347.514562.814054.4114
08/30/20128LE_PCH25.5853.5232.9974.2481.9215.3933.4263.1623.7282.3067.8329.90107.79717.4414.7439.519
09/03/20129LPSMQ139.513040.011020.712728.313134.012834.37023.810956.713652.413724.913236.97566.314340.613737.513246.612579.3143
09/09/20130AdaStereoF313.74919.6637.416610.66514.56715.7417.853322.6639.32407.00729.20422.45014.53417.84614.85624.256
09/24/20131ACMCQ131.911250.813316.511423.411921.29051.111126.511739.510328.89715.910951.311337.910232.311833.112039.311553.1110
10/28/20132HITNetH26.46106.25344.67334.5192.1766.5295.18122.9212.6612.371036.7739.2846.27111.214.6119.5410
11/10/20133FC-DCNNH217.96021.2686.52599.565614.16531.96723.410723.46419.7765.936626.95022.85220.05619.35318.26323.955
11/12/20134RLStereoH227.99520.56715.010823.512026.310751.511235.813627.17523.48315.610763.613432.37721.56323.27344.712317.443
11/12/20135UnDAF-GANetH216.2573.7492.94516.710118.37724.15826.311519.26015.7631.86136.87426.86211.11824.8856.542128.063
11/16/20136SSCasStereoH215.25433.6935.73528.134712.66051.11108.193616.7555.02165.706348.59817.33616.04020.15512.3499.256
11/17/20137RASNetH213.14611.9495.65515.71208.364525.8598.31387.18265.29212.932325.04816.03213.93218.44738.210821.452
11/21/20138DecStereoF320.27119.46211.99515.69413.56323.05626.711813.34815.1617.607728.35530.27123.47117.64238.911338.482
11/25/20139LPSCH210.7375.15204.23225.48176.383516.5467.84329.563410.3484.024120.23819.04217.74818.5509.733218.046
11/26/20140CooperativeStereoQ128.810028.58712.39917.310418.57962.312622.410436.39524.78415.810874.514037.810128.410226.69441.611828.466
12/22/20141SLCCFH28.83266.97374.90366.05264.35268.89175.33136.29225.15184.805113.02018.13917.85017.7436.932315.438
12/24/20142ACR-GIF-OWQ124.58037.510610.88916.39917.47644.99717.28633.59025.28711.49645.49235.78926.69223.37623.67938.483
03/05/21144ORStereoF319.16738.91099.97869.215323.39542.69013.06318.2586.63294.935235.47133.18024.17423.67718.26226.061
03/05/21145LocalExp-RCH25.5443.78113.0283.8542.0845.9553.4873.6193.6562.521410.3126.8517.25516.1325.12510.215
04/22/21146LESCH26.78124.07123.46133.2633.36209.15194.0884.76145.21202.802011.71713.01610.21517.0365.521212.529
05/09/21147ADSGQ124.78236.310011.39115.69520.08635.97618.28835.29227.29312.210242.78633.88226.38923.37527.08336.677
06/02/21148FADNet_RVCH228.49718.3609.488013.98416.07140.98613.06443.411045.01248.438157.812135.78824.88123.98047.412868.1132
06/04/21149RANet++H228.59819.1619.918418.410615.76937.27814.27842.910843.41227.567650.911037.29628.610525.69148.813059.0120
06/07/21150FADNet++Q140.213125.27522.113233.413828.811454.011633.613146.811746.812623.513073.413947.112428.510337.713365.414471.9138
06/10/21151ReS2tACQ135.812341.811420.712628.113024.610242.48930.312538.910134.910823.012950.310748.912639.813639.413744.112065.1128
06/11/21152R3DCNNH233.011734.29615.811013.47941.713947.910522.010160.114257.414312.610340.38146.412326.89637.013019.36945.298

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: June 24 2020 by Daniel Scharstein