vision.middlebury.edu
stereomviewMRFflowcolor
Stereo EvaluationDatasetsCodeSubmit 
Middlebury Stereo Evaluation - Version 3

Middlebury Stereo Evaluation - Version 3

Mouseover the table cells to see the produced disparity map. Clicking a cell will blink the ground truth for comparison. To change the table type, click the links below. For more information, please see the description of new features.

Submit and evaluate your own results. See snapshots of previous results. See the evaluation v.2 (no longer active).

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.48727.98012.19217.810113.76374.513214.07330.38226.38911.09164.413037.99925.88525.38629.38643.793
07/25/142SGBM1Q127.99228.38117.211119.010214.56757.911715.68131.88431.410013.29958.611738.610127.09425.98831.49159.7118
07/25/143SGMQ120.87235.5939.577913.88116.57132.16719.08725.87016.7678.958139.87931.17422.66520.75921.37432.269
07/25/144SGBM1F328.49443.51139.097413.68025.910182.013614.47843.410630.3985.986759.312045.811628.59924.98320.17145.997
07/28/146SGBM1H223.87832.98710.88713.67916.26971.212712.65826.67323.0805.836353.811239.210325.68422.86918.86547.4100
07/28/147SGMH218.46140.31054.54298.034322.99040.57911.45124.76710.1455.405929.65828.56623.97220.05314.25130.967
07/28/148SGMF325.38445.11174.33246.873232.211750.010113.06348.111418.3727.667629.65736.18931.210724.27824.57850.2104
07/28/145Cens5H226.68847.11218.747211.97225.69945.39319.59040.610229.0969.938636.57138.610031.010625.08525.67944.695
08/25/149LPSH219.2686.14315.34489.24537.534196.014112.3569.61349.40415.185592.414227.46424.37423.07110.03425.659
08/27/1410LPSF320.3716.72346.06559.72569.875094.314014.17411.24011.2515.886489.314136.08820.55623.87716.05825.457
08/31/1411BSMQ141.513059.813825.813327.912438.913160.611933.312546.911237.311126.312764.813151.512242.613245.213442.811766.6126
09/10/1412LAMC_DSMH226.08555.813411.99014.38418.37544.08718.38639.910129.5976.677031.16134.58428.810026.38930.18935.773
09/18/1413SNCCH221.97348.61256.98619.795725.710046.09612.45736.89516.6667.257423.14334.28326.79221.86519.96928.466
10/07/1414IDRH218.16037.51014.08177.494023.39240.68012.85924.56511.3525.466033.16626.05921.56321.76415.35621.250
01/21/1515TSGOF339.112334.19016.911020.010343.313355.411214.37654.112449.212533.913566.213245.911739.812942.613147.212452.6106
04/08/1516REAFH231.410458.313530.913913.17545.313563.812230.912238.79825.3878.607939.37836.89227.09335.512218.26339.783
04/09/1517PFSF332.211165.114029.413812.17350.013870.812628.211644.610823.1817.857737.07537.79527.99636.012419.86835.774
04/17/1518TMAPH216.95720.2624.94378.134612.86030.06311.75227.97720.4765.095431.56223.15220.95919.05118.86618.044
04/19/1519MeshStereoH213.2465.90284.883410.86612.96110.62411.04812.2439.01375.395827.45123.55417.74821.06015.45720.949
08/28/1520MC-CNN-acrtH28.08225.59244.55315.96232.831311.4305.81198.32298.89352.711916.32914.12213.22613.076.401911.122
09/14/1521ELASF332.311250.91279.177511.06933.012088.213818.38547.311326.89011.79641.78237.49323.77128.89963.013642.889
09/28/1522R-NCCF348.413726.27414.810330.212830.911472.913041.613777.714164.114027.413059.111971.914150.913833.912078.214180.8138
10/13/1523MDPH212.64314.4524.994010.66510.75327.2618.113412.5458.07334.274630.45920.54712.62017.84413.45017.340
11/03/1524MC-CNN+RBSH28.42236.05295.16436.24273.271911.1276.36238.87329.83433.213015.12615.92912.82213.5127.04239.9914
12/18/1525INTSH214.55220.2614.52278.624911.65429.56210.74616.45310.3464.694827.65322.55020.75720.55711.54424.956
01/19/1626NTDEH27.44175.72274.36255.92212.831310.4215.71175.30175.54232.401213.52214.12012.62113.9156.391812.228
01/26/1627MC-CNN-fstH29.47277.35375.07417.18364.712816.8468.47397.37266.97292.822020.73817.43715.43715.1257.902812.629
02/18/1628LS-ELASF336.711853.512910.38515.89337.012883.613724.510549.111634.610513.910044.98845.711534.912029.110064.413862.7124
03/15/1629MPSVQ143.513358.813633.914134.213337.913052.410730.812156.813251.013030.613256.911551.512344.613443.413244.211854.2110
04/03/1630ICSGF345.613569.714219.111521.310943.613477.613536.913265.313740.411620.311753.611158.713646.513647.113660.713479.1135
04/24/1631HLSC_corH226.08626.57515.210521.010720.58435.77423.410133.18635.010611.99739.17734.28225.28232.811328.38422.753
04/27/1632JEMQ137.212035.79427.913630.612933.212143.08631.412349.511747.312226.512949.610146.011835.712230.810737.510355.8115
05/12/1633PMSCH26.71113.4612.6816.19262.5486.92104.5493.96114.04132.371013.12012.31512.21916.2335.881410.819
05/28/1634APAP-StereoH27.26155.43214.91365.11145.173021.6526.99274.31124.23153.243114.3249.7897.32613.4106.30168.462
07/03/1635LPUH210.43511.4443.18108.10456.083320.9508.24366.94244.00124.044133.96916.93315.23617.8439.123011.626
08/31/1636SEDF363.414254.313122.412772.914364.514371.412842.513880.114267.914149.814279.613774.414265.414355.114286.114391.6142
09/13/1637SNP-RSMH28.75245.46234.85336.50303.372010.4237.31288.73319.37403.583614.32314.72514.93512.8610.13610.820
10/19/1638LW-CNNH27.04124.65143.95155.30152.63911.2295.41154.32134.22142.431312.21713.41813.62914.8224.72212.027
10/23/1639SIGMRFQ164.214360.013933.014067.914263.214299.514539.813584.814382.014335.213795.214391.514358.114165.814355.013188.6141
11/06/1640SPSF319.66914.25112.39414.98812.05615.84119.18817.45515.4618.237830.96034.88530.610525.38628.38328.061
11/15/1641MC-CNN-WSH212.14114.8567.206311.1707.624215.94211.85311.5429.01373.893819.73620.54616.34116.33412.14718.346
11/16/1642MCSCF311.34013.3505.965410.6628.69467.221111.34910.6377.48303.07253.10125.25719.05317.23710.33825.558
11/24/1643ADSMQ138.712240.410620.311927.312235.112555.911322.39856.112850.912924.212458.011656.313136.512332.111238.710869.7128
01/15/1744IGFQ134.011542.711020.111823.711732.211645.69528.611943.010537.211021.412250.910544.711434.711931.911137.410147.199
01/24/17453DMSTH25.9283.7182.7824.75102.72107.36124.2883.4453.7692.35912.61811.5148.56914.0165.3598.873
03/09/1746SGMEPiF313.9496.92356.71599.47549.724811.83213.66710.93910.6495.265632.86526.96222.76622.76812.04621.752
03/10/1747MC-CNN+TDSRF36.3595.45224.45266.80313.462110.7256.05205.01165.19192.621510.8149.6266.59311.426.01157.041
03/22/1748JMRH212.5424.09123.97168.44486.933811.12613.86919.56019.0743.663717.03118.23918.05021.0617.292617.843
03/23/1749DSGCAQ133.811342.911120.912223.611630.211045.59427.611442.010436.010821.012050.210344.211333.311634.612138.410646.898
04/04/1750DDLQ130.110044.311619.411625.812128.310742.18421.19537.19628.79421.712346.89336.08730.310428.49632.79537.577
05/23/1751r200highH240.912770.514314.410021.310837.712972.212938.113453.212231.410018.310752.410952.612544.113345.413550.712666.5125
06/14/1752DoGGuidedQ141.412845.411923.612930.613034.612352.510828.311759.113653.813426.412860.612454.713038.312635.512344.511972.0133
06/22/1753LocalExpH25.4323.6552.8742.9811.9935.5943.3733.4873.3542.05310.3119.7588.571014.4195.40109.5511
10/12/1754FEN-D2DRRH27.23144.68154.11185.03133.03168.42156.05204.90155.32213.202911.51614.12013.42813.9145.06414.334
11/13/1755CBMVH211.1396.07305.22448.09444.052418.7489.314110.7389.61423.112733.76715.62817.54617.13610.13514.435
12/11/1756OVODH28.87264.74173.64135.51174.822912.8346.51249.91359.96443.132816.63014.82614.13215.4266.922113.231
01/24/1857SMSSRQ134.811747.412322.412627.312328.810846.79823.610349.511843.411920.911937.77644.111234.611833.011539.111149.8103
02/07/1858DFQ156.114047.712427.913536.113646.713762.512150.214272.414069.914237.813888.214070.013952.814050.214177.514091.8143
02/28/1859SDRH27.69195.41204.22204.2062.731110.2205.40146.40225.76244.724911.21515.42713.42716.5355.22813.030
03/09/1860SGM_RVCH218.46237.4995.31459.035114.26531.76514.37724.76812.6575.275731.86329.76924.98022.06618.66428.263
03/11/1861SGM-ForestH27.37164.71163.69144.93123.181711.1275.37135.57195.81252.651714.52513.21613.12414.8235.631211.224
03/14/1862DTSH213.4478.45407.54667.46395.503114.93610.24524.56625.1854.935119.23518.74014.63415.93113.04917.239
03/23/1863MEDIAN_ROBH297.814596.114495.614499.014598.414598.414499.214598.414598.114499.014599.014599.614599.914594.714595.114498.3144
03/23/1864AVERAGE_ROBH297.614496.214596.514596.814497.814497.814398.214497.914498.214598.914498.914499.114499.714493.114497.914598.9145
03/26/1865ELAS_RVCH227.38943.411212.49613.98223.89366.412320.49333.08520.77711.09043.98537.59426.38628.79838.410733.370
04/17/1866ISMQ140.812642.510926.413434.813436.112644.59034.412656.212952.713325.212651.010752.412439.712733.311738.810975.3134
05/01/1867PSMNet_ROBQ142.113233.08823.112830.112731.411554.811130.712048.711548.312328.313180.813853.512936.912438.612963.913771.2130
05/18/1868PDSH214.25014.4525.805310.56110.55122.15314.07214.5508.97365.936524.24621.54818.25218.95011.94533.671
05/22/1869DN-CSS_ROBH222.87631.4859.287713.57812.45844.38912.15428.17917.6699.118350.910640.010421.26025.08431.99343.290
05/26/1870NOSS_ROBH25.0113.5742.8433.9951.9325.1513.3423.3243.1522.3278.5537.4527.06412.555.2079.065
05/31/1871FBW_ROBH232.211036.3959.377814.28319.17969.312513.26551.012039.111310.88943.98541.510833.011429.910551.312771.4131
05/31/1872iResNet_ROBH224.88223.06810.28414.78612.45725.96012.96028.07824.98411.59446.69238.910221.46127.89345.612166.7127
05/31/1873CBMV_ROBH27.65183.4823.35114.80113.57226.3286.88264.84143.91101.97225.44811.11213.12315.8307.342713.833
06/05/1874CBMBNetH210.2338.30395.10426.87324.522611.5317.703013.94913.2583.042421.94013.31713.63015.42711.24211.021
06/14/1875MSMD_ROBQ130.910226.97814.610120.010422.68933.76827.811543.910738.411221.112149.59940.810731.810831.610837.510443.692
06/27/1876DCNNH210.9385.66264.98386.49295.733212.5338.514015.65210.9503.082624.14520.24416.84315.52910.33913.832
07/31/1877MotionStereoH240.412567.614125.013129.212640.913257.311635.512857.513340.411519.911442.88452.612639.812837.112651.712834.972
10/10/1878DISCOH224.58035.0927.346411.77118.77848.610017.18231.48322.4789.338546.09133.58027.59524.68027.58155.0113
10/29/1880iResNetH222.97728.3819.197615.89219.38235.17011.35027.77616.86815.210154.711327.66519.55421.56331.99251.6105
10/29/1879Dense-CNNH27.98215.59244.54295.83202.791210.4225.78188.26278.84342.661815.62814.22313.22513.296.301611.122
11/07/1881IEBIMstH233.811436.79712.19316.99832.511851.010325.310758.113449.812711.29248.69656.913330.210326.89226.98071.7132
11/08/1882HSM-Net_RVCF310.23212.0495.32467.50416.723715.6399.89446.83235.14174.174522.74217.13415.63814.31810.84014.636
11/11/1883MBMH222.87536.4969.958215.39019.38136.57519.99127.57518.17010.18741.58132.77726.38723.37321.47539.984
11/28/1884MSFNetAH27.96206.21324.26226.02243.66238.95186.28228.41308.06322.621517.93213.91911.91811.538.002910.618
01/12/1986EHCI_netH29.47283.75104.272313.17527.61045.3023.2313.4763.1833.90399.2049.5859.261213.91317.36010.616
01/17/1987FASWQ128.69541.710718.111223.111327.210340.68019.18934.99028.19318.510940.88036.49029.310128.49531.19041.086
12/18/1885MCV-MFCH224.88126.8779.638114.88717.47254.111014.27526.57218.27116.010562.612728.76820.95824.68137.410248.1101
02/05/1988AMNetQ153.313854.313063.714351.214051.313940.68239.913651.612155.913755.414358.911857.513452.713949.514058.113361.6121
02/15/1989DAWA-FH227.49047.212213.69813.17719.28066.412320.49430.38133.91038.738048.99737.89626.79129.910428.08236.575
03/06/1990SM-AWPQ138.112130.78424.013025.212030.311144.99138.113356.012755.813619.911560.112251.212132.110930.210640.011461.7122
03/09/19913DMST-CMH25.4734.10133.37122.9922.95157.63134.55103.2633.95112.16410.288.2836.37213.285.86139.358
04/12/1992TCSCSMH219.16745.21185.765211.06822.18841.18313.46624.86911.4547.177229.55626.66026.68820.55816.55917.441
05/10/1993tMGM-16F317.3588.70426.49579.825820.78513.73513.97121.86116.0645.576126.95025.45828.39722.16714.65339.682
05/13/1994VNH214.2519.69439.588010.9677.33409.541913.87011.34111.3537.177227.45223.35324.87922.87014.65418.447
05/15/1995PSMNet_2000H228.99720.4638.237015.18927.710635.27115.28050.811951.81319.298461.912531.17325.28127.89329.38652.9107
05/28/1996PWCA_SGMQ130.910143.911518.911422.911224.49550.910222.29735.79127.59220.611853.411040.610632.411333.311832.39442.188
06/26/1997DeepPruner_ROBQ130.19834.29119.911724.311823.89347.29926.110826.17122.87918.410859.812136.59123.26831.711048.312544.896
07/26/1998EdgeStereoF318.76325.3726.796010.66325.19822.1538.313724.56416.5656.63699.20432.07524.67720.25519.26754.3111
11/01/1999NVstereo2DH215.45411.5455.33477.21379.504718.04713.76812.94610.6484.414718.03324.45522.06421.26222.47653.6109
11/07/19100LBPSH29.68295.05184.98385.57183.24186.03712.9615.44185.50223.553515.22715.93017.54517.3389.843228.364
11/11/19101SACA-NetQ131.710621.86616.010621.511024.59638.07634.612738.69736.310919.011249.49840.210532.111033.611936.09758.2117
11/14/19102HSM-Smooth-OccF310.83711.7465.62498.75508.394515.4379.60428.29286.11274.094223.64420.44517.04413.41110.23716.638
11/15/19103SPPSMNetF341.412932.58620.612034.013233.011955.911436.313153.812348.612435.013671.613352.812737.112538.112846.712356.9116
12/19/19104CRLEH25.7573.6663.1195.92212.1456.0163.3943.4983.6872.34810.289.6378.04814.9245.45119.267
12/30/19105F-GDGIFH231.610537.3987.726716.19434.912435.27220.19255.312646.61209.018247.69452.912829.410229.710329.48861.0120
01/02/20106PPEP-GFQ134.611642.410821.712424.811930.811344.08825.110645.711142.111720.111644.18743.611135.212132.811439.311355.0114
01/05/20107MTS2F353.813951.712821.512338.813852.714097.514243.013966.413860.813832.013385.713969.013846.313545.113371.213985.2139
01/07/20108ADSR_GIFQ137.111943.611418.611336.713724.69758.611822.810056.313049.712618.711156.011448.511932.211124.57936.39879.1136
02/07/20109CasStereoH218.86423.9709.017310.56011.75574.013113.16410.1367.86314.094245.49025.25624.47617.33920.57344.394
02/20/20110CRARH222.07423.26913.59716.49616.37021.05121.89628.58026.99110.58832.56432.97823.36923.67620.37237.476
02/24/20111SGBMPF327.89137.510216.310817.19927.610575.713414.67933.48825.88812.29860.312334.08123.16729.310128.78531.268
03/13/20112MTSF359.714158.813725.213251.113960.414191.313948.314170.313963.413944.414179.313671.714060.914247.413779.614288.4140
05/14/20114SRMH213.1448.50417.04627.86427.734316.1437.903318.45818.5735.035322.34120.04218.15118.54811.34319.348
05/19/20115SUWNetQ130.19924.57113.99920.310520.08335.77326.110940.910343.211817.910649.810228.66724.47528.59752.513037.979
05/20/20116AANet++H215.45517.5588.377110.2599.864923.9569.824317.75615.9633.253218.13427.16316.24018.44720.07037.778
05/23/20117CCNetQ131.910927.07916.010720.310618.67738.87752.014335.99234.010418.611049.610030.57226.79036.212537.110062.0123
05/28/20119RTSMNetH245.613447.012021.912531.913136.412775.113343.914058.913555.313532.713462.212656.413242.213139.113058.013259.9119
05/28/20118LEAStereoH27.15137.56384.52274.6294.64278.83165.66165.86206.03263.303413.12111.31310.31512.147.06249.9013
06/08/20120MANEH230.910354.713211.58914.68529.410952.610926.411145.111031.510211.59442.58341.810933.111531.610934.29643.591
07/16/20121HLocalExp-CMH25.6863.6872.9563.9242.4578.12143.4153.74103.5352.17510.2810.0118.751114.1175.1259.6112
07/17/20122GANetREF_RVCH218.96516.6576.42567.403810.65225.85912.25536.59435.51074.104433.86820.14316.44220.25614.35248.1102
07/21/20123AANet_RVCH225.28322.66711.38812.97415.96830.56417.98433.48730.9996.346828.85543.411025.38326.79137.09969.8129
08/09/20124UCNetH210.13014.6557.91697.10346.983916.3446.822513.44812.3562.822010.1717.4369.481314.6219.853310.616
08/10/20125CVANet_RVCQ131.810725.67314.610221.711122.18739.87828.411844.710947.012119.111350.610430.47124.77829.310252.112941.687
08/11/20126NLCA_NET_v2_RVCH210.43411.8474.12196.39286.443519.74910.94714.55013.2593.263321.23914.72410.11414.5207.172511.525
08/12/20127CFNet_RVCH210.13114.4547.81687.12356.613615.5387.532912.34411.5553.022310.71316.63210.71615.42810.9419.014
08/14/20128STTRV1_RVCQ141.813126.87629.113736.013530.711246.19735.812939.29939.711442.114074.713549.412034.411747.513862.813554.4112
08/30/20129LE_PCH25.5853.5232.9974.2471.9215.3933.4263.1623.7282.3067.8329.90107.79717.4404.7439.519
09/03/20130LPSMQ139.512440.010420.712128.312534.012234.36923.810456.713152.413224.912536.97466.313740.613037.512746.612279.3137
09/09/20131AdaStereoF313.74819.6607.416510.66414.56615.7407.853222.6629.32397.00719.20422.44914.53317.84514.85524.255
09/24/20132ACMCQ131.910850.812616.510923.411421.28651.110526.511239.510028.89515.910451.310837.99832.311233.111639.311253.1108
10/28/20133HITNetH26.46106.25334.67324.5182.1766.5295.18112.9212.6612.371036.7729.2846.27111.214.6119.5410
11/10/20134FC-DCNNH217.95921.2656.52589.565514.16431.96623.410223.46319.7755.936526.94922.85120.05519.35218.26223.954
11/12/20135RLStereoH227.99320.56415.010423.511526.310251.510635.813027.17423.48215.610263.612932.37621.56223.27244.712017.442
11/12/20136UnDAF-GANetH216.2563.7492.94516.79718.37424.15726.311019.25915.7621.86136.87326.86111.11724.8826.542028.062
11/16/20137SSCasStereoH215.25333.6895.73518.134612.65951.11048.193516.7545.02165.706248.59517.33516.03920.15412.3489.256
11/17/20138RASNetH213.14511.9485.65505.71198.364425.8588.31377.18255.29202.932225.04716.03113.93118.44638.210521.451
11/21/20139DecStereoF320.27019.45911.99115.69113.56223.05526.711313.34715.1607.607528.35430.27023.47017.64138.911038.480
11/25/20140LPSCH210.7365.15194.23215.48166.383416.5457.84319.563310.3474.024020.23719.04117.74718.5499.733118.045
11/26/20141CooperativeStereoQ128.89628.58312.39517.310018.57662.312022.49936.39324.78315.810374.513437.89728.49826.69041.611528.465
12/22/20142SLCCFH28.83256.97364.90356.05254.35258.89175.33126.29215.15184.805013.01918.13817.84917.7426.932215.437
12/24/20143ACR-GIF-OWQ124.57937.510010.88616.39517.47344.99217.28333.58925.28611.49345.48935.78626.68923.37423.67738.481
02/28/21144SIFT_R3DCNNH248.313655.713349.314252.414145.513657.211533.312454.112450.612841.213962.912858.213550.613748.013941.711640.585
03/05/21145ORStereoF319.16638.91039.97839.215223.39142.68513.06218.2576.63284.935135.47033.17924.17323.67518.26126.060
03/05/21146LocalExp-RCH25.5443.78113.0283.8532.0845.9553.4873.6193.6562.521410.3126.8517.25516.1325.12510.215

Reference list

 

 

 

 

 

 

 

 

 

 

Last modified: June 24 2020 by Daniel Scharstein