Middlebury Stereo Evaluation - Version 3

before rounding bug fix

We fixed a rounding issue on 1/8/2017. This affected the error numbers for the three "old" image pairs with integer ground truth (test/Computer, training/ArtL, and training/Teddy), for which submitted disparities should have been rounded to integers (at full resolution) before evaluation.

See other snapshots here.

Set: test densetest sparsetraining densetraining sparse
Metric: bad 0.5 bad 1.0 bad 2.0 bad 4.0 avgerr rms A50 A90 A95 A99 time time/MP time/GD
Mask: nonocc all
Reset sort   Reference list
Reference
Description
Parameters
Running Environment
Loading...
[stat] error

Warning: Undefined variable $ids in /home/vision/public_html/stereo/snap3/2017_01_07/eval3/get_table.php on line 402
bad 2.0 (%)Weight
DateNameResAvgAustrAustrPBicyc2ClassClassECompuCrusaCrusaPDjembDjembLHoopsLivgrmNkubaPlantsStairs
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 290
im0im1
GT
nonocc
MP: 5.6
nd: 250
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 5.7
nd: 610
im0im1
GT
nonocc
MP: 1.5
nd: 256
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.5
nd: 800
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 320
im0im1
GT
nonocc
MP: 5.7
nd: 410
im0im1
GT
nonocc
MP: 5.9
nd: 320
im0im1
GT
nonocc
MP: 5.5
nd: 570
im0im1
GT
nonocc
MP: 5.6
nd: 320
im0im1
GT
nonocc
MP: 5.2
nd: 450
im0im1
GT
nonocc
07/25/141SGBM2Q126.63627.92812.13817.84213.72474.54616.23430.33226.33711.04064.44737.93925.83325.33429.33943.738
07/25/142SGBM1Q128.13928.33017.24419.04314.52557.93818.23531.83331.44213.24358.64438.64127.03725.93731.44159.746
07/25/143SGMQ121.23035.5339.573313.83616.52732.12223.34225.82916.7288.953639.83531.12822.62620.72221.33432.231
07/25/144SGBM1F328.44043.5399.093113.63425.93982.04914.42743.44030.3415.982759.34645.84428.53924.93220.13245.940
07/28/146SGBM1H224.03232.93110.83613.63316.22671.24314.72926.63023.0335.832553.84139.24225.63222.82818.82747.441
07/28/147SGMH218.72440.3364.54108.031422.93440.52714.62824.72710.1195.402229.61928.52423.92820.02014.22130.930
07/28/148SGMF325.33345.1414.3376.871132.24150.03413.01948.14418.3307.663029.61836.13431.24324.23124.53550.242
07/28/145Cens5H226.93747.1428.743011.93025.63745.33122.64140.63929.0399.933836.53038.64031.04225.03325.63644.639
08/25/149LPSH219.4256.14115.34219.24207.531396.05315.0309.61139.40175.182092.45327.42324.32923.02910.01225.627
08/27/1410LPSF320.3286.72126.06259.72219.871694.35214.12311.21611.2215.882689.35136.03320.52123.83016.02525.425
08/31/1411BSMQ141.54859.85025.84827.94838.94760.63933.34946.94237.34526.34764.84851.54742.64845.25042.84566.648
09/10/1412LAMC_DSMH226.23455.84711.93714.33918.33044.03021.33939.93829.5406.672831.12434.53128.84026.33830.14035.734
09/18/1413SNCCH222.23148.6436.98269.792225.73846.03215.23236.83616.6277.252923.11434.23026.73521.82719.93128.429
10/07/1414IDRH218.42337.5354.0867.491323.33540.62815.73324.52611.3225.462333.12626.02121.52521.72615.32221.220
11/12/1415LCUQ117.02124.7257.592811.62911.91927.91814.02219.32315.8268.103236.12929.12521.32418.41714.12023.823
01/21/1516TSGOF339.14734.13216.94320.04443.34855.43614.32554.14749.24833.95166.24945.94539.84742.64847.24752.643
04/08/1517REAFH231.44158.34830.95113.13245.35063.84030.94738.73725.3368.603439.33336.83527.03635.54618.22639.736
04/09/1518PFSF332.24265.15229.45012.13150.05170.84228.24544.64123.1347.853137.03137.73727.93836.04719.83035.735
04/17/1519TMAPH217.12220.2224.94178.131612.82130.02014.12427.93120.4315.091931.52523.11820.92319.01818.82818.016
04/20/1520MeshStereoH213.4165.9094.881510.82612.92210.6713.62012.2189.01145.392127.41523.51917.71621.02315.42320.919
08/28/1521MC-CNN-acrtH28.2965.5974.55115.9662.83311.4108.4458.3298.89132.71416.3914.1713.2713.026.40611.17
09/14/1523ELASF332.34350.9449.173211.02733.04288.25118.33647.34326.83811.74141.73637.43623.72728.84063.05142.837
09/14/1522ELASH227.33843.33812.54013.93823.73666.14120.43833.13420.53211.03943.93737.83826.43428.63938.34333.333
09/28/1524R-NCCF348.45126.22614.84130.24930.94072.94541.65277.75164.15127.44959.14571.95150.95133.94578.25380.851
10/13/1525MDPH212.61514.4184.991810.62510.71727.2178.11412.5198.07104.271630.42020.51512.6417.81613.41917.315
11/04/1526MC-CNN+RBSH28.6276.05105.16206.2483.27611.188.9178.87119.83183.21915.1815.9912.8613.547.0479.993
11/05/1527GCSVRH214.81917.1203.5038.221716.52847.43311.4169.75147.0683.17834.42827.12218.31719.21916.02419.318
12/18/1529INTSH214.81820.2214.5298.621811.61829.51913.72116.42010.3204.691827.61622.51720.72220.52111.51624.924
01/19/1630NTDEH27.6255.7284.3685.9252.83310.458.0235.3055.5462.40213.5514.1612.6513.956.39512.210
01/26/1632MC-CNN-fstH29.69107.35135.07197.18124.71916.81411.2147.3776.9772.82520.71217.41215.41215.197.90912.611
01/21/1631MCCNN_LayoutH29.1695.5365.63235.0613.59812.6119.97107.5388.86125.792423.01313.6515.01014.775.85210.44
02/18/1633LS-ELASF336.74453.54510.33515.84137.04583.65024.54349.14534.64313.94444.93845.74334.94429.14164.45262.747
03/15/1634MPSVQ143.54958.84933.95334.25137.94652.43530.84656.84951.05030.65056.94251.54844.64943.44944.24654.244
04/03/1635ICSGF345.65069.75319.14521.34643.64977.64736.95065.35040.44620.34553.64058.75046.55047.15160.74979.150
04/12/1636MeshStereoExtH27.2934.4123.9855.4043.17510.048.8964.6244.7753.491112.7312.4310.4214.567.8088.852
04/13/1637GlstereoH219.82720.7238.252913.93718.63134.62312.91825.42823.2358.613531.12330.62720.32025.43621.13322.722
04/24/1638HLSC_corH226.43526.52715.24221.04520.53335.72427.74433.13535.04411.94239.13234.22925.23132.84428.33822.721
04/28/1639JEMQ137.24535.73427.94930.65033.24343.02931.44849.54647.34726.54849.63946.04635.74530.84237.54255.845
05/12/1640PMSCH26.8713.4612.6816.1972.5416.9216.5413.9614.0422.37113.1412.3212.2316.2105.88310.85
05/28/1641APAP-StereoH27.4645.4344.91165.1125.171021.6169.5084.3124.2343.241014.379.7817.32113.436.3048.461
11/06/1528SOU4P-netH213.51723.1245.41226.39913.12330.52111.11316.42112.7243.13728.91717.11116.41416.91210.71514.512
07/03/1642LPUH210.51111.4153.1828.10156.081220.9159.8496.9464.0014.041433.92716.91015.21117.8159.121011.68
08/31/1643SEDF363.45254.34622.44772.95464.55371.44442.55380.15267.95249.85479.65074.45265.45455.15286.15491.654
09/14/1644SNP-RSMH28.9885.4654.85146.50103.37710.4610.1118.73109.37163.581214.3614.7814.9912.8110.11310.86
09/20/1645LFSIRQ170.15475.75460.35467.15272.45480.84853.75485.45483.85442.55391.25290.45364.15371.35461.55090.353
10/19/1646LW-CNNH27.2324.6533.9545.3032.63211.297.8624.3234.2232.43312.2213.4413.6814.884.72112.09
10/23/1647SIGMRFQ164.25360.05133.05267.95363.25299.55439.85184.85382.05335.25295.25491.55458.15265.85355.04888.652
11/07/1648SPSF319.62614.21712.33914.94012.02015.81219.13717.42215.4258.233330.92134.83230.64125.33428.33728.028
11/11/1649JMRH216.52027.9294.79138.621820.23237.62615.13124.22517.4294.471719.21022.01620.01921.1249.431116.214
11/14/1650DESH211.2127.80144.561210.2235.62119.75310.4129.19128.39114.211530.92217.51316.91517.11312.21815.313
11/15/1651MC-CNN-SSH212.31414.8197.202711.1287.621415.91314.32611.5179.01143.891319.71120.51416.31316.31112.11718.317
11/16/1652UCNNH220.52944.8409.773413.63418.22936.52512.81723.42412.4239.223739.53430.52624.83021.22519.12932.332
11/16/1653MCSCF311.31313.3165.962410.6248.69157.22211.31510.6157.4893.0763.10125.22019.01817.21410.31425.526
11/25/1654ADSMQ138.74640.43720.34627.34735.14455.93722.34056.14850.94924.24658.04356.34936.54632.14338.74469.749

Reference list