[DO NOT MERGE] Run CI on 1.11 #583

avik-pal · 2024-04-11T02:57:04Z

No description provided.

github-actions

Benchmark Results

Benchmark suite	Current: `7b92729`	Previous: `baa2092`	Ratio
`Dense(2 => 2)/cpu/reverse/ReverseDiff (compiled)/(2, 128)`	`3639.25` ns	`3679.375` ns	`0.99`
`Dense(2 => 2)/cpu/reverse/Zygote/(2, 128)`	`7238.5` ns	`7207.4` ns	`1.00`
`Dense(2 => 2)/cpu/reverse/Tracker/(2, 128)`	`20809` ns	`20859` ns	`1.00`
`Dense(2 => 2)/cpu/reverse/ReverseDiff/(2, 128)`	`9644` ns	`9684.666666666666` ns	`1.00`
`Dense(2 => 2)/cpu/reverse/Flux/(2, 128)`	`8968.8` ns	`8986.666666666666` ns	`1.00`
`Dense(2 => 2)/cpu/reverse/SimpleChains/(2, 128)`	`4488.375` ns	`4574.75` ns	`0.98`
`Dense(2 => 2)/cpu/reverse/Enzyme/(2, 128)`	`1177.1629629629629` ns	`1169.9851851851852` ns	`1.01`
`Dense(2 => 2)/cpu/forward/NamedTuple/(2, 128)`	`1111.8853503184714` ns	`1115.9166666666667` ns	`1.00`
`Dense(2 => 2)/cpu/forward/ComponentArray/(2, 128)`	`1186.6715328467153` ns	`1181.2536231884058` ns	`1.00`
`Dense(2 => 2)/cpu/forward/Flux/(2, 128)`	`1786.9818181818182` ns	`1788.9636363636364` ns	`1.00`
`Dense(2 => 2)/cpu/forward/SimpleChains/(2, 128)`	`180.00414937759336` ns	`179.43360995850622` ns	`1.00`
`Dense(20 => 20)/cpu/reverse/ReverseDiff (compiled)/(20, 128)`	`17302` ns	`17392` ns	`0.99`
`Dense(20 => 20)/cpu/reverse/Zygote/(20, 128)`	`17633` ns	`17221` ns	`1.02`
`Dense(20 => 20)/cpu/reverse/Tracker/(20, 128)`	`37119.5` ns	`37329` ns	`0.99`
`Dense(20 => 20)/cpu/reverse/ReverseDiff/(20, 128)`	`27992` ns	`28302` ns	`0.99`
`Dense(20 => 20)/cpu/reverse/Flux/(20, 128)`	`19797` ns	`19887` ns	`1.00`
`Dense(20 => 20)/cpu/reverse/SimpleChains/(20, 128)`	`16882` ns	`16811` ns	`1.00`
`Dense(20 => 20)/cpu/reverse/Enzyme/(20, 128)`	`4345.142857142857` ns	`4346.714285714285` ns	`1.00`
`Dense(20 => 20)/cpu/forward/NamedTuple/(20, 128)`	`3869.75` ns	`3879.0625` ns	`1.00`
`Dense(20 => 20)/cpu/forward/ComponentArray/(20, 128)`	`3967.5` ns	`3961.125` ns	`1.00`
`Dense(20 => 20)/cpu/forward/Flux/(20, 128)`	`4913.428571428572` ns	`4987.857142857143` ns	`0.99`
`Dense(20 => 20)/cpu/forward/SimpleChains/(20, 128)`	`1655.1` ns	`1656.1` ns	`1.00`
`Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 3, 128)`	`46630528` ns	`41206998.5` ns	`1.13`
`Conv((3, 3), 3 => 3)/cpu/reverse/Zygote/(64, 64, 3, 128)`	`58110807` ns	`58084277` ns	`1.00`
`Conv((3, 3), 3 => 3)/cpu/reverse/Tracker/(64, 64, 3, 128)`	`111532215` ns	`95974627` ns	`1.16`
`Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff/(64, 64, 3, 128)`	`106783695.5` ns	`84598711` ns	`1.26`
`Conv((3, 3), 3 => 3)/cpu/reverse/Flux/(64, 64, 3, 128)`	`106110031` ns	`78159912` ns	`1.36`
`Conv((3, 3), 3 => 3)/cpu/reverse/SimpleChains/(64, 64, 3, 128)`	`12022866.5` ns	`11772504` ns	`1.02`
`Conv((3, 3), 3 => 3)/cpu/reverse/Enzyme/(64, 64, 3, 128)`	`8451645` ns	`18049386` ns	`0.47`
`Conv((3, 3), 3 => 3)/cpu/forward/NamedTuple/(64, 64, 3, 128)`	`7040823` ns	`7017401` ns	`1.00`
`Conv((3, 3), 3 => 3)/cpu/forward/ComponentArray/(64, 64, 3, 128)`	`7004926` ns	`6988900` ns	`1.00`
`Conv((3, 3), 3 => 3)/cpu/forward/Flux/(64, 64, 3, 128)`	`18608830` ns	`12026497` ns	`1.55`
`Conv((3, 3), 3 => 3)/cpu/forward/SimpleChains/(64, 64, 3, 128)`	`6388819` ns	`6400683` ns	`1.00`
`vgg16/cpu/reverse/Zygote/(32, 32, 3, 16)`	`703079865.5` ns	`707312690.5` ns	`0.99`
`vgg16/cpu/reverse/Zygote/(32, 32, 3, 64)`	`2852092995` ns	`2891978969` ns	`0.99`
`vgg16/cpu/reverse/Zygote/(32, 32, 3, 2)`	`146441488.5` ns	`140302461` ns	`1.04`
`vgg16/cpu/reverse/Tracker/(32, 32, 3, 16)`	`933713790` ns	`890688154` ns	`1.05`
`vgg16/cpu/reverse/Tracker/(32, 32, 3, 64)`	`2940602031` ns	`2714950301` ns	`1.08`
`vgg16/cpu/reverse/Tracker/(32, 32, 3, 2)`	`215604417.5` ns	`225976751` ns	`0.95`
`vgg16/cpu/reverse/Flux/(32, 32, 3, 16)`	`827744969` ns	`801249895` ns	`1.03`
`vgg16/cpu/reverse/Flux/(32, 32, 3, 64)`	`3044927816` ns	`2961915053` ns	`1.03`
`vgg16/cpu/reverse/Flux/(32, 32, 3, 2)`	`149311703` ns	`139932281.5` ns	`1.07`
`vgg16/cpu/forward/NamedTuple/(32, 32, 3, 16)`	`174138655.5` ns	`173883578.5` ns	`1.00`
`vgg16/cpu/forward/NamedTuple/(32, 32, 3, 64)`	`650837835` ns	`651910781` ns	`1.00`
`vgg16/cpu/forward/NamedTuple/(32, 32, 3, 2)`	`45187017` ns	`34366107` ns	`1.31`
`vgg16/cpu/forward/ComponentArray/(32, 32, 3, 16)`	`164627116.5` ns	`164939253` ns	`1.00`
`vgg16/cpu/forward/ComponentArray/(32, 32, 3, 64)`	`630571399` ns	`638849519` ns	`0.99`
`vgg16/cpu/forward/ComponentArray/(32, 32, 3, 2)`	`45859496` ns	`30235503` ns	`1.52`
`vgg16/cpu/forward/Flux/(32, 32, 3, 16)`	`201798356` ns	`188881068` ns	`1.07`
`vgg16/cpu/forward/Flux/(32, 32, 3, 64)`	`797347549.5` ns	`754357005.5` ns	`1.06`
`vgg16/cpu/forward/Flux/(32, 32, 3, 2)`	`38904621.5` ns	`38172946` ns	`1.02`
`Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 64, 128)`	`1187501424` ns	`1238098344.5` ns	`0.96`
`Conv((3, 3), 64 => 64)/cpu/reverse/Zygote/(64, 64, 64, 128)`	`1860951297.5` ns	`1879598642` ns	`0.99`
`Conv((3, 3), 64 => 64)/cpu/reverse/Tracker/(64, 64, 64, 128)`	`2048061849` ns	`2103828637` ns	`0.97`
`Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff/(64, 64, 64, 128)`	`2526914565` ns	`2621168429` ns	`0.96`
`Conv((3, 3), 64 => 64)/cpu/reverse/Flux/(64, 64, 64, 128)`	`1922592823.5` ns	`1873350018` ns	`1.03`
`Conv((3, 3), 64 => 64)/cpu/reverse/Enzyme/(64, 64, 64, 128)`	`347241798.5` ns	`555155171` ns	`0.63`
`Conv((3, 3), 64 => 64)/cpu/forward/NamedTuple/(64, 64, 64, 128)`	`318582424` ns	`323862659.5` ns	`0.98`
`Conv((3, 3), 64 => 64)/cpu/forward/ComponentArray/(64, 64, 64, 128)`	`317495923.5` ns	`319815055` ns	`0.99`
`Conv((3, 3), 64 => 64)/cpu/forward/Flux/(64, 64, 64, 128)`	`372380604.5` ns	`381155916` ns	`0.98`
`Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 1, 128)`	`11896810.5` ns	`11907678.5` ns	`1.00`
`Conv((3, 3), 1 => 1)/cpu/reverse/Zygote/(64, 64, 1, 128)`	`17938514` ns	`17975316` ns	`1.00`
`Conv((3, 3), 1 => 1)/cpu/reverse/Tracker/(64, 64, 1, 128)`	`19143148` ns	`19370540.5` ns	`0.99`
`Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff/(64, 64, 1, 128)`	`23924566.5` ns	`23997074` ns	`1.00`
`Conv((3, 3), 1 => 1)/cpu/reverse/Flux/(64, 64, 1, 128)`	`17984767.5` ns	`18030252` ns	`1.00`
`Conv((3, 3), 1 => 1)/cpu/reverse/SimpleChains/(64, 64, 1, 128)`	`1161692` ns	`1176666` ns	`0.99`
`Conv((3, 3), 1 => 1)/cpu/reverse/Enzyme/(64, 64, 1, 128)`	`2523746` ns	`5932006` ns	`0.43`
`Conv((3, 3), 1 => 1)/cpu/forward/NamedTuple/(64, 64, 1, 128)`	`2050103` ns	`2047003` ns	`1.00`
`Conv((3, 3), 1 => 1)/cpu/forward/ComponentArray/(64, 64, 1, 128)`	`2026629` ns	`2037245` ns	`0.99`
`Conv((3, 3), 1 => 1)/cpu/forward/Flux/(64, 64, 1, 128)`	`2062216` ns	`2069660` ns	`1.00`
`Conv((3, 3), 1 => 1)/cpu/forward/SimpleChains/(64, 64, 1, 128)`	`201957` ns	`203548` ns	`0.99`
`Dense(200 => 200)/cpu/reverse/ReverseDiff (compiled)/(200, 128)`	`290934` ns	`295038` ns	`0.99`
`Dense(200 => 200)/cpu/reverse/Zygote/(200, 128)`	`265200.5` ns	`268278` ns	`0.99`
`Dense(200 => 200)/cpu/reverse/Tracker/(200, 128)`	`363414.5` ns	`369396` ns	`0.98`
`Dense(200 => 200)/cpu/reverse/ReverseDiff/(200, 128)`	`406970.5` ns	`411339.5` ns	`0.99`
`Dense(200 => 200)/cpu/reverse/Flux/(200, 128)`	`273200` ns	`275196` ns	`0.99`
`Dense(200 => 200)/cpu/reverse/SimpleChains/(200, 128)`	`407261` ns	`417436` ns	`0.98`
`Dense(200 => 200)/cpu/reverse/Enzyme/(200, 128)`	`83326` ns	`83805.5` ns	`0.99`
`Dense(200 => 200)/cpu/forward/NamedTuple/(200, 128)`	`81042` ns	`81742` ns	`0.99`
`Dense(200 => 200)/cpu/forward/ComponentArray/(200, 128)`	`82423.5` ns	`83805` ns	`0.98`
`Dense(200 => 200)/cpu/forward/Flux/(200, 128)`	`86552` ns	`87463` ns	`0.99`
`Dense(200 => 200)/cpu/forward/SimpleChains/(200, 128)`	`105196` ns	`104605` ns	`1.01`
`Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 16, 128)`	`195535315` ns	`207927735` ns	`0.94`
`Conv((3, 3), 16 => 16)/cpu/reverse/Zygote/(64, 64, 16, 128)`	`327097715` ns	`328556229` ns	`1.00`
`Conv((3, 3), 16 => 16)/cpu/reverse/Tracker/(64, 64, 16, 128)`	`433967146.5` ns	`426297886` ns	`1.02`
`Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff/(64, 64, 16, 128)`	`460238893.5` ns	`449822254.5` ns	`1.02`
`Conv((3, 3), 16 => 16)/cpu/reverse/Flux/(64, 64, 16, 128)`	`421556149` ns	`416626671` ns	`1.01`
`Conv((3, 3), 16 => 16)/cpu/reverse/SimpleChains/(64, 64, 16, 128)`	`325140160.5` ns	`356307340` ns	`0.91`
`Conv((3, 3), 16 => 16)/cpu/reverse/Enzyme/(64, 64, 16, 128)`	`51367241` ns	`102079450.5` ns	`0.50`
`Conv((3, 3), 16 => 16)/cpu/forward/NamedTuple/(64, 64, 16, 128)`	`43898898` ns	`43917976` ns	`1.00`
`Conv((3, 3), 16 => 16)/cpu/forward/ComponentArray/(64, 64, 16, 128)`	`43621269` ns	`43754303.5` ns	`1.00`
`Conv((3, 3), 16 => 16)/cpu/forward/Flux/(64, 64, 16, 128)`	`57711517.5` ns	`57211297` ns	`1.01`
`Conv((3, 3), 16 => 16)/cpu/forward/SimpleChains/(64, 64, 16, 128)`	`28388202` ns	`28500022` ns	`1.00`
`Dense(2000 => 2000)/cpu/reverse/ReverseDiff (compiled)/(2000, 128)`	`18769569` ns	`19110514` ns	`0.98`
`Dense(2000 => 2000)/cpu/reverse/Zygote/(2000, 128)`	`19460090` ns	`19613738` ns	`0.99`
`Dense(2000 => 2000)/cpu/reverse/Tracker/(2000, 128)`	`23222157` ns	`23555064.5` ns	`0.99`
`Dense(2000 => 2000)/cpu/reverse/ReverseDiff/(2000, 128)`	`24096859` ns	`24249957.5` ns	`0.99`
`Dense(2000 => 2000)/cpu/reverse/Flux/(2000, 128)`	`19567711` ns	`19704581` ns	`0.99`
`Dense(2000 => 2000)/cpu/reverse/Enzyme/(2000, 128)`	`6516573` ns	`6552337` ns	`0.99`
`Dense(2000 => 2000)/cpu/forward/NamedTuple/(2000, 128)`	`6514068` ns	`6544616` ns	`1.00`
`Dense(2000 => 2000)/cpu/forward/ComponentArray/(2000, 128)`	`6480756` ns	`6523364` ns	`0.99`
`Dense(2000 => 2000)/cpu/forward/Flux/(2000, 128)`	`6507756` ns	`6567641` ns	`0.99`

This comment was automatically generated by workflow using github-action-benchmark.

avik-pal · 2024-06-01T21:21:50Z

Failing just because of AMDGPU

avik-pal force-pushed the ap/test1.11 branch from 483a721 to d8f571b Compare April 11, 2024 03:04

github-actions bot reviewed Apr 11, 2024

View reviewed changes

avik-pal force-pushed the ap/test1.11 branch from d8f571b to 0014d69 Compare April 28, 2024 05:24

avik-pal force-pushed the ap/test1.11 branch from 0014d69 to 9d7842d Compare May 28, 2024 02:47

Run CI on 1.11

7b92729

avik-pal force-pushed the ap/test1.11 branch from 9d7842d to 7b92729 Compare May 31, 2024 01:12

avik-pal closed this Jun 1, 2024

avik-pal deleted the ap/test1.11 branch June 1, 2024 21:21

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[DO NOT MERGE] Run CI on 1.11 #583

[DO NOT MERGE] Run CI on 1.11 #583

avik-pal commented Apr 11, 2024

github-actions bot left a comment •

edited

Loading

avik-pal commented Jun 1, 2024

[DO NOT MERGE] Run CI on 1.11 #583

[DO NOT MERGE] Run CI on 1.11 #583

Conversation

avik-pal commented Apr 11, 2024

github-actions bot left a comment • edited Loading

Choose a reason for hiding this comment

Benchmark Results

avik-pal commented Jun 1, 2024

github-actions bot left a comment •

edited

Loading