Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchmark: add bls12 synthetic loop example #379

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Conversation

axic
Copy link
Member

@axic axic commented Jun 8, 2020

No description provided.

@codecov
Copy link

codecov bot commented Jun 8, 2020

Codecov Report

Merging #379 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #379   +/-   ##
=======================================
  Coverage   98.72%   98.72%           
=======================================
  Files          56       56           
  Lines        8660     8660           
=======================================
  Hits         8550     8550           
  Misses        110      110           

@axic
Copy link
Member Author

axic commented Jun 25, 2020

@chfast @gumb0 should we merge this as a good basis for benchmarking comparison?

@chfast
Copy link
Collaborator

chfast commented Jun 25, 2020

How long does it run?

@chfast
Copy link
Collaborator

chfast commented Jun 25, 2020

How long does it run?

It looks like it runs 2x faster than the slowest pairing benchmark. Fine to me then.

@axic
Copy link
Member Author

axic commented Jun 26, 2020

@cdetrio do you have a newer/different build of this?

@axic axic marked this pull request as ready for review June 26, 2020 13:48
@axic
Copy link
Member Author

axic commented Jul 29, 2020

My benchmarks between 0.2.0 and 0.3.0:

fizzy/parse/bls12_websnark                    1239 us         1188 us         1170 rate=72.6548M/s size=86.324k
 wabt/parse/bls12_websnark                    3617 us         3575 us          401 rate=24.1454M/s size=86.324k
wasm3/parse/bls12_websnark                    98.7 us         96.8 us        12053 rate=892.146M/s size=86.324k
fizzy/instantiate/bls12_websnark              1324 us         1308 us         1014
 wabt/instantiate/bls12_websnark              4869 us         4330 us          361
wasm3/instantiate/bls12_websnark               150 us          145 us         9035
fizzy/execute/bls12_websnark/synth          507587 us       491826 us            3
 wabt/execute/bls12_websnark/synth          448672 us       437398 us            3
wasm3/execute/bls12_websnark/synth           98672 us        94976 us           15

vs

fizzy/parse/bls12_websnark                    1429 us         1411 us          979 rate=61.1893M/s size=86.324k
 wabt/parse/bls12_websnark                    3645 us         3539 us          402 rate=24.3947M/s size=86.324k
wasm3/parse/bls12_websnark                     103 us         97.8 us        13425 rate=882.507M/s size=86.324k
fizzy/instantiate/bls12_websnark              1736 us         1652 us          885
 wabt/instantiate/bls12_websnark              4411 us         4180 us          355
wasm3/instantiate/bls12_websnark               152 us          147 us         8261
fizzy/execute/bls12_websnark/synth          409873 us       403466 us            3
 wabt/execute/bls12_websnark/synth          447030 us       434259 us            3
wasm3/execute/bls12_websnark/synth           95460 us        94336 us           15

@axic axic force-pushed the bench-bls12 branch 2 times, most recently from 9865474 to 7cb64f5 Compare August 23, 2020 10:22
@chfast
Copy link
Collaborator

chfast commented Oct 19, 2020

Can we finally merge this?

@axic
Copy link
Member Author

axic commented May 27, 2022

Can we finally merge this?

@chfast I think the only delay here was whether this would cause anything else to be GPL-3.0, because this code is.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants