-
-
Notifications
You must be signed in to change notification settings - Fork 13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Make @adjoint unthunk pullback inputs #17
Conversation
Replaced my internal macro _adjoint_keepthunks in Zygote.
See FluxML/Zygote.jl#966 for discussion. |
Note: the |
@oxinabox and @DhairyaLGandhi - if you have a moment, could you check if we can move forward with this in the current form? We'll need a release with this before FluxML/Zygote.jl#966 can go through full CI. I would suggest that this can be released as as patch release, since it's non-breaking and doesn't introduce any new public features. |
I approve this. |
Sure, thanks! |
@DhairyaLGandhi will you give us your blessing? :-) |
bump |
@DhairyaLGandhi , @oxinabox , now that ChainRulesCore v1.0 is out, can we proceed with this, so that we can merge FluxML/Zygote.jl#966 ? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I believe we have since wanted to move to not unthunk quite so aggressively. Let me revisit FluxML/Zygote.jl#966 too!
Sorry to be a pest - good to merge now, @DhairyaLGandhi ? |
I think this is alright for now. I do wonder about some of the longer term effects of 966 (we should discuss those there), but seeing what implicit changes happen with generating gradients and the behaviour of rrules in general for a fairly spread out system. I have wanted to run some benchmarks with some more dP kinds of tools like Flux3D, ChemistryFeaturization and all too, which is what I've also been up to over the past couple weeks :) |
Oh sure! Can we have a release of ZygoteRules with this PR first though (it's non-breaking), so that we can run full CI on FluxML/Zygote.jl#966? |
Gente bump regarding merge, @DhairyaLGandhi |
I don't mean to nag @DhairyaLGandhi, but it's been a while. Can we move forward with this? |
I think I'm fine with merging this but be careful about 966, this has been on my radar :) |
@DhairyaLGandhi I don't think @oschulz has merge rights. So if you are fine with this then you will have to merge it? |
No, I don't, you guys will have to merge and make a release, so we can run full CI on FluxML/Zygote.jl#966:
|
It seems I don't have merge rights either. |
I don't have merge rights as well @DhairyaLGandhi |
Ah missed this. Thanks all |
Thanks @DhairyaLGandhi ! Could you release a ZygoteRules v0.2.2, so I can finish up FluxML/Zygote.jl#966 with full CI? |
@DhairyaLGandhi , could you tag a new release of ZygoteRules (should be v0.2.2, I guess)? It would make it much easier to proceed with FluxML/Zygote.jl#966. |
Required to support FluxML/Zygote.jl#966