Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: Avoid to call import and export Arrow array for native execution #1055

Open
wants to merge 68 commits into
base: main
Choose a base branch
from
Open

fix: Avoid to call import and export Arrow array for native execution #1055

wants to merge 68 commits into from

Commits on Aug 13, 2024

  1. fix: Optimize not to call getNullCount as much as possible

    @kazuyukitanimura
    kazuyukitanimura committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    50d686e View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    532b9f6 View commit details
    Browse the repository at this point in the history

  3. fix: Optimize not to call getNullCount as much as possible

    @kazuyukitanimura
    kazuyukitanimura committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    388ea7f View commit details
    Browse the repository at this point in the history

  4. fix: Optimize not to call getNullCount as much as possible

    @kazuyukitanimura
    kazuyukitanimura committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    dbd4016 View commit details
    Browse the repository at this point in the history

  5. fix: Optimize not to call getNullCount as much as possible

    @kazuyukitanimura
    kazuyukitanimura committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    a773832 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. fix ci

    @kazuyukitanimura
    kazuyukitanimura committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f6176fb View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. fix ci

    @kazuyukitanimura
    kazuyukitanimura committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    87bcd03 View commit details
    Browse the repository at this point in the history

  2. fix ci

    @kazuyukitanimura
    kazuyukitanimura committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    a903b41 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    bc7136e View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. fix: Optimize CheckOverflow

    @kazuyukitanimura
    kazuyukitanimura committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    0d87c6e View commit details
    Browse the repository at this point in the history

  2. fix: Optimize CheckOverflow

    @kazuyukitanimura
    kazuyukitanimura committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    0cd44c0 View commit details
    Browse the repository at this point in the history

  3. fix: Optimize CheckOverflow

    @kazuyukitanimura
    kazuyukitanimura committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    9d68eed View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. fix: Optimize CheckOverflow

    @kazuyukitanimura
    kazuyukitanimura committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    d0569bc View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    7385cc8 View commit details
    Browse the repository at this point in the history

  3. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    efb4a50 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4c64265 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    027dd06 View commit details
    Browse the repository at this point in the history

  2. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    8e4ea8d View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    5df5309 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    c2e2874 View commit details
    Browse the repository at this point in the history

  2. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    5045374 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    2da220f View commit details
    Browse the repository at this point in the history

  2. chore: fix compatibility guide

    @kazuyukitanimura
    kazuyukitanimura committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    d4d03e8 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    513acd3 View commit details
    Browse the repository at this point in the history

  2. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    2af8b36 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    18fff6e View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    b50348f View commit details
    Browse the repository at this point in the history

  3. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    eaebd6d View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    93e350d View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    f93ba1d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    49f1903 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    8032c26 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    bf4d3e4 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    a6d5e77 View commit details
    Browse the repository at this point in the history

  2. Revert "fix: Remove export" 

    This reverts commit a6d5e77.
    @kazuyukitanimura
    kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    1967a68 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    7299ae9 View commit details
    Browse the repository at this point in the history

  4. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    81339a8 View commit details
    Browse the repository at this point in the history

  5. Revert "fix: Remove export" 

    This reverts commit 81339a8.
    @kazuyukitanimura
    kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    41a6695 View commit details
    Browse the repository at this point in the history

  6. "fix: Remove export" 

    This reverts commit 1967a68.
    @kazuyukitanimura
    kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    e356b8a View commit details
    Browse the repository at this point in the history

  7. fix: Fallback to Spark if named_struct contains duplicate field names (… 

    …apache#1016)
    @viirya @kazuyukitanimura
    viirya authored and kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    282c3e3 View commit details
    Browse the repository at this point in the history

  8. chore: Reserve memory for native shuffle writer per partition (apache… 

    …#988)

* chore: Reserve memory for native shuffle writer per partition

* Revise

* skip large partition number shuffle on macos runners

* For review
    @viirya @kazuyukitanimura
    viirya authored and kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    7fae9c5 View commit details
    Browse the repository at this point in the history

  9. chore: Bump arrow-rs to 53.1.0 and datafusion (apache#1001) 

    ## Which issue does this PR close?

## Rationale for this change

Arrow-rs 53.1.0 includes performance improvements 

## What changes are included in this PR?

Bumping arrow-rs to 53.1.0 and datafusion to a revision

## How are these changes tested?

existing tests
    @kazuyukitanimura
    kazuyukitanimura committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    37b1e9c View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    a3602df View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    765a387 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    cd0ae7e View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    bee3740 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    c2f7288 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    59ed00c View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    75dd04c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    dc2c0bf View commit details
    Browse the repository at this point in the history

  3. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    58cb5a2 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    df03371 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    01fd025 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    74043b5 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    5ac4408 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    10ffc64 View commit details
    Browse the repository at this point in the history

  2. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    14053ec View commit details
    Browse the repository at this point in the history

  3. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 8, 2024
    Configuration menu
    Copy the full SHA
    ed8f546 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    7ede86d View commit details
    Browse the repository at this point in the history

  2. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    e49d092 View commit details
    Browse the repository at this point in the history

  3. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    a8a38f7 View commit details
    Browse the repository at this point in the history

  4. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    adf5a90 View commit details
    Browse the repository at this point in the history

  5. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    0bf2415 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    203e16e View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    97960d7 View commit details
    Browse the repository at this point in the history

  2. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    ec72117 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Merge remote-tracking branch 'upstream/main' into optimize-null-count

    @kazuyukitanimura
    kazuyukitanimura committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    8a01335 View commit details
    Browse the repository at this point in the history

  2. fix: Remove export

    @kazuyukitanimura
    kazuyukitanimura committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    0c7a228 View commit details
    Browse the repository at this point in the history