Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AMORO-3118][Improvement]: Move iceberg codes from amoro-core to a new module amoro-iceberg #3108

Merged
merged 3 commits into from
Aug 23, 2024

Conversation

baiyangtx
Copy link
Contributor

@baiyangtx baiyangtx commented Aug 16, 2024

Why are the changes needed?

Currently, there are too many logics related to mixed-format in our amoro-core module.

In order to make amoro to support multiple formats better, amoro needs to have the ability to run without Iceberg.

Therefore, I moved the codes related to mixed-format in amoro-core to the mixed-format module.

In the future, the amoro-core module should focus on the interface definitions across formats.

close #3118

Brief change log

I moved all the codes related to mixed-format in amoro-core to a new module amoro-mixed-format/amoro-mixed-format-core, and only retained some common codes in core, such as those related to Client and UnifiedCatalog.

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before making a pull request

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@github-actions github-actions bot added module:mixed-flink Flink moduel for Mixed Format module:core Core module module:ams-server Ams server module module:mixed-hive Hive moduel for Mixed Format type:build labels Aug 16, 2024
@baiyangtx baiyangtx force-pushed the amoro-core-without-iceberg branch 3 times, most recently from a4bd588 to e2bee39 Compare August 17, 2024 07:29
@github-actions github-actions bot added the module:mixed-spark Spark module for Mixed Format label Aug 17, 2024
@baiyangtx baiyangtx force-pushed the amoro-core-without-iceberg branch from a7b7224 to faebed7 Compare August 19, 2024 08:39
@baiyangtx baiyangtx marked this pull request as ready for review August 19, 2024 08:39
@baiyangtx baiyangtx changed the title [DRAFT][Improvement]: Move mixed-format codes from core to a new module amoro-mixed-format-core [Improvement]: Move mixed-format codes from core to a new module amoro-mixed-format-core Aug 19, 2024
@baiyangtx baiyangtx changed the title [Improvement]: Move mixed-format codes from core to a new module amoro-mixed-format-core [AMORO-3118][Improvement]: Move mixed-format codes from core to a new module amoro-mixed-format-core Aug 19, 2024
@baiyangtx baiyangtx force-pushed the amoro-core-without-iceberg branch 2 times, most recently from dc73e22 to 0c13876 Compare August 20, 2024 02:34
@github-actions github-actions bot added the module:mixed-trino trino module for Mixed Format label Aug 20, 2024
@baiyangtx baiyangtx force-pushed the amoro-core-without-iceberg branch 2 times, most recently from b1c81b0 to acb6f38 Compare August 21, 2024 12:16
@baiyangtx baiyangtx changed the title [AMORO-3118][Improvement]: Move mixed-format codes from core to a new module amoro-mixed-format-core [AMORO-3118][Improvement]: Move iceberg codes from amoro-core to a new module amoro-iceberg Aug 21, 2024
@baiyangtx baiyangtx force-pushed the amoro-core-without-iceberg branch from acb6f38 to bff5939 Compare August 22, 2024 02:28
Copy link
Contributor

@zhoujinsong zhoujinsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left some minor suggestions, PTAL. @baiyangtx

Copy link
Contributor

@zhoujinsong zhoujinsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@zhoujinsong zhoujinsong merged commit 7f70f01 into apache:master Aug 23, 2024
4 checks passed
@baiyangtx baiyangtx deleted the amoro-core-without-iceberg branch August 23, 2024 03:30
@czy006 czy006 added this to the Release 0.8.0 milestone Aug 28, 2024
@Aireed Aireed mentioned this pull request Dec 4, 2024
33 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module:ams-server Ams server module module:core Core module module:mixed-flink Flink moduel for Mixed Format module:mixed-hive Hive moduel for Mixed Format module:mixed-spark Spark module for Mixed Format module:mixed-trino trino module for Mixed Format type:build
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Subtask]: Decouple Amoro Core from Iceberg to achieve equal support for different table formats
3 participants