Kyuubi 1.1.0 release note

[ulysses-you]

Changelog

v1.1.0-rc3 (09/03/2021)

No changelog for this release.

---

v1.1.0-rc2 (08/03/2021)

Bug

• [Bug][Test] Error running 'select function' command #397

---

v1.1.0-rc1 (08/03/2021)

Bug

• [Bug] Can not access hivevar set by beeline --hivevar #383
• [Bug] FetchOrientation.FETCH_FIRST is not handled properly #360

Feature

• [Feature] [Feature Request] Support run kyuubi-server in the foreground #312
• [Feature] GetTables supports DSv2 and keeps its backward compatibility #309

closed

• [closed] Move to hadoop shaded client #398
• [closed] Clean up discovery service before engine stop in connection share level #386
• [closed] Release session if shared level is CONNECTION #381
• [closed] Auto upload test log in GitHub Actions #372
• [closed] THRIFT-4858 causes metadata operations being flaky #368
• [closed] Log Framework conflict #363
• [closed] Avoid using HiveResult #350
• [closed] Add Spark 3.1 profile #298

dependencies

• [dependencies] Make distribution bundle Spark optional #377

enhancement

• [enhancement][experimental] GetColumns supports DSv2 and keeps its backward compatibility #310

question

• [question] DBeaver try conect 'jdbc:hive2//ip:port' fail #384
• [question] Does session have a timeout cleanup mechanism? #347

[ulysses-you]

cc @pan3793 @yaooqinn

[ulysses-you]

This note created by https://github.com/github-tools/github-release-notes

[pan3793]

It almost looks good! Only one thing I noticed that Bug Feature start with UPPER CASE, but others start with lower case. Can we align them?

[ulysses-you]

Seems it comes from the github label, which has different case. We may need cleanup it manul if we want to do this ..

[yaooqinn]

https://github.com/yaooqinn/kyuubi/milestone/13?closed=1 why the list is smaller than 1.1 milestone

[ulysses-you]

I guess it only collect the issue, without pr.

[yaooqinn]

It looks ugly :(

how about glog

• 471dbbc (HEAD -> master) [KYUUBI [DOC] Access Kyuubi with Hive JDBC and ODBC Drivers #411] [DOC] Access Kyuubi with Hive JDBC and ODBC Drivers
• 3eefea6 [KYUUBI Failed to start Spark 3.1 with error msg 'Cannot modify the value of a Spark config' #410] Add Spark-3.1 trouble shooting
• 57ed76f [KYUUBI Fix engine log does not be overwrite #408] Fix engine log does not be overwrite
• e971732 [KYUUBI Auto update release note #407] Auto update release note
• e2fd967 [KYUUBI Error running 'select function' command #397] Add test case for querying columns with dots
• 016277d [KYUUBI Create GitHub Release only once #406] Create GitHub Release only once
• 5e2a129 Prepare Kyuubi v1.2.0
• 183e18f [KYUUBI How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi #404] How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
• 03b7112 (tag: v1.1.0-rc1, tag: v1.1.0-rc0, tag: v1.1) [KYUUBI FIx flaky test in ConnectionLevelSparkEngineSuite #403] FIx flaky test in ConnectionLevelSparkEngineSuite
• 9cb507d [KYUUBI [WIP] FIx flaky test in ConnectionLevelSparkEngineSuite #395] [WIP] FIx flaky test in ConnectionLevelSparkEngineSuite
• 352b4eb [KYUUBI Implement a simpler toHiveString to convert spark row #400] Implement a simpler toHiveString to convert spark row
• 8e83245 [KYUUBI Remove hadoop suffix from tarball name when dist —without-spark #402] Remove hadoop suffix from tarball name when dist —without-spark
• 562c458 [KYUUBI Move to hadoop shaded client #398][FOLLOWUP] exclude unused jars
• 4abc3ff [KYUUBI Move to hadoop shaded client #398] Move to hadoop shaded client
• 8dd54a2 [KYUUBI Can not access hivevar set by beeline --hivevar  #383] Support beeline --hivevar --hiveconf
• 874c71c [KYUUBI Add Backward Compatibility Checker for Compile with Spark 3.0 but Run on 3.1 #396] Add Backward Compatibility Checker for Compile with Spark 3.0 but Run on 3.1
• 25d2d58 [KYUUBI Add Support for Hadoop 3.2 #393] Add Support for Hadoop 3.2
• 2e33158 [KYUUBI Add Spark 3.1 profile #298]Add Support for Apache Spark 3.1.1
• aa878e4 [KYUUBI Clean up discovery service before engine stop in connection share level #386] Clean up discovery service before engine stop in connection share level
• 8e8679e [KYUUBI Remove netty dependency #392] Remove netty dependency
• d10b17d [KYUUBI Bump up guava to 14.0.1 #391] Bump up guava to 14.0.1
• e49ff88 [KYUUBI Replace abbr in doc #390] Replace abbr in doc
• f83faa8 [KYUUBI Bump up curator to 2.12.0 #389] Bump up curator to 2.12.0
• 3d0f050 [KYUUBI How To Use Spark Adaptive Query Execution (AQE) in Kyuubi #388] How To Use Spark Adaptive Query Execution (AQE) in Kyuubi

[ulysses-you]

I just find some config, how about this

Changelog

v1.1.0 (10/03/2021)

• [KYUUBI #413] [MINOR]: remove unused class import - @MyLanPangzi
• [KYUUBI #412] [MINOR] Simplify ProcBuilder code - @MyLanPangzi
• [KYUUBI #411] [DOC] Access Kyuubi with Hive JDBC and ODBC Drivers - @yaooqinn

---

v1.1.0-rc3 (09/03/2021)

• [KYUUBI #408] Fix engine log does not be overwrite - @ulysses-you

---

v1.1.0-rc2 (08/03/2021)

• [KYUUBI #397] Add test case for querying columns with dots - @Honglun
• [KYUUBI #406] Create GitHub Release only once - @yaooqinn
• Prepare Kyuubi v1.2.0 - @yaooqinn

---

v1.1.0-rc1 (08/03/2021)

• [KYUUBI #403] FIx flaky test in ConnectionLevelSparkEngineSuite - @ulysses-you
• [KYUUBI #395] [WIP] FIx flaky test in ConnectionLevelSparkEngineSuite - @ulysses-you
• [KYUUBI #400] Implement a simpler toHiveString to convert spark row - @yaooqinn
• [KYUUBI #402] Remove hadoop suffix from tarball name when dist —without-spark - @pan3793
• [KYUUBI #398][FOLLOWUP] exclude unused jars - @pan3793
• [KYUUBI #398] Move to hadoop shaded client - @pan3793
• [KYUUBI #383] Support beeline --hivevar --hiveconf - @pan3793
• [KYUUBI #396] Add Backward Compatibility Checker for Compile with Spark 3.0 but Run on 3.1 - @yaooqinn
• [KYUUBI #393] Add Support for Hadoop 3.2 - @yaooqinn
• [KYUUBI #298]Add Support for Apache Spark 3.1.1 - @yaooqinn
• [KYUUBI #386] Clean up discovery service before engine stop in connection share level - @ulysses-you
• [KYUUBI #392] Remove netty dependency - @yaooqinn
• [KYUUBI #391] Bump up guava to 14.0.1 - @yaooqinn
• [KYUUBI #390] Replace abbr in doc - @pan3793
• [KYUUBI #389] Bump up curator to 2.12.0 - @yaooqinn
• [KYUUBI #388] How To Use Spark Adaptive Query Execution (AQE) in Kyuubi - @yaooqinn
• [KYUUBI #385] Improve pass config between kyuubi and spark engine - @ulysses-you
• [KYUUBI #381] Release session if shared level is CONNECTION - @ulysses-you
• [KYUUBI #380] [FOLLOWUP #377] change default distribution bundle name, and distribute without spark bundle - @pan3793
• [KYUUBI #379] Improve engine log capture - @yaooqinn
• [KYUUBI #377] build/dist support --spark-provided - @pan3793
• [KYUUBI #376] Use spark-hive instead of spark-hive-thriftserver in engine test - @yaooqinn
• [KYUUBI #375] THRIFT-4858 causes metadata operations being flaky - @yaooqinn
• [KYUUBI #374] [DOC] Add Collaborators page - @pan3793
• [KYUUBI #372] Auto upload unit-tests.log - @pan3793
• [KYUUBI #371] Avoid creating useless operation log for meta operation - @yaooqinn
• [KYUUBI #360] Correct handle getNextRowSet with FETCH_PRIOR FETCH_FIRST - @pan3793
• [KYUUBI #369] Using a lightweight zk client for kyuubi session - @yaooqinn
• [KYUUBI #367] Engine terminating checker should start after exposed - @yaooqinn
• [KYUUBI #365] Support user specify app name and tag - @ulysses-you
• [KYUUBI #363] exclude hive-shims unused dependencies - @pan3793
• [KYUUBI #361] Remove Hive Suffix for built in - @yaooqinn
• [KYUUBI #310] GetColumns supports DSv2 and keeps its backward compatibility - @yaooqinn
• [KYUUBI #356] Fix missing default versions - @yaooqinn
• [KYUUBI #356] Update built-in Spark version to 3.0.2 - @ulysses-you
• [KYUUBI #347] The 'lastIdleTime' needs to be updated after the last expired Handle has been cleaned - @Honglun
• [KYUUBI #350] Avoid using HiveResult - @pan3793
• [KYUUBI #312] Support run kyuubi in foreground - @pan3793
• [KYUUBI #349] Fix typo - @yangrong688
• [KYUUBI #309] GetTables supports DSv2 and keeps its backward compatibility - @yaooqinn
• [KYUUBI #347]Closing expired operations does not require updating 'lastAccessTime' - @Honglun

[yaooqinn]

LGTM

[yaooqinn]

Is it able to group them to Feature/Bug/Doc/Others

[yaooqinn]

some patch seems belong to the master branch

[ulysses-you]

Is it able to group them to Feature/Bug/Doc/Others

A liitle hard. This log is based on commits not issues.

some patch seems belong to the master branch

Seems it get commits use the tag date ..

[yaooqinn]

I'd like our release note template to be like this (we can keep update!)

Anouncing Kyuubi 1.1.0

Part.1 - Greeting
Hi, xxxxx...

• release tag link
• Doc link
• milestone link

HighLighting

Part.2 - HighLighting, manually highlight some PR that brings remarkable feature, such as Spark 3.1 support

Breaking Changes

Part.3 - Breaking Changes, manually add some PR that breaks with the last stable release if any

Features

Part 4 autogen

Bugs

Part 5 autogen

Thanks

WDYT?

[ulysses-you]

Yes, we can do this. It's so kind to provide the clear note and it's always useful.

Otherhand, I believe almost people won't read the commit log.

[yaooqinn]

any update on this？

[ulysses-you]

Has updated a rough note..

[yaooqinn]

I've updated the release note, please review thanks

[pan3793]

LGTM, and I tuned some spaces in HighLighting

[Honglun]

There’s no space between some issue id and the title, e.g. [KYUUBI #307]GetCatalogs, [KYUUBI #347]Closing, [KYUUBI #298]Add

[pan3793]

Let me recheck

[pan3793]

Reformatted, and tuned some descriptions, it should look better now.