Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support protobuf struct type #205

Open
tscottcoombes1 opened this issue Nov 26, 2024 · 0 comments
Open

Support protobuf struct type #205

tscottcoombes1 opened this issue Nov 26, 2024 · 0 comments
Labels
Type: enhancement New feature or request

Comments

@tscottcoombes1
Copy link
Contributor

Describe the enhancement requested

current

no support for protobuf struct type, due to recursion issue, Struct -> Value -> Struct -> Value ....

message Struct {
  // Unordered map of dynamically typed values.
  map<string, Value> fields = 1;
}

message Value {
  // The kind of value.
  oneof kind {
    // Represents a null value.
    NullValue null_value = 1;
    // Represents a double value.
    double number_value = 2;
    // Represents a string value.
    string string_value = 3;
    // Represents a boolean value.
    bool bool_value = 4;
    // Represents a structured value.
    Struct struct_value = 5;
    // Represents a repeated `Value`.
    ListValue list_value = 6;
  }
}

expected

add support

suggest following pyspark impl: https://spark.apache.org/docs/latest/sql-data-sources-protobuf.html#handling-circular-references-protobuf-fields

Component(s)

Other

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant