[luci/service] Support dynamic shape inference for reshape

[jongwonyang]

This commit supports dynamic shape inference for reshape operation

Dynamic shape inference algorithm

from: Samsung#13927 (comment), Samsung#13927 (comment)

• CircleReshape always has two inputs: tensor and shape.
  • otherwise, throw an error
• The shape input can be CircleConst, CircleOutputDummy, or CircleNode.
• When the shape input is CircleConst
  • The shape is inferred from the constant shape
  • output_shape would be static
  • e.g. reshape(tensor, [2, 3]) --> [2, 3]
• When the shape input is CircleOutputDummy
  • First, try to inference shape using node's attribute (newShape)
  • If there's no attribute (and no shape input), propagate the shape of node itself
• When the shape input is CircleNode
  • The shape is inferred by shape input's size (because the exact shape cannot be determined at compile time)
  • output_shape would be dynamic
  • e.g. reshape(tensor, shape_node(with size 3)) --> [?, ?, ?]
• If there is single unknown dimension in output_shape and input tensor is fully known, that dimension is inferred by the count of the elements

When should not infer?

Unknown dimension of output_shape is NOT inferred (by the should_infer) when:

• the shape input is CircleNode. Because if it's not constant, the only thing we can infer at compile time is the size of dimensions.
• the tensor input is not fully known. Because shape inference of reshape is based on the sameness of elements count.

Exclude Net_Gather_SparseToDense_AddV2_000

from: Samsung#13935 (comment), FoldSparseToDensePass.cpp

Net_Gather_SparseToDense_AddV2_000 is excluded from optimization test because constant folding of SparseToDense is not fully supported.

Remaining own_shape?

from: Samsung#13935 (comment), Samsung#13935 (comment)

The usage of circle_shape might seems to be remaining of own_shape which should be removed by the new shape inference algorithm.

First, this logic is used to support this recipe(Reshape_003) which has no attribute, no shape input.
I've tried to revise this recipe according to this comment, and have read the related PRs (Samsung#1554, Samsung#1519).
But it was hard to make a policy about no attribute, no shape input case.
So, we decided not to fix another code(importer, recipes) and do it best in shape inference logic.
As a result, I followed the suggestion from Samsung#13927 (comment).

Neg test cases

from: Samsung#13977

Some of the neg test cases might not directly related to the changes that have been made in this PR.
(which means the false return and throws are not made in CircleReshape.cpp.)
Please tell me if these are inappropriate.

---

Related: Samsung#13927
Draft: Samsung#13935
Depends on: Samsung#13989

ONE-DCO-1.0-Signed-off-by: Jongwon Yang [email protected]