You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The only place we can get guaranteed batch name information is when jobs are still in the queue, via a query. If you ask us to parse an event log whose jobs have all left the queue, we have to go with the default batch name. Although this is probably not a common use case, it will probably be surprising when it happens.
The text was updated successfully, but these errors were encountered:
This gets particularly nasty when you're running a DAG with many completed jobs in it. You get thousands of rows, because we don't understand how to group them after they've the queue, and unlike a normal submit, they probably all have different cluster ids.
The only place we can get guaranteed batch name information is when jobs are still in the queue, via a query. If you ask us to parse an event log whose jobs have all left the queue, we have to go with the default batch name. Although this is probably not a common use case, it will probably be surprising when it happens.
The text was updated successfully, but these errors were encountered: