THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
State
[progress record]:
Proposed time: 2022/05/06
Discussion time:
Acceptance time:
Complete time:
[issues]:
[email]：
[release]:
[proposer]:
Motivation & Background
In
...
the
...
current
...
version,
...
an
...
exception
...
occurs
...
when
...
the
...
Linkis
...
Client
...
submits
...
the
...
task.
...
The
...
client
...
will
...
decide
...
whether
...
to
...
retry
...
according
...
to
...
the
...
parameter
...
configuration.
...
However,
...
when
...
an
...
error
...
occurs
...
during
...
the
...
execution
...
of
...
the
...
task,
...
the
...
client
...
does
...
not
...
have
...
a
...
mechanism
...
to
...
retry,
...
especially
...
for
...
some
...
tasks,
...
which
...
may
...
Because
...
network,
...
resource
...
and
...
other
...
issues
...
are
...
not
...
submitted
...
to
...
the
...
EC
...
for
...
execution,
...
in
...
order
...
to
...
further
...
improve
...
the
...
fault
...
tolerance
...
of
...
the
...
system,
...
the
...
client
...
adds
...
a
...
retry
...
function
...
for
...
tasks
...
that
...
report
...
errors
...
before
...
being
...
submitted
...
to
...
the
...
EC
...
for
...
execution.
Basic concept
Expect to achieve goals
- Linkis
...
- client
...
- adds
...
- a
...
- task
...
- retry
...
- function
...
- that
...
- reports
...
- an
...
- error
...
- if
...
- it
...
- is
...
- not
...
- submitted
...
- to
...
- the
...
- ECM
...
- for
...
- execution
Implementation plan
- Linkis Job adds the attribute retryNums, whose type is Int;
- The table linkis_ps_job_history_group_history adds a field to indicate whether to enter the EC for execution: execByEcm, the field type is Boolean; A function has been planned for this, task metrics are added to the record of ec information, requirements: https://github.com/apache/incubator-linkis/issues/2075 This record can be reused.
- The client retry function is added to isCompleted of LinkisJob. This method has two implementation classes:
...
Things to Consider & Note:
- Do you need to consider the compatibility of the original parameter method? Retry is only supported if retry is added. If it is not added, it is still the original logic.
Changes
| Modification | Detail | |
|---|---|---|
| 1 | Modification of maven module | |
| 2 | Modification of HTTP interface | |
| 3 | Modification of the client interface | |
| 4 | Modification of database table structure | |
| 5 | Modification of configuration item | |
| 6 | Modification Error code | |
| 7 | Modifications for Third Party Dependencies |
...