...
- Extend
*.field to support nested notation.
New configurations (additional to field.style described above):
Name | Type | Default | Importance | Documentation |
|---|
field.on_.missing_.parent | STRING | create | MEDIUM | Permitted values: create, ingore. Defines how to react when the field to act on does not have a parent and "field.style" is "nested". If set to "create", then the SMT will create the parent struct/map when it does not exist. If set to "ignore", then it will SMT have no effect. |
field.on_.existing_.field | STRING | overwrite | MEDIUM | Permitted values: overwrite, ingore. Defines how to react when the field to act on already exists and "field.style" is "nested". If set to "overwrite", then the SMT will be applied to the existing field. If set to "ignore", then it will SMT have no effect. |
...
| scenario | input | smt | output |
|---|
| 1. Nested field. |
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
}
}
} |
|
| Code Block |
|---|
| {
"transforms": "smt1",
"transforms.smt1.type": "org.apache.kafka.connect.transforms.InsertField$Value", "transforms.smt1.field.style": "nested",
"transforms.smt1.static.field": "parent.child.k3"
"transforms.smt1.static.value": "v3"
} |
|
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123",
"k3": "v3"
}
}
} |
|
| 2. Nested field, when field names include dots |
| Code Block |
|---|
| {
"k1": 123,
"parent.child": {
"k2": "123"
}
} |
|
| Code Block |
|---|
| {
"transforms": "smt1",
"transforms.smt1.type": "org.apache.kafka.connect.transforms.InsertField$Value", "transforms.smt1.field.style": "nested",
"transforms.smt1.static.field": "parent..child.k3"
"transforms.smt1.static.value": "v3"
} |
|
| Code Block |
|---|
| {
"k1": 123,
"parent.child": {
"k2": "123",
"k3": "v3"
}
} |
|
| 3. Nested field with the parent missing |
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
}
}
} |
|
| Code Block |
|---|
| {
"transforms": "smt1",
"transforms.smt1.type": "org.apache.kafka.connect.transforms.InsertField$Value", "transforms.smt1.field.style": "nested",
"transforms.smt1.static.field": "parent.other.k3"
"transforms.smt1.static.value": "v3"
} |
|
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
},
"other": {
"k3": "v3"
}
}
} |
|
| 4. Nested field with the parent missing, and ignore is set |
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
}
}
} |
|
| Code Block |
|---|
| {
"transforms": "smt1",
"transforms.smt1.type": "org.apache.kafka.connect.transforms.InsertField$Value", "transforms.smt1.field.style": "nested",
"transforms.smt1.static.field": "parent.other.k3"
"transforms.smt1.static.value": "v3",
"transforms.smt1.field.on_.missing_.parent": "ignore"
} |
|
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
}
}
} |
|
| 5. Nested field with the parent missing |
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
}
}
} |
|
| Code Block |
|---|
| {
"transforms": "smt1",
"transforms.smt1.type": "org.apache.kafka.connect.transforms.InsertField$Value", "transforms.smt1.field.style": "nested",
"transforms.smt1.static.field": "parent.child.k2"
"transforms.smt1.static.value": "456"
} |
|
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "456"
}
}
} |
|
| 6. Nested field with the parent missing, and ignore is set |
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
}
}
} |
|
| Code Block |
|---|
| {
"transforms": "smt1",
"transforms.smt1.type": "org.apache.kafka.connect.transforms.InsertField$Value", "transforms.smt1.field.style": "nested",
"transforms.smt1.static.field": "parent.child.k2"
"transforms.smt1.static.value": "456",
"transforms.smt1.field.on_.existing_.field": "ignore"
} |
|
| Code Block |
|---|
| {
"k1": 123,
"parent": {
"child": {
"k2": "123"
}
}
} |
|
...