DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
Status
| State | |
| Accepted | |
| Discussion Thread | https://lists.apache.org/thread/dgpgvoszh52vxxszmg65wmcgxnj9zwby |
| Vote Thread | https://lists.apache.org/thread/vhy4bynwmqvrxw0cqgwkvmx6vhlzbqnr |
| Vote Result Thread | https://lists.apache.org/thread/7g2gw53lf9yf8mmt9g6mnf29rj2yzgpr |
| Progress Tracking (PR/GitHub Project/Issue Label) | https://github.com/orgs/apache/projects/586/views/1 |
| Date Created |
|
| Version Released | |
| Authors | |
Background & Motivation
In today's evolving data landscape, organizations face significant challenges:
...
We propose both embedded and separate HITL patterns:
Option A: Embedded HITLHITL
(Out of scope this scenario moving this to New AIP)
| Code Block | ||||
|---|---|---|---|---|
| ||||
quality_check = LLMDataQualityOperator( task_id="customer_quality_analysis", data_sources=[customer_s3], prompt="Generate data quality validation queries", require_approval=True, # Built-in HITL approval_timeout=timedelta(hours=2) ) |
...
By completing all the phases
Future Scope:
- Embedded HITL as mentioned in the Option A example.
- Progress reporting the task running in cycliness, eg: see comment from Unknown User (potiuk)