在 `feast apply` 中进行粒度化的 OpenLineage 事件发布,以实现精确的 FeatureView 来源
作者: mao-liu创建于 2026年9月20日更新于 2026年9月20日
标签kind/feature
Describe the solution you'd like
FeastOpenLineageEmitter.emit_apply() could emit more granular, per-FeatureView definition events instead of a single monolithic job event. Specifically:
- For each
FeatureView/StreamFeatureView/OnDemandFeatureView, emit a distinct definition event where:
inputs: Only the data sources and entities declared for that specific feature view.outputs: That specific feature view dataset.
- Maintain the existing pattern used for
FeatureServicedefinitions (which are already emitted individually per service). This ensures that OpenLineage accurately captures the true 1:1 or N:1 dependency graph between sources and feature views both in the Feast UI and in external lineage backends (e.g., Marquez, DataHub, Atlan).
内容来源: feast-dev/feast