特性

通知

qianmoQqianmoQ· 更新于 2026-09-27· 阅读 6 分钟· 0 次阅读

登录后可跨设备保存划线和私人笔记登录

通知

Apache Atlas 的通知

Apache Atlas 会将元数据变更的通知发送到名为 ATLAS_ENTITIES 的 Kafka 主题。关注元数据变更的应用可以监听这些通知。例如,Apache Ranger 会处理这些通知,以便根据分类标记来授权数据访问。

通知 - V2:Apache Atlas 1.0 版本

Apache Atlas 1.0 会针对元数据的以下操作发送通知。

ENTITY_CREATE:         sent when an entity instance is created
      ENTITY_UPDATE:         sent when an entity instance is updated
      ENTITY_DELETE:         sent when an entity instance is deleted
      CLASSIFICATION_ADD:    sent when classifications are added to an entity instance
      CLASSIFICATION_UPDATE: sent when classifications of an entity instance are updated
      CLASSIFICATION_DELETE: sent when classifications are removed from an entity instance

通知包含以下数据。

AtlasEntity  entity;
   OperationType operationType;
   List<AtlasClassification>  classifications;

通知 - V1:Apache Atlas 0.8.x 及更早版本

Apache Atlas 0.8.x 及更早版本发出的通知,其内容格式有所不同,详见下文。

操作

ENTITY_CREATE: sent when an entity instance is created
      ENTITY_UPDATE: sent when an entity instance is updated
      ENTITY_DELETE: sent when an entity instance is deleted
      TRAIT_ADD:     sent when classifications are added to an entity instance
      TRAIT_UPDATE:  sent when classifications of an entity instance are updated
      TRAIT_DELETE:  sent when classifications are removed from an entity instance

通知包含以下数据。

Referenceable entity;
   OperationType operationType;
   List<Struct>  traits;

Apache Atlas 1.0 可以配置为发送较早版本格式的通知,而非最新版本格式。这对于尚未准备好处理最新版本格式通知的部署非常有帮助。若要将 Apache Atlas 1.0 配置为发送较早版本格式的通知,请在 atlas-application.properties 中设置以下配置:

atlas.notification.entity.version=v1

向 Apache Atlas 发送通知

Apache Atlas 通过向名为 ATLAS_HOOK 的 Kafka 主题发送通知,来获知元数据变更和血缘关系。Apache Hive、Apache HBase、Apache Storm 和 Apache Sqoop 的 Atlas 钩子(hook)使用此机制,将相关事件通知给 Apache Atlas。

ENTITY_CREATE            : create an entity. For more details, refer to Java class HookNotificationV1.EntityCreateRequest
ENTITY_FULL_UPDATE       : update an entity. For more details, refer to Java class HookNotificationV1.EntityUpdateRequest
ENTITY_PARTIAL_UPDATE    : update specific attributes of an entity. For more details, refer to HookNotificationV1.EntityPartialUpdateRequest
ENTITY_DELETE            : delete an entity. For more details, refer to Java class HookNotificationV1.EntityDeleteRequest
ENTITY_CREATE_V2         : create an entity. For more details, refer to Java class HookNotification.EntityCreateRequestV2
ENTITY_FULL_UPDATE_V2    : update an entity. For more details, refer to Java class HookNotification.EntityUpdateRequestV2
ENTITY_PARTIAL_UPDATE_V2 : update specific attributes of an entity. For more details, refer to HookNotification.EntityPartialUpdateRequestV2
ENTITY_DELETE_V2         : delete one or more entities. For more details, refer to Java class HookNotification.EntityDeleteRequestV2

评论

登录后参与评论

正在加载评论…