Notifications from Apache Atlas
Apache Atlas sends notifications about metadata changes to Kafka topic named ATLAS_ENTITIES . Applications interested in metadata changes can monitor for these notifications. For example, Apache Ranger processes these notifications to authorize data access based on classifications.
Notifications - V2: Apache Atlas version 1.0
Apache Atlas 1.0 sends notifications for following operations on metadata.
ENTITY_CREATE: sent when an entity instance is created ENTITY_UPDATE: sent when an entity instance is updated ENTITY_DELETE: sent when an entity instance is deleted CLASSIFICATION_ADD: sent when classifications are added to an entity instance CLASSIFICATION_UPDATE: sent when classifications of an entity instance are updated CLASSIFICATION_DELETE: sent when classifications are removed from an entity instance
Notification includes the following data.
AtlasEntity entity; OperationType operationType; List<AtlasClassification> classifications;
Notifications - V1: Apache Atlas version 0.8.x and earlier
Notifications from Apache Atlas version 0.8.x and earlier have content formatted differently, as detailed below.
Operations
ENTITY_CREATE: sent when an entity instance is created ENTITY_UPDATE: sent when an entity instance is updated ENTITY_DELETE: sent when an entity instance is deleted TRAIT_ADD: sent when classifications are added to an entity instance TRAIT_UPDATE: sent when classifications of an entity instance are updated TRAIT_DELETE: sent when classifications are removed from an entity instance
Notification includes the following data.
Referenceable entity; OperationType operationType; List<Struct> traits;
Apache Atlas 1.0 can be configured to send notifications in older version format, instead of the latest version format. This can be helpful in deployments that are not yet ready to process notifications in latest version format. To configure Apache Atlas 1.0 to send notifications in earlier version format, please set following configuration in atlas-application.properties:
atlas.notification.entity.version=v1
Notifications to Apache Atlas
Apache Atlas can be notified of metadata changes and lineage via notifications to Kafka topic named ATLAS_HOOK. Atlas hooks for Apache Hive/Apache HBase/Apache Storm/Apache Sqoop use this mechanism to notify Apache Atlas of events of interest.
ENTITY_CREATE : create an entity. For more details, refer to Java class HookNotificationV1.EntityCreateRequest ENTITY_FULL_UPDATE : update an entity. For more details, refer to Java class HookNotificationV1.EntityUpdateRequest ENTITY_PARTIAL_UPDATE : update specific attributes of an entity. For more details, refer to HookNotificationV1.EntityPartialUpdateRequest ENTITY_DELETE : delete an entity. For more details, refer to Java class HookNotificationV1.EntityDeleteRequest ENTITY_CREATE_V2 : create an entity. For more details, refer to Java class HookNotification.EntityCreateRequestV2 ENTITY_FULL_UPDATE_V2 : update an entity. For more details, refer to Java class HookNotification.EntityUpdateRequestV2 ENTITY_PARTIAL_UPDATE_V2 : update specific attributes of an entity. For more details, refer to HookNotification.EntityPartialUpdateRequestV2 ENTITY_DELETE_V2 : delete one or more entities. For more details, refer to Java class HookNotification.EntityDeleteRequestV2