lineage_events

Creates, updates, deletes, gets or lists a lineage_events resource.

Overview

Name	lineage_events
Type	Resource
Id	google.datalineage.lineage_events

Fields

Name	Datatype	Description
name	string	Immutable. The resource name of the lineage event. Format: projects/{project}/locations/{location}/processes/{process}/runs/{run}/lineageEvents/{lineage_event}. Can be specified or auto-assigned. {lineageevent} must be not longer than 200 characters and only contain characters in a set: `a-zA-Z0-9-:.`
endTime	string	Optional. The end of the transformation which resulted in this lineage event. For streaming scenarios, it should be the end of the period from which the lineage is being reported.
links	array	Optional. List of source-target pairs. Can't contain more than 100 tuples.
startTime	string	Required. The beginning of the transformation which resulted in this lineage event. For streaming scenarios, it should be the beginning of the period from which the lineage is being reported.

Methods

Name	Accessible by	Required Params	Description
get	SELECT	lineageEventsId, locationsId, processesId, projectsId, runsId	Gets details of a specified lineage event.
list	SELECT	locationsId, processesId, projectsId, runsId	Lists lineage events in the given project and location. The list order is not defined.
create	INSERT	locationsId, processesId, projectsId, runsId	Creates a new lineage event.
delete	DELETE	lineageEventsId, locationsId, processesId, projectsId, runsId	Deletes the lineage event with the specified name.

SELECT examples

Lists lineage events in the given project and location. The list order is not defined.

SELECT
name,
endTime,
links,
startTime
FROM google.datalineage.lineage_events
WHERE locationsId = '{{ locationsId }}'
AND processesId = '{{ processesId }}'
AND projectsId = '{{ projectsId }}'
AND runsId = '{{ runsId }}';

INSERT example

Use the following StackQL query and manifest file to create a new lineage_events resource.

All Properties

/*+ create */
INSERT INTO google.datalineage.lineage_events (
locationsId,
processesId,
projectsId,
runsId,
startTime,
name,
endTime,
links
)
SELECT 
'{{ locationsId }}',
'{{ processesId }}',
'{{ projectsId }}',
'{{ runsId }}',
'{{ startTime }}',
'{{ name }}',
'{{ endTime }}',
'{{ links }}'
;

Manifest

- name: your_resource_model_name
  props:
    - name: startTime
      value: string
    - name: name
      value: string
    - name: endTime
      value: string
    - name: links
      value:
        - - name: target
            value:
              - name: fullyQualifiedName
                value: string

DELETE example

Deletes the specified lineage_events resource.

/*+ delete */
DELETE FROM google.datalineage.lineage_events
WHERE lineageEventsId = '{{ lineageEventsId }}'
AND locationsId = '{{ locationsId }}'
AND processesId = '{{ processesId }}'
AND projectsId = '{{ projectsId }}'
AND runsId = '{{ runsId }}';