Skip to Content

Wiki source code of 4.7 Data Lineage

Last modified by publicadmin on 2025/12/16 13:04
Hide last authors
publicadmin 1.1 1 ==== About the Data Lineage Graph ====
2
3 The** **Data Lineage Graph** **displays the file's history from upload to its current destination (**Upstream Lineage**) along with all derivatives of the file from the current destination (**Downstream Lineage**). Data provenance, as shown in the Data Lineage Graph, can be useful for discovering the data lifecycle of the file as well as for auditability and data governance purposes.
4
5 The Data Lineage Graph can be accessed from the File Explorer by clicking the[[image:kebab.png||height="23" width="23"]] //Action menu //icon beside a file and selecting **Properties > Data Lineage Graph.**
6
7
8 ==== Exploring the Data Lineage Graph ====
9
10 To view the Data Lineage Graph in a larger window, click the expand[[image:fullscreen.png||height="23" width="23"]]icon.
11
12 * The Data Lineage Graph can be explored by scrolling with a mouse or scrolling with the //Ctrl// key held down to zoom in/out.
13 * Click **Fit view** to refit the graph back to the default, centered state.
14 * Click the **Nodes** dropdown to filter the Data Lineage Graph to show //Downstream// nodes, //Upstream// nodes, or //All Nodes// in the file’s lineage
15
16 ==== ====
17
18 ==== Understanding the Data Lineage Graph ====
19
20 The Data Lineage Graph displays file lineage information as nodes starting with file upload as the first node. If the file was processed or copied, additional nodes will be displayed. Hovering on a node displays //Node Info// containing some of the following information:
21
22 * **Type**: the file’s metadata entity while in this state. For uploaded files, this is always //nfs_file// (network file storage file).
23 * **Name**: the name of the file while in this state.
24 * **Process Time**: the end time of the processing activity (if applicable).
25 * **Location: **the location of the file within the VRE - either Green Room or Core
26 * **File Attributes**: the attached attributes and values.
27
28 Different icons distinguish the first and last node and any interim processing nodes.
29
30 |(% style="width:74px" %)(((
31 (% style="text-align:center" %)
32 [[image:1615479166844-247.png]]
33 )))|(% style="width:572px" %)(((
34 **Current File**
35
36 Represents the current state of the file in its lineage. Hover over the file node to view the //Type, Name,// and //Process Time //of the current file.
37 )))
38 |(% style="width:74px" %)(((
39 (% style="text-align:center" %)
40 [[image:1615479163329-716.png]]
41 )))|(% style="width:572px" %)(((
42 **Processing Node**
43
44 The Processing node indicates a processing activity such as a processing pipeline, or copy/delete action. Hover over the Processing node with your cursor to view the processing action and the date and time it was completed.
45 )))
46 |(% style="width:74px" %)(((
47 (% style="text-align:center" %)
48 [[image:1615479172446-315.png]]
49 )))|(% style="width:572px" %)**Upstream or Downstream Version of Current File**
50 Represents either an upstream or downstream version of the current file. Hover over the file node to view the //Type, Name,// and //Upload Time //of the file.
51 |(% style="width:74px" %)(((
52 (% style="text-align:center" %)
53 [[image:VRE UI Diagrams for User Manual - Processing Node_ Lineage.png||height="50" width="50"]]
54 )))|(% style="width:572px" %)(((
55 **Data Transfer Node**
56
57 This node represents data transfer or copy from the Green Room to the Core.
58 )))
59
60 ----
61
62 **See Also: **
63
64 [[File Upload>>doc:Main.user_guide.Managing Data.File Upload.WebHome]]
65
66 [[File Download>>doc:Main.user_guide.Managing Data.File Download.WebHome]]
67
68 [[File Processing>>doc:Main.user_guide.Managing Data.File Processing - Green Room.WebHome]]
69
70 [[File Explorer>>doc:Main.user_guide.Navigating the Project Canvas.File Explorer.WebHome]]
71
72 [[Platform Architecture>>doc:Main.user_guide.About the VRE.Introduction]]
73
74 ----
75
76 {{box}}
77 (% style="text-align:center" %)
78 image:https://i.creativecommons.org/l/by-sa/4.0/88x31.png
79
80 (% style="text-align: center;" %)
81 Copyright © 2022, Indoc Research. This work is licensed under a [[Creative Commons Attribution-ShareAlike 4.0>>http://creativecommons.org/licenses/by-sa/4.0/ ||rel="noopener noreferrer" target="blank"]] International License.
82 {{/box}}