Week 1 What is Cloud?
Download 2.55 Mb.
|
| Snowflake Schema: Very imp
Snowflake schema one fact depends on many dimesnions. what is the diff between fact and dimension? Very imp Fact means transactional data, aggregations of data. A dimension table contains dimensions of a fact which is nothing but attributes of the facts. what is incremental/delta load and full load? Very imp incremental load is a process of loading data incrementally. Only new and changed data is loaded to the destination. Full load always truncates and load. Data will come in rare cases what is watermark table? Very imp A watermark is a column that has the last updated time stamp or an incrementing key. The delta/incremental loading loads the changed data between an old watermark and a new watermark. By using stored procedure, we will update this water mark table when ever we did incremental data loads. what is audit table? Very imp To log the adf activities inside the pipeline and understand the below points when it will come to use. Updating Pipeline Status and Datetime columns in a static pipeline parameter table using an ADF Stored Procedure activity Creating a pipeline log table in Azure SQL Database and storing the pipeline activity as records in the table what is logic app? Very imp Logic app most common thing which is used to send an email notification to users for the pipeline failure and success. We have one of the azure functions developer he is taking care about that even I can create by my own as well. So many activities are possible with logic app, we can trigger out activities, pipelines by using logic apps. what is alerts and metrics? Generally, when people started using azure version v1 they don’t have current feasible options logic app’s and all. For them it is avalible inbuilt option from adf environment we can send metrics and alerts for our pipeline failure/success. Download 2.55 Mb. Share with your friends:
|