Week 1 What is Cloud?


Is your pipeline being completely static or dynamic way?



Download 2.55 Mb.
Page13/26
Date23.09.2022
Size2.55 Mb.
#59575
1   ...   9   10   11   12   13   14   15   16   ...   26
adfproject qstns main
Is your pipeline being completely static or dynamic way?
Both the ways we did depends on the client requirement. But most of the people likes dynamic because to avoid the manual work.


If i have 100 parameters in your pipeline can you say which parameter belongs to what?
Yes, I can tell by looking the name itself.
@pipeline belongs pl level, @dataset for dataset level and @linkedservice for ls level.


what is local and global level parameters?
Local is up to a single ADF level, when it comes to global it can pass values from one adf to another adf.
Mostly this scenario comes in the deployment cases, we can pass our environment credentials and needed settings.


what is system variables?
Predefined variables in azure data factory, pipeline name, pipeline run id, pipeline runtime, trigger name, trigger runtime, etc.,
how many types of file formats you used as a source? Very imp
Azure Data Factory supports the following file formats. Refer to each article for format-based settings.

  • Avro format

  • Binary format

  • Delimited text format

  • Excel format

  • JSON format

  • ORC format

  • Parquet format

  • XML format

.csv,.txt,.xlsx and .xlsm.


If my pipeline is running slow and how to increase the performance? Very imp
A Data Integration Unit is a measure that represents the power (a combination of CPU, memory, and network resource allocation) of a single unit in Azure Data Factory. Data Integration Unit we can increase if we have budget.
Can I Pass parameters to a pipeline run?
YES, we can pass parameters to Pipeline.

Download 2.55 Mb.

Share with your friends:
1   ...   9   10   11   12   13   14   15   16   ...   26




The database is protected by copyright ©ininet.org 2024
send message

    Main page