What is the difference between Get metadata activity and Look up activity? very imp
Get metadata activity is used for fetch the head level data (file names,size). Get metadata
Can’t fetch the data which is available inside file or table Very imp
Lookup activity reads and returns the content of a configuration file or table. It also returns the result of executing a query or stored procedure. The output from Lookup activity can be used in a subsequent copy or transformation activity if it's a singleton value. The output can be used in a ForEach activity if it's an array of attributes.
By using look up activity we can get data which is available inside file or table
What are the activities being you used in pipeline? Very IMP
Get meta data activity, Lookup activity, for each activity, set variable activity, copy activity, Filter activity, switch activity, Delete activity and if activity.
I have csv file which contains date in end of the file name, how would you process files which contains yesterday date in file name? Very imp
By using get metadata activity we will get file name by using item.name property then we will use sub string to get the date format then we will use today-1.
How to improve the performance in ADF if my pipeline is running slow? IMP
Data integration units, Degree of copy parlalizam, Bulk insert
Data flows-practicing and broad casting (shared variable)
Difference between control flows and data flow transformations? IMP
Control Flow can execute only one task at a time in a linear fashion. On the other hand, Data Flow can perform multiple transformations at the same time.
If you are running more no of pipelines and its taking longer time to execute. How to resolve this type of issues? IMP
We can go with splitting pipelines batches wise and create multiple integration runtimes. Then those loads will be shared by multiple integration runtimes and we can improve the load performance of more no of pipelines.
Share with your friends: |
