Avoid Use of Blocking Transformations such as Sort .If you have a Relational Source sort it in the source adapter query .
Avoid use Oledb Command for updates on a large dataset,try to use set based updates by using staging table and sql task.
If you use SCD component try to do the updates in a setbased way by removing oledb command and using a staging table.
Convert DateTime Conversions at source itself
Increase Network PacketSize at Source Adapter default is 4k maximum is 32k
Select only the required columns from source
Use LockHint NoLock in the source query to avoid locking over head when there is no trasactional activity going at source at the time of load
Efficiently use lookup Full Cache where possible.avoid using full cache for small number of records
When using lookups try to ignore failure and handle all the lookups failures down in a derived column transform.Because if you error handle in lookup and unionall ,the union all copies the buffer bucket which creates overhead
Avoid use Oledb Command for updates on a large dataset,try to use set based updates by using staging table and sql task.
If you use SCD component try to do the updates in a setbased way by removing oledb command and using a staging table.
Convert DateTime Conversions at source itself
Increase Network PacketSize at Source Adapter default is 4k maximum is 32k
Select only the required columns from source
Use LockHint NoLock in the source query to avoid locking over head when there is no trasactional activity going at source at the time of load
Efficiently use lookup Full Cache where possible.avoid using full cache for small number of records
When using lookups try to ignore failure and handle all the lookups failures down in a derived column transform.Because if you error handle in lookup and unionall ,the union all copies the buffer bucket which creates overhead
No comments:
Post a Comment
Note: only a member of this blog may post a comment.