Thursday, 22 December 2011

SSIS Non Relational Source Optimisation



When dealing with non relational  sources  a lot factors can play important role increasing the performance of the flow.As we know ssis moves the data in buffers in the data flow,so  the buffer size play an important role in  the overall  speed of load.When we connect to non relational    sources such as text file ,the source component allocates  default data type string of  length 50 as shown below










which might consume a lot of buffer size.You can optimise by selecting a sample of rows and analysing the data types and length.This can be done on connection manager editor  advanced  properties  and suggest types  tab and accept the suggest column types as below



and after  accepting suggest column types it will optimise to minimum length. based on the column length as
shown below






This is an important  step as it impacts buffer size heavily


No comments:

Post a Comment

Note: only a member of this blog may post a comment.

Power BI Report Server

Power BI Report Server  is a new product which can be used to host both Power BI reports and SSRS reports. Currently beta version is ava...