Scenario The client provided a large file of 5 million rows which is example raw file. In production environment, the file would be larger. I have to think about how to load it with minimal timing possibly. Solutions In order to load this file in good performance, it requires many factors. I have been thought … Continue reading How to run Parallelism Data Flows with SSIS Balanced Data Distributor Transformation
Problem A couple of days ago, my client sent historical data of sales to me through a zip file. I tried to unzip it and loaded with SSIS package. However, the zip file contains a lot of sub folders and files in and a sales file is also zipped within .gz extension. It requires me … Continue reading How to load data through folders and files in SSIS
Scenario My client has a dictionary table that they're defining list of standard TV Program name. Currently, their data team must compare and match new Program with existing standard Program manually. It takes much time and efforts of the team. So they want us to provide a mechanism to help us reduce this work. For … Continue reading How to apply FUZZY algorithm in SSIS?
Introduction A couple of weeks ago, my client requested me to implement a SSIS package that allows them to download their files from a FTP server and archives them. Microsoft SSIS is the powerful tool which allows us to proceed multiple files at same time even we can use SSIS to download files from FTP … Continue reading FTP Task, For EachLoop component and File System Task in SSIS
Problem My client sends data in an Excel file to me to load them into Staging database. The file contains many sheets that they have same structure. In this article, I would like to share the simple way to load data of multiple sheets by using SSIS. Solution Source Files For demonstration purpose, I have an … Continue reading How to load multiple sheets of an Excel File in SSIS
Problem You have a SSIS package and a .NET application allows your end-users whenever they determine to transfer data from server A to server B in your system. Solution One of approaches, Iwill use .NET framework to develop our application to call a SSIS package system file(.dtsx) . In this article, I'm developing .NET application … Continue reading How to call a SSIS package from .NET application
Problem I need to retrieve data from my partner system but they do not allow to access the system directly. Instead they provide me some Web Services to retrieve data what I need. Solution One of approaches is we use Web Service Task and XML Task components in SSIS. In this article, I'm going to demonstrate … Continue reading How to load data with Web Service Task and XML Task in SSIS