Hi, Is any one have/had problem. I have very simple SSIS Package. Flat file source and SQL Destination. No other transformation. Somehow I am missing few data from source. For E.g my flat file source has 987 rows, but I am getting in SQL Table 687 rows. I am not sure where I am missing those data. Is Anyone help would be great appreciate. Please let me know if my question is not clear or need more information.Thank You,
↧
Flat File Source Problem in SSIS
↧
How to create a command line for winzip command tool in SSIS that can be used to archive file.
Hello,I would like to have codes and the illustration of steps to do in order to create a command line tools in SSIS which can be used to archive file.Thanks,Mark
↧
↧
SSIS package to create backup of Procs and Functions
Hi all,i want to create SSIS package to create backup of Procs and Functions .Please guide me.Thanks.
↧
SSIS 2008: insufficient disk
Hi All,Executed as user: --. Microsoft (R) SQL Server Execute Package Utility Version 10.50.4000.0 for 64-bit Copyright (C) Microsoft Corporation 2010. All rights reserved. Started: 7:00:02 AM Error: 2014-04-08 07:13:53.20 Code: 0x800705AA Source: dbo.TestDetails Description: End Error Error: 2014-04-08 07:13:53.43 Code: 0xC004704B Source: dbo.TestDetails Description: The buffer manager cannot write 8 bytes to file "T:\Windows\Temp\DTS{7BA097F6-DC45-4A49-B1E4-1824946D0F2B}.tmp". There was insufficient disk space or quota. End Error Error: 2014-04-08 07:14:45.69 Code: 0x800705AA Source: dbo.TestDetails Description: End Error Error: 2014-04-08 07:14:45.69 Code: 0xC004704B Source: dbo.TestDetails Description: The buffer manager cannot write 8 bytes to file "T:\Windows\Temp\DTS{44CBA3AE-1C3A-4A64-AFB0-02C2E748A86D}.tmp". There was insufficient disk space or quota. End Error Error: 2014-04-08 07:15:56.06 Code: 0x800705AA Source: dbo.TestDetails Description: End Error Error: 2014-04-08 07:15:56.06 Code: 0xC004704B Source: dbo.TestDetails Description: The buffer manager cannot write 8 bytes to file "T:\Windows\Temp\DTS{3927E2A2-A4E1-45C0-81B9-33941CC0D4BB}.tmp". Description: The Data Flow task failed to create a buffer to call PrimeOutput for output "OLE DB Source" (1) on component "OLE DB Source Output" (11). This error usually occurs due to an out-of-memory condition. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 7:00:02 AM Finished: 7:23:54 AM Elapsed: 1431.79 seconds. The package execution failed. The step failed.-----------------------I am getting above error when running SSIS package through job. The error was saying "insufficient dis space", when I checked T drive have 400 GB free space. I could not find what was the problem. Please help me on this.Thanks,Arooj
↧
Need to check file name before it get process
Hi,I need help in checking the file name before i load it to staging tables.I have all the file stored in C:\Database\SourceFiles\ABCSourceFilesand file name like ABC_YYYYMMDDHHMMSSExampleSourceFile1_20140803073209.txtSourceFile2_20130904071210.txtSourceFile3_20120703041530.txtFor i took foreach loop container and point to this location and only selected .txt files and file name put it into @Filename variable.I took data flow task on control flow and take flat file connection i am using this variable in flat file connection order to pull the data from that local location.So my question is how i will do the file validation for file name.We need to reject the file if the file name format is not valid Like SourceFile1_2014073209.txt --Reject this file because --it is not YYYYMMDDHHMMSSand also we need to reject this file if the file name like SourceFile1_uuu2019hhj --- Reject this file because it is not Filename_YYYYMMDDHHMMSS.I am not sure how i will do it before i process this file.I appreciate for your help in advanced.Thanks,Unnati
↧
↧
Get new files and folders from FTP
I need to check an ftp site nightly for new folders containing image files and download just the files and folders and exclude folders that I don't need. There hundreds of folders and each folder containing from 5 to 10 image files. I have already done an initial download of all of the file that I need. There new files uploaded to the site on a regular basses. I just need those new files. Can any one help me with this?
↧
Help with Derived Column To Split-Up An Individual's Name into Separate Parts
I'm working on an SSIS package for a client. They receive files exported from their clients and they don't put any restrictions on how the data is provided to them via the Excel files they send, so 99.9% of the files arrive with a "Full Name" field instead of individual "First Name, "Middle Initial/Name", "Last Name", and "Surname" columns.The names are generally in this pattern, which has a few possible variances as you can see as far as how the names are present in the column:Adams, Jr., Dwight([Last Name], [Surname], [First Name])Allen, Frederick ([Last Name], [First Name])Bishop, Joseph A.([Last Name], [First Name] [Middle Initial])Butler, III, Lamarrick J.([Last Name], [Surname], [First Name] [Middle Initial])Nicholson, Tina Michelle([Last Name], [First Name] [Middle Name])Cagle, Sr., Kimzey Alan([Last Name], [Surname], [First Name] [Middle Name])I'm trying to determine exactly how to handle these varying scenarios as far as how the names will be present in the single column as to appropriate & accurately split them into their various parts.I wasn't sure if I should go with parsing formulas for each component of the full name directly within the derived column task, or if I should write a function that accepts the full name as an incoming parameter and then the parts of the name are parsed that way and somehow returned to the derived column task. I'm trying to tackle this the best way possible and I'm seeking suggestions.I've seen a few code samples out there for parsing through a full name into the various individual parts of the name, but I haven't run across any specific examples yet that deal with full names structured exactly the way that I've shown above in the examples that they can be structured in the incoming files.Thanks in advance.
↧
How to Use XML Config File to Allow SSIS Pkg to Run Successfully on Development/Production Locations?
I'm new to SSIS and am working my way through a project for a client in order to get some valid SSIS experience under my belt.I will hopefully finish the project in about a month and am curious as to how to configure/use an XML config. file to allow the project to run successfully in my development environment, but also run successfully in the client's production environment once it's installed there.I believe that most of the XML config. file will need to contain unique entries for several variables that will need to be set to specific values to allow the package to run in both environments, but I'm not quite sure as to the specifics as to how to do that.For example, let's say I've got a variable named "sExcelFileRoot" and it's set for "c:\IncomingExcelFiles\" in the development environment. The proper setting for "sExcelFileRoot" may need to be "c:\SSISProject\IncomingFiles\" in the production environment. Similar situation exists for numerous variables that will need to be set to one entry to work appropriate in the development environment, and set to different entries to seamlessly allow the SSIS to function properly in the production environment.Do I need 2 XML config. files, one that's utilized to dynamically set the variables in the development environment and another one that will reside in the production environment and has the variables set appropriately to permit successful SSIS package execution in that environment?Any assistance w/my questions is greatly appreciated.
↧
loading data from SQL 2008 to AS400 - getting error, please help!
We are using ADO net connection for both SQL 2008 and AS400, when I am trying to insert all the data from the sql 2008 table(about 66k rows), only about 44 rows are getting inserted into the AS400 file and then it errors out with below error:[ADO NET Destination [457]] Error: An exception has occurred during data insertion, the message returned from the provider is: ERROR [07002] [IBM][iSeries Access ODBC Driver]Wrong number of parameters.
↧
↧
Import NULL GUID - SSIS Help needed
Hi Everyone,I am a newbie here. I am trying to import data from flat file to SQL DB using SSIS. I have GUID data which i am importing into uniqueidentifier field.My flow is as "Source File" -> Derived Column (Convert to GUID) -> Data Conversion -> OLEDB destinationIt works fine as far as there is a valid GUID data in the source, but it fails when there is a "NULL / Empty". However i made that field to ignore failure and it successfully passed by.But I feel it's not an optimal solution to ignore the error and pass through. Please advice.Any suggestions would be much appreciated except "Not Possible :P" as I seen enough. I tired -- User == "" ? "" : (DT_GUID)("{" + User + "}")but it has a syntax errorVersion using SQL 2012. Thanks in advance,newbie :)
↧
Issue with temp table as destibation
Hi All,I have the requirement to load source txt file and perform incremental update on my destination table. As I was not allowed to create any table to hold staging records (from file), I'm storing file data to a global temp table and then performing MERGE operation (temp & Dest table).In the data low task i have a derived column that handls date column (if blank or null then pass db_null to dest db else pass the column as it it).Now everything is working fine. The only problem is with performance. For transferring 1 million records through the derived column task my package is taking almost an hour.Any help on where I'm loosing my performance??Thanks,Anjan
↧
FTP security issue
hi i have an ssis job, which runs various calculations, creates a .txt file and then uploads to an FTP site.when i run it in bids it works fine, but when i schedule to run using sql agent, it fails with the below error..[i]"An error occurred in the requested FTP operation. Detailed error description: The password was not allowed"[/i]how should i be saving my FTP password?thanksmal
↧
SSIS package: unable to enlist in the transaction
Hi,I have SSIS package where the property of package for TransactionOption is set to “Required”.This package when I am executing from the SQL 2005 server (the same machine where the SQL server 2005 is installed), then it’s working fine and the transaction is also working successfully.But the same package when I am executing from my PC, then its giving error message as follows:[Connection manager "Plan CDDH-M3"] Error: The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D00A "Unable to enlist in the transaction.". Can any one help me in this?RegardsRaj
↧
↧
Script Task to Copy Same File Over & Over & Rename Uniquely (Odd Request I Guess)
I'm working on a project for a client that initially loops through a folder where several Excel spreadsheets are found from day to day as newly exported from the client's clients.The "For... Loop" container loops through all subfolders within a specific location, determines if files exist, and proceeds to move each file into a similar folder/subfolder structure in a different directory. No issues there... works fine.The issue I'm trying figure out is how to take an Excel template file that will always reside in a specific location and always have the same name, and just after each client's Excel file is found and moved into the similar directory/subfolder structure as described in the previous paragraph, I also want to move this empty Excel template file (for example purposes let's just say the file is always located/named as follows: "c:\TemplateFile\ExcelTemplateToUse.xls") and name it similarly as the client's Excel file that was just moved, with the addition of the text "_Final" added to the end of the file. More details below...So, taking one of potentially many client files in consideration, let's say the "For... Loop" process finds that a file is located here: "c:\ClientFiles\ABCCompany\ABCInfo.xls". There's code within the "For... Loop" process that will find this file and move it to "c:\ReadyForProcessing\ABCCompany\ABCInfo.xls". What I need to happen at this point once the "ABCInfo.xls" file has been moved is that the empty "c:\TemplateFile\ExcelTemplateToUse.xls" Excel template file (only has column headers in the file) also needs to be *copied* to the ""c:\ReadyForProcessing\ABCCompany\" location but it needs to be renamed to "ABCInfo_Final.xls" when it's copied instead of being left named as "ExcelTemplateToUse.xls".Moving forward, let's say the continuing "For... Loop" process finds another file recently placed there from a client... "c:\ClientFiles\XYZIndustries\ZYZPayrollData.xls". This file will be moved to "c:\ReadyForProcessing\XYZIndustries\ZYZPayrollData.xls". What I need to happen again at this point once the "ZYZPayrollData.xls" file has been moved is that the empty "c:\TemplateFile\ExcelTemplateToUse.xls" Excel template file also needs to be *copied* to the ""c:\ReadyForProcessing\XYZIndustries\" location but it needs to be renamed to "ZYZPayrollData_Final.xls" when it's copied instead of being left named as "ExcelTemplateToUse.xls".And so on for however many files the looping process finds...I've read all sorts of posts on the pros/cons of using a File System Task vs a Script Task to accomplish when I'm trying to do with copying the "c:\TemplateFile\ExcelTemplateToUse.xls" over and over to new locations and renaming the copied "ExcelTemplateToUse.xls" file to the other Excel file's name that was just moved into the location with the desired naming convention as described above.More and more of what I read seems to recommend using a Script Task to accomplish this instead of the File System Task.Any recommendations or code snippets any of you that have done a similar sort of thing have to pass my way?Many thanks in advance.
↧
Non-SysAdmins have been denied permission to run DTS Execution job steps without a proxy account.
Trying to execute a maintenance plan that simply checks db integrity, backups the db and the transaction logs and cleans up any .bak/.trn files older than 3 days and am getting:"Non-SysAdmins have been denied permission to run DTS Execution job steps without a proxy account. The step failed."My user is owner of the job and is in the 'sysadmin' server role.The SQL Server Agent and SQL Server service accounts are both 'Local System' (I'll fix this later)The BUILTIN\Administrators group is a valid login (I'll fix this later)'guest' can connect to the 'msdb' database (I'll fix this later)What am I missing? These jobs run w/o issue on all my other servers, that are setup the same.TIA.
↧
"VS_ISBROKEN" error message
hello,I created an import package in Sql server 2005 that gets the data from db400 database.when i ran it the first time it succeeded but when i run it from the Integration Services i get this error:Error: 2009-09-04 13:01:29.40 Code: 0xC0202009 Source: Data Flow Task Source - Query [1] Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.End ErrorError: 2009-09-04 13:01:29.76 Code: 0xC004706B Source: Data Flow Task DTS.Pipeline Description: "component "Source - Query" (1)" failed validation and returned validation status "VS_ISBROKEN".End ErrorError: 2009-09-04 13:01:29.76 Code: 0xC004700C Source: Data Flow Task DTS.Pipeline Description: One or more component failed validation.End ErrorError: 2009-09-04 13:01:29.76 Code: 0xC0024107 Source: Data Flow Task Description: There were errors during task validation.End ErrorDTExec: The package execution returned DTSER_FAILURE (1).i can not even run this from the SQL Server Business Intelligence Development Studio, so if i create a data task in there it also ends with the same error.can you help me on solving this issue.thank you.
↧
SSIS Event Handler email task not executing
I am trying to run a proof of concept to prove I can send an email with the error message using the event handler OnError. I'm basically using the instructions here:[url]http://sql.richarddouglas.co.uk/archive/2009/11/let-ssis-notify-you-of-its-own-errors.html#axzz2zukUesQK[/url]WhenI run the package the dataflow fails but I dont recieve an email but when I right click the send Mail task and left click Execute task I do get the email.Why am I not getting the email when I execute the package?
↧
↧
Conversion failed because the data value overflowed the specified type error
I have a .net etl package that imports data from a table in Oracle into SQL Server, however the job fails and the error I am getting is as follows:Error: 0xC02020C5 at INC PO_LINE_LOCATIONS_ALL, Data Conversion [18465]: Data conversion failed while converting column "QUANTITY" (9832) to column "QUANTITY" (18478). The conversion returned status value 6 and status text "Conversion failed because the data value overflowed the specified type.".Error: 0xC0209029 at INC PO_LINE_LOCATIONS_ALL, Data Conversion [18465]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "output column "QUANTITY" (18478)" failed because error code 0xC0209082 occurred, and the error row disposition on "output column "QUANTITY" (18478)" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.Error: 0xC0047022 at INC PO_LINE_LOCATIONS_ALL, DTS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Data Conversion" (18465) failed with error code 0xC0209029. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.Error: 0xC0047021 at INC PO_LINE_LOCATIONS_ALL, DTS.Pipeline: SSIS Error Code DTS_E_THREADFAILED. Thread "WorkThread0" has exited with error code 0xC0209029. There may be error messages posted before this with more information on why the thread has exited.I checked the external and output column datatype in the Advanced Editor of the OLE DB Source and the datatype is set to double precision float for both. I used a data conversion component, but that did not help. Any inputs in resolving this will be much appreciated.Best regards,Monisha
↧
SSIS 2005 service not starting after KB2716429
Hi all,We have been experiencing problems with SSIS service not starting with the usual useful error "The service did not respond to the start or control request in a timely fashion."The common factor on the machines on which this is happening compared to those where it is not would appear to be that KB2716429 (for MS12-070) has been applied. It was working fine a fortnight ago.Has anyone else experienced this? If so, do you have any fix/workaround?
↧
FTP Task does not receive files
I have a very simple SSIS package with one task that receives a file from an FTP site and saves it to a local folder. The SSIS package shows the it executes successfully with no errors, but the file is not received. I am completely stumped - I have another program that is able to receive the same file from the same FTP site with the same options, but it doesn't work in SSIS. In SSIS, I can send files to this FTP site just fine, and I can receive files from other FTP sites without issues. So, I'm really stumped.I want to use the SSIS FTP task (rather than my other program that works) because I will add steps to this SSIS package once the FTP part works.[u]Here are my settings[/u]:Connection Manager: FTP (these settings work to send files to the site): Server Name: Server port: 21 User name: Password: Time-out: 60 Use Passive mode Retries: 5 Chunk size: 1Connection Manager: Destination Type: Existing Folder Folder: D:\FTP Task: FtpConnection: FTP (defined above) StopOnFailure: True IsRemotePathVariable: False RemotePath: "/filename.csv" IsLocalPathVariable: False Local Path: Destination (defined above) OverwriteFileAtDesk: True Operation: Receive Files IsTransferAscii: FalseAny thoughts as to why I can send to the FTP site, but not receive? Or why the package shows success when it's run? I can receive using a different program.
↧