Yes, I'm kind of a noob with SSIS. We frequently move hundreds of thousands of records from Text files to Raw tables, and ultimatley to production. After I get the Raw data into a Database table, I use a Data Flow Task to push it to a Staging table. What does Bulk Insert get me? Just throwing it out there to see what comes back.
↧
Bulk Insert vs. Data Flow Task?
↧
No tables or views could be loaded.
In the OLE DB Source Editor, the drop down select list for "Name of the table or view" returns "No tables or views could be loaded." The Test Connection succeeds in the connection manager for the DB2 data source.I am creating this SSIS package to replace a DTS package that does show/load the list of tables from this data source.Would greatly appreciate some assistance with this!
↧
↧
Conditional SSIS Tasks based on a result set?
I have a source table with data that could go to multiple sources. For example, Apples, Oranges, Kumquats. I could write an Execute SQL Container to push the Apples to the Apples table. But each week, there may or may not be data for Apples in the source. I could write a script that only executes the sql if the records are there, but I wondered if there is SSIS way I could check and then skip the Data Flow task if there is no data to flow....Does that make Sense?Crusty
↧
Copy a CSV file to another network drive
I am using SSIS 2008. The task is following.1: Execute a storted proc and using the output create a CSV file.2: this CSV file need to be copy to network drive e.g. (\\servername\datafolder)please suggest what is the easiest way to acheiev this.
↧
we don´t see packages on MSDB chapter SSIS
hello all:we have a problem with SSIS of sql server 2005 on server with SO windows 2003 SP2, I try to explain the best posible but my english is poor, both remotely and locally we don´t see the packages on chapter MSDB of SSIS, the packages en File System chapter are well, we review on the sysdtspackages90 table and the packages exists, we review this url http://blogs.msdn.com/b/dataaccesstechnologies/archive/2009/11/13/ssis-error-failed-to-retrieve-data-for-this-request-reasons-and-resolutions.aspx, and we tested with change the file MsDtsSrvr.ini.xml, add the instance name, review the permissions on MSDTC chapter on Component Services, view that the users are in Disctibuted COM User Group, we restarted the SSIS Server and the Server, but we follow the same error, someone have any idea of which is the solution, thanks. :crazy:Microsoft SQL Server 2005 - 9.00.4035.00 (X64) Nov 24 2008 16:17:31 Copyright (c) 1988-2005 Microsoft Corporation Enterprise Edition (64-bit) on Windows NT 5.2 (Build 3790: Service Pack 2)the error that show isFailed to retrieve data for this request. (Microsof.SqlServer.SmoEnum)Communication link failureTCP Provider: The specified network name is no longer available. (Microsoft SQl Native Client)
↧
↧
File System Task > Move Files > Error - Process cannot access the file because its being used by another process
Hi,I have 2 foreach loop containers within my control flow:The first foreach loop container loops through a directory and loads files into a tableThe second foreach loop container loops through the same directory and moves the files to an archive directory.When executing the package I receive the following error message:[File System Task] Error: An error occurred with the following error message: "The process cannot access the file because it is being used by another process".Any suggestions would be greatly appreciated.Regards,Chris
↧
combining the flat file without changing its original spaces between the columns...Spaces are critical
Hi All,I have created an ETL process which could delete sapces and have managed to get a flat file with required spaces between the columns (spaces between the columns are not fixed). i have 4 output flat files now i have to union them ( they are of same datatype). i dont want any delimiter in my output i just want to union those flat files.i want the flat files one after the other.1) combining the output flatfiles in exact same way.2)they must be one below the other eg:1 ----------------------------------- 2 ---------------------------------------3---------------------------------------4Can Anyone Help Please its urgent!!!Thanks:-D
↧
Data Conversion error after redirect row on OLEDB Destination
Using SQL Server 2008 Integration Services.In the oledb destination I have set data access mode as Table or View and have set a redirect row to a exception table. The field that I need to insert is type DT_STR and the exception table expects the field as DT_WSTR. So after the redirect row I added a Data Conversion to convert the field from DT_STR to DT_WSTR. But I get the error below:[Data Conversion [9010]] Error: Data conversion failed while converting column A to column B . The conversion returned status value 8 and status text "DBSTATUS_UNAVAILABLE".I tried to convert other columns from DT_STR to DT_WSTR, but get the same error. If I don't include any fields from the oledb destination and just sample text then the record gets inserted successfully in the exception table. Is there something I need to do the fields after a redirect row?When doing a table or view - fast load there are no issue with the data conversions.
↧
SSIS Importing A Null DateTime Problem
Hi,
Im running SQL Server 2005 and having a problem importing a text file using SSIS.
I was using DTS to import an ASCII text file into a table in SQL 2000. The table has 2 fields: a primary key varchar(10), and a DateTime field which can be null. Everything was working fine with DTS, if the text file's date field was emtpy, i.e. (~20070914BM~, ), a Null value was placed in the table.
After I migrated to SSIS, the table shows a value of 1753-01-01 00:00:00.000 instead of a null value using the same text file as before. Scouring the net, I found that this value is the lowest possible value for a DateTime field.
To hopefully solve the problem, I tried making a new table with the same structure as the other table and manually entering in a record leaving the datetime null. Then using SSIS to export this value (from the new table) to a text file and importing that into the original table. It still loaded as 1753-01-01 00:00:00.000.
On the table structure, the default value of the DateTime field is set to use Null.
My question is why is it defaulting to this value and not using the null from the text file.
Thank you in advance.
↧
↧
Downgrade SSIS 2008 package to 2005
I developed and tested 3 .dtsx packages in my development environment using Visual Studio 2008 v9.0.30729.4462 QFE, not realising that the servers these packages should be run on are still SQL server 2005. How do I make these packages created using Visual Studio 2008 with SQL Server Integration Services installed run on SQL server 2005 ?The error messages I get when trying to execute the packages on SQL 2005 are:[code="other"]The version number in the package is not valid. The version number cannot be greater than current version number.Package migration from version 3 to version 2 failed with error 0xC001700A "The version number in the package is not valid. The version number cannot be greater than current version number".Error loading value "<DTS:Property xmlns:DTS="www.microsoft.com/SqlServer/Dts" DTS:Name="PackageFormatVersion">3</DTS:Property>" from node "DTS:Property".[/code]The servers can not be upgraded to SQL 2008, so I need a way to get my packages saved in a format acceptable for SQL 2005.Thanks a lot.
↧
Problem in loading filenames through ForEachLoop container
Hi,I am using SSIS 2005 ForEachLoop container to pick the files from a location. My files have mainly 3 types of names. 1.XYZ_ra20130406289018wb_59815.NOR2.XYZ_a201304300926hbv0_58099.NOR3.XYZ_ca20130406289012vq_8.NORI have configured the ForEachLoop accordingly by providing appropriate variable name as into 'directory' property (in collection) and set the variable mapping to a variable which will store the filename for each file.I am storing the file names in a table. The problem is, I could store only single type of filenames (starting with XYZ_a) and not the other types which are starting with XYZ_ra and XYZ_ca. Any inputs on where I am making any mistake will be very helpful.Regards. --------------------------------------------------------------------------------
↧
Script to open encrypted, dynamic excel files
Hi I need a script for my SSIS package that will open my encrypted excel file, that has a dynamic filename ending in "mmddyyyy". I have a powershell script that will open and reset the password, but I think I would prefer a vb script that will open the file and remove the password (or maybe not as long as I can extract the data while it is open?) as I will likely set it up as a SQL job to extract and send to sql daily. Any insight greatly appreciated!Thanks,Lorna
↧
Problem with connection argument in CMDEXEC command
I'm putting this under the SQL Server 2005 Integration Services subject because I'm trying to execute a package using a SQL Server Agent Job and I can't get the change I need to make to work.To make a long story short, I have to use the "Operating System(CmdExec)" type when using the SQLl Server Agent Job because my package uses Excel and I have to access the 32-bit DTExec.exe. I'm having trouble with my package database connections, in all likelihood related to the lack of a password in the connection string. So, I went to the Execute Package Utility (DTExecUI), added a password to the connection string under the connection managers, went to the command line, saw that the connection command was there ("How nice," I thought, "DTExecUI did all the work for me"), tested everything (everything ran just fine), copied the command line text, then pasted the part I needed into the command of my SQL Server Agent Job. But it didn't work.Here is an example of my command:"C:\Program Files (x86)\Microsoft SQL Server\90\DTS\Binn\DTExec.exe" /FILE "D:\MyFile\MyPackage.dtsx" /DECRYPT "mypassword"/[b]CONNECTION "My Connection String Name"[/b];"\"Data Source=MyServer;User ID=myuserid;pwd=thepassword;Initial Catalog=MyCatalog;Provider=SQLNCLI.1;Persist Security Info=True;Auto Translate=False;\"" /CONNECTION "MySecond.Connection.String";"\"Data Source=MyServer;User ID=myuserid;pwd=thepassword;Initial Catalog=mycatalog;Persist Security Info=True;\"" /MAXCONCURRENT " -1 " /CHECKPOINTING OFF /REPORTING EWCDI And here is an example of the error message I'm getting from the agent job:Argument "My" for option "connection" is not valid. Process Exit Code 6. The step failed. So what's wrong? And why does it work when using DTExecUI? I seem to remember that in the past I've had to edit some apostrophes when using the DTExecUI command text in an agent job but I can't remember what I did. Or, is it that there are spaces in "My Connection String Name?" When I've tried to search for the correct syntax, there is paltry information available online.If I go back to my original command text without the database connection information, everything works fine (well, except for the password problem when trying to make the connection), so I don't believe this is a problem with running a command in a job Any ideas?
↧
↧
SSIS Execute SQL Task with String Output Parameter problem, using ADO.NET
Greetings ... SSIS newb here.I have an Execute SQL task using ado.net that successfully uses an output parameter that is an integer. What I really want, however, is for the output parameter to be a string. I've been banging my head against the wall for a couple of days on this now. I'm using VS 2008, sp1 against SQL Server 2005.However, when I change the (1) parameter in the sproc to a varchar(250) and (2) in the SSIS variable to a string, defaulting the value to MyOutput, and (3) changing the datatype from Int32 to String in the Execute SQL Task Editor Parameter Mapping I get an error that's not too terribly informative: "A severe error occurred on the current command. The results, if any, should be discarded.A severe error occurred on the current command. The results, if any, should be discarded.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.For testing, I've set the string output to a constant making sure there's no issues with Null values. Any ideas about where I've gone wrong? Again, works fine when the output is an INT -- the STRING is giving me fits. I'd really prefer not to use OLE_DB. I know that I could always use a resultset but it's now a personal mission to make this work! :-)Thanks so much for any thoughts or ideas.-Steve
↧
Merge records in a sorted order in SSIS.
I have a set of record types saying TH as Header and T1a, T1b, T1c, T1d, T1e, T2a, T2b, T2c, T2d, T2e as other type of records. TH table has a SortKey column with values 1, 2, 3, 4, 5. All these record types are tied by a column called RecordID. The output fashion I desire is below having corresponding number of records listed under associated TH record:RecordType RecordID SortKey TH 3678 1 T1a 3678 T1b 3678 T1e 3678 TH 2455 2T1c 2445 T2d 2445 TH 4522 3T2d 4522 The SortKey order has to be maintained in 1, 2, 3 fashion in output file, and keeping all the record types tied by RecordID because the output file has to be read in the order of SortKey. I am doing this all in SSIS using Merge task to have the records merged as TH ->T1a ->T1b....Thank you for you help!
↧
SSIS Error - Code : 0xC002F304 (At Send Mail Task)
Hi all I have an SSIS package scheduled to run once a month. It's running under the SA Account and account has all privileges. The package used to run fine with no errors until two months ago. Error (Only happens when SQL Server Job executes the package) - Code: 0xC002F304 Source: Send Mail Task Description: An error occurred with the following error message: "Service not available, closing transmission channel. The server response was: 4.4.1 Connection timed out". End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 12:53:43 PM Finished: 1:05:25 PM Elapsed: 701.953 seconds. The package execution failed. The step failed.However, when the package is run from visual studio, outside the scope of the SQL Job it runs fine. Can any one suggest any pointers / areas I could investigate thanksvani
↧
SSIS and MIMER
Hi, I have to copy some data on a nightly bassis from a MIMER database hosted on a UNIX platform. However as the MIMER engine is so old i can not use the ADO.Net connectors for mimer. The only way i can create a connection is VIA ODBC, but if i use the ado.net connectors for ODBC, retrieving data is painfully slow, even if i compare this to a straight forward linked server connection using OLEDB for ODBC drivers. Is there another angle I could take for this?Thanks,Karl McIntyre
↧
↧
SSIS - Truncation Warnings
I have created a package to import data into a table that has been created per a data dictionary. I used Bryan Knight's book as a guide to get everything set up and am confident with that part. The package runs when I sart debugging, and it appears to be going through all the rows in the text file, then it ends without inserting any rows, and I see a list of Truncation warnings pertaining to 66 columns in the rows under the progress tab. My data flow task finishes successfully, although no rows make it into the table. Several of these warnings appear:[Load alphaData [346]] Warning: Truncation may occur due to inserting data from data flow column "Gl Co Cd" with a length of 50 to database column "GL_CO_CD" with a length of 5. Any thoughts? Thanks, bph
↧
create a SSIS package which will call the stored procedure and dump the output of the procedure into table
I want to create a SSIS package which will call the stored procedure and dump the output of the procedure into table.This stored procedure accept an input parameter e.g. Date which i can retrieve from another table like select max(Date) from userid and pass to procedure.SSIS packae will return the output and i need this resultset ouput to dump into another table.But before inserting i want to delete the rows from that tables if any rows exist for that date and then finally insert the resultset.
↧
How to read data in a pdf file in SSIS
I was wondering if any body had a situation where data needs to be extracted from pdf files and exported to SQL Server. I really appreciate in advance.
↧