What is the best way to open this to see what it is doing? I am told it is executing a stored procedure & then writing to .csv file. It is running via scheduled job using exec master..xp_cmdshell (I think this may have something to do with migration & 32 bit vs 64 bit, but not sure). I do see that the scheduled job is executing & the .csv files are being populated, but how can I see this from the designer? I want to see each step in the process. Nothing I have tried to do will open it so I can see it via a design type of screen. Help? Please.thxjude
↧
Inherited a .dtsx
↧
SSIS & Environment Variables
I've been struggling w/ some quirky issues lately regarding use of environment variables with package configurations in my SSIS packages.When does a package read the value of an environment variable? We’ve got into a position where we need to regularly change the value of an env var. We were hoping a package references the value at runtime, but we thought we found that it was in fact when a package was deployed.To make it worse, we’re finding that this may not even be the case. When the value of an env var is changed, sometimes the package picks it up, sometimes not, even after a redeploy.This little problem is quite reproducible, and for the env var values that the change doesn't get picked up by the package, I've verified, as the service account that is running the packages, in the 3 places I know to look that the env value is in fact changed and correct in all three places it just isn't right in the SSIS package when it runs:Places I checked:1) My Computer>Properties>Advanced...2) DOS "SET" command3) The registry.Is anybody else experiencing similar problems with Environment Variables?Is there anywhere else I should be checking to see the current value of an env var?I've got a lot more detail I can provide, but I was trying to keep things breif.
↧
↧
Import Flat File Database (Entire) to SQL Server?
We were given an ODBC driver to connect to some flat file database. This database is no longer in use but we want to keep the data around for auditing purposes. The users would like to convert the flat file database into a SQL Server database. Would I have to use SSIS and do this table by table? Or can I import the entire thing at once?
↧
Pull "unformatted" data into existing table structure via SSIS?
We created a bunch of tables some with 40+ columns each and this was a tedious process. We also have several flat files that match the table layouts and we want to import the flat files, using SSIS, into the tables withtout defining the schema of the flat files in SSIS. Is that even possible? (Bottom line: who wants to do the same work -- defining schemas -- twice. Once when we defined the tables and again using the usual out-of-the box approach SSIS seems to adopt. )TIA,edm2
↧
Executing SSIS package with parameters and 32 bit data source from SSMS
Greetings, I have a SSIS package that imports data via a 32 bit data source. I am able to run this from the command line on the server, but am unable to execute if from SSMS. The package property Run64BitRuntime is set to False.Here is the syntax when I run it successfully from command line from C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn[code="plain"]dtexec.exe /FILE "C:\Program Files\Microsoft SQL Server\100\DTS\Packages\MAS90Hybrid\MAS90Hybrid.dtsx" /CHECKPOINTING OFF /REPORTING EWCDI /set \package.variables[StartDate].Value;2013-02-01 /set \package.variables[EndDate].Value;2013-02-28 /set \package.variables[CountryCode].Value;AF /set \package.variables[ODBCConnection].Value;"AFG"[/code]Here is the syntax I'm using in SSMS:[code="plain"]declare @param varchar(4000)declare @country varchar(2)declare @odbc varchar(10)SET @country = 'AF'SET @odbc = 'AFG'SET @param = 'C:\"Program Files (x86)"\"Microsoft SQL Server"\100\DTS\Binn\DTExec.exe /F "C:\Program Files\Microsoft SQL Server\100\DTS\Packages\MAS90Hybrid\MAS90Hybrid.dtsx"'+ ' /CHECKPOINTING OFF /REPORTING EWCDI '+ ' /set \package.variables[StartDate].Value;2013-02-01'+ ' /set \package.variables[EndDate].Value;2013-02-28' + ' /set \package.variables[CountryCode].Value;' + @country + ' /set \package.variables[ODBCConnection].Value;"' + @odbc + '"'EXEC master..xp_cmdshell @param[/code]I believe the main error "Description: System.Data.Odbc.OdbcException: ERROR [IM002] [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified" is cause by not being able to access the 32 bit driver. Why can I run this from the command line, but not SSMS? I'm trying to run it in SSMS because I would like to put it into a stored procedure and have it called by an end user. Any thoughts or suggestions on other methods?Thanks,Tim
↧
↧
error 0x80040E21 "Multiple-step OLE DB operation generated errors...."
I've used the Import / Export wizard to dump a tables from a SQL 2005 db to a series of Excel sheets, however when I try to import this data back into a SQL 2005 DB I get the error above.Full error:An OLE DB error has occurred. Error code: 0x80040E21. An OLE DB record is available. Source: "Microsoft Native Client" Hresult: 0x80040E21 Description: "Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.".Cannot create an OLE DB accessor. Verify that the column metadata is valid.
↧
SSIS - Package Configurations - Store Client Certificate in SQL Server Table for HTTP Connection Manager -> CLIENT CERTIFICATE
Dear All, Hi! I have a requirement to download Access file from HTTPS server using Client Certificate. To achieve the same I designed a SSIS package with HTTP Connection Manager and supply the Client Certificate in it by ticking "Use Client Certificate".Now, the problem is I have 3 different environments (Development, Testing & Production) with their dedicated servers. On all these 3 I need to open Package & re-select the Client Certificate in "HTTP Connection Manager".Is there any solution to store the Client Certificate in SQL Server & use it via SSIs -> Package Configurations -> Configuration Type = SQL SERVER.So that there will be no need to open & edit SSIS package. Instead of this we need to just populate CLIENT Certificate row in SQL Server table & use that value for the "Client Certificate" in HTTP Connection Manager.Please provide the complete code / solution as I don't know the coding.
↧
Access Schemas
I was recently assigned a task of dynamically extracting Access schemas...How do i approach using SSIS..Any thoughts or suggestions would be highly appreciated
↧
General SSIS package to export any table into .csv
Hi guys,I need to create an SSIS package that takes a table name as a parameter and exports out its data in a CSV file.The challenge is that if I use a data flow task and a flat file connection manager (for csv export), I have to specify the file/table structure. I will not know the table structure until the run time because it is input specific.Has anyone had a similar problem and implemented a solution?I was thinking along the lines of using C# in a script task to get the column structure of the input table, read the data and write it out into a CSV file. I could not come up with a full blown solution though.Any advise is appreciated.Thanks!
↧
↧
Converting VARCHAR(max) to unicode for Excel export
I am calling a function which returns a comma-separated list of values as a single column. It is part of an overall stored proc that pulls multiple columns. I have no problems returning a good results set. My issues is that I'm attempting to export the results to Excel using SSIS. I was able to use the Data Conversion Transform to convert all the non-unicode fields to their unicode equivalent before selecting them in the destination configuration mapping. The only one giving me trouble is that function-based field. I am guessing it's the field length? I tried to substring the value using the derived column transform before I even attempted the conversion but that didn't work. I tried to convert it to DT_NText (the unicode text stream) which it seems to like ok. (No red X on the destination transform). However, when I run the package, it keeps failing with:[32]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E21.An OLE DB record is available. Source: "Microsoft JET Database Engine" Hresult: 0x80040E21 Description: "Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.".[InvoiceDetails [32]] Error: An error occurred while setting up a binding for the "BilledCodes" column. The binding status was "DT_NTEXT".[InvoiceDetails [32]] Error: Cannot create an OLE DB accessor. Verify that the column metadata is valid.
↧
ftp task - PGP public key
Hi,I am in the process of using a FTP task in my ssis package.This is to retrieve files from a source such as xxx.comThe source company is saying in order for them to allow this (i.e. files to be retrieved over the internet using FTP), The files need to be PGP encrypted and so they are asking me for the PGP public key.Question:1- Does the ftp task in ssis have to do anything with this PGP public key?2- I have checked the properties of the ftp task and there is no setting for PGP. Is there a setting for this in ftp task?Any thoughts please?Thanks
↧
ssis and ssrs interview questions
can any one tell some interview questions in reporting service and integration serviceon sql server 2005 please this is urgent and that will be help full thanks
↧
SSIS, "Class Not Registered" error...deployment or permissions issue?
I'm getting an error with an SSIS package that reads from an Access DB on a network share and writes to the SQL Server (local to the SQL Agent). The error is long, but it basically seems to say:...MySSISPackage Connection manager "MyAccessDB.mdb".......SSIS Error Code DTS_E_OLEDBERROR........An OLE DB record is available. Source: "Microsoft OLE DB Service Components" Hresult: 0x80040154 Description: "Class not registered".However, the error only occurs when the SQL Agent attempts to run the package (i.e. when scheduled). No error when I run it from my local machine (package running with MY network credentials). I think this is a permissions issues with the SQL Agent that's running the SSIS package (it may not have read access to the MS Access DB). Still waiting for verification from the IT folks that the SQL Agent account has the correct permissions.On the other hand, I'm dealing with two dynamics that I'm not used to (not to mention that I'm still finding my way around SSIS) so I thought I'd ask about them here:1. In my environment, you cannot store/install SSIS packages on the SQL servers. To get around this, I've been storing the SSIS packages on a network file server share and pointing the SQL Agent to the share location. Does anyone else do this and if so, any problems?2. I haven't been "installing" the SSIS packages...just moving the object file around...from the "bin" folder of my SSIS project's directory (in the VS2005, "projects" folder), to the network share. Is this ok to do?
↧
↧
How to load Date columns in consistent manner
Hi,I am loading the table from Excel source using SSIS 2005.Excel contains one of the columns as [b]Exp_Date[/b] and its examples values are10/09/2010 17:00:51 11/09/2010 11:45:16 11/09/2010 11:45:16 13/09/2010 10:07:59 13/09/2010 10:07:59 13/09/2010 10:07:59 14/09/2010 10:44:59 15/09/2010 10:44:59 16/09/2010 14:19:25 In table, for some columns it is loading fine. But for some columns it is loading in an inconsistent manner, i.e. a date that should be loading as ‘10/09/2010’ is actually loading as ‘09/10/2010’.Please advise how to load the date column values into table as it is in Excel file.RegardsSqlStud
↧
Split up date in conditional split SSIS
Just now I have a date column with format of 2011-05-25 I would like to split this into three columns:Year Month Day2011 05 25 Can this be done using SSIS ? or even in SQL OLE DB?
↧
Improve Performance of Lookup Transformation
HelloI need to tune SSIS package.I use Lookup Transformation for Insert Vs Update Operation on Destination Table.Every night I ran ETL, From Source Query I got 740K records and I compare some key columns for Insert via Lookup transformation. If its No match then Insert to Destination table through OLE DB Destination else Update some defined column through OLE DB Command.I got perfect setup that meet the requirement but Problem is Performance.The Lookup takes a while to finish. Yesterday it took 25 Hours to finish so please help me to Improve Performance for lookup Transformation.Thanks
↧
VISUAL STUDIO 2005 ALWAYS THROW AN ERROR DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER
HI!I have SSIS Package and I set the protection level to DontSaveSensitive. I'm using Xml File and SQL Database as my configuration.It works fine in my machine then I copy my ssis project to other machine and It won't compile anymore.Visual Studio 2005 in that machine always throw an error(see below) for the connection manager that is saved in sql server.The connection manager that is saved in xml doesn't throw an error at all. DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "[TESTTABLE]" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed.
↧
↧
Load data into CSV file
I am fetching data from sql server 2005 table, there are 3 columns D1,D2,D3 which are in datetime datatype. Into SSIS i have used oledb source to read all the data from a table and then Flat File destination to load into CSV file using flat file connection manager.However the data load is successfull but the column D1,D2,D3 are population as below.The source value in table are D1: 2011-02-03 00:00:00.000D2: 2011-02-03 09:53:41.740D3: 2011-12-15 14:42:09.490The CSV file column format for D1,D2, D3D1: 2/3/2011 0:00D2:2/3/2011 9:53:42 AMD3:12/15/2011 2:42:09 PMBut i need into to load into mm/dd/yyyy or mm-dd-yyyy format only into CSV file. please help
↧
Import XML Data into SQL Server database using SSIS package?????
Is this even possible? I looked everywhere. I can't find a tutorial to save my life. All I found on internet are a bunch of unanswered questions like mine. Can someone point me in the right direction?
↧
Metadata errors moving from Testing to Production
Guys, I really need some life saving help on this one!I have a package that uses Progress 10b OpenEdge ODBC drivers. We have a system DSN created on the TEST box which connects to a DEV progress database and the package works just fine.When we modify the ODBC connection to point at the migration testing environment I get the following error message from one of the dataflow tasks which carries out a slowly changing dimension upsert."The external metadata column collection is out of synchronization with the data source columns..."I have pulled the .df (table definition file) from the DEV and TEST environments and there are not differences in the columns or indexes. Any idea why I would be getting this error message and how to fix it. Unfortunately using BIDS does not seem to be an option because:a) the package is deployed on a 64bit VM server with the OpenEdge10b 64 bit drivers and BIDS2005 is a 32bit application and won't run the 64bit ODBCb) Because the test db contains live data it takes an act of GOD to get a username and passoword on a development machine so I can't recompile against the TEST server.
↧