Hi I tried to loading xml into Oracle table using SSIS,OLEDB destination wont support, so I use ADO.Net Destination,ADO.NET Destination will load upto some records and then its failing so,I increase the Batch size property of the ADO.net Destination property.I need One clarification, how to calculate the Correct Batch size, If it is internal buffer size, then how to calculate the Internal Buffer size, and How it relates to batchsize.thanks,Sai.
↧
ADO.NET Destination Custom Propertiees?
↧
How to load data to target tables (only if no dataflow task is fail in ssis package)
Hello All,In my ssis package, i have 25 data flow tasks which will load from some third party database in sql server to staging database in sql server(both db's are in same server)the target tables has some primary key constraints, this job runs daily once,first step is it clears all tables in target DB,second it loads data to tables,so when ever one dataflow task fails(due with primary key violate or soem data type errs mostly) then some tables has data and some tables has no data,so what i am planning is first store temp tables (normal tables) in target db then at last (if no errors) then load to actual tables.,is this goodway or can i do any smart way to do this funcatioanlity (because i have to create 25 temp tables)?so at the end, if any step fails they the tables should contain yesterdays dataThanksasita
↧
↧
how to devied fullname into firstname and lastname
Hiin my source i have fullname column it has fullname--------RobertJainJansonStuartIsmailSummitJohnAbharahamin my destination i have change this fullname column into firstname column and lastname columnfirstname Lastname-------- --------Robert JainJanson StuartIsmail SummitJohn AbharahamHow do i have to do this in SSISThanksvasu
↧
Creating Header AND Footer to a flat file destination file
Hi Guys,I am working on a financial project; the requirement is interface flat file should not contain any duplicated arrangement. (e.g. Check Sum) this requires the source extraction process to include quality checks to ensure that same arrangement is not included in interface files more than once.[b]Header Record [/b][b]Fields Type Value [/b]Record TypeCode String 000Record Format Version No Number 1Creation Date/Time Stamp DateTime 20060601013120Region String US [b]Trailer Records[/b]Record Type Code String 999Record Format Version No Number 1Creation Date/Time Stamp DateTime 20060601013120Region String USDetailRecordCount Number 35001Control Total Number -2993278934.87 [b]Every interface file will consist of the following record types:[/b]· Header record – The first record will be the header record.The purpose of the header is to provide identification information of the file that can be checked by the receving system for assurance that the correct file received. There is only one such record per file and it is the 1st record in the file. · Detail records – There will be zero or many detail records. They will follow the header record.· Trailer record – The last record will be the trailer record.The purpose of the trailer record is to provide identification information of the file and control data that can be checked by the receiving system for assurance that the correct file received and provide a set of batch control total that can be used by the receiving system to check if the content of the file has not been altered since the file was created. [b]Control Totals:[/b] Detail Record count, excluding the header record and trailerrecord.Control Total 1 = Simple sum of “principle_amount_1” of every detail arrangement. There is only one such record per file and it is the last record in the file. I need some help here, how to approach this requirement. Do I need to create separate tables for header and footer with value types. How to check sum header and footer as per above requirement ? Any article or code related to above requirements please let me know I will try my best to figure it out.Management insist me to do it MS SSIS. need some help. Thanks in Advance, D
↧
Varchar data displaying NULL while loading to the table
HiIn excel 2007 file, one of the columns contains the below values[b]Job Number [/b]1013238610289093101326281019100210162417101371361018901710160436101333331019275210182457WSDD-105346353WSDD-105685515WSDD-105977159WSDD-107316895WSDD-107479127As i am using ssis 2005, installed driver to support the 2007 file format and set the connection string as "Data Source="+ @[User::File_Name] + ";Provider=Microsoft.ACE.OLEDB.12.0;Extended Properties='Excel 12.0 XML;HDR=YES;IMEX=1';".[b]Issue:[/b]In sql server table, i declared column "Job number" as Varchar.While loading the data from SSIS to table, it loads the numeric data correctly, but displayed "NULL" for Varchar data (ie)1013238610289093101326281019100210162417101371361018901710160436101333331019275210182457NULLNULLNULLNULLWhile previewing the data in OLEDB source itself, it is showing "NULL".Please advise how to load the varchar data for this scenario.RegardsSqlStud
↧
↧
help needed
hello everyone, I am a DBA for last 12 yrs. But I am out of work since a yr because of illness. Now I am back and I would like to start working again.But I need to update myself with the SSIS, SSAS,sql reporting service etc. Can anybody help me with these? Or know any place that they help people in these areas. I live in brooklyn, please help me if anyone can. Thanks in advance.
↧
SSIS Package execution through SQL Server Agent Jobs
I am try to execute the SSIS package through the jobs. When I schedule it as a job, it fails getting error 12291. But an individual package runs fine. I have many other SSIS packages scheduled on the same server using the same security. What can be wrong, or where can I look to find out what the problem is?Please suggest to resolve.
↧
Issues With DB2 CHARACTER Field Source - SSIS 2008
I don't see a forum for SSIS 2008, so I guess I will post here??I have an OLE DB connection to an IBM DB2 source. I am trying to bring in some data from a query on a few tables. One of the fields I am trying to import is defined as a CHARACTER with a length 70.When I run the package, I get the following errors:[OLE DB Source [1]] Error: There was an error with output column "CC_COMMENT" (743) on output "OLE DB Source Output" (11). The column status returned was: "Text was truncated or one or more characters had no match in the target code page.".[OLE DB Source [1]] Error: The "output column "CC_COMMENT" (743)" failed because truncation occurred, and the truncation row disposition on "output column "CC_COMMENT" (743)" specifies failure on truncation. A truncation error occurred on the specified object of the specified component.I have tried adding a Data Conversion and converting to both DT_STR and DT_WSTR with Lengths of 70 and 255.I have tried inserting into both a varchar(max) field as well as a char(255) and an nvarchar(max)In every case, it fails.Any ideas? It makes we wonder if there is some kind of wonky character in the field somewhere, hence the "no match on the code page".PK
↧
Issues while executing the xp_cmdshell through SSIS
Hi All -First let me tell you what my SSIS package does,[u][b]SSIS Package[/b][/u]: -As per the business requirement, i have to run the Excel & Access Macro's thru SSIS package. So, what i did is, i have created the .vbs scripts and trying to executing them through SSIS package but unable to succeed becasue of the following errorMicrosoft (R) Windows Script Host Version 5.8Copyright (C) Microsoft Corporation. All rights reserved.NULLC:\LCSP Applications\Alcspscript.vbs(6, 1) Microsoft Office Excel: Microsoft Office Excel cannot access the file 'C:\LCSP Applications\partner_email.xls'. There are several possible reasons:NULLThe file name or path does not exist.The file is being used by another program.The workbook you are trying to save has the same name as a currently open workbook.NULLNULLBut the interesting thing is, if i run those .vbs scripts just by double clicking them its working fine.Note: - I have enabled the "xp_cmdshell" command also.Any ideas will be greatly appreciated.Many Thanks in Advance.
↧
↧
SSIS - to read a NULL values in excel source
Hi,How to read the null values from excel source while doing in the transformation or to stop the package when the particular column has null values.
↧
Need help with recordset
Hello, I am very new to SSIS. I currently have 9 million rows in a recordset. I am going through each of the 9 million records in a foreach loop. What my question is, how can I change the values of a row while I am in the for each loop? Any feedback would be greatly appreciated!
↧
Script task using batch file parameters
Hi all,I have created a batch file to run my SSIS package. I will be able to pass parameters in my batch file such as 20121228 (YYYYMMDD format) I have created a package variable named ExecDate of string type in SSIS. And inside script task i have a line of code as:[code="vb"]Dim runDate As DateTime = Now[/code]now instead of declaring runDate as current datetime, i would like to change it to if ExecDate = "Default", runDate = Nowelse runDate = to the parameter i passed in the batch file. Note: my ExecDate is of String datatypeThanks in advance, pros please helpupdate: i think i have solve the above problem by advising user to only pass in parameters of 2012/12/28 format and using a CDATE function to convert it to date.
↧
SSIS Script task to change table name in data flow task
Hello,We need to change the table name of 'OLE DB Destination' task.I am not able to use variable due to there are almost 20 data flow tasks in SSIS package and I need to use more variables.Is it possible to update table name using SSIS Script task?If yes, how can I use SSIS Script task to update the table name?I am really thankful if you help me to resolve the issue.
↧
↧
Demanding and difficult logic qns PART 2. Sorry but i need help.
Hi all, Please read the following attached word doc. Inside there is a target table with 6 columns which is what i want to achieve. However now i am only able to derive 5 out of the 6 columns. Base on the 5 columns, i should be able to derive the 6th but i do not know how after thinking for days. The 6th column which is FirstEntry should record down what is the First Entry Date time for that consecutive days. I dk how to explain in words. Hope some1 out there will be able to uds my table.Anyone can help me derive the 6th columns? Hopefully using simple sql.Thanks
↧
SSIS Package hangs without any errors
Hello all,
The package I've been working on just hangs now without any errors in the execute process window or the application event log; running by either right clicking the master package and using "execute package" as well as double clicking on the master file and executing from the execute package utility. It just hangs, no red boxes just yellow and green ones if they change at all, no errors logged anywhere that I've found.
It has a three level hierarchy: master calls four (with more to come) packages each in a sequence container to use DTC, without any precedences for max. parallel execution, those four use another four packages which encapsulate repeated tasks writing to or updating common related tables. All packages use the same two DB connection managers for the local source and target databases.
The original all TSQL version of the same imports using a master and child sprocs ran without any deadlocks or hanging.
Because it's in SSIS now I thought it might be a new deadlock issue and have found checking deadlocks is a lot more complicated in SQL 2005 (having to export a deadlock grid xml from profiler and all that poop) but the xml file is empty and no deadlock events are being captured at all from what I can tell.
Anyone else get stuck in this corner? I searched here but didn't find anything hope this is not a re-post. Thanks all, this forum is a live saver!
↧
How to load Date columns in consistent manner
Hi,I am loading the table from Excel source using SSIS 2005.Excel contains one of the columns as [b]Exp_Date[/b] and its examples values are10/09/2010 17:00:51 11/09/2010 11:45:16 11/09/2010 11:45:16 13/09/2010 10:07:59 13/09/2010 10:07:59 13/09/2010 10:07:59 14/09/2010 10:44:59 15/09/2010 10:44:59 16/09/2010 14:19:25 In table, for some columns it is loading fine. But for some columns it is loading in an inconsistent manner, i.e. a date that should be loading as ‘10/09/2010’ is actually loading as ‘09/10/2010’.Please advise how to load the date column values into table as it is in Excel file.RegardsSqlStud
↧
Rename .xlsx file to .csv file in ssis 2005
Hi,Am loading the file from the below path:D:\SSIS\1812212_Sample.xlsx.Client asked me to change the file as CSV format and load the dataHow to rename .xlsx file to .csv file using SSIS 2005 in the same folder D:\SSIS\?Am using Filesystem task.RegardsSqlStud
↧
↧
Convert Varchar to Numeric Using SSIS 2005
Hi,Loading the data from Excel source to Sql Table using SSIS 2005.Have two columns Sample1 and Sample2 and both are declared as numeric in Sql Table.But while loading, it displayed the below error:There was an error with output column "Sample1" (678) on output "OLE DB Source Output" (11). The column status returned was: "The value could not be converted because of a potential loss of data.". When looking into the advanced Editor, both external and output columns shows datatype as "String".Please suggest how to solve this or how to convert Varchar to Numeric using SSIS 2005?RegardsSqlStud
↧
Calling a SSIS package from ASP.NET
I have 2 servers, one for the database and the other for the web apps. Both server are in different domains and Im trying to execute a ssis package using a stored procedure to call dtexec utility like this: SET @dtsCmd = 'dtexec /F "C:\MyFolder\MyPackage.dtsx" When the SP is executed from the web app it will run fine without any errors but is not running any of the package tasks. But if if execute the SP in SSMS it works fine and the package tasks are executed. Thank you for your help.
↧
"Could not bulk load because SSIS file mapping object 'Global\DTSQLIMPORT' could not be opened. Operating system error code 5(Access is denied.).
I've created a set of SSIS packages which run fine in our test environment. The packages access a SQL server database on the local server. I can change the data source to use Windows or SQL Server authentication and both work.We've transferred the packages to another server, and again are running them against a local sql server database. Using Windows authentication they work fine, but when I change them to use SQL Server authentication they fail with :-An OLE DB record is available. Source: "Microsoft SQL Native Client" Hresult: 0x80040E14 Description: "Could not bulk load because SSIS file mapping object 'Global\DTSQLIMPORT ' could not be opened. Operating system error code 5(Access is denied.). Make sure you are accessing a local server via Windows security.".From the documentation I understand that the SQL Server Data Flow Destination needs permission to create Global Objects - but what needs that permission assigned? Or any other ideas how to cure the problem?
↧
