Home
TeamSite
Why are IWTEMP tables being created?
Bill Klish
TeamSite 6.5 SP1
Solaris 2.9
OpenDeploy 6.0.2
We are attempting to perform a real update using standalone DataDeploy and we are getting a Null Pointer Exception. I am not sure why it looks to be logging into the database again and then creating IWTEMP tables. This is a simple 4 column table that has 2 rows in it. In this deployment, non of these rows were changed, so I am not really sure what DataDeploy is doing. Can someone shed some light on this?
DD : TTableSchemaHelper object for [ts_guest_rooms_amenities2] found in cache.
DD : GetCurrentRowsFromGroupInfo: 2 rows selected from ts_guest_rooms_amenities2
DD : Building Row map tree for group [ts_guest_rooms_amenities2].
DD : This may take a while....
DD : Row map tree for group [ts_guest_rooms_amenities2] built.
DD : TTableSchemaHelper object for [ts_guest_rooms_amenities2] found in cache.
DD : url : jdbc:mysql://brandstest.hilton.com:3306/webdb
DD : login : teamsite
DD : login timeout=3
DD : Connecting to the database...
DD : Try connecting using jdbc:mysql://brandstest.hilton.com:3306/webdb...
DD :
Connected to jdbc:mysql://brandstest.hilton.com:3306/webdb
DD : Driver MySQL-AB JDBC Driver
DD : Version mysql-connector-java-3.0.16-ga ( $Date: 2004/09/30 07:35:03 $, $Revision: 1.27.2.44 $ )
DD : Table [IWTEMP_c4b4d92] does not exist. Creating..
DD : CREATE TABLE IWTEMP_c4b4d92(ctyhocn VARCHAR(7) NOT NULL ,crsrmtype VARCHAR(6) NOT NULL ,gra_sequence INT(11) NOT NULL ,amenity VARCHAR
(30) NOT NULL )
DD : Column CTYHOCN not found in array
DD : WARNING:Value for [CTYHOCN] exceeds column width [ 7 > -1]
DD : Column CRSRMTYPE not found in array
DD : WARNING:Value for [CRSRMTYPE] exceeds column width [ 6 > -1]
DD : Column GRA_SEQUENCE not found in array
DD : WARNING:Value for [GRA_SEQUENCE] exceeds column width [ 1 > -1]
DD : Column AMENITY not found in array
DD : WARNING:Value for [AMENITY] exceeds column width [ 6 > -1]
DD : Column CTYHOCN not found in array
DD : WARNING:Value for [CTYHOCN] exceeds column width [ 7 > -1]
DD : Column CRSRMTYPE not found in array
DD : WARNING:Value for [CRSRMTYPE] exceeds column width [ 6 > -1]
DD : Column GRA_SEQUENCE not found in array
DD : WARNING:Value for [GRA_SEQUENCE] exceeds column width [ 1 > -1]
DD : Column AMENITY not found in array
DD : WARNING:Value for [AMENITY] exceeds column width [ 9 > -1]
DD : Inserted 2 rows into IWTEMP_c4b4d92
DD : TTableSchemaHelper not found in cache for [IWTEMP_C4B4D92]. Creating new.
DD : ERROR:Unable to create TTableSchemaHelper object for [IWTEMP_C4B4D92].
DD : ERROR:Exception occured: null
java.lang.NullPointerException
at com.interwoven.dd100.dd.TDbSchemaUtils.BuildColumnListFromVector(TDbSchemaUtils.java:389)
at com.interwoven.dd100.dd.TDbSchemaGroupCfg.BuildSelectStmt(TDbSchemaGroupCfg.java:2302)
at com.interwoven.dd100.dd.TDbSchemaRowSort.BuildSortedRows(TDbSchemaRowSort.java:300)
Find more posts tagged with
Comments
Migrateduser
IWTEMP tables are temp tables that DD creates to help it figure out what rows to update. They are created and deleted soon after. So DD must have adequate permissions to write to the database to create them.
Below is an excerpt from a support case where a customer asked a similar question.
Mariam
----------------------------------------------------------------------------------------------------------------------------------------------
Just got confirmation that the DD user will need the CREATE table privlege. The IWTEMP tables are temporary tables used to store update information and are dropped after the transaction is over. Here is a KB article that lists the specific privileges the DD user account will need:
https://support.interwoven.com/kb/kb_show_article2.asp?ArticleID=50012
The DataDeploy user must be table owner to create a table. It is not necessary with synonyms like insert, update, and delete but for create table it is mandatory.
The conventional approach would be for the DataDeploy user to have it's own tables but no access to any other schema's tables, and to create (public) synonyms such as:
'create public synonym ddtable for dduser.ddtable'
This allows other applications / users to use 'ddtable' without having to know the owner.
Also, in the OD Databae Administration guide, it says you need the following DB privileges for the DD user account:
OpenDeploy must have the following privileges when accessing a database:
insert
update
delete
create table
create view
query permissions
Bill Klish
thanks for the overview. The temp tables are getting created and populated with data, so I am not sure why I am getting all of these error messages about exceeding length of -1.
any idea?
Migrateduser
To get some clarification: The actual table (not the temp table) has two rows in it for presumably two prior data records that you deployed. How many records are in this current deployment? I'm assuming you have added some additional records that you want to deploy into the table? Are you sure these records are valid, no nulls, proper column values sizes etc?
You may need to post your dd config and the data records that you are deploying (old and new), so we can try to reproduce this. The errors appear to be related to the data getting inserted.
Mariam
Bill Klish
I opened a support case on this so we'll see where it goes. I was just hoping it was something simple I was missing.
Migrateduser
What does your config look like and similarly, what does your DCR (or data source) look like?
Environments:
(1,2) TS6.5, TS6.5SP1 on W2K3
(3) Vignette V7 Portal on Solaris 9
sivaramiyer
I ran into the same issue -
TS671, OD620, MySQL db
any pointers appreciated. Thanks. Sivaram
DBD: Table [IWTEMP_6853a91c] does not exist. Creating..
DBD: CREATE TABLE IWTEMP_6853a91c(ASSET_ID VARCHAR(255) NOT NULL ,JOURNAL_ID VARCHAR(10) NOT NULL )
DBD: Column ASSET_ID not found in array
DBD: WARNING:Value for [ASSET_ID] exceeds column width [ 36 > -1]
DBD: Column JOURNAL_ID not found in array
DBD: WARNING:Value for [JOURNAL_ID] exceeds column width [ 4 > -1]
DBD: Column ASSET_ID not found in array
DBD: WARNING:Value for [ASSET_ID] exceeds column width [ 36 > -1]
DBD: Column JOURNAL_ID not found in array
DBD: WARNING:Value for [JOURNAL_ID] exceeds column width [ 4 > -1]
DBD: Column ASSET_ID not found in array
DBD: WARNING:Value for [ASSET_ID] exceeds column width [ 36 > -1]
DBD: Column JOURNAL_ID not found in array
DBD: WARNING:Value for [JOURNAL_ID] exceeds column width [ 2 > -1]
DBD: Inserted 3 rows into IWTEMP_6853a91c
DBD: TTableSchemaHelper not found in cache for [IWTEMP_6853A91C]. Creating new.
DBD: ERROR:Unable to create TTableSchemaHelper object for [IWTEMP_6853A91C].
DBD: ERROR:Exception occured: null
DBD: ERROR:
java.lang.NullPointerException
at com.interwoven.dd100.dd.TDbSchemaUtils.BuildColumnListFromVector(TDbSchemaUtils.java(Compiled Code))
at com.interwoven.dd100.dd.TDbSchemaGroupCfg.BuildSelectStmt(TDbSchemaGroupCfg.java:2329)
at com.interwoven.dd100.dd.TDbSchema
remyah
I am also getting similar error. How did you solve your issue
Env: Teamsite 6.7.2 (windows 2003) deploying to MySQL
DBD: SelectCurrentRowsUsingPath: 2 rows selected.
DBD: Loading com.mysql.jdbc.Driver
DBD: url : jdbc:mysql://:3306/nikonebiz
DBD: login : interwoven
DBD: login timeout=3
DBD: Connecting to the database...
DBD: Try connecting using jdbc:mysql://:3306/nikonebiz...
DBD:
Connected to jdbc:mysql://:3306/nikonebiz
DBD: Driver MySQL-AB JDBC Driver
DBD: Version mysql-connector-java-5.1.7 ( Revision: ${svn.Revision} )
DBD: Table [IWTEMP_9ac8e552] does not exist. Creating..
DBD: CREATE TABLE IWTEMP_9ac8e552(path VARCHAR(255) NOT NULL ,reporder int(11) NULL ,intPdtId int(11) NOT NULL ,intCountryId int(11) NOT NULL ,strPromoCode VARCHAR(250) NULL ,intDiscType int(11) NOT NULL ,intPercentDisc DOUBLE NULL ,intDollarDisc DOUBLE NULL ,strRemarks VARCHAR(255) NULL ,blnActive INT(2) NULL ,intCreatedById int(11) NOT NULL ,dtDateCreated DATETIME NOT NULL ,intUpdatedById int(11) NOT NULL ,dtDateModified DATETIME NOT NULL )
DBD: Column PATH not found in array
DBD: WARNING:Value for [PATH] exceeds column width [ 46 > -1]
DBD: Column REPORDER not found in array
DBD: WARNING:Value for [REPORDER] exceeds column width [ 1 > -1]
DBD: Column INTPDTID not found in array
DBD: WARNING:Value for [INTPDTID] exceeds column width [ 3 > -1]
DBD: Column INTCOUNTRYID not found in array
DBD: WARNING:Value for [INTCOUNTRYID] exceeds column width [ 1 > -1]
DBD: Column STRPROMOCODE not found in array
DBD: WARNING:Value for [STRPROMOCODE] exceeds column width [ 8 > -1]
DBD: Column INTDISCTYPE not found in array
DBD: WARNING:Value for [INTDISCTYPE] exceeds column width [ 1 > -1]
DBD: Column INTPERCENTDISC not found in array
DBD: WARNING:Value for [INTPERCENTDISC] exceeds column width [ 4 > -1]
DBD: Column INTDOLLARDISC not found in array
DBD: WARNING:Value for [INTDOLLARDISC] exceeds column width [ 1 > -1]
DBD: Column STRREMARKS not found in array
DBD: WARNING:Value for [STRREMARKS] exceeds column width [ 1 > -1]
DBD: Column BLNACTIVE not found in array
DBD: WARNING:Value for [BLNACTIVE] exceeds column width [ 1 > -1]
DBD: Column INTCREATEDBYID not found in array
DBD: WARNING:Value for [INTCREATEDBYID] exceeds column width [ 2 > -1]
DBD: Column DTDATECREATED not found in array
DBD: WARNING:Value for [DTDATECREATED] exceeds column width [ 19 > -1]
DBD: Column INTUPDATEDBYID not found in array
DBD: WARNING:Value for [INTUPDATEDBYID] exceeds column width [ 2 > -1]
DBD: Column DTDATEMODIFIED not found in array
DBD: WARNING:Value for [DTDATEMODIFIED] exceeds column width [ 19 > -1]
DBD: Column PATH not found in array
DBD: WARNING:Value for [PATH] exceeds column width [ 46 > -1]
DBD: Column REPORDER not found in array
DBD: WARNING:Value for [REPORDER] exceeds column width [ 1 > -1]
DBD: Column INTPDTID not found in array
DBD: WARNING:Value for [INTPDTID] exceeds column width [ 3 > -1]
DBD: Column INTCOUNTRYID not found in array
DBD: WARNING:Value for [INTCOUNTRYID] exceeds column width [ 1 > -1]
DBD: Column STRPROMOCODE not found in array
DBD: WARNING:Value for [STRPROMOCODE] exceeds column width [ 8 > -1]
DBD: Column INTDISCTYPE not found in array
DBD: WARNING:Value for [INTDISCTYPE] exceeds column width [ 1 > -1]
DBD: Column INTPERCENTDISC not found in array
DBD: WARNING:Value for [INTPERCENTDISC] exceeds column width [ 4 > -1]
DBD: Column INTDOLLARDISC not found in array
DBD: WARNING:Value for [INTDOLLARDISC] exceeds column width [ 2 > -1]
DBD: Column STRREMARKS not found in array
DBD: WARNING:Value for [STRREMARKS] exceeds column width [ 1 > -1]
DBD: Column BLNACTIVE not found in array
DBD: WARNING:Value for [BLNACTIVE] exceeds column width [ 1 > -1]
DBD: Column INTCREATEDBYID not found in array
DBD: WARNING:Value for [INTCREATEDBYID] exceeds column width [ 2 > -1]
DBD: Column DTDATECREATED not found in array
DBD: WARNING:Value for [DTDATECREATED] exceeds column width [ 19 > -1]
DBD: Column INTUPDATEDBYID not found in array
DBD: WARNING:Value for [INTUPDATEDBYID] exceeds column width [ 2 > -1]
DBD: Column DTDATEMODIFIED not found in array
DBD: WARNING:Value for [DTDATEMODIFIED] exceeds column width [ 19 > -1]
DBD: Inserted 2 rows into IWTEMP_9ac8e552
DBD: TTableSchemaHelper not found in cache for [IWTEMP_9AC8E552]. Creating new.
DBD: ERROR:Unable to create TTableSchemaHelper object for [IWTEMP_9AC8E552].
DBD: ERROR:Exception occured: null
DBD: ERROR:
java.lang.NullPointerException
at com.interwoven.dd100.dd.TDbSchemaUtils.BuildColumnListFromVector(TDbSchemaUtils.java:389)
at com.interwoven.dd100.dd.TDbSchemaGroupCfg.BuildSelectStmt(TDbSchemaGroupCfg.java:2327)
at com.interwoven.dd100.dd.TDbSchemaRowSort.BuildSortedRows(TDbSchemaRowSort.java:302)
at com.interwoven.dd100.dd.TDbSchemaRowSort.PerformSort(TDbSchemaRowSort.java:87)
at com.interwoven.dd100.dd.TDbSchemaUpdateHelper.PerformSort(TDbSchemaUpdateHelper.java:137)
at com.interwoven.dd100.dd.TDbSchemaUpdateHelper.GetOperationRequired(TDbSchemaUpdateHelper.java:157)
at com.interwoven.dd100.dd.TDbSchemaGroupCfg.DoRealUpdate(TDbSchemaGroupCfg.java:823)
at com.interwoven.dd100.dd.TDbSchemaGroupCfg.DoUpdate(TDbSchemaGroupCfg.java:857)
at com.interwoven.dd100.dd.TDbSchemaCfg.InsertWithGroupTree(TDbSchemaCfg.java:448)
at com.interwoven.dd100.dd.TDbSchemaCfg.Insert(TDbSchemaCfg.java:409)
at com.interwoven.dd100.dd.TDbSchemaAgent.BasicWriteTuple(TDbSchemaAgent.java:457)
at com.interwoven.dd100.dd.TDbSchemaAgent.WriteTuple(TDbSchemaAgent.java:336)
at com.interwoven.dd100.dd.TConsumerManager.WriteConsumerInternal(TConsumerManager.java:399)
at com.interwoven.dd100.dd.TConsumerManager.WriteConsumers(TConsumerManager.java:388)
at com.interwoven.dd100.dd.TAgentClient.DoOneTeamSiteSource(TAgentClient.java:1018)
at com.interwoven.dd100.dd.TAgentClient.ProcessOneFileList(TAgentClient.java:609)
at com.interwoven.dd100.dd.TAgentClient.ProcessFileList(TAgentClient.java:566)
at com.interwoven.dd100.dd.TAgentClient.DoTeamSiteSources(TAgentClient.java:511)
at com.interwoven.dd100.dd.TAgentClient.DoOneDeployment(TAgentClient.java:289)
at com.interwoven.dd100.dd.TAgentClient.Go(TAgentClient.java:178)
at com.interwoven.dd100.dd.IWDataDeploy.Go(IWDataDeploy.java:582)
at com.interwoven.dd100.dd.TDASThread.ProcessItem(TDASThread.java:203)
at com.interwoven.dd100.dd.TDASThread.run(TDASThread.java:128)
DBD: ERROR:WriteTuple failure to consumer[0]
DBD: ERROR:Unable to process TeamSite source templatedata/en_nsg/promotion_codes/data/test1, obtained from filelist=C:\share\10feb2009\test4.txt
DBD: Filelist walk done
DBD: ERROR:deployment [DCRs] FAILED
DBD: Error occured in area outside TDbAgent consumer (explicit rollback initiated)
DBD: Stat for group [product_code]:
DBD: -----------------------------------
DBD: Rows inserted : 0
DBD: Rows updated : 0
DBD: Rows deleted : 0
DBD: Rows failed : 0
DBD: Rows rolled back : 0
DBD: Rows skipped : 0
DBD: -----------------------------------
DBD: Rollback database [:3306/nikonebiz]...
DBD: Deployment[DCRs]
DBD: -----------------------------------
DBD: DCRs inserted : 0
DBD: DCRs updated : 0
DBD: DCRs deleted : 0
DBD: DCRs failed : 0
DBD: DCRs rolled back : 0
DBD: DCRs skipped : 0
DBD: -----------------------------------
remyah
DBD: TTableSchemaHelper not found in cache for [IWTEMP_9AC8E552]. Creating new.
DBD: ERROR:Unable to create TTableSchemaHelper object for [IWTEMP_9AC8E552].
DBD: ERROR:Exception occured: null
DBD: ERROR:
java.lang.NullPointerException
at com.interwoven.dd100.dd.TDbSchemaUtils.BuildColumn ListFromVector(
The above error got soved after changing lower_case_table_names=1 in mysql settings.