DD 6.0.2 - filter help

Adam Stoller

Environment

TeamSite 6.5 SP1
OpenDeploy/DataDeploy 6.0.2
Windows 2003 EE

Problem

I'm trying to arrange things in my DD config so that I can pass it a filelist that could contain any number of different kinds of files, and have it just process the relevant files - and that if there are no relevant files for a given definition, to essentially be a no-op.

Filters seem like the way to do this, but they do not seem to be working, or at least not the way I imagined they should.

Given the config file shown below, if I pass in a file list that contains a single entry for a file that matches the AA_filter (and not the BB_filter) I would expect the AA_file_list definition to get executed and not the other (BB_file_list).

However, when testing, it appeared that both definitions were processed and this causesd errors (I don't have the log file with me right now, but I'll probably post it tomorrow as the error is an annoying one in which it composes a large SELECT statement with a WHERE clause followed by a space and then an ORDER directive - which fails because it doesn't understand the blank WHERE clause (or more accurately it doesn't understand the directive ... WHERE ORDER ...)

I'm hoping someone can spot a mistake in the way I'm setting up or using the filters that would explain this odd behavior.

DD Client Config

<?xml version="1.0" encoding="ISO-8859-1" standalone="yes" ?>
<data-deploy-configuration>
<data-deploy-elements filepath="D:/Interwoven/OpenDeployNG/etc/database.xml"/>

<filter name="AA_filter">
<keep><and><field name="TeamSite/Templating/DCR/Type" value=".*/AA"/></and></keep>
</filter>
<filter name="BB_filter">
<keep><and><field name="TeamSite/Templating/DCR/Type" value=".*/BB"/></and></keep>
</filter>

<client>
<deployment name="ALL">
<exec-deployment use="AA_file_list"/>
<exec-deployment use="BB_file_list"/>
</deployment>

<deployment name="AA_file_list">
<source>
<xml-source options="wide" area="$area" area-type="ts-filesystem"
include-extended-attributes="yes" xml-type="interwoven">
<path filelist="$flist"/>
</xml-source>
</source>
<!-- Only process the right kind of DCRs -->
<filter use="AA_filter"/>

<destinations>
<database use="$mode^-db" update-type="standalone" state-field="state"
enforce-ri="yes" delete-tracker="yes">
<dbschema>
<group name="****" root-group="yes">
<!-- ... omitted for brevity ... -->
</group>
<!-- ... omitted for brevity ... -->
</dbschema>
</database>
</destinations>
</deployment>

<deployment name="BB_file_list">
<source>
<xml-source options="wide" area="$area" area-type="ts-filesystem"
include-extended-attributes="yes" xml-type="interwoven">
<path filelist="$flist"/>
</xml-source>
</source>
<!-- Only process the right kind of DCRs -->
<filter use="BB_filter"/>

<destinations>
<database use="$mode^-db" update-type="standalone" state-field="state"
enforce-ri="yes" delete-tracker="yes">
<dbschema>
<group name="****" root-group="yes">
<!-- ... omitted for brevity ... -->
</group>
<!-- ... omitted for brevity ... -->
</dbschema>
</database>
</destinations>
</deployment>
</client>
</data-deploy-configuration>

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com

Adam Stoller

I'm attaching the deployment log this time.
The first run succeeded without any problems.
The second run, using the exact same filelist, with the exact same file. The only change to the config file was to add the <exec-deployment use="BB_file_list"/> to the definition of the ALL deployment - fails. The error (in short) is:

---

...
DAS: Consumer setup for deployment [BB_file_list] ok
...
DAS: SELECT KEYCOLNAME , KEYCOLVALUE FROM IWDELTRACKER WHERE PATH = ? AND AREA = ? AND KEYCOLNAME IN ( 'mv_id')
DAS: 0 PK values retrieved from iwdeltracker for templatedata\category\AA\data\TI_4144878_1125623636598.dcr, /default/main/bt/WORKAREA/bt_wa
DAS: TTableSchemaHelper object for [MV] found in cache.
DAS: TTableSchemaHelper object for [MV] found in cache.
DAS: TTableSchemaHelper object for [MV] found in cache.
DAS: SELECTELECT parent_mv_id,mt_id,ss_id,ss_name,ss_version_id,ss_lp_id,ss_asset_id,mv_type,lg_code,fm_code,rt_code,oa_title,run_time,log_line,service_code,et_type,last_updt_dt,last_updt_by,enabled,mv_id FROM MV WHERE ORDER BY MV.mv_id
DAS:
DAS: *******************************************************
DAS: SQLException occured in TDbSchemaGroupInfoNode
DAS: Exception Message: Incorrect syntax near the keyword 'ORDER'.

DAS: Vendor Error Code: 156
DAS: SQL state: ZZZZZ
DAS: *******************************************************
...
DAS: ERROR:WriteTuple failure to consumer[0]
DAS: ERROR:Unable to process TeamSite source templatedata/category/AA/data/TI_4144878_1125623636598.dcr, obtained from filelist=D:\temp\gdaiTtx6DJ
DAS: Filelist walk done
DAS: ERROReployment [BB_file_list] FAILED
DAS: ERROR:multi-deployment [ALL] FAILED

---

So - the BB_file_list definition is being entered, but apparently the BB_filter is not preventing the file which does not match the criteria in that filter from being processed - and subsequently a badly formed SQL statement is generated and attempted to be executed - which causes everything to fail.

Help?

--fish
Senior Consultant, Quotient Inc.
http://www.quotient-inc.com