I'm working with a legacy process that passes a large number of
transactions to my server as a single file in an FTP process.  I want
to be able to break out each one of these transactions from the batch
file and process them individualy through a schedule.  I've thought
about doing this either with a pre-processor, that puts each
transaction onto MSMQ, or a pipeline component that submits them
direct to the schedule.   However I'm concerned that this must be such
a common problem that I'm missing a blindingly obvious way to do this
in a far more elegant way.

Thanks

Gavin Eyre

[ Post a follow-up to this message ]

Do you mean a single transaction with many documents?  What does your
document look like?  Is it many flat file documents? or many XML documents?

--
Dave

This posting is provided "AS IS" with no warranties, and confers no rights.

"Gavin" <gavin.eyre@rsl.com> wrote in message
news:661be5d2.0405071416.57cf57f0@posting.google.com...
> I'm working with a legacy process that passes a large number of
> transactions to my server as a single file in an FTP process.  I want
> to be able to break out each one of these transactions from the batch
> file and process them individualy through a schedule.  I've thought
> about doing this either with a pre-processor, that puts each
> transaction onto MSMQ, or a pipeline component that submits them
> direct to the schedule.   However I'm concerned that this must be such
> a common problem that I'm missing a blindingly obvious way to do this
> in a far more elegant way.
>
> Thanks
>
> Gavin Eyre

[ Post a follow-up to this message ]

"David Downing [MSFT]" <ddowning@online.microsoft.com> wrote in message news:<uUhWXSINEH
A.2500@TK2MSFTNGP12.phx.gbl>...[vbcol=seagreen]
> Do you mean a single transaction with many documents?  What does your
> document look like?  Is it many flat file documents? or many XML documents?[/vbcol
]

Basically we get a whole load of unrelated part orders from the legacy
mainframe system.  At the end of its processing cycle it gives me a
single file containing all the parts we need to order - 5,000 line
file with 5,000 requests in it.  Each line is a single stand alone
request subject to different business rules and each is totally
unrelated to any other.  I want to be able to pass 5000 separate
documents into BizTalk and track each one individually.


Gavin Eyre

[ Post a follow-up to this message ]

Not knowing what your data looks like I'll give you a sample that should get
you going.  It seems to me that your data is flat file data that looks
something like the following.

Request1, Field1, Field2,...
Request2, Field1, Field2,...
...
Request5000, Field1, Field2,...


If you have a flat file schema like the following:

<schema>
<RootRecord> delimited, child_order="postfix",
child_delimiter_type="hex", child_delimiter="0x0d 0x0a"
<RequestRecord> delimited, child_order="postfix",
child_delimiter_type="char", child_delimiter="," maxOccurs=1
<Field1></Field1>
<Field2></Field2>
..
</RequestRecord>
</RootRecord>
</schema>

This should break up your document into individual requests.

--
Dave

This posting is provided "AS IS" with no warranties, and confers no rights.

"Gavin" <gavin.eyre@rsl.com> wrote in message
news:661be5d2.0405081510.188a0359@posting.google.com...
> "David Downing [MSFT]" <ddowning@online.microsoft.com> wrote in message[/vbcol
]
news:<uUhWXSINEHA.2500@TK2MSFTNGP12.phx.gbl>...[vbcol=seagreen] 
documents?[vbcol=seagreen]
>
> Basically we get a whole load of unrelated part orders from the legacy
> mainframe system.  At the end of its processing cycle it gives me a
> single file containing all the parts we need to order - 5,000 line
> file with 5,000 requests in it.  Each line is a single stand alone
> request subject to different business rules and each is totally
> unrelated to any other.  I want to be able to pass 5000 separate
> documents into BizTalk and track each one individually.
>
>
> Gavin Eyre

[ Post a follow-up to this message ]

David,

My schema is as you describe...  but is there an easy way of
submitting each of the requests to a schedule or a queue without
having to write any code?  In this example lets say I want 5000 MSMQ
records - one per line.

Thanks

Gavin
"David Downing [MSFT]" <ddowning@online.microsoft.com> wrote in message news:<uEln68qNEH
A.268@TK2MSFTNGP11.phx.gbl>...
> Not knowing what your data looks like I'll give you a sample that should g
et
> you going.  It seems to me that your data is flat file data that looks
> something like the following.
>
> Request1, Field1, Field2,...
> Request2, Field1, Field2,...
> ...
> Request5000, Field1, Field2,...
>
>
> If you have a flat file schema like the following:
>
> <schema>
>     <RootRecord> delimited, child_order="postfix",
> child_delimiter_type="hex", child_delimiter="0x0d 0x0a"
>         <RequestRecord> delimited, child_order="postfix",
> child_delimiter_type="char", child_delimiter="," maxOccurs=1
>             <Field1></Field1>
>             <Field2></Field2>
>             ...
>         </RequestRecord>
>     </RootRecord>
> </schema>
>
> This should break up your document into individual requests.

[ Post a follow-up to this message ]

The flat file disassembler will actually create the 5000 individual
messages.  What you do with them is entirely under your control.  As an
example see the following scenario:

File Receive -> Flat File Disassembler Pipeline -> Flat File Assembler
Pipeline -> File Send

Assuming you submit the file with 5000 requests into the File Receive
location (and the example schema mentioned below), you will get 5000
individual flat file messages sent to the file send location.

--
Dave

This posting is provided "AS IS" with no warranties, and confers no rights.

"Gavin" <gavin.eyre@rsl.com> wrote in message
news:661be5d2.0405170330.16d9ef0c@posting.google.com...[vbcol=seagreen]
> David,
>
> My schema is as you describe...  but is there an easy way of
> submitting each of the requests to a schedule or a queue without
> having to write any code?  In this example lets say I want 5000 MSMQ
> records - one per line.
>
> Thanks
>
> Gavin
> "David Downing [MSFT]" <ddowning@online.microsoft.com> wrote in message[/vbcol
]
news:<uEln68qNEHA.268@TK2MSFTNGP11.phx.gbl>...[vbcol=seagreen] 
get[vbcol=seagreen] 

[ Post a follow-up to this message ]