|
Home > Archive > BizTalk Server Orchestration > May 2006 > FTP
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
|
|
| BizTalkTyro 2006-05-23, 1:15 am |
| Hi,
I'm working on an interface, which will recieve a zip file in an FTP
location and the zip file contains an XML file of huge size. so currently im
have developed a custom component which splits the xml file into smaller
chunks, so that the BizTalk can process these chunks in a faster manner.
Im thinking of using this splitter component in the custom adapter, since i
dont want a large message to come until the pipeline component in the
biztalk, which could impair the performance.
But, though there are samples for the file adapter, i dont how to customize
the FTP adapter, so that i can receive the zip file and then split it using
my component. It would be great if i can get some pointers in this direction.
One thing i can think of is to divert the zip file using the FTP receive
location and using a (File) send port subscribed to that receieve port to put
it into a local file location , to which my adapter is listening and then
perform the required operations, but im a little hesitant about the amount of
I/O invloved.
Please let me know your suggestions with this regard.
Thanks in anticipation..!!
| |
| Greg Forsythe 2006-05-23, 1:15 pm |
| You are as likely to impair performance by using your custom adapter to
unzip and split the incoming message as using the pipeline to do this.
Your plan of receiving the message, storing in the messagebox(SQL database),
reading from the messagebox and writing to a file, reading the file,
unzipping and splitting
will probably not produce a performance gain.
You could potentially produce a FTP adapter that will do this and save the
trip through the messagebox, although coding your own FTP adatper could
prove a bit tricky.
The Biztalk receive process uses streaming, so the pipeline components are
starting to process the message before it is completely received.
Have you attempted this using the standard Xml Disassembler with an
envelope/document pattern.
When you say your file is huge, what does that mean - are you talking MB or
GB
Greg
The input process (adapter -> pipeline) uses streaming
"BizTalkTyro" <BizTalkTyro@discussions.microsoft.com> wrote in message
news:3F4579FA-961F-41BE-AD19-5E13F85A8C45@microsoft.com...
> Hi,
>
> I'm working on an interface, which will recieve a zip file in an FTP
> location and the zip file contains an XML file of huge size. so currently
> im
> have developed a custom component which splits the xml file into smaller
> chunks, so that the BizTalk can process these chunks in a faster manner.
>
> Im thinking of using this splitter component in the custom adapter, since
> i
> dont want a large message to come until the pipeline component in the
> biztalk, which could impair the performance.
>
> But, though there are samples for the file adapter, i dont how to
> customize
> the FTP adapter, so that i can receive the zip file and then split it
> using
> my component. It would be great if i can get some pointers in this
> direction.
>
> One thing i can think of is to divert the zip file using the FTP receive
> location and using a (File) send port subscribed to that receieve port to
> put
> it into a local file location , to which my adapter is listening and then
> perform the required operations, but im a little hesitant about the amount
> of
> I/O invloved.
>
> Please let me know your suggestions with this regard.
>
> Thanks in anticipation..!!
>
|
|
|
|
|