BizTalk Server - How to map a large incoming flat file in a performant way?

This is Interesting: Free IT Magazines  
Home > Archive > BizTalk Server > July 2004 > How to map a large incoming flat file in a performant way?





You are viewing an archived Text-only version of the thread. To view this thread in it's original format and/or if you want to reply to this thread please [click here]

Author How to map a large incoming flat file in a performant way?
Sam Vanhoutte

2004-07-19, 5:52 pm

Hello,

I have an 80 MB big flat file that needs to be processed by Biztalk Server
2004. This file needs to be mapped to another XML format. But it's
impossible to handle this message in the standard way, because the
disassembling to XML of this message is way too slow. If XSL is used, the
performance impact would even be bigger.

We are considering to split the flat file in a custom pipeline component (in
a streaming way), before the disassemble stage begins. Is it possible to
split an incoming message into one or more messages on the messagebox in a
decoding pipeline component? By doing this, we would split the message per
record and translate each record to XML with the standard flat file
disassembler.

What is the best way to implement this functionality?

Best regards...

Sam Vanhoutte


Sponsored Links






Free braindumps | Software forum | Database administration forum

Copyright 2003 - 2008 webservertalk.com