|
Home > Archive > BizTalk Server Orchestration > October 2004 > merge two files...
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
merge two files...
|
|
| Alan Smith 2004-09-28, 5:52 pm |
| Hi Madhu,
Check the "Service Instances" in HAT, if your orchestration is dehydrated,
it sugests that is is waiting for a message to come in (using correlation).
If you suspend the orchestration in HAT, you sould be able to debug it, and
step through the processing steps. This should give you an idea what is
happening to the messages.
Shout if you need more help,
Alan
"Madhu Sudhanan Ramanujam" wrote:
> I have 2 input schemas, mapped to one output schema. I've created the
> orchestration and the receive shapes are placed in a parallel processor.
> Further to that, I have a transform shape which combines both the received
> files into one and send it to the send port using a send shape. I've also
> created 3 correlation type with just the ReceivedFileName property promoted
> on all the three shapes and I've associated the 2 receive shapes and 1 send
> shape with this correlation. But I don't have a very clear idea about this
> correlation stuff since I'm a kid in the BizTalk Server jobs. When I palced
> both the input files on the input folder, they were consumed. I never saw
> any erros in the event log and there is no output file. The HAT says that
> the file has been consumed but dehydrated. Can you please help me out with
> this? I'm attaching my project along with this message.
>
> PS: I'm using BizTalk Server 2004 along with VS.Net 2003
>
> Madhu Sudhanan Ramanujam
>
>
>
| |
| Devdutt Patnaik 2004-09-28, 5:52 pm |
| What configurations have you associated for the 2 Receives and 1
Send....Initializes Correlation or Follows Correlation?
Regards
Dev
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:u8QaeZWpEHA.1460@TK2MSFTNGP12.phx.gbl...
> I have 2 input schemas, mapped to one output schema. I've created the
> orchestration and the receive shapes are placed in a parallel processor.
> Further to that, I have a transform shape which combines both the received
> files into one and send it to the send port using a send shape. I've also
> created 3 correlation type with just the ReceivedFileName property
promoted
> on all the three shapes and I've associated the 2 receive shapes and 1
send
> shape with this correlation. But I don't have a very clear idea about this
> correlation stuff since I'm a kid in the BizTalk Server jobs. When I
palced
> both the input files on the input folder, they were consumed. I never saw
> any erros in the event log and there is no output file. The HAT says that
> the file has been consumed but dehydrated. Can you please help me out with
> this? I'm attaching my project along with this message.
>
> PS: I'm using BizTalk Server 2004 along with VS.Net 2003
>
> Madhu Sudhanan Ramanujam
>
>
>
| |
| Devdutt Patnaik 2004-09-28, 5:52 pm |
| Okay Taking a look at your attachment now.
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:u8QaeZWpEHA.1460@TK2MSFTNGP12.phx.gbl...
> I have 2 input schemas, mapped to one output schema. I've created the
> orchestration and the receive shapes are placed in a parallel processor.
> Further to that, I have a transform shape which combines both the received
> files into one and send it to the send port using a send shape. I've also
> created 3 correlation type with just the ReceivedFileName property
promoted
> on all the three shapes and I've associated the 2 receive shapes and 1
send
> shape with this correlation. But I don't have a very clear idea about this
> correlation stuff since I'm a kid in the BizTalk Server jobs. When I
palced
> both the input files on the input folder, they were consumed. I never saw
> any erros in the event log and there is no output file. The HAT says that
> the file has been consumed but dehydrated. Can you please help me out with
> this? I'm attaching my project along with this message.
>
> PS: I'm using BizTalk Server 2004 along with VS.Net 2003
>
> Madhu Sudhanan Ramanujam
>
>
>
| |
| Madhu Sudhanan Ramanujam 2004-09-28, 5:52 pm |
| Hi,
If you can get me out of this problem from the attachment, I'll be very
greatful friend. I just can't call it a day without marking this is as
complete.
Madhu Sudhanan Ramanujam
"Devdutt Patnaik" <aquarius@taurus.com> wrote in message
news:%23K$079WpEHA.3300@TK2MSFTNGP12.phx.gbl...
> Okay Taking a look at your attachment now.
>
> "Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
> news:u8QaeZWpEHA.1460@TK2MSFTNGP12.phx.gbl...
> promoted
> send
> palced
>
>
| |
| Madhu Sudhanan Ramanujam 2004-09-28, 5:52 pm |
| To be fairly simple, the following is what i require.
File 1:
SupplierCode1|SupplierName|
File 2:
ItemCode1|SupplierCode1|ItemName|UnitPri
ce|
File 3: (this is how the output should be)
SupplierCode1|SupplierName1|ItemCode1|It
emName|UnitPrice|
Madhu Sudhanan Ramanujam
"Devdutt Patnaik" <aquarius@taurus.com> wrote in message
news:%23K$079WpEHA.3300@TK2MSFTNGP12.phx.gbl...
> Okay Taking a look at your attachment now.
>
> "Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
> news:u8QaeZWpEHA.1460@TK2MSFTNGP12.phx.gbl...
> promoted
> send
> palced
>
>
| |
| Devdutt Patnaik 2004-09-28, 5:52 pm |
| Are you dropping the files in the same folder or different ones?
Regards
Dev
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:eb5KePXpEHA.3728@TK2MSFTNGP09.phx.gbl...
> To be fairly simple, the following is what i require.
>
> File 1:
> SupplierCode1|SupplierName|
>
> File 2:
> ItemCode1|SupplierCode1|ItemName|UnitPri
ce|
>
> File 3: (this is how the output should be)
> SupplierCode1|SupplierName1|ItemCode1|It
emName|UnitPrice|
>
> Madhu Sudhanan Ramanujam
>
> "Devdutt Patnaik" <aquarius@taurus.com> wrote in message
> news:%23K$079WpEHA.3300@TK2MSFTNGP12.phx.gbl...
processor.[vbcol=seagreen]
also[vbcol=seagreen]
saw[vbcol=seagreen]
that[vbcol=seagreen]
>
>
| |
| Madhu Sudhanan Ramanujam 2004-09-28, 5:52 pm |
| I'm dropping them in the same folder. If they are in different folders also,
it doesn't matter.
Madhu Sudhanan
"Devdutt Patnaik" <aquarius@taurus.com> wrote in message
news:Of6tEZXpEHA.4008@TK2MSFTNGP14.phx.gbl...
> Are you dropping the files in the same folder or different ones?
> Regards
> Dev
> "Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
> news:eb5KePXpEHA.3728@TK2MSFTNGP09.phx.gbl...
> processor.
> also
> saw
> that
>
>
| |
| Devdutt Patnaik 2004-09-28, 5:52 pm |
| Plz send the test files that you are using
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:eY3hwfXpEHA.3592@TK2MSFTNGP09.phx.gbl...
> I'm dropping them in the same folder. If they are in different folders
also,
> it doesn't matter.
>
> Madhu Sudhanan
> "Devdutt Patnaik" <aquarius@taurus.com> wrote in message
> news:Of6tEZXpEHA.4008@TK2MSFTNGP14.phx.gbl...
the[vbcol=seagreen]
1[vbcol=seagreen]
about[vbcol=seagreen]
never[vbcol=seagreen]
out[vbcol=seagreen]
>
>
| |
| Devdutt Patnaik 2004-09-28, 5:52 pm |
| You are having a problem because all your shapes Initialize
correlations....none of them follow those correlations.
I can suggest a couple of solutions to your problem. The first and easiest
is to implement a nonuniform sequential convoy. You can see what a uniform
sequential convoy looks like from my blog. This will need a few
modifications.
http://devdutt10.blogspot.com/2004/...2004-using.html
Your orchestration will have an Activating Receive which initializes a
correlation set. The next shape should be a non-activating receive(not in
parallel) which follows the above correlation set. These Receives will map
to a Single port, but 2 Operations (for your 2 types of input schemas).
You need to find out the exact correlation set to use so that the 2 files
get routed to the same instance of the orchestration. You might want to use
a custom pipeline component to manipulate correlation parameters before the
mesages hit the message box.
Regards
Dev
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:eY3hwfXpEHA.3592@TK2MSFTNGP09.phx.gbl...
> I'm dropping them in the same folder. If they are in different folders
also,
> it doesn't matter.
>
> Madhu Sudhanan
> "Devdutt Patnaik" <aquarius@taurus.com> wrote in message
> news:Of6tEZXpEHA.4008@TK2MSFTNGP14.phx.gbl...
the[vbcol=seagreen]
1[vbcol=seagreen]
about[vbcol=seagreen]
never[vbcol=seagreen]
out[vbcol=seagreen]
>
>
| |
| Madhu Sudhanan Ramanujam 2004-09-28, 5:52 pm |
| Hi,
I understood your idea, and I've also visited your blog and downloaded your
source. But one thing which I don't understand is about how I can have two
operations in one port. Can you please explain me about that. I think I'll
be done if I get to know this.
Madhu Sudhanan Ramanujam
"Devdutt Patnaik" <aquarius@taurus.com> wrote in message
news:%23JlaXqXpEHA.4008@TK2MSFTNGP14.phx.gbl...
> You are having a problem because all your shapes Initialize
> correlations....none of them follow those correlations.
> I can suggest a couple of solutions to your problem. The first and easiest
> is to implement a nonuniform sequential convoy. You can see what a uniform
> sequential convoy looks like from my blog. This will need a few
> modifications.
> http://devdutt10.blogspot.com/2004/...2004-using.html
> Your orchestration will have an Activating Receive which initializes a
> correlation set. The next shape should be a non-activating receive(not in
> parallel) which follows the above correlation set. These Receives will map
> to a Single port, but 2 Operations (for your 2 types of input schemas).
> You need to find out the exact correlation set to use so that the 2 files
> get routed to the same instance of the orchestration. You might want to
> use
> a custom pipeline component to manipulate correlation parameters before
> the
> mesages hit the message box.
> Regards
> Dev
>
> "Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
> news:eY3hwfXpEHA.3592@TK2MSFTNGP09.phx.gbl...
> also,
> the
> 1
> about
> never
> out
>
>
| |
| Devdutt Patnaik 2004-09-28, 5:52 pm |
| Madhu,
In your orchestration designer right-click on the Receive Port and select
New Operation.
Regards
Dev
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:eOxSO6ZpEHA.2684@TK2MSFTNGP11.phx.gbl...
> Hi,
>
> I understood your idea, and I've also visited your blog and downloaded
your
> source. But one thing which I don't understand is about how I can have two
> operations in one port. Can you please explain me about that. I think I'll
> be done if I get to know this.
>
> Madhu Sudhanan Ramanujam
>
> "Devdutt Patnaik" <aquarius@taurus.com> wrote in message
> news:%23JlaXqXpEHA.4008@TK2MSFTNGP14.phx.gbl...
easiest[vbcol=seagreen]
uniform[vbcol=seagreen]
http://devdutt10.blogspot.com/2004/...2004-using.html[vbcol=seagreen]
in[vbcol=seagreen]
map[vbcol=seagreen]
files[vbcol=seagreen]
message[vbcol=seagreen]
property[vbcol=seagreen]
When[vbcol=seagreen]
>
>
| |
| Madhu Sudhanan Ramanujam 2004-09-28, 5:52 pm |
| Hi,
Regarding the error "in a sequential convoy receive the messagetypes must be
identical unless the port is marked for OrderedDelivery", I've found that
the property ordered delivery is available only when the port's transport
type is MSMQ. But in my case I'm using a FILE transport. But when we have
two receive shapes, the messages should be identical or the port should be
marked for ordered delivery. Also let me know how I can find the exact
correlation that I can use to make sure that the messages get routed to the
same instance of the orchestration.
Madhu Sudhanan Ramanujam
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:%23JXqiLapEHA.3592@TK2MSFTNGP14.phx.gbl...
> Thanks for the info, I've created another operation on the same port and
> I've connected it to the recv shape. The 2nd operation points to the
> second schema of my project. But when I build the project I get the error
> "in a sequential convoy receive the messagetypes must be identical unless
> the port is marked for OrderedDelivery". I've attached my project, incase
> you need that.
>
> Madhu Sudhanan Ramanujam
>
> "Devdutt Patnaik" <aquarius@taurus.com> wrote in message
> news:ufwd5$ZpEHA.1160@tk2msftngp13.phx.gbl...
>
>
>
| |
| Devdutt Patnaik 2004-09-29, 8:02 pm |
| Madhu,
wrt the Ordered delivery thing, I think you are still specifying the port
configuration as SPECIFY NOW. Make the ports as specify later, specify
ordered Delivery, and bind them to a file port from BizTalkExplorer.
Secondly, in one of the previous mails, I saw that one of the fields in both
the schemas are common, i assume that would be the field to correlate on. If
thats the case, then promote these fields as properties. Once promoted, you
can see these when you are creating a correlation type.
At the end of it all you should have a orchestration that receives a
message, creates a correlation set like 'SupplierCode1=xyz', then goes on to
the second receive, and waits for a message of the second type which has a
SupplierCode = xyz and routes that message to the same orchestration
instance. If you are having difficulty grasping this, I can post a sample on
my blog.
Hope this helps
Regards
Dev
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:ejz4W3apEHA.896@TK2MSFTNGP12.phx.gbl...
> Hi,
> Regarding the error "in a sequential convoy receive the messagetypes must
be
> identical unless the port is marked for OrderedDelivery", I've found that
> the property ordered delivery is available only when the port's transport
> type is MSMQ. But in my case I'm using a FILE transport. But when we have
> two receive shapes, the messages should be identical or the port should be
> marked for ordered delivery. Also let me know how I can find the exact
> correlation that I can use to make sure that the messages get routed to
the
> same instance of the orchestration.
>
> Madhu Sudhanan Ramanujam
>
> "Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
> news:%23JXqiLapEHA.3592@TK2MSFTNGP14.phx.gbl...
error[vbcol=seagreen]
unless[vbcol=seagreen]
incase[vbcol=seagreen]
select[vbcol=seagreen]
http://devdutt10.blogspot.com/2004/...2004-using.html[vbcol=seagreen]
a[vbcol=seagreen]
receive(not[vbcol=seagreen]
will[vbcol=seagreen]
shape.[vbcol=seagreen]
idea[vbcol=seagreen]
I[vbcol=seagreen]
HAT[vbcol=seagreen]
help[vbcol=seagreen]
>
>
| |
| Devdutt Patnaik 2004-09-29, 8:02 pm |
| I have posted a sample which solves your problem at
http://devdutt10.blogspot.com/2004/...oys-in-bts.html
Regards
Dev
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:ejz4W3apEHA.896@TK2MSFTNGP12.phx.gbl...
> Hi,
> Regarding the error "in a sequential convoy receive the messagetypes must
be
> identical unless the port is marked for OrderedDelivery", I've found that
> the property ordered delivery is available only when the port's transport
> type is MSMQ. But in my case I'm using a FILE transport. But when we have
> two receive shapes, the messages should be identical or the port should be
> marked for ordered delivery. Also let me know how I can find the exact
> correlation that I can use to make sure that the messages get routed to
the
> same instance of the orchestration.
>
> Madhu Sudhanan Ramanujam
>
> "Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
> news:%23JXqiLapEHA.3592@TK2MSFTNGP14.phx.gbl...
error[vbcol=seagreen]
unless[vbcol=seagreen]
incase[vbcol=seagreen]
select[vbcol=seagreen]
http://devdutt10.blogspot.com/2004/...2004-using.html[vbcol=seagreen]
a[vbcol=seagreen]
receive(not[vbcol=seagreen]
will[vbcol=seagreen]
shape.[vbcol=seagreen]
idea[vbcol=seagreen]
I[vbcol=seagreen]
HAT[vbcol=seagreen]
help[vbcol=seagreen]
>
>
| |
| Madhu Sudhanan Ramanujam 2004-10-02, 8:59 pm |
| Hi,
Your idea has almost worked I guess. I've setup things the way you've said
and despite that I'm recieving an error which says that the "File adapter
has susspended "1" message because a subscription wasn't found". How do I
deal with that.
Madhu Sudhanan Ramanujam
"Devdutt Patnaik" <aquarius@taurus.com> wrote in message
news:ues00ElpEHA.3592@TK2MSFTNGP14.phx.gbl...
>I have posted a sample which solves your problem at
> http://devdutt10.blogspot.com/2004/...oys-in-bts.html
> Regards
> Dev
>
> "Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
> news:ejz4W3apEHA.896@TK2MSFTNGP12.phx.gbl...
> be
> the
> error
> unless
> incase
> select
> http://devdutt10.blogspot.com/2004/...2004-using.html
> a
> receive(not
> will
> shape.
> idea
> I
> HAT
> help
>
>
| |
| Madhu Sudhanan Ramanujam 2004-10-02, 8:59 pm |
| The entire error message looks like this :
The Messaging engine failed to process a message submitted by adapter:FILE
Source URL:C:\MultiFileReader\In\Master*.txt. Details:Could not find a
matching subscription for the message. . This error occurs if the subscribed
orchestration schedule or send port has not been started, or if some of the
message properties necessary for subscription evaluation have not been
promoted. Please refer to Health and Activity Tracking tool for more
detailed information on this failure
Madhu Sudhanan Ramanujam
"Madhu Sudhanan Ramanujam" <ramanum@fusiontech.com> wrote in message
news:eo9wsM6pEHA.3668@TK2MSFTNGP15.phx.gbl...
> Hi,
> Your idea has almost worked I guess. I've setup things the way you've said
> and despite that I'm recieving an error which says that the "File adapter
> has susspended "1" message because a subscription wasn't found". How do I
> deal with that.
>
> Madhu Sudhanan Ramanujam
>
> "Devdutt Patnaik" <aquarius@taurus.com> wrote in message
> news:ues00ElpEHA.3592@TK2MSFTNGP14.phx.gbl...
>
>
|
|
|
|
|