Small numbers in mapping result in NaN
Web Server forum
Back To The Forum Home!Search!Private Messaging System

Web Server Talk Web Server Talk > Web Servers reviews > BizTalk Server > BizTalk Server General > Small numbers in mapping result in NaN




  Last Thread   Next Thread Next
  Show Printable Version Email this Page Subscribe to this Thread      Post New Thread    Post A Reply      

    Small numbers in mapping result in NaN  
sanders@avanade.com


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
08-23-05 12:53 PM

Hi everyone,

The next issue is really driving me mad.

In a mapping I'm calling a function in an external assembly with does
some calculations. Sometimes the result of the calculations is a very
tiny number, f.e. -0.0000000000072759576141834259. The function uses
the datatype 'double'. In the mapping this value results in NaN. Why is
that?






[ Post a follow-up to this message ]



    Re: Small numbers in mapping result in NaN  
Scott Colestock


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
08-23-05 10:52 PM

What is the datatype of the schema element you are mapping to?

(fyi - assigning the number below to a double will result in some loss of
precision - you have 17 significant digits, whereas doubles are good for
15.)

Scott Colestock
www.traceofthought.net


<sanders@avanade.com> wrote in message
news:1124801523.372635.311710@g43g2000cwa.googlegroups.com...
> Hi everyone,
>
> The next issue is really driving me mad.
>
> In a mapping I'm calling a function in an external assembly with does
> some calculations. Sometimes the result of the calculations is a very
> tiny number, f.e. -0.0000000000072759576141834259. The function uses
> the datatype 'double'. In the mapping this value results in NaN. Why is
> that?
>







[ Post a follow-up to this message ]



    Re: Small numbers in mapping result in NaN  
Marvin Smit


View Ip Address Report This Message To A Moderator Edit/Delete Message


 
08-29-05 12:49 PM

Hi,

i think this is based on the "XSD" part of the definition, not the
return type of the external assembly.

Hope this helps,

Marvin Smit.

On 23 Aug 2005 05:52:03 -0700, "sanders@avanade.com"
<sanders@avanade.com> wrote:

>Hi everyone,
>
>The next issue is really driving me mad.
>
>In a mapping I'm calling a function in an external assembly with does
>some calculations. Sometimes the result of the calculations is a very
>tiny number, f.e. -0.0000000000072759576141834259. The function uses
>the datatype 'double'. In the mapping this value results in NaN. Why is
>that?






[ Post a follow-up to this message ]



    Sponsored Links  




 





   All times are GMT. The time now is 08:12 AM.      Post New Thread    Post A Reply      
  Last Thread   Next Thread Next


Most Popular forums 

Forum Jump:
Rate This Thread:

Forum Rules:
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is OFF
vB code is ON
Smilies are ON
[IMG] code is OFF
 
Medical and Health forum | Computer Games Reviews | Graphics design forum

Back To The Top
Home | Usercp | Faq | Register