|
Home > Archive > BizTalk Server General > August 2005 > Small numbers in mapping result in NaN
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
Small numbers in mapping result in NaN
|
|
| sanders@avanade.com 2005-08-23, 7:53 am |
| Hi everyone,
The next issue is really driving me mad.
In a mapping I'm calling a function in an external assembly with does
some calculations. Sometimes the result of the calculations is a very
tiny number, f.e. -0.0000000000072759576141834259. The function uses
the datatype 'double'. In the mapping this value results in NaN. Why is
that?
| |
| Scott Colestock 2005-08-23, 5:52 pm |
| What is the datatype of the schema element you are mapping to?
(fyi - assigning the number below to a double will result in some loss of
precision - you have 17 significant digits, whereas doubles are good for
15.)
Scott Colestock
www.traceofthought.net
<sanders@avanade.com> wrote in message
news:1124801523.372635.311710@g43g2000cwa.googlegroups.com...
> Hi everyone,
>
> The next issue is really driving me mad.
>
> In a mapping I'm calling a function in an external assembly with does
> some calculations. Sometimes the result of the calculations is a very
> tiny number, f.e. -0.0000000000072759576141834259. The function uses
> the datatype 'double'. In the mapping this value results in NaN. Why is
> that?
>
| |
| Marvin Smit 2005-08-29, 7:49 am |
| Hi,
i think this is based on the "XSD" part of the definition, not the
return type of the external assembly.
Hope this helps,
Marvin Smit.
On 23 Aug 2005 05:52:03 -0700, "sanders@avanade.com"
<sanders@avanade.com> wrote:
>Hi everyone,
>
>The next issue is really driving me mad.
>
>In a mapping I'm calling a function in an external assembly with does
>some calculations. Sometimes the result of the calculations is a very
>tiny number, f.e. -0.0000000000072759576141834259. The function uses
>the datatype 'double'. In the mapping this value results in NaN. Why is
>that?
|
|
|
|
|