|
Home > Archive > BizTalk Server General > January 2006 > Web Scraping
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
|
|
|
| Has anyone, beside using a code, constructed a web scraping adpater???? Just
curious about the possibility of it...
| |
| Jon Flanders 2006-01-05, 6:03 pm |
| Hello JS, You can use the HTTP adapter to get HTML. Not sure what else
you'd want the adapter to do.
Jon Flanders [MVP]
http://www.masteringbiztalk.com
> Has anyone, beside using a code, constructed a web scraping
> adpater???? Just curious about the possibility of it...
>
| |
|
| Ok, I admit I am slightly new to this, but I thought the HTTP could only
access areas that were setup to be accessed. For example, I want to scrape
information from Yahoo, just as an example. I.E., get a particular piece of
news from it. Can it do that?
"Jon Flanders" wrote:
> Hello JS, You can use the HTTP adapter to get HTML. Not sure what else
> you'd want the adapter to do.
>
>
> Jon Flanders [MVP]
> http://www.masteringbiztalk.com
>
>
>
>
| |
| Jon Flanders 2006-01-05, 8:53 pm |
| You could use the Http adapter to get the HTML back from yahoo - and then
write some code that would pull out the data you want.
if it is news etc - you might want to look at RSS feeds.
Jon Flanders [MVP]
http://www.masteringbiztalk.com
[vbcol=seagreen]
> Ok, I admit I am slightly new to this, but I thought the HTTP could
> only access areas that were setup to be accessed. For example, I want
> to scrape information from Yahoo, just as an example. I.E., get a
> particular piece of news from it. Can it do that?
>
> "Jon Flanders" wrote:
>
| |
|
| Jon, I really hate to ask this, but can you email me directly @
jspohn@afsvision.com I guess maybe I just need a "push" in the right
direction.
I am also looking at taking a class @ Developmentor on this in very, very
near future. I really appreicate the help.
"Jon Flanders" wrote:
> You could use the Http adapter to get the HTML back from yahoo - and then
> write some code that would pull out the data you want.
>
> if it is news etc - you might want to look at RSS feeds.
>
>
> Jon Flanders [MVP]
> http://www.masteringbiztalk.com
>
>
>
>
| |
| alex_f_il@hotmail.com 2006-01-09, 5:57 pm |
| Look at SWExplorerAutomation
(http://home.comcast.net/~furma=ADna/SWIEAutomation.htm).
SW Explorer Automation (SWEA) creates an object model (automation
interface) for any Web application running in Internet Explorer. The
object model is defined visually by SWEA designer. The designer allows
to record scripts (C# and VB) based on the defined application object
model.
SWEA allows to run the automation scripts from a service account or
ASPNET account, so it possible to write the adapter for BizTalk or
create a "scrapping" Web Service to be called from BizTalk.
|
|
|
|
|