|
Home > Archive > IIS Index Server > April 2004 > UGGHH Index Server too slow to be usefull
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
UGGHH Index Server too slow to be usefull
|
|
| Chris Wertman 2004-03-26, 2:04 pm |
| I am having a serious problem, Index server is just too slow in
returning answers from a query to be usefull WHAT IN GODS NAME CAN BE
DONE TO SPEED THIS UP ? When I say slow I mean 30 + seconds.
Here is the asp.net code I am using to search the catalog
sub Page_Load(sender as Object, e as EventArgs)
Dim sConn As String
Dim sSQL As String
sConn = "Provider=MSIDXS;Data Source=books;"
sSQL = "select filename, url, characterization FROM SCOPE()
WHERE " _
& " FREETEXT(Contents, 'truman capote')"
Dim oConn As New OleDbConnection(sConn)
Dim oComm As New OleDbCommand(sSQL, oConn)
Dim oReader As OleDbDataReader
oConn.Open()
oReader = oComm.ExecuteReader
While oReader.Read
response.write("<a href=""" & oReader.Item("url") & """> " &
oReader.Item("url") & "</a><br> " & oReader.Item("filename") & "<br> "
& oReader.Item("characterization") & "<br><Br><Br>")
End While
End Sub
It works but its sllllllooooooowwwwwwww, Using another older ASP page
that returns only 10 results it is faster but still very slow. But I
cannot figure out for the life of me how to limit returned records in
ASP.NET and ADO.NET , using top throws all kinds of errors. There is
no limit command on the windows side of the world.
The catalog has about 50,000 pages most (49,000) are less than 5k
bytes. WHY is this soo slow. I am running on Windows 2003 Server.
Everything else snaps nicley, IIS , SQL Server etc.
Can anyone also tell me why after rebuilding my catalog URL comes up
empty ? It worked the first time around, then I deleted the catalog
and rebuilt it now it comes up empty.
Are there any good free alternatives to Index Server ? Ive tried HTDig
and while I love it on my Linux systems Indexing is too horribly slow
on Windows and Since I regenerate all 50k of these pages on a nightly
basis I need something that will be able too keep up with that.
This is the last thing I have to fix before kicking this site live and
Im getting really frustrated, I have never used Index server to build
a catalog this big before, on 2k or smaller sites it always worked
nicely, is the size of the catalog the problem ? I absolutley NEED the
characterization otherwise my search is useless so taking that out is
not an option.
Chris
| |
| Hilary Cotter 2004-03-27, 8:34 am |
| is your IS set up as a dedicated server?
check out this kb for more info
http://support.microsoft.com/defaul...b;en-us;Q317586
"Chris Wertman" <cwertman@yahoo.com> wrote in message
news:14ab71da.0403260918.2feeb102@posting.google.com...
> I am having a serious problem, Index server is just too slow in
> returning answers from a query to be usefull WHAT IN GODS NAME CAN BE
> DONE TO SPEED THIS UP ? When I say slow I mean 30 + seconds.
>
> Here is the asp.net code I am using to search the catalog
>
> sub Page_Load(sender as Object, e as EventArgs)
>
>
>
> Dim sConn As String
> Dim sSQL As String
>
> sConn = "Provider=MSIDXS;Data Source=books;"
> sSQL = "select filename, url, characterization FROM SCOPE()
> WHERE " _
> & " FREETEXT(Contents, 'truman capote')"
>
> Dim oConn As New OleDbConnection(sConn)
> Dim oComm As New OleDbCommand(sSQL, oConn)
> Dim oReader As OleDbDataReader
>
> oConn.Open()
> oReader = oComm.ExecuteReader
> While oReader.Read
>
> response.write("<a href=""" & oReader.Item("url") & """> " &
> oReader.Item("url") & "</a><br> " & oReader.Item("filename") & "<br> "
> & oReader.Item("characterization") & "<br><Br><Br>")
>
>
> End While
>
> End Sub
>
> It works but its sllllllooooooowwwwwwww, Using another older ASP page
> that returns only 10 results it is faster but still very slow. But I
> cannot figure out for the life of me how to limit returned records in
> ASP.NET and ADO.NET , using top throws all kinds of errors. There is
> no limit command on the windows side of the world.
>
> The catalog has about 50,000 pages most (49,000) are less than 5k
> bytes. WHY is this soo slow. I am running on Windows 2003 Server.
> Everything else snaps nicley, IIS , SQL Server etc.
>
> Can anyone also tell me why after rebuilding my catalog URL comes up
> empty ? It worked the first time around, then I deleted the catalog
> and rebuilt it now it comes up empty.
>
> Are there any good free alternatives to Index Server ? Ive tried HTDig
> and while I love it on my Linux systems Indexing is too horribly slow
> on Windows and Since I regenerate all 50k of these pages on a nightly
> basis I need something that will be able too keep up with that.
>
> This is the last thing I have to fix before kicking this site live and
> Im getting really frustrated, I have never used Index server to build
> a catalog this big before, on 2k or smaller sites it always worked
> nicely, is the size of the catalog the problem ? I absolutley NEED the
> characterization otherwise my search is useless so taking that out is
> not an option.
>
> Chris
| |
| Chris Wertman 2004-03-28, 10:35 am |
| Thanks for the suggestion, But I tried it, and well it make absolutley
no difference in my query response time (BUT it will be usefull in
making it index pages quicker)
I think the problem is the amount of query responses , say for exmple
king it returns out of the 50k pages indexed probably 7k hits, and
Without being able to reduce the result to 20 or so , well you get the
idea.
I dont understand why SELECT TOP 10 dosent work and throws exceptions.
In Classic ASP I am able to do a Maxrecords and that make the response
MUCH faster.
Chris
"Hilary Cotter" <hilaryk@att.net> wrote in message news:<Og0g0z$EEHA.3856@TK2MSFTNGP12.phx.gbl>...[color=darkred]
> is your IS set up as a dedicated server?
>
> check out this kb for more info
>
>
> http://support.microsoft.com/defaul...b;en-us;Q317586
> "Chris Wertman" <cwertman@yahoo.com> wrote in message
> news:14ab71da.0403260918.2feeb102@posting.google.com...
| |
| Hilary Cotter 2004-03-28, 8:36 pm |
| what you have to do is use classic adodb through a com interrupt, set max
records, and then consume your recordset in your datareader.
"Chris Wertman" <cwertman@yahoo.com> wrote in message
news:14ab71da.0403280711.3db5c7d3@posting.google.com...
> Thanks for the suggestion, But I tried it, and well it make absolutley
> no difference in my query response time (BUT it will be usefull in
> making it index pages quicker)
>
> I think the problem is the amount of query responses , say for exmple
> king it returns out of the 50k pages indexed probably 7k hits, and
> Without being able to reduce the result to 20 or so , well you get the
> idea.
>
> I dont understand why SELECT TOP 10 dosent work and throws exceptions.
>
> In Classic ASP I am able to do a Maxrecords and that make the response
> MUCH faster.
>
> Chris
>
>
>
> "Hilary Cotter" <hilaryk@att.net> wrote in message
news:<Og0g0z$EEHA.3856@TK2MSFTNGP12.phx.gbl>...[color=darkred]
| |
| Chris Wertman 2004-03-29, 3:38 pm |
| Thanks , but I looked again and I saw my Classic ASP page wasnt in
fact the one I thought it was (I have no idea where it came from) BUT
, and a BIG but is I cannot for the life of me find any samples in
VB.NET, a few in C# but even using them as a reference I still cant
get it working in VB.NET
Do you have or know of any samples for accessing IS from VB.NET and
IXSSO
Chris
"Hilary Cotter" <hilaryk@att.net> wrote in message news:<ek1CC6SFEHA.3748@TK2MSFTNGP09.phx.gbl>...[color=darkred]
> what you have to do is use classic adodb through a com interrupt, set max
> records, and then consume your recordset in your datareader.
>
> "Chris Wertman" <cwertman@yahoo.com> wrote in message
> news:14ab71da.0403280711.3db5c7d3@posting.google.com...
> news:<Og0g0z$EEHA.3856@TK2MSFTNGP12.phx.gbl>...
| |
| Roel Hofkens 2004-04-11, 3:37 pm |
| you'll find a nice example here:
http://dotnetjunkies.com/WebLog/dav...03/03/8345.aspx
cheers,
Roel
"Chris Wertman" <cwertman@yahoo.com> wrote in message
news:14ab71da.0403291152.2f9c76f@posting.google.com...
> Thanks , but I looked again and I saw my Classic ASP page wasnt in
> fact the one I thought it was (I have no idea where it came from) BUT
> , and a BIG but is I cannot for the life of me find any samples in
> VB.NET, a few in C# but even using them as a reference I still cant
> get it working in VB.NET
>
> Do you have or know of any samples for accessing IS from VB.NET and
> IXSSO
>
> Chris
>
> "Hilary Cotter" <hilaryk@att.net> wrote in message
news:<ek1CC6SFEHA.3748@TK2MSFTNGP09.phx.gbl>...[color=darkred]
max[color=darkred]
BE[color=darkred]
SCOPE()[color=darkred]
" &[color=darkred]
"<br> "[color=darkred]
page[color=darkred]
I[color=darkred]
in[color=darkred]
is[color=darkred]
up[color=darkred]
catalog[color=darkred]
HTDig[color=darkred]
slow[color=darkred]
nightly[color=darkred]
and[color=darkred]
build[color=darkred]
the[color=darkred]
is[color=darkred]
|
|
|
|
|