Web Servers General Talk - Webtrends problems

This is Interesting: Free IT Magazines  
Home > Archive > Web Servers General Talk > January 2004 > Webtrends problems





You are viewing an archived Text-only version of the thread. To view this thread in it's original format and/or if you want to reply to this thread please [click here]

Author Webtrends problems
TValdo

2004-01-19, 6:32 am

Hello everyone!

I was wondering if webtrends has any limitation for the log files it
analises.
I'm running Webtrends Enterprise Reporting Server 3.5C on Win2000. It
works with one of my sites, which is not so visited, but the other one
it stops in the middle of the log file. When looking on the profile
status, it shows that about 40,000 records were processed, but the log
file has about 280,000 lines.
Does anyone knows if it's a problem with this version, or a limitation
in general, or it may be configured somewhere.

Thanks for any suggestions...

[]s
TFValdo
Scott Yanoff

2004-01-19, 6:32 am

TValdo wrote:
quote:

> Hello everyone!
>
> I was wondering if webtrends has any limitation for the log files it
> analises.
> I'm running Webtrends Enterprise Reporting Server 3.5C on Win2000. It
> works with one of my sites, which is not so visited, but the other one
> it stops in the middle of the log file. When looking on the profile
> status, it shows that about 40,000 records were processed, but the log
> file has about 280,000 lines.
> Does anyone knows if it's a problem with this version, or a limitation
> in general, or it may be configured somewhere.



Is it stopping after the FIRST 40,000 records in the file? If you look
at the date range of the log file, are the 40,000 records you see in
your report indicative of the entire date range of the log file? I am
just wondering if you have a filter in place and that it really is
processing the 280,000 lines and turning them into 40,000 hits or
visits. Perhaps you are filtering out images or some other content?

Also, do you have a status log for this import? Perhaps you could post
the tail end of it so we can see what error you are gettting.


--
-Scott
yanoff@STOP-SPAMMINGyahoo.com | http://www.yanoff.org | AOL IM: SAY KJY

TValdo

2004-01-19, 6:32 am

> Is it stopping after the FIRST 40,000 records in the file? If you look
quote:

> at the date range of the log file, are the 40,000 records you see in
> your report indicative of the entire date range of the log file? I am
> just wondering if you have a filter in place and that it really is
> processing the 280,000 lines and turning them into 40,000 hits or
> visits. Perhaps you are filtering out images or some other content?
>
> Also, do you have a status log for this import? Perhaps you could post
> the tail end of it so we can see what error you are gettting.



Actually the hole log file is for a specific day... there is a script
in the server that splits the log-file, and generates a file for each
day, so there is no filter that I've set in webtrends that could be
the cause of this...

Anyway, I took the samefile that I was trying to process and separated
it into smaller files, with 10,000 records each. Webtrends passed
through all the files and generated the report, but there are still
some problems with the report, not all the records where processed...
But now, I'm thinking that the problem must be within apache or the
script that splits the logs...

Thanks for your ideas!
Scott Yanoff

2004-01-19, 6:32 am

> Anyway, I took the samefile that I was trying to process and separated
quote:

> it into smaller files, with 10,000 records each. Webtrends passed
> through all the files and generated the report, but there are still
> some problems with the report, not all the records where processed...
> But now, I'm thinking that the problem must be within apache or the
> script that splits the logs...



How do you know the entire log file is not getting processed?
Does Webtrends show hits for every hour of the day, assuming that you
have a hit from every hour of the day in the log?

One thing I learned about log files is that they are not always in
chronological order, so Webtrends can have trouble correctly reporting
visits. I found that when using iPlanet, it buffers the hits to the
website and upon examining the access log files, some lines would be out
of chronological order.

My script to retrieve the log files and remove hits to image files then
sorts the log file by date into chronological order.

Good luck,

--
-Scott
yanoff@STOP-SPAMMINGyahoo.com | http://www.yanoff.org | AOL IM: SAY KJY

Sponsored Links






Free braindumps | Software forum | Database administration forum

Copyright 2003 - 2008 webservertalk.com