Foote, Chris
Chris.Foote at uk.thalesgroup.com
Fri Feb 10 03:57:06 CST 2006
Interesting project! I too had considered such a project in the past, but was daunted by the complexity. My web hosting company (DSVR) supports a product called Webalizer. This is a server-side (PERL?) jobbie that analyses log files. Feel free to have a look at http://emmajohnstoneceramics.com/usage/ . Regards! Chris Foote > -----Original Message----- > From: accessd-bounces at databaseadvisors.com > [mailto:accessd-bounces at databaseadvisors.com]On Behalf Of Shamil > Salakhetdinov > Sent: Friday, February 10, 2006 9:22 AM > To: Access Developers discussion and problem solving > Subject: Re: [AccessD] OT: Affiliate Program > > > Rocky, > > Internet servers are usually able to keep raw logs of HTTP > requests - these > are seperate ASCII files and their records are well formatted > and look like > the sample log records from my site's today HTTP requests > log in the P.S. > of this message. > > I did plan for quite some time to write code to parse these > records and to > put them into database for further analysis but I didn't have > good reasons > to that for myself. > > Now, if nobody here will point on a ready to use solution > then we can write, > test and use such TCP/IP log parser together and when well done make > it available on AccessD site for download... > > How about this idea? I can write some code for starters on weekend... > > Shamil > > P.S. HTTP requests sample log: > > 139.18.2.214 - - [10/Feb/2006:00:04:09 +0300] "GET > /robots.txt HTTP/1.1" 404 > 297 "-" "findlinks/1.1.1-a1 > (+http://wortschatz.uni-leipzig.de/findlinks/)" > > 70.85.193.178 - - [10/Feb/2006:00:05:57 +0300] "HEAD > /shamil_s HTTP/1.1" > 301 - "-" "LWP::Simple/5.803" > > 70.85.193.178 - - [10/Feb/2006:00:06:00 +0300] "HEAD > /shamil_s/ HTTP/1.1" > 200 - "-" "LWP::Simple/5.803" > > 70.85.193.178 - - [10/Feb/2006:00:06:03 +0300] "GET /shamil_s > HTTP/1.1" 301 > 334 "http://www.jaja-jak-globusy.com/" "Poirot" > > ... > > 70.78.74.47 - - [10/Feb/2006:05:33:36 +0300] "GET > /shamil_s/pics/clearday.jpg HTTP/1.1" 200 5675 > "http://smsconsulting.spb.ru/shamil_s/" "Mozilla/4.0 > (compatible; MSIE 6.0; > Windows NT 5.1; SV1; .NET CLR 1.1.4322)" > > 70.78.74.47 - - [10/Feb/2006:05:33:36 +0300] "GET > /shamil_s/pics/pole2.gif > HTTP/1.1" 200 226 "http://smsconsulting.spb.ru/shamil_s/" "Mozilla/4.0 > (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)" > > ... > > 68.142.249.46 - - [10/Feb/2006:11:31:19 +0300] "GET > /robots.txt HTTP/1.0" > 404 297 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; > http://help.yahoo.com/help/us/ysearch/slurp)" > > 68.142.251.104 - - [10/Feb/2006:11:31:20 +0300] "GET > /.net/tutorials/vb.net/ncm.htm HTTP/1.0" 200 37707 "-" "Mozilla/5.0 > (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)" 68.142.250.147 - - [10/Feb/2006:11:34:21 +0300] "GET /shamil_s/topics/tstmodex.htm HTTP/1.0" 200 3088 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)" ...