syntax for analyzing web logs?

classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

syntax for analyzing web logs?

J P-6
Hello,
 
Is anyone aware of a SPSS program that can analyze web logs?
 
Thanks,
John
Reply | Threaded
Open this post in threaded view
|

Automatic reply: syntax for analyzing web logs?

Genevieve Odoom
Thank you for your email. Please note that I will be out of the office beginning Thursday, April 23rd returning on Monday April 27th. I will respond to your email upon my return to the office.

Thank you.

Genevieve Odoom
Policy and Program Analyst
OANHSS
7050 Weston Rd.
Suite 700
Woodbridge, On
L4L 8G7
Tel: (905) 851-8821 x241 Fax: (905) 851-0744
[hidden email]
www.oanhss.org

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

Ruben Geert van den Berg
In reply to this post by J P-6
What exactly do you mean by "web logs"? Do you mean server (as in software, like Apache) logs? And what would you like to find out? There's a program called "webalizer" but I've no idea what it does. I'd rather read/edit/analyze the raw data myself.

Interesting topic though!
Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

Art Kendall
In reply to this post by J P-6
If you have a large enough application to justify the expense the professional version of the MODELER has text-mining capabilities.
I saw a demo recently and it makes me drool, but it is way beyond the budget of  statisticians who are in their first retirement and might not come up with a paying application.
Art Kendall
Social Research Consultants
On 5/23/2013 8:25 AM, J P-6 [via SPSSX Discussion] wrote:
Hello,
 
Is anyone aware of a SPSS program that can analyze web logs?
 
Thanks,
John



If you reply to this email, your message will be added to the discussion below:
http://spssx-discussion.1045642.n5.nabble.com/syntax-for-analyzing-web-logs-tp5720371.html
To start a new topic under SPSSX Discussion, email [hidden email]
To unsubscribe from SPSSX Discussion, click here.
NAML

Art Kendall
Social Research Consultants
Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

J P-6
In reply to this post by Ruben Geert van den Berg
Yes, I mean server logs.
 
Currently I am using Analog (http://www.analog.cx/) which is very good, especially for  the price (free). Problem is it is no longer supported by the developer and it is a bit of a 'blackbox' for me. I can make some basic adjustments to the configuration file, but I would like more control and understanding.
 
Here is a SAS program http://www2.sas.com/proceedings/sugi28/026-28.pdf that might do the trick. But I thought it prudent to check to see if someone has developed something similiar (or better) using SPSS.
 
Thank you,
John

From: Ruben Geert van den Berg <[hidden email]>
To: [hidden email]
Sent: Thursday, May 23, 2013 10:35 AM
Subject: Re: syntax for analyzing web logs?

What exactly do you mean by "web logs"? Do you mean server (as in software,
like Apache) logs? And what would you like to find out? There's a program
called "webalizer" but I've no idea what it does. I'd rather
read/edit/analyze the raw data myself.

Interesting topic though!



--
View this message in context: http://spssx-discussion.1045642.n5.nabble.com/syntax-for-analyzing-web-logs-tp5720371p5720376.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD


Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

Albert-Jan Roskam
Server logs are usually pretty straightforward. You can't read them into spss as fixed-width text? I can send you some python snippets to read license server logs if that would help.
 
Regards,
Albert-Jan


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a
fresh water system, and public health, what have the Romans ever done for us?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
From: J P <[hidden email]>
To: [hidden email]
Sent: Friday, May 24, 2013 4:04 PM
Subject: Re: [SPSSX-L] syntax for analyzing web logs?

Yes, I mean server logs.
 
Currently I am using Analog (http://www.analog.cx/) which is very good, especially for  the price (free). Problem is it is no longer supported by the developer and it is a bit of a 'blackbox' for me. I can make some basic adjustments to the configuration file, but I would like more control and understanding.
 
Here is a SAS program http://www2.sas.com/proceedings/sugi28/026-28.pdf that might do the trick. But I thought it prudent to check to see if someone has developed something similiar (or better) using SPSS.
 
Thank you,
John

From: Ruben Geert van den Berg <[hidden email]>
To: [hidden email]
Sent: Thursday, May 23, 2013 10:35 AM
Subject: Re: syntax for analyzing web logs?

What exactly do you mean by "web logs"? Do you mean server (as in software,
like Apache) logs? And what would you like to find out? There's a program
called "webalizer" but I've no idea what it does. I'd rather
read/edit/analyze the raw data myself.

Interesting topic though!



--
View this message in context: http://spssx-discussion.1045642.n5.nabble.com/syntax-for-analyzing-web-logs-tp5720371p5720376.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD




Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

J P-6
Reading the data shouldn't be much trouble. Making sense of the data and generating reports is more of what I'm looking for.
 
I have no experience with server logs, so am not sure what the variables are or what they mean. Guess I can find some sort of a data guide somewhere.
 
Just trying to not reinvent the wheel.
 
Thanks!

From: Albert-Jan Roskam <[hidden email]>
To: [hidden email]
Sent: Friday, May 24, 2013 11:10 AM
Subject: Re: syntax for analyzing web logs?

Server logs are usually pretty straightforward. You can't read them into spss as fixed-width text? I can send you some python snippets to read license server logs if that would help.
 
Regards,
Albert-Jan


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a
fresh water system, and public health, what have the Romans ever done for us?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
From: J P <[hidden email]>
To: [hidden email]
Sent: Friday, May 24, 2013 4:04 PM
Subject: Re: [SPSSX-L] syntax for analyzing web logs?

Yes, I mean server logs.
 
Currently I am using Analog (http://www.analog.cx/) which is very good, especially for  the price (free). Problem is it is no longer supported by the developer and it is a bit of a 'blackbox' for me. I can make some basic adjustments to the configuration file, but I would like more control and understanding.
 
Here is a SAS program http://www2.sas.com/proceedings/sugi28/026-28.pdf that might do the trick. But I thought it prudent to check to see if someone has developed something similiar (or better) using SPSS.
 
Thank you,
John

From: Ruben Geert van den Berg <[hidden email]>
To: [hidden email]
Sent: Thursday, May 23, 2013 10:35 AM
Subject: Re: syntax for analyzing web logs?

What exactly do you mean by "web logs"? Do you mean server (as in software,
like Apache) logs? And what would you like to find out? There's a program
called "webalizer" but I've no idea what it does. I'd rather
read/edit/analyze the raw data myself.

Interesting topic though!



--
View this message in context: http://spssx-discussion.1045642.n5.nabble.com/syntax-for-analyzing-web-logs-tp5720371p5720376.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD






Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

JKRockStomper
I have been on the same quest for awhile now and it has been very time consuming in SPSS.

Below is some syntax to help you read in your server logs.

GET DATA
   /TYPE = TXT
   /FILE = SERVER1
   /DELCASE = LINE
   /DELIMITERS = " "
   /ARRANGEMENT = DELIMITED
   /FIRSTCASE = 5
   /VARIABLES =
      DATE A10
      TIME TIME8.0
      SITENAME A15
      S_IP A11
      S_METHOD A4
      CS_URI_STEM A48
      CS_URI_QUERY A145
      S_PORT F2.0
      CS_USERNAME A1
      CS_IP A15
      CS_USER_AGENT A478
      SC_STATUS F3.0
      SC_SUBSTATUS F1.0
      SC_WIN32_STATUS F1.0
      TIME_TAKEN F4.0.

Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

Ruben Geert van den Berg
In reply to this post by J P-6
This kinda puzzles me: "...am not sure what the variables are or what they mean..."

I think that's about the very essence of proper data analysis. How would you expect any software to solve this problem (reliably) for you? If you don't even know, how can the software know and how can you make sure the software is "thinking" what you think it's "thinking"?

Reply | Threaded
Open this post in threaded view
|

Autosvar: syntax for analyzing web logs?

Villegas, Emilio (Bisnode)

Jag är föräldraledig och är åter på kontoret onsdag den 12 Juni 2013.

Vid brådskande ärenden kontakta mig på 0709 471115.

 

/Emilio

 

 

Reply | Threaded
Open this post in threaded view
|

Re: syntax for analyzing web logs?

Art Kendall
In reply to this post by J P-6
I not only advocate the use of syntax, I advocate filling in most of the data view so that you know what the variables and their labels mean.  The data view may not always be sufficient to make sense of the data, e.g., unless documents are included it does not cover how the cases were selected).  But the dictionary goes a long way toward making sense of the data.

Perhaps if someone who works with the data were to send you a .sav file with only 1 case but all of the data definition it would speed you along.
Art Kendall
Social Research Consultants
On 5/24/2013 11:35 AM, J P-6 [via SPSSX Discussion] wrote:
Reading the data shouldn't be much trouble. Making sense of the data and generating reports is more of what I'm looking for.
 
I have no experience with server logs, so am not sure what the variables are or what they mean. Guess I can find some sort of a data guide somewhere.
 
Just trying to not reinvent the wheel.
 
Thanks!

From: Albert-Jan Roskam <[hidden email]>
To: [hidden email]
Sent: Friday, May 24, 2013 11:10 AM
Subject: Re: syntax for analyzing web logs?

Server logs are usually pretty straightforward. You can't read them into spss as fixed-width text? I can send you some python snippets to read license server logs if that would help.
 
Regards,
Albert-Jan


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a
fresh water system, and public health, what have the Romans ever done for us?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
From: J P <[hidden email]>
To: [hidden email]
Sent: Friday, May 24, 2013 4:04 PM
Subject: Re: [SPSSX-L] syntax for analyzing web logs?

Yes, I mean server logs.
 
Currently I am using Analog (http://www.analog.cx/) which is very good, especially for  the price (free). Problem is it is no longer supported by the developer and it is a bit of a 'blackbox' for me. I can make some basic adjustments to the configuration file, but I would like more control and understanding.
 
Here is a SAS program http://www2.sas.com/proceedings/sugi28/026-28.pdf that might do the trick. But I thought it prudent to check to see if someone has developed something similiar (or better) using SPSS.
 
Thank you,
John

From: Ruben Geert van den Berg <[hidden email]>
To: [hidden email]
Sent: Thursday, May 23, 2013 10:35 AM
Subject: Re: syntax for analyzing web logs?

What exactly do you mean by "web logs"? Do you mean server (as in software,
like Apache) logs? And what would you like to find out? There's a program
called "webalizer" but I've no idea what it does. I'd rather
read/edit/analyze the raw data myself.

Interesting topic though!



--
View this message in context: http://spssx-discussion.1045642.n5.nabble.com/syntax-for-analyzing-web-logs-tp5720371p5720376.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD









If you reply to this email, your message will be added to the discussion below:
http://spssx-discussion.1045642.n5.nabble.com/syntax-for-analyzing-web-logs-tp5720371p5720402.html
To start a new topic under SPSSX Discussion, email [hidden email]
To unsubscribe from SPSSX Discussion, click here.
NAML

Art Kendall
Social Research Consultants