I run my app on google app engine…..My log files are huge due to heavy traffic
The log file looks like this
122.167.221.243 - - [06/Mar/2012:01:11:29 -0800] "GET /Bengali/enable HTTP/1.1" 404 0 "http://www.epicsearch.in/" -
---Similar rows ---- below
I want to process them to get meaningful stats such as no. of unique IP addresses or no. of hits on a given page….
I am a beginner so do not know how to go about it!!!!!
Assuming you haven’t already done so, the first thing you’ll want to do is download your App Engine logs using the
appcfg.pyutility, for example:After you download it, you will have to throw together a script or program to parse your logs for whatever information you deem useful.
This Stack Overflow question might be a good place to start — really any decent scripting language should be able to adequately parse those logs for you.