[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ilugc
Subject:    Re: [Ilugc] Parsing Large Log Files which is of size ~1GB
From:       Mohan Sundaram <mohan.tux () gmail ! com>
Date:       2007-07-31 7:29:10
Message-ID: 46AEE1F6.5090309 () gmail ! com
[Download RAW message or body]

Antano Solar wrote:
>>
>>
>> the logs are generated on the production box where large no of
>> requests come. i should not  bring the system down but i should also
>> know the log details so that i can monitor the server.
>>
>> thanks for all the folks who advised on perl/ruby regex stuff.  also i
>> googled before i was mailing to the mailing list. i was looking for
>> various good techniques which will not bring the live server down.
> 
> 
> I didnt realise that you were processing server logs.
> Cpan  has a neat module for  parsing apache server logs .
> if you are writing the regex yourself be extremely careful.
> there is nothing as awful as an one liner which is ten times as slower.
>
Take a look at logreport.org for lire.

Mohan
_______________________________________________
To unsubscribe, email ilugc-request@ae.iitm.ac.in with 
"unsubscribe <password> <address>"
in the subject or body of the message.  
http://www.ae.iitm.ac.in/mailman/listinfo/ilugc
[prev in list] [next in list] [prev in thread] [next in thread]