Squid: Logfile Analysis
| Calamaris | By Cord Beermann is a tool to analyse Squid's access.log. It generates ascii or html-reports. For a full list of features, please visit the Calamaris home page. |
|---|---|
| The Webalizer | Its a fast, free web server log file analysis program. It produces highly detailed, easily configurable usage reports in HTML format, for viewing with a standard web browser. |
| Squidalyser (local copy) |
Squidalyser is a squid traffic analyser, designed to allow per-user scrutiny and analysis of squid logfiles. The program runs from a Unix system via a web browser. |
| Squeezer | by Maciej Kozinski, gathers information abount Squid's internal performance and eficiency of relationship, finds bottlenecks, shows data transfer speed from particular sources. |
| Squeezer2 | by Andrew Fresh is derived from Squeezer, but with more features, including running from a chroot environment. |
| SCALAR | SCALAR (Squid Cache Advanced Log Analyzer & Reporter) produces many detailed reports, such as: Time Based Load Statistic, Extensions Report, Content Report, Object Sizes Report, Request Methods Report, Squid & HTTP Result Codes Report and Cache Hierarchy Reports - most of reports are splitted on Requests, Traffic, Timeouts and Denies statistic. SCALAR is highly customizable tool/script written on AWK - all setting can be defined inside script header. SCALAR developed by Yuri N. Fominov. |
| Squidview | Squidview is an interactive program Which monitors Squid's access.log and displays it in a nice fashion. It has searching and reporting functions. Squidview is a console program which also runs in an xterm. It has been tested on several distributions of Linux and is available under the GPL. |
| bt-LogAnalyzer | This utility, by Burstek, parses logfiles from Squid and other caching products. It can generate combined reports for all logs and also includes email usage. The software runs on Windows 2000/XP. |
| squid-graph | Squid Graph is a free, simple, yet powerful Squid v2 native logfile analysis tool that generates reports with graphical representation of the proxy server's traffic. It is distributed under the GNU General Public License (GPL). Squid Graph runs on Unix systems with Perl version 5.6.0 or later. |
| squint | squint generates a little report of who is spending the most time and resources browsing the internet via your squid proxy server. The top offenders in terms of data transfer, number of files transferred and on-line time are reported. squint now also generates a detailed history for each person which can be viewed with a browser. |
| logrep | Logrep is a framework for extraction and presentation of information from various logfiles. It now supports snort, squid, postfix, apache, IIS and viruswall. HTML-reports, 2D analysis, overview page, ssh communication and bar charts are available. |
| Squid-Log-Analyzer | Squid-Log-Analyzer is a small Perl script that analyses Squid's access.log. |
| squidclients | by Nico Tranquilli. |
| squidtimes | By Nico Tranquilli generates a report of average transfer times. |
| Sarg | By Pedro Lineu Orso Squid Analysis Report Generator is a tool that allows you to view "where" your users are going to on the Internet. |
| ModLogAn | The modular logfile analyzer tool is able to analyze logfiles from 15 different servers (http, ftp, mail, streaming, etc.), including Squid. Its template engine generates XHTML based on usersupplied themes which makes it possible to provide look & feel of your own wishes. |
| Seafood (local copy) |
Brought to you by the DFN-Cache and TERENA projects, Seafood collects log file statistics into a relational database (such as Postgres and Oracle). |
| Squij | By Mark Nottingham, is a Python application that analyzes Squid log files, in conjunction with squid.conf. It can tell you when your cache serves stale or fresh responses. |
| WebLog | By Mark Nottingham, is a set of Python classes for parsing Web logfiles, including one for Squid. |
| pwebstats | By Martin Gleeson includes support for Squid's native log format. In particular squid2common.pl will convert it to the common httpd log format. |
| squidsites | is a tool that parses Squid access log file and generates a report of the most visited sites, sorting by hit count or by bytes count. It has a GPL license. |
| Squidtaild | By Maurice Smiley is a Perl daemon designed to tail the squid log file and report user activity in real time based on user definable filter matches. Output generated by squidtaild is sent to an html page showing you how many filter matches, what they were and what ip address matched the filter. [Squidtaild used to be at http://trailer.linuxatwork.at/, but that site is now gone.] |
| ip2fqdn.pl | by Martin Gleeson translates IP addresses to hostnames. |
| generic filters | from LBL also translate IP addresses to hostnames. |
| proxy_stats.gawk | By Richard Huveneers produces a different kind of report for an access.log. |
| access-times.awk | By Andrew Richards shows access times for various categories of requests. |
| cache-stats | By Iain Lea produces daily usage statistics for Netscape and Squid caches. |
| PY_Squid_Stats | By David Ramahefason, this is a set of graphical stats tools for squid log files, written in python. |
| NLANR | Here are the old and difficult scripts that we use on our own caches. |
| SRG - Squid Report Generator | SRG is a fast log analyser that creates detailed output reports right down to the individual URLs visited. SRG has strong support for integration with authentication systems to allow granular access to the reports. |
| Internet Access Monitor for Squid | Internet Access Monitor is a software for monitoring the efficiency of your company's Internet bandwidth usage. Using this product you can easily find out who, when, where to, where from and what accessed the Internet. |
| rotilia | by Mehdi Adibi. Rotilia is a web-based logfile analyzer, written in PHP.It is distributed under the GNU General Public License (GPL).It able to calculate the total time that the cache server was busied, total size of packages and the list of sites visited by the users, also report all of these per user in any period of time. |
| Kraken Reports | Kraken Reports is a log analyser written in C# for the .NET platform. It allows Administrators to do analysis on what users have been doing on their systems and filter users based on key words. |
| Stone Steps Webalizer | Supports IIS and custom Apache log formats; CSS2-based HTML reports; run-time configurable languages; native DNS support (Windows & Linux); |
| SAcc | Squid log analyser & accounting system |
| LightSquid | LightSquid - lite log analizer for squid proxy small size (~45k) and fast parser ;-) small disk usage generate many report type |
| .Traf (dotTraf) | .Traf is a simple but complete proxy server log analyzer, for Windows 98/ME/NT/2000/2003/XP, supporting actually squid native log file (squid-cache proxy server). .Traf can generate html reports and/or browse all entries from its GUI |
| ManageEngine Firewall Analyzer | ManageEngine Firewall Analyzer is a web-based log analysis tool that collects, correlates, and reports on logs from enterprise-wide firewalls, proxy servers, and Radius servers. Features include threshold-based alerting, log archiving, historical trending, and more. |
| Logfile Analyzer for Squid (LFA) | very simple logfileanalyzer written in PHP, it is curently unter develop and will get more features in future. this software is available in german language, but you can change it if you like it ;-) |
| MySAR | MySQL Squid Access Report is a dynamic database-based squid log analysis software, designed to be both flexible and easy to use. |
| squish | Squish maintains a per-user record of proxy traffic and time on-line. (ab)Users exceeding configured quotas are squished (added to a blacklist acl). (Licence GPL) |
| ProxCube | Squid log file analyser with comprehensive interactive reports. Drill down on most fields - user, client IP, response codes etc. Commercial software with 30 day trial. |
| S.L.A.E. (Squid Log Analyzer Express) | S.L.A.E. is a platform, developed using C# and the .NET Framework 1.1 (and Mono), for analyze the Squid's log file. The project's aims are: be an OpenSource project, support for Windows and Linux (using Mono), support for rich and web client, support for SQl, MySQl and Access database, provide a rich class's sets for database's access and manage, provide OLTP and OLAP database, analyze and import "BIG" access.log file, manage multiple server and log's file |
| OSSEC | OSSEC is an open source project for security log analysis that supports squid, web, auth and mail logs. Some of the things you can detect by analyzing your squid logs are presented in the following document: http://www.ossec.net/en/loganalysis.html |
| Cache+ | Cache+ is a squid-cache based product and SQL Based squid reporting. Technical Features: WCCP, MS Active Directory Auth, Radius Auth, Access Control List, URL brolcking, Detail Log Analyzer (with database) |
| Cyfin Reporter | Cyfin Reporter is a scalable logfile analyzer that supports 95 different logfile formats, including Squid logfiles. From these logfiles, Cyfin produces Web-use reports that are detailed, accurate and easy to read. Customizable features fit any organization's Web-use policy. Supports Windows 2003/XP/2000/NT, Red Hat Linux, Solaris SPARC and Active Directory. Free 30-Day Trial. |
| W3Perl | W3Perl is a free logfile analyser. Demo is http://www.w3perl.com/demo/squid/ |
| Free-SA | Free-SA is tool for statistical analysis of daemons' log files, similar to SARG. Its main advantages over SARG are much better speed (7x-20x), more support for reports, and W3C compliance of generated HTML/CSS reports. It can be used to help control traffic usage, to control Internet access security policies, to investigate security incidents, to evaluate server efficiency, and to detect troubles with configuration. |
| squidARG | squidARG is a program that generates reports from the Squid access.log. |
| squidltc | squidltc is the Squid Access Log Time Convertor. |
| Squid Top Site Report Generator | STSRG (Squid Top-Site Report Generator) is a Perl script to analyze the previous days squid access.log log file and produce a report of the most frequently visited URLs. It~Rs reasonably quick processing about 100,000 lines of log file in 12 seconds. |
| Surftrackr | Surftrackr is a log file analyser for squid and Dan's Guardian. The program allows a non-technical user to extract information about Web usage patterns, the type of information downloaded, the sites visited by users, and the amount of information (per-byte or per-file) accessed. Surftrackr runs via a web browser. |
Note to developers: If you write a tool that generates HTML reports, please insert this in the HEAD section so that your reports are not indexed by search engines, etc:
<meta name="robots" content="noindex,nofollow">
Please use this form to add your software to this list
Search
Introduction
- About Squid
- Why Squid?
- Squid Developers
- How to Help Out or Donate
- Getting Squid
- Squid Source Packages
- Squid Deployment Case-Studies
- Squid Software Foundation
Documentation
- Configuration:
- FAQ and Wiki
- Guide Books:
- Non-English
- More...
Support
- Security Advisories
- Bugzilla Database
- Mailing lists
- Contacting us
- Commercial services
- Project Sponsors
- Squid-based products
