FileBuzz: Software Download
Find shareware, freeware downloads from thousands of software titles

Program Name: Spider Session Remover

Published By:

License Type: Freeware

Date Released: February 22, 2012

Spider Session Remover v1.0 Instant Download

Spider Session Remover Desciption:


This contribution uses Apache mod_rewite to look for specific spiders, and remove the
session (osCsid) from the URL, and return a '301' back to the spider.

Basically, if the spider tries to do this:


the Apache mod_rewrite will rewrite the url to be:


and also return a "301" (Moved Permanently) to the spider.

The problem

You may use one of the following:

* 2-2MS2 "Prevent Spider Sessions" admin feature is set to true.
* SID Killer contribution (homepage
* Spider Killer for MS1 contribution (homepage

All of these features are very good, and aim to prevent spiders from adding an session ID (osCsid) to the url.

However, what if a spider started to crawl your website BEFORE you enabled one of the above features ? What can happen, is that the (previously) harvested URLS with SIDs in them will show as results in search engines. Afterwards, often many months later, you will still see the spider trying to access the the URLs it harvested earlier with the session ID in it.

In summary, URL's with sessions ID's were harvested PRIOR to any session disabling, and therefore these URL's are now indexed in search engines, and the spiders continue to re-visit your website using the URL's with the 'osCsid' in them.

The Solution

So, how do we remove these session ID's for the spiders that continue to use the previously harvested URL ? By the use of Apache mod_rewrite, look for the spider agent name, and if the condition is true, re-write the URL without the 'osCsid' in it, and ALSO return a "301" back to the spider.

What results from the mod_rewite

As to what the search engines will do, they'll see the 301-Moved Permanently response, re-fetch the page from the new (osCsid-less) URL given in that response, and, after a while, update their database to use the new URL.

License: Freeware | Downloads (132)

Platform: All

Language: PHP

Related Software
New Reviews
New Downloads Top Downloads Top Search

New Downloads

ChequePulse Cheque Printing Software
HttpMaster Express
HttpMaster Professional
Aiseesoft Mac Cleaner
PDF Shaper Professional
IDpack Business
IGES Viewer alias ABViewer
JoyoPlayer for Windows
Mirekusoft Install Monitor
Smart Defrag
APKF Product Key Finder
User Time Control
DVDFab UHD Creator
SEO PowerSuite Enterprise
Free Window Registry Repair
DVDFab DVD Cinavia Removal for Mac
Universal SQL Editor
Cash Register VPN for Android
Nsauditor Network Security Auditor

Top Downloads

Opera Mini
Turbo C++
Abyss Web Server X1
TaskMerlin Project Management Software
Macrorit Disk Partition Expert Server Edition
Foxit Advanced PDF Editor
Kids Online Browser
Rapid PHP Editor
Cleanup and Update Tool for Cisco CUCM
Open-School Community Edition
Count Code
simplitec simplisafe
Multi-Process Killer Portable
SCEA Part 2 & 3 Exam EPractize Labs Enterprise
Silva 2.1a2
Agama Web Menus
aXmag Free
Flash Player Pro
Red Call Recorder
Syston Data Recovery Free
Photo! 3D Album
Photo! Editor
Sondle Virtual Desktop Assist

Top Search

Duplicate Files Remover Spider
Cookies Remover Spider
Spider Organizer Template
Nokia Mobile Spyware Remover
Dvd Copy Lock Remover
Samsung Password Remover
Analogx Vocal Remover Torrent
Hdd Bad Sector Remover Boot Disk
Download Spider Game Vista
Samsung Mobile Mobiletracker Remover
Sonyericsson Password Remover
Download Full Spyware Remover
Fix Shortcut Virus Remover
Font Remover Sms
Free Down Loadnew Folder Virus Remover
Rar Pw Remover Mac
Block Remover Software Free Download
Spider Solitaire Full Version
Adobe Master Collection Remover
Easy Photo Editor Red Eye Remover
Dress Remover Babies
Data Spider Freeware
Memorycard Passward Remover Softwere
Picture Blue Eye Remover
Nokia6300 Spider Solitaire 240x320 Piksel Jar