[Home]  [Headlines]  [Latest Articles]  [Latest Comments]  [Post]  [Sign-in]  [Mail]  [Setup]  [Help] 

Status: Not Logged In; Sign In

What is quantum computing?

12 Important Questions We Should Be Asking About The Cover Up The Truth About Jeffrey Epstein

TSA quietly scraps security check that every passenger dreads

Iran Receives Emergency Airlift of Chinese Air Defence Systems as Israel Considers New Attacks

Russia reportedly used its new, inexpensive Chernika kamikaze drone in the Ukraine

Iran's President Says the US Pledged Israel Wouldn't Attack During Previous Nuclear Negotiations

Will Japan's Rice Price Shock Lead To Government Collapse And Spark A Global Bond Crisis

Beware The 'Omniwar': Catherine Austin Fitts Fears 'Weaponization Of Everything'

Roger Stone: AG Pam Bondi Must Answer For 14 Terabytes Claim Of Child Torture Videos!

'Hit Us, Please' - America's Left Issues A 'Broken Arrow' Signal To Europe

Cash Jordan Trump Deports ‘Thousands of Migrants’ to Africa… on Purpose

Gunman Ambushes Border Patrol Agents In Texas Amid Anti-ICE Rhetoric From Democrats

Texas Flood

Why America Built A Forest From Canada To Texas

Tucker Carlson Interviews President of Iran Mosoud Pezeshkian

PROOF Netanyahu Wants US To Fight His Wars

RAPID CRUSTAL MOVEMENT DETECTED- Are the Unusual Earthquakes TRIGGER for MORE (in Japan and Italy) ?

Google Bets Big On Nuclear Fusion

Iran sets a world record by deporting 300,000 illegal refugees in 14 days

Brazilian Women Soccer Players (in Bikinis) Incredible Skills

Watch: Mexico City Protest Against American Ex-Pat 'Invasion' Turns Viole

Kazakhstan Just BETRAYED Russia - Takes gunpowder out of Putin’s Hands

Why CNN & Fareed Zakaria are Wrong About Iran and Trump

Something Is Going Deeply WRONG In Russia

329 Rivers in China Exceed Flood Warnings, With 75,000 Dams in Critical Condition

Command Of Russian Army 'Undermined' After 16 Of Putin's Generals Killed At War, UK Says

Rickards: Superintelligence Will Never Arrive

Which Countries Invest In The US The Most?

The History of Barbecue

‘Pathetic’: Joe Biden tells another ‘tall tale’ during rare public appearance


Miscellaneous
See other Miscellaneous Articles

Title: jwpu xa keep
Source: [None]
URL Source: [None]
Published: Aug 27, 2012
Author: elgoog
Post Date: 2012-08-27 07:19:50 by Itistoolate
Keywords: None
Views: 212
Comments: 6

elgoog test to see when it appears as a result

Post Comment   Private Reply   Ignore Thread  


TopPage UpFull ThreadPage DownBottom/Latest

Begin Trace Mode for Comment # 1.

#1. To: Itistoolate, christine, Pinguinite (#0)

Assuming Google and the others still honor the directives contained in every webserver's robots.txt file, it won't appear in search engine results at all.

Here is 4um's robots.txt file:

User-agent: *
Disallow: /cgi-bin/latestcomments.cgi
Disallow: /cgi-bin/latestarticles.cgi
Disallow: /cgi-bin/readart.cgi

Meaning: for all search engine spiders, do not look at anything in Latest Comments, Latest Articles, or any article whatsoever.

I don't check in here much any more but drop me a forum mail if you discover they did index this thread (publicly) and publish it in their search results.

That is not to say Google and others don't index anything here. You can find that info by entering site:freedom4um.com or site:www.freedom4um.com into a Google search. Google appears to keep a separate set of entries depending on whether you use 'www' or not.

Doing such searches reveals that Google does index 4um's user pages since those are not forbidden in the robots.txt file.

If Neil and christine wanted to stop the indexing of the homepages here, they could add a line to robots.txt like: "Disallow: /cgi-bin/homepage.cgi" "Disallow: /cgi-bin/bookmarks.cgi". This would guard user privacy and keep Google from sniffing around. Google also indexes the Sign-in page, the Help page, etc.

As far as I can see, Google is obeying the rules Neil posted in the robots.txt file. Neil just hasn't excluded quite enough to ensure true privacy.

LP forbids most everything to search engines. LF allows indexing of virtually everything (and incurs the bandwidth overhead of having all those search engines constantly eating their bandwidth). Freeperville also allows search engines pretty full access and this is a huge part of the bandwidth costs they claim to incur, possibly rivaling the bandwidth consumed by actual users at Freeperville.

TooConservative  posted on  2012-08-27   12:19:45 ET  Reply   Untrace   Trace   Private Reply  


Replies to Comment # 1.

#2. To: TooConservative, Critter (#1)

thanks for the info, TC.

christine  posted on  2012-08-27 12:33:40 ET  Reply   Untrace   Trace   Private Reply  


#3. To: TooConservative, christine (#1)

I no longer host 4um, but that robots file is as it was when it was on my server. I'd forgotten about it, but no doubt it's there due to bandwidth issues. Or actually server load issues is more likely.

Pinguinite  posted on  2012-08-27 12:36:11 ET  Reply   Untrace   Trace   Private Reply  


#4. To: TooConservative (#1)

Who has homepages any longer?

Lod  posted on  2012-08-27 13:16:16 ET  Reply   Untrace   Trace   Private Reply  


End Trace Mode for Comment # 1.

TopPage UpFull ThreadPage DownBottom/Latest


[Home]  [Headlines]  [Latest Articles]  [Latest Comments]  [Post]  [Sign-in]  [Mail]  [Setup]  [Help]