[Home]  [Headlines]  [Latest Articles]  [Latest Comments]  [Post]  [Sign-in]  [Mail]  [Setup]  [Help] 

Status: Not Logged In; Sign In

What The Pentagon Is Planning Against Trump Will Make Your Blood Run Cold Once Revealed

How Trump won the Amish vote in Pennsylvania

FEC Filings Show Kamala Harris Team Blew Funds On Hollywood Stars, Private Jets

Israel’s Third Lebanon War is underway: What you need to know

LEAK: First Behind-The-Scenes Photos Of Kamala After Getting DESTROYED By Trump | Guzzling Wine!🍷

Scott Ritter Says: Netanyahu's PAINFUL Stumble Pushes Tel Aviv Into Its WORST NIGHTMARE

These Are Trump's X-Men | Dr. Jordan B. Peterson

Houthis (Yemen) Breached THAAD. Israel Given a Dud Defense!!

Yuma County Arizona Doubles Its Outstanding Votes Overnight They're Stealing the Race from Kari Lake

Trump to withdraw U.S. troops from northern Syria

Trump and RFK created websites for the people to voice their opinion on people the government is hiring

Woke Georgia DA Deborah Gonzalez pummeled in re-election bid after refusing Laken Riley murder case

Trump has a choice: Obliterate Palestine or end the war

Rod Blagojevich: Kamala’s Corruption, & the Real Cause of the Democrat Party’s Spiral Into Insanity

Israel's Defense Shattered by Hezbollah's New Iranian Super Missiles | Prof. Mohammad Marandi

Trump Wins Arizona in Clean Sweep of Swing States in US Election

TikTok Harlots Pledge in Droves: No More Pussy For MAGA Fascists!

Colonel Douglas Macgregor:: Honoring Veteran's Day

Low-Wage Nations?

Trump to pull US out of Paris climate agreement NYT

Pixar And Disney Animator Bolhem Bouchiba Sentenced To 25 Years In Prison

Six C-17s, C-130s deploy US military assets to Northeastern Syria

SNL cast members unveil new "hot jacked" Trump character in MAGA-friendly cold open

Here's Why These Geopolitical And Financial Chokepoints Need Your Attention...

Former Army Chief Moshe Ya'alon Calls for Civil Disobedience to Protest Netanyahu Government

The Deep State against Trump

A Post Mortem Autopsy: From A Diddy Party to a Pity Party

Whoopie Goldberg Blames Inflation on Grocery Store Owners, Calls Them Pigs

Sean ‘Diddy’ Comb’s Attorneys Seek $50M Bail Package,

Mike Pompeo and Nikki Haley Will NOT Be Invited To be Part of Trump’s Second Administration!


Miscellaneous
See other Miscellaneous Articles

Title: jwpu xa keep
Source: [None]
URL Source: [None]
Published: Aug 27, 2012
Author: elgoog
Post Date: 2012-08-27 07:19:50 by Itistoolate
Keywords: None
Views: 155
Comments: 6

elgoog test to see when it appears as a result

Post Comment   Private Reply   Ignore Thread  


TopPage UpFull ThreadPage DownBottom/Latest

#1. To: Itistoolate, christine, Pinguinite (#0)

Assuming Google and the others still honor the directives contained in every webserver's robots.txt file, it won't appear in search engine results at all.

Here is 4um's robots.txt file:

User-agent: *
Disallow: /cgi-bin/latestcomments.cgi
Disallow: /cgi-bin/latestarticles.cgi
Disallow: /cgi-bin/readart.cgi

Meaning: for all search engine spiders, do not look at anything in Latest Comments, Latest Articles, or any article whatsoever.

I don't check in here much any more but drop me a forum mail if you discover they did index this thread (publicly) and publish it in their search results.

That is not to say Google and others don't index anything here. You can find that info by entering site:freedom4um.com or site:www.freedom4um.com into a Google search. Google appears to keep a separate set of entries depending on whether you use 'www' or not.

Doing such searches reveals that Google does index 4um's user pages since those are not forbidden in the robots.txt file.

If Neil and christine wanted to stop the indexing of the homepages here, they could add a line to robots.txt like: "Disallow: /cgi-bin/homepage.cgi" "Disallow: /cgi-bin/bookmarks.cgi". This would guard user privacy and keep Google from sniffing around. Google also indexes the Sign-in page, the Help page, etc.

As far as I can see, Google is obeying the rules Neil posted in the robots.txt file. Neil just hasn't excluded quite enough to ensure true privacy.

LP forbids most everything to search engines. LF allows indexing of virtually everything (and incurs the bandwidth overhead of having all those search engines constantly eating their bandwidth). Freeperville also allows search engines pretty full access and this is a huge part of the bandwidth costs they claim to incur, possibly rivaling the bandwidth consumed by actual users at Freeperville.

TooConservative  posted on  2012-08-27   12:19:45 ET  Reply   Trace   Private Reply  


#2. To: TooConservative, Critter (#1)

thanks for the info, TC.

christine  posted on  2012-08-27   12:33:40 ET  Reply   Trace   Private Reply  


#3. To: TooConservative, christine (#1)

I no longer host 4um, but that robots file is as it was when it was on my server. I'd forgotten about it, but no doubt it's there due to bandwidth issues. Or actually server load issues is more likely.

Pinguinite  posted on  2012-08-27   12:36:11 ET  Reply   Trace   Private Reply  


#4. To: TooConservative (#1)

Who has homepages any longer?

I predict future happiness for Americans if they can prevent government from wasting the labors of the people under the pretense of taking care of them ~ Thomas Jefferson

Lod  posted on  2012-08-27   13:16:16 ET  Reply   Trace   Private Reply  


#5. To: Lod (#4) (Edited)

Who has homepages any longer?

X15, TommyTheMadArtist, both of their homepages here are linked to on those Google links I offered. Plenty of others as well.

Use this link to see your page linked at Google. And you do have Bookmarks entered on your home page too.

TooConservative  posted on  2012-08-27   16:13:42 ET  Reply   Trace   Private Reply  


#6. To: Itistoolate (#0)

Nothing shows at Google yet.

I think it would show up within a day if you add this thread to your Bookmarks page on your Home Page here at 4um. Or if you just add the title into your Home Page.

Since 4um has relatively static content for Google's purposes for reasons I showed above (very few pages available to Google and those pages seldom change), you might have to wait longer than a day for Google or others to spider it. Maybe a week or month. But I suspect they scan absolutely any page they can get access to. The more dynamic the pages are, the more often they will scan.

TooConservative  posted on  2012-08-27   21:13:39 ET  Reply   Trace   Private Reply  


TopPage UpFull ThreadPage DownBottom/Latest


[Home]  [Headlines]  [Latest Articles]  [Latest Comments]  [Post]  [Sign-in]  [Mail]  [Setup]  [Help]