[Home]  [Headlines]  [Latest Articles]  [Latest Comments]  [Post]  [Sign-in]  [Mail]  [Setup]  [Help] 

Status: Not Logged In; Sign In

“The government wants to make sure that that does not come out. A huge part of our political system is predicated on blackmail,”

You Know What Happens Next

Cash Jordan: Half-Built Tower Abandoned… as ICE Deports Entire ‘Migrant Workforce’

Heavy rainfall causes flash flooding Tuesday night, some cars stuck in high water on Chicago's West

Biden Doctor PLEADS THE FIFTH, Refuses To Testify To Congress, Biden Pardons ARE VOID

Joe Rogan says FBI director Kash Patel played him for a fool and maga for fools with the Jeff Epstein files

Elon's AI System "Grok" Went Rogue And Has Been SHUT DOWN in an Emergency!

Earthquake Swarms at One of the MOST DANGEROUS Volcanoes in the USA

Ben Shapiro Declares Epstein Case CLOSED: ‘Facts on the Ground Have Changed’

Iran receives 40 Chinese J10-C Fighter Jets

China’s Railgun Is Now Battle-Ready, Thanks to Nuclear Power

Chinese Hypersonic Advancements! Deadly new missile could decimate entire US fleet in 20 minutes

Iran Confirms Massive Chinese HQ 9 B Missile Deal

Why Is Europe Hitting 114°F And Still Rising?

The INCREDIBLE Impacts of Methylene Blue

The LARGEST Eruptions since the Merapi Disaster in 2010 at Lewotobi Laki Laki in Indonesia

Feds ARREST 11 Leftists For AMBUSH On ICE, 2 Cops Shot, Organized Terror Cell Targeted ICE In Texas

What is quantum computing?

12 Important Questions We Should Be Asking About The Cover Up The Truth About Jeffrey Epstein

TSA quietly scraps security check that every passenger dreads

Iran Receives Emergency Airlift of Chinese Air Defence Systems as Israel Considers New Attacks

Russia reportedly used its new, inexpensive Chernika kamikaze drone in the Ukraine

Iran's President Says the US Pledged Israel Wouldn't Attack During Previous Nuclear Negotiations

Will Japan's Rice Price Shock Lead To Government Collapse And Spark A Global Bond Crisis

Beware The 'Omniwar': Catherine Austin Fitts Fears 'Weaponization Of Everything'

Roger Stone: AG Pam Bondi Must Answer For 14 Terabytes Claim Of Child Torture Videos!

'Hit Us, Please' - America's Left Issues A 'Broken Arrow' Signal To Europe

Cash Jordan Trump Deports ‘Thousands of Migrants’ to Africa… on Purpose

Gunman Ambushes Border Patrol Agents In Texas Amid Anti-ICE Rhetoric From Democrats

Texas Flood


Science/Tech
See other Science/Tech Articles

Title: Google kills Scroogle??
Source: Scroogle
URL Source: http://www.scroogle.org/cgi-bin/nbbw.cgi
Published: Jul 1, 2010
Author: Daniel Brandt
Post Date: 2010-07-01 20:09:51 by X-15
Keywords: None
Views: 448
Comments: 23

July 1, 2010: Here we go again...

We regret to announce that our Google scraper may have to be permanently retired, thanks to a change at Google. It depends on whether Google is willing to restore the simple interface that we've been scraping since Scroogle started five years ago. Actually, we've been using that interface for scraping since Google-Watch.org began in 2002.

This interface (here's a sample from years ago) was remarkably stable all that time. During those eight years there were only about five changes that required some programming adjustments. Also, this interface was available at every Google data center in exactly the same form, which allowed us to use 700 IP addresses for Google.

That interface was at www.google.com/ie but on May 10, 2010 they took it down and inserted a redirect to /toolbar/ie8/sidebar.html. It used to have a search box, and the results it showed were generic during that entire time. It didn't show the snippets unless you moused-over the links it produced (they were there for our program, so that was okay), and it has never had any ads. Our impression was that these results were from Google's basic algorithms, and that extra features and ads were added on top of these generic results. Three years ago Google launched "Universal Search," which meant that they added results from other Google services on their pages. But this simple interface we were using was not affected at all.

It is not possible to continue Scroogle unless we have a simple interface that is stable. Google's main consumer-oriented interface that they want everyone to use is too complex, too bloated, and changes too frequently, to make our scraping operation possible.

After a lot of suggestions from Scroogle users, and a fair amount of publicity, we found a fix and Scroogle was back in 24 hours. This fix was to insert an extra parameter, &output=ie, into the search terms that were relayed to Google. The extra parameter recovered the same interface that we thought was gone forever.

Now it seems like it actually might be gone forever. Late on June 30, 2010, the results produced while using this parameter began to shift to the usual busy Google interface with ads and a left-margin sidebar. Scroogle users saw a Scroogle page that said, "Google returned no results for this search," when in fact Google returned results but our scraper was unable to deal with them. Over the next few days we will attempt to contact Google and determine whether the old interface is gone as a matter of policy at Google, or if they simply have it hidden somewhere and will tell us where it is so that we can continue to use it.

Thank you for your support during these past five years. Check back in a week or so; if we don't hear from Google by next week, I think we can all assume that Google would rather have no Scroogle, and no privacy for searchers.

— Daniel Brandt, Public Information Research, scroogle AT lavabit.com

Post Comment   Private Reply   Ignore Thread  


TopPage UpFull ThreadPage DownBottom/Latest

Begin Trace Mode for Comment # 8.

#3. To: Pinguinite, christine (#0)

Can either of you recommend a search engine besides "Google", or another anonymous method of accessing the internet. I don't want to give my internet search info to Google.

X-15  posted on  2010-07-01   22:15:39 ET  Reply   Untrace   Trace   Private Reply  


#5. To: X-15 (#3)

Try www.ixquick.com/

I refuse to use Google most of the time and ixquick does not record IP's or your search results.

Original_Intent  posted on  2010-07-01   22:24:46 ET  Reply   Untrace   Trace   Private Reply  


#7. To: Original_Intent, GreyLmist (#5)

Startpage is powered by Ixquick.com - the world's most private search engine. Startpage and Ixquick are one and the same. Startpage is just easier to remember.

Looks like they're the same. Thanks GreyLmist and O_I

X-15  posted on  2010-07-01   22:30:19 ET  Reply   Untrace   Trace   Private Reply  


#8. To: X-15 (#7)

You are most welcome.

Original_Intent  posted on  2010-07-01   22:36:12 ET  Reply   Untrace   Trace   Private Reply  


Replies to Comment # 8.

        There are no replies to Comment # 8.


End Trace Mode for Comment # 8.

TopPage UpFull ThreadPage DownBottom/Latest


[Home]  [Headlines]  [Latest Articles]  [Latest Comments]  [Post]  [Sign-in]  [Mail]  [Setup]  [Help]