Feeds:
Posts
Comments

Posts Tagged ‘Search’

Google may eventually solve the problem of finding data on the web. Too bad its first effort reports the wrong numbers for unemployment.

Since leaving public service, I have occasionally pondered whether to start a company / organization to transform the way that data are made available on the web. The data are out there, but they remain a nuisance to find, a nuisance to manipulate, and a nuisance to display. I cringe every time I have to download CSV files, import to Excel, manipulate the data (in a good sense), make a chart, and fix the dumb formatting choices that Excel makes. All those steps should be much, much easier.

There are good solutions to many of these problems if you have a research assistant or are ready to spend $20,000 on an annual subscription. With ongoing technology advances, however, there ought to be a much cheaper (perhaps even free) way of doing this on the net.  With some good programming, some servers, and careful design (both graphic and human factors), it should be possible to dis-intermediate research assistants and democratize the ability to access and analyze data. At least, that’s my vision.

Many organizations have attacked various pieces of this problem, and a few have even made some headway (FRED deserves special mention in economics). But when you think about it, this is really a problem that Google ought to solve. It has the servers, software expertise, and business model to make this work at large scale. And with its launch of a search service for public data it has already signaled its interest in this problem.

As a major data consumer, I wish Google every success in this effort. However, I’d also like to use their initial effort, now almost three months old, as a case study in what not to do.

Google’s first offering of economics data is the unemployment rate for the United States (also available for the individual states and various localities). Search for “unemployment rate united states” and Google will give you the following graph:

Google UE

Your first reaction should be that this is great. With absolutely no muss and no fuss, you have an excellent (albeit sobering) chart of the unemployment rate since 1990. I would add myriad extensions to this – e.g., make it easier to look at shorter time periods, allow users to look at the change in the unemployment rate, rather than the level, etc. – but the basic concept is outstanding.

Unfortunately, there is one major problem:  That’s the wrong unemployment rate.

Click over to the Bureau of Labor Statistics, open a newspaper (remember them?), or stay right here on my blog – all of them will tell you that the unemployment rate in June was 9.5% not 9.7%.

(more…)

Read Full Post »

Some good items elaborating on topics I’ve discussed in the past week:

Read Full Post »

As Jeff Horwitz notes in the Washington Post this morning (“Google Says It’s Actually Quite Small“, previously posted on Slate), the search giant will likely face close scrutiny from the Obama administration.  Indeed, Google is already the subject of at least three separate antitrust reviews.

How will Google try to defend itself?

As Horwitz reports, Google will undoubtedly employ two classic defenses:

Defense 1.  Being a monopolist isn’t illegal.  If firms achieve market dominance through “superior skill, foresight, and industry” (as Justice Learned Hand put it decades ago), that’s fine under our system.  We want to reward firms that gain market share by being innovative and delivering value to customers.

(more…)

Read Full Post »

People usually think of eBay as the master auctioneer of the Internet age.  As this month’s Wired points out, however, Google is the real master.

Google famously uses auctions to decide which ads appear in which positions when you do a search.  But Google takes auctions much further:

Google even uses auctions for internal operations, like allocating servers among its various business units. Since moving a product’s storage and computation to a new data center is disruptive, engineers often put it off. “I suggested we run an auction similar to what the airlines do when they oversell a flight. They keep offering bigger vouchers until enough customers give up their seats,” [Google Chief Economist Hal] Varian says. “In our case, we offer more machines in exchange for moving to new servers. One group might do it for 50 new ones, another for 100, and another won’t move unless we give them 300. So we give them to the lowest bidder—they get their extra capacity, and we get computation shifted to the new data center.”

Read Full Post »

« Newer Posts

Follow

Get every new post delivered to your Inbox.

Join 107 other followers