There’s a paradox at work – Social Software and Media links for Thursday

Clay Shirky: Help, the Price of Information Has Fallen, and It Can’t Get Up

The interesting thing about this piece, written way back in 1995, is that it leaves wide open the concept of information.

Just what is information? People instinctively grasp for “facts” as their definition. But in computing, we think otherwise. Can music be described as information – sure can. Opinions? Yep. Visual arts? Certainly. Video. Yes, even video. Anything that can be described in ones and zeroes can be thought of as information that can be transmitted and shared on a network.

Well, what about advertising? Yes, that too.

Jeneane Sussum: The Value of Words: These. People. Are. Lying. To. You. And. Themselves.

There is a paradox at work here. As the cost of generating and transmitting information decreases, more of it becomes available, thus increasing the need for better filters.

Advertising, Newspapers, and Libraries were the premier filters of the pre-Internet age.

So were the ‘big 3’ TV stations, radio conglomerates, record companies, book stores and magazine stands for that matter.

Search engines, blogs, social networks, and smart aggregators are those of the now.

How the practices of the old evolve in the infrastructure of the new, how new disciplines arise to meet the needs of today and tomorrow, will determine how informed, or how uninformed, we will be as a society.

Other interesting links for today:

P’unk Avenue Window: What should a modern library be?

reddit: Young Deer hit by google map VAN. Caught on street view.

keithhopper.com: A Brief History of Hyperlocal News

Fanboy.com:
Social Media “Experts” are the Cancer of Twitter (and Must Be Stopped)

MediaPost: Yelp Reviews Spawn At Least Five Lawsuits

Epicenter: eMusic Says Data Supports Long Tail Theory

Epicenter: Want Proof OpenID Can Succeed? Just Scroll Down

ComputerWorld: What the Web knows about you

Irfan Essa: “We’re talking about a new breed of people”

Miller-McCune: Deep Throat Meets Data Mining: In the nick of time, the digital revolution comes to democracy’s rescue. And, perhaps, journalism’s.:

Investigative reporters have long used computers to sort and search databases in pursuit of their stories. Investigative Reporters and Editors and its National Institute for Computer-Assisted Reporting, for example, hold regular computer-assisted reporting training sessions around the country. And the country’s major journalism schools all deal in some way with computer-enhanced journalism. The emerging academic/professional field of computational journalism, however, might be thought of as a step beyond computer-assisted reporting, an attempt to combine the fields of information technology and journalism and thereby respond to the enormous changes in information availability and quality wrought by the digital revolution.

I would be remiss to write about computational journalism and not mention Irfan Essa, a professor in the School of Interactive Computing of the College of Computing at the Georgia Institute of Technology, who teaches a class in computational journalism and is often credited with coining the term. He says both journalism and information technology are concerned, as disciplines, with information quality and reliability, and he views the new field as a way to bring technologists and journalists together so they can create new computing tools that further the traditional aims of journalism. In the end, such collaboration may even wind up spawning a new participant in the public conversation.

“We’re talking about a new breed of people,” Essa says, “who are midway between technologists and journalists.”

Chris Amico’s “Tools for news”

Tools for news is a Django driven application that lists web apps, references, software, and more that would be useful to anyone building a mashup, but in particular if you are a journalist. Via DigiDave.

Doc Searls: “What if the roles we play are not to pass along substances called ‘data or ‘information’ but rather to feed hungry minds?”

Doc Searls: Beyond mediation: We are all media now, right? That’s what we, the mediating, tell ourselves. (Or some of us, anyway.) But what if that’s not how we feel about it? What if the roles we play are not to pass along substances called “data” or “information” but rather to feed hungry minds? That’s different.

I believe that we truly are the media now.

When we criticize ‘the media’ we are criticizing ourselves. Media is intermingled. It’s everywhere and each of us take part from the smallest of web forums to the largest of social networks. That implies a civic responsibility.

People hate that word – responsibility – but there it is. And when it comes to media – the responsibilities that spring from it are now shared by us all.

Newspapers, news organizations, and social media in transition

This much is clear – by the end of 2009, there will be many fewer newspapers publishing in America.

Some attribute the fall of newspapers to:

Coming from where I come from, with the experience that I had at Philly.com, I couldn’t help but think that Jeff Jarvis and Clay Shirky’s point of view is a damaging re-write of history that obscures complicated truths. This is disappointing for me because both of them have important knowledge for newspaper organizations that can help them in their on going efforts to evolve, and their posting of what are essentially pieces that incite rather than provide insight did no one any favors. Jeff Jarvis, in particular, has been a major force in pushing along papers to meet the future. And I am literally a *fan* of Clay Shirky’s writings – I share many of them with who I work.

It could be that Clay Shirky was trolled by the off the wall piece by Ron Rosenbaum in Slate about Jeff Jarvis. It was a true blue hatchet job. Still, I felt the need to reply in comments to Shirky’s piece and to Jeff Jarvis’s piece celebrating Shirky’s article.

Me, replying to Clay Shirky (paraphrasing):

Sadly it is people like Rosenbaum who get the limelight, when perspectives of those within the industry are far, far different.

In fact they are so different that I say it is a dangerous re-writing of history to say that “The people who made their living from printing the news listened, and then decided not to believe us.”

You can pull famous examples such as Dan Gillmor or Jay Rosen or Jeff Jarvis himself.

You can look directly at archive.org to see the competitive state of newspaper websites in the late 90s or early 00s (note when they stopped evolving – the .com crash).

Undeniably there some within news organizations that are (were?) willfully ignorant – for sure – however I can tell you from personal experience that the majority of my ex-co-workers were not keeping their heads in the sand and had fought (are fighting) tooth and nail to bring culture change to their organizations.

Take a look at

http://inquirer.philly.com/packages/somalia/

1997.

These organizations were doing fabulously well in their economics btw. So much so that what is occurring is a textbook example of “the Innovator’s Dilemma” (thank you Henry Copeland for suggesting that book to me so long ago!).

You are more correct in your glacier analogy – however – think of it as a slow approaching death – a frog in a slow boiling pot of water.

Speaking of Dan Gillmor – I remember the difficulties he faced in getting his first blog off the ground within Knight Ridder. But he wasn’t alone in pursuing the future.

It is factually incorrect to state otherwise.

If there are any lessons to be learned by all this – they won’t occur if the narrative becomes a simplistic “we spoke – they ignored”.

And to not expect people to cry out as they lose their jobs – jobs that many have been fighting to transform when they are still relevant (the reporting not the papers) is bull.

Oh, and speaking of those in the trenches, consider speaking to Wendy Warren, Will Bunch, and Daniel Rubin of Philly.com, the Daily News, and Inquirer.

As Jeff Jarvis himself spoke well of two years ago:

http://www.buzzmachine.com/2006/03/25/saving-journalism-and-killing-the-press/

This narrative of “us smart people verus those dumb-asses who deserve what they get” needs to stop.

Me, replying to Jeff Jarvis (paraphrasing):

I’ll call bullshit on Clay and you both on the idea that no one has been “caught up in this great upheaval”. I’m a big fan of Clay Shirky. I share his writing with folks at work all the time and I’ve actually quoted him to you in various responses to you over the years.
There have been many newspaper folks fighting for change in that industry over the past ten years.

Ya know, there is part of me that is downright mad at this – it almost resembles a re-writing of history.

I maybe in your ignore list now Jeff, I’m not sure.

But I am secure in knowing that of the many, many people losing their jobs and careers in the midst of this ongoing revolution – a revolution I feel part of as an early adopter, promoter, evangelist, software engineer, blogger and more – there are thousands that do *not* deserve blame for what is going on.

I WILL NOT thumb my nose at them.

They fought, and in many places continue to fight, to drive business and culture changes in organizations that still have relevant value in a world where we are no better informed then we were 10 years ago according to Pew.

Change is life. But the big story here isn’t in the numbers of people who willfully looked the other way. There was some. But not the vast majority of people I worked with in the trenches at Philly.com.

Hell no.

And my heart goes out to them who fought (and continue to fight) with everything they have – to turn their ship around from the glacier that Shirky is right to indicate.

When the definitive history of this is recorded, hopefully it will capture the truth – that many of the guns pointed at the patient were those of the patient – but willful ignorance was the least of these. That many knew they were pursuing immediate profits over long term investments. Others were fighting for change and evolution to meet the future in every single project they worked on and found frustrating blockers in culture and immediate ROI turnaround demands of established businesses meeting the calls of investors. That culture and technology were dealing death blows to the ‘paper’ as information costs dropped towards zero and we each became empowered with our own printing presses – the Web.

There are *many* reasons. But I repeat – the narrative of “us smart people verus those dumb-asses who deserve what they get” needs to stop.

Everyone needs to get over themselves already.

Elsewhere and recent:

Talking Points Memo has announced it will be sending two new additional paid reporters to Washington DC while it has been reported that newspapers will be sending far fewer to cover happenings at the Capitol.

Pew Research Center, in a recent study, has announced the Internet has overtaken newspapers as a source of news.

Consumers Union (publisher of Consumer Reports) is buying Consumerist from Gawker Media. More on the news at Consumerist.

Business Week takes a look at other business models for journalism including a glance at Spot.us.

And at the LA Times an important milestone has been reached Web site revenue now exceeds its editorial payroll costs.

Meanwhile, Gabe Rivera speaks some hard to hear truth (to some) about automated news filters: Guess what? Automated news doesn’t quite work.

Jay Rosen summarizes the moment: Migration Point for the Press Tribe:

The professional news tribe is in the midst of a great survival drama. It has over the last few years begun to realize that it cannot live any more on the ground it settled so successfully as the industrial purveyors of one-to-many, consensus-is-ours news. The land that newsroom people have been living on–also called their business model–no long supports their best work. So they have come to a reluctant point of realization: that to continue on, to keep the professional press going, the news tribe will have to migrate across the digital divide and re-settle itself on terra nova, new ground. Or as we sometimes call it, a new platform.

Migration-which is easily sentimentalized by Americans–is a community trauma. Pulling up stakes and leaving a familiar place is hard. Within the news tribe some people don’t want to go. These are the newsroom curmudgeons, a reactionary group. Others are in denial still, or they are quietly drifting away from journalism. Many are being shed as the tribe contracts and its economy convulses. A few are admitting that it’s time to panic.

Porn and Music are the canaries in a coal mine

While it can be argued that the attention economy has hurt the pornography and music industries the most over the past few years, I’d turn that around and say they are both spheres where real innovation can be found. Two cases in point:

Andrew Chen: Freemium business model case study: AdultFriendFinder ARPU, churn, and conversion rates

NYTimes: Songs From the Heart of a Marketing Plan:

While people still love music enough to track it down, collect it, argue over it and judge their Facebook friends by it, many see no reason to pay for it. The emerging practical solution is to let music sell something else: a concert, a T-shirt, Web-site pop-up ads or a brand.

Musicians have to eat and want to be heard, and if that means accompanying someone else’s sales pitch or videogame, well, it’s a living.

Must Read: David Cohn’s “Drupal Nation: Software to Power the Left”

David Cohn has published to his blog his final project to graduate with a Masters from Columbia’s journalism school – a report on the technology and people behind the Dean campaign of 2004 – Drupal Nation: Software to Power the Left.

NYTimes on using GeoDjango

Nice work NYTimes.

Open: Represent:

We built Represent with Django, the Python web framework. Although we do most of our work with Ruby on Rails, we chose Django for this project so we could use GeoDjango, an add-on that supports geometry fields and extends the ORM to allow spatial queries.

We started with maps from New York City’s Department of City Planning showing district boundaries for City Council, State Assembly, State Senate and the U.S. House of Representatives. We used the Geospatial Data Abstraction Library, a translator library for raster geospatial data formats, through GeoDjango’s LayerMapping class to populate a PostgreSQL database extended with the PostGIS spatial extension. The geometry relationship functions provided by PostGIS allow for quick, accurate lookups to determine which legislative districts contain your address.

Represent shows you your address in relation to each of the political districts that contain it. To draw the maps of your districts, we used GEOS, a C++ port of the Java Topology Suite, an API for modeling and manipulating 2-dimensional linear geometry, via GeoDjango’s GEOS API. GEOS allows for the conversion of a geometry to KML, which can then be consumed by Google Maps.

But to do all that, we need an address: yours, hopefully, if you live in New York City. To turn that address into coordinates, we built a geocoding service based on Geo-Coder-US, the perl library that powers geocoder.us.