Month: December 2007

Toward Social Science

But it is Facebook’s role as a petri dish for the social sciences — sociology, psychology and political science that particularly excites some scholars, because the site lets them examine how people, especially young people, are connected to one another, something few data sets offer, the scholars say. Social scientists at Indiana, Northwestern, Pennsylvania State, Tufts, the University of Texas and other institutions are mining Facebook to test traditional theories in their fields about relationships, identity, self-esteem, popularity, collective action, race and political engagement.

could “social science” actually become science one day?
2013-11-02:

The social sciences are undergoing a dramatic transformation from studying problems to solving them; from making do with a small number of sparse data sets to analyzing increasing quantities of diverse, highly informative data; from isolated scholars toiling away on their own to larger scale, collaborative, interdisciplinary, lab-style research teams; and from a purely academic pursuit to having a major impact on the world. To facilitate these important developments, universities, funding agencies, and governments need to shore up and adapt the infrastructure that supports social science research. We discuss some of these developments here, as well as a new type of organization we created at Harvard to help encourage them — the Institute for Quantitative Social Science. An increasing number of universities are beginning efforts to respond with similar institutions. This paper provides some suggestions for how individual universities might respond and how we might work together to advance social science more generally.

Automated Scraping

our scraping tools (Solvent and Crowbar) let you deal with web pages at the level of the DOM (e.g., evaluating XPaths, retrieving HTML attributes) rather than at the level of streaming characters. This higher level of abstraction is easier to operate in. Furthermore, Solvent and Crowbar can wait for all the dynamic Javascript code in web pages to finish running; this means that you can even scrape those new Web 2.0 sites rather than just static web pages.

their DOM scraping has come a long way

Asteroid mining

A 0.5km diameter asteroid is worth more than $20 trillion in nickel, iron and platinum-group metals.

a few quintillion worth of elements up for grabs
This is what worthwhile start ups look like: solving hard problems, not trivial toys.

Great to see Planetary Resources — a company I invested in launch officially today. Their first mission: to mine asteroids for the benefit of humanity! Check out the video below. What could you do with a huge amount of currently rare materials on earth? Or a lot of raw material for building things in space?

this goes into considerable detail about the plans for asteroid mining.

why we need asteroids as gas stations. that is, until we can switch away from chemical propulsion.

Planetary Resources has shifted the company’s focus to a more mundane space resource: water. Water found on or near asteroids could be processed into fuel to extend the useful lives of aging commercial satellites. “I still consider that mining. We’re going to take the resources of space and turn them into a usable material.”

Advertisers cling to TV

“This industry looks like it can’t get out of its own way…We need measurement of the audience and their use of the system that’s clear, simple and actionable for a marketer. You need comparability with other media.” So THAT’s the problem. That’s why Google grew its US ad revenue 46% in Q3 and the aggregate revenue of 18 traditional media companies grew 1%–because Internet media companies can’t make it simple.

heh