“A Delicate Agreement” gets an Alberta Digital Award!!

Congrats to Lindsay MacDonald for getting the prestigious Alberta Digital Award for her work (with us) in the digital piece A Delicate Agreement.

She received the award on Monday the 6th at the Hotel Arts in Calgary.

We are only hoping to see more awards coming… way to start a PhD Lindsay!!

Some more coverage here.

Also congrats to Jon Haber for getting his QEII scholarship! It’s nice to see students/collaborators getting prices!

Advertisements

Standing on the shoulders of… nobody? – Connected Research, Related Work and Discussion sections in Human Computer Interaction

Disclaimer: this is purely personal opinion

This is a great time for Human-Computer Interaction. It seems that society and computer science’s awareness of how important it is to find new ways of interacting with the real world, engaging with our data, and finding our way in virtual communities keeps increasing. However, there seems to be an increasing discontent about some aspects of the community and the work it is generating. Some people complain about how difficult it is to publish real systems that perform real tasks and evaluate real scenarios. Others have suggested that forcing research to include empirical studies can kill new promising ideas in our field, but also that empirical research rarely replicates previous results, sometimes because it is considered incremental.

I agree with most of these concerns. I believe that our role as researchers in this community is to find the new, disruptive technologies, as well as to establish true and tried ways to improve people’s way of creating and interacting with their new interactive space. In my opinion, however, one of the main problems of this community is that work is disconnected. Probably one of the reasons why our empirical knowledge does not seem lead anywhere is because so many authors have no interest in taking others’ research further, but rather to publish their bit as fast as possible, or find some new original bit, without regard for how this advances the overall field.

I believe this is reflected in much related work sections of new works (particularly of interaction technique papers), probably as a symptom of how papers are written. I am tired of reviewing papers that have very weak related work sections that go like this:

  • Our work relates to [very famous early reference]
  • Some people have done work in the general area [X,Y,Z]
  • Author P did AB (superficial discussion of what they did), but not C, and their work is therefore
  • Author Q did BC (same problem), but not A
  • Author R did AC (same problem), but not B
  • We did ABC (and therefore our work is worth publishing – and better than P,Q, and R’s)

Many related work sections like this get published every day (and much worse). I myself might be even guilty of some of these. The main problem is that this is very superficial. These related work sections are often written only after the research is done, and they are written only because reviewers will not accept a paper if it does not mention certain basic references, and sometimes their own work.

However, this is not enough. The problem is that these connections with previous work are very weak. It should not only be about connecting nodes in the networks of publications. It should be about the quality of these connections. These related work sections mention other research, but they do not connect to other research meaningfully; they do not build knowledge. We are trying to find our little hole, the only clear snow where nobody has stepped before (and step on it), but not to build something upon each others’ work. How are we supposed to build a strong discipline, to stand on the shoulders of giants?

Perhaps one of the ways of solving this problem is to ask more of our related work sections. Related work sections should include all relevant work, and help the reader understand how the presented work builds upon it; moreover, related work sections should be paired with a part of the discussion, where the connection from previous work and current work is explained and developed. How does our work contradict previous findings? How does it support previous speculation? What are its possible limitations?

A related work section like this probably needs to be written before much of the research of the paper is done. In my opinion, this would prevent of bad papers to even come to life, will increase the connectedness of our work, and save a lot of time to researchers and students that find (to their dismay) that after all the research and a study, what they have done is a (bad) replication of previous work, which does not teach us much. I am also inclined to think that better connection with previous research would even increase our incentive as a community to replicate research: if we are to stand on each others’ shoulders, we will want to know that the fundamentals are solid, and this will require replication and an improvement of our methods.

I’m I crazy? Is this only a rant? Too prescriptive, not accurately descriptive? Will this all lead to disaster? or does people even care? Any examples of good related work sections?