Student Paper on Representations and Transformations

Adam Binks (A PhD Student at the University of St Andrews) and myself (Miguel Nacenta) just published an article in the International Journal of Human Computer Studies) about our recent research.

Adam built a new tool to support people when transforming complex networks of thoughts and ideas into text prose. The tool itself (called Write Reason) and a short description of what we found when we studied essay writers using the tool is accessible through the WriteReason site.

One of the most interesting things about our findings is that there is a lot of interesting stuff going on in between the creation of different representations of the ideas. In other words, transformations between representations are much more complex, interesting and important than we thought before.

This post is also in the VIXI website.

JCURA Nominations Open for next Academic Year

Jamie Cassel Undergraduate Research Awards (JCURA) nominations are open for 3rd and 4th year students at UVic. See: https://onlineacademiccommunity.uvic.ca/LearnAnywhere/jcura/ If you are one of these students and want to try out research in Human-computer Interaction, reach out to me by e-mail. Many of my projects are visible in https://vixi.cs.uvic.ca/positions/, but there are many more possibilities. You might also have your own!

Just send me a short e-mail to nacenta@uvic.ca and we will explore!

How to talk to your supervisor about what you have read

This is a post in a series of posts regarding student-supervisor communication.

Audience: you are a PhD or MSc or project student, and you meet your supervisor regularly. In the previous meeting, your supervisor asked you to do research in some topic area, perhaps by a keyword (e.g., please do some search in the area of “provenance in User Interfaces”), or perhaps through another paper (e.g., follow the references in this other paper).

Naturally, you have done the work, and you have read (there will be another post on what this means in the future) a bunch of papers. Now you come to your supervisor, eager to demonstrate that you have done what you were expected to do, and indeed, you have found and read some interesting papers.

What NOT to do

Perhaps more important than the “do’s”, consider the things that you should avoid. Unless your supervisor has explicitly asked for any of these, you should NOT:

  • Detail the contents of a paper in general (your supervisor would generally not be interested in the full content of the paper. If they already know it what is the point on repeating pretty much everything on it? If they are not familiar with it, they probably will not be interested in the full content, but only in how it relates to your own project; your supervisor has probably very little time for this, and communication about previous work usually needs to be done in an efficient way.
  • Read a summary that you have written (if you have written something about a paper, your supervisor can probably read it much faster than you can read it aloud – if you really need them to read your summary, and they agree with this, send it in advance of your meeting).
  • Forget, loose or misplace the paper (your supervisor might want to come back to it, it is your responsibility to be able to retrieve that paper quite quickly if you need to).
  • Insist on going over all the information that you have retrieved without paying attention to your supervisor’s reception of it (your supervisor). Do not discuss things that you do not think are important.

What to do

These are all items that you might not know are important, but are often key for good communication about research.

Background and context: Not all papers are created equal or are going to have the same importance. If you only list the title (and yes, the title is important), you are missing many of the ways in which your supervisor might help you filter out the really relevant papers from those which are not. More specifically, this is information that is likely to be useful:

  • Year (of publication). This information is key. The paper might be precisely about your topic of interest, but too old to have been important. Perhaps the opposite: the paper is very old and incredibly relevant, but has been ignored. Or the paper just came up last month and your supervisor is not aware of it (and should be!). Making all these judgments is much more difficult without the date.
  • Authors. It is important for you to start recognizing the people who have work a lot in that particular subarea, and their collaborators and students. Your supervisor might use that information to remember about other important papers by the same author, or to assign more weight to that paper because they trust the author (or even know it personally). Put the authors next to the title if you are showing only a subset of the paper. Sometimes knowing which institutions the authors come from can be useful. For example, if they come from a place that is well-known for research in the area.
  • Venue. Although it is not a perfect correlation, a paper published in a reputable and competitive venue is likely to be more important, since it denotes interest by the community, and some degree of rigour. A paper in a leading venue which is ignored in a literature review is also likely to cause more trouble in the review cycle, whereas most reviewers will easily forgive (or forget) a poster in an unknown or disreputable venue.
  • Format/length. Scientific publications come in many shapes and forms. For example, a valuable piece of scientific writing can be a textbook, a chapter in a textbook, a chapter in an edited book, a survey article, a long journal article, a paper, a short paper, a poster, a position paper, or even a blog or a tweet. It does not help if your notes, summary or what you are showing or describing to your supervisor hides what kind of publication it is. Your supervisor (and yourself) can use this information to determine the importance and value of that work.

Note that giving some kind of impression of the above should take very little time. You do not have to list or read aloud the whole list of authors, but having it out there so that your supervisor can take a glance at it can be very useful.

Content: An article or piece of scientific literature typically contains much information, more than you can efficiently convey within a meeting. If you have to summarize any part of the work, because you think it is relevant, this does not mean necessarily that this is going to be a piece of text. There are often different kinds of elements that might be way more effective at summarizing a paper. For example:

  • A diagram included in the paper.
  • An image of the system/technique that describes the core of the paper (or the part that is most related to your work).
  • A short fragment of video.
  • A formula.
  • A table (with results or a taxonomy)
  • A chart showing results (e.g., a bar chart).
  • A couple of sentences describing results of conclusions (yes, this is text, and is legitimate).

Note that any of the elements above might be incredibly difficult to understand in isolation, but this is why you are having a meeting: a quick few sentences can help make any of these items really effective.

Relationship: Probably the most important reason why your supervisor wants you to read a piece of scientific literature is because it relates to your work. Very often this relationship remains implicit. You should be able to describe as succinctly and accurately as possible how what you have read relates to one or more of the following (depending on the stage of your research):

  • The fundamental issues, techniques or technologies upon which your work builds upon.
  • One or more of your research questions.
  • The specific contribution that you are hoping to make in your research.
  • What you have designed/built/proposed already.
  • The methodologies that you have applied.

By making explicit the relationship between your work and what you have read, you are also communicating a number of things that are important for the supervisory relationship and signalling your level of maturity in research. For example, your supervisor will learn to what extent you are able to relate your work to the close and fairly distant (perhaps only abstractly related) pieces of literature, and whether you really understand the contributions of existing work. This is a kind of syntopical reading or deep reading that is very important for academic work.

Please let me know if you have found this article useful, or if you have concrete examples, or possible improvements that you think I can use to improve it.

Post-Doctoral Researcher Position

I am looking for a researcher/scientist interested in Human-Computer Interaction, Cognition and Information Visualization, to become part of our new and growing VIXI group as a Post-doctoral fellow.

Where: University of VictoriaVictoria, British Columbia, Canada
What: A Post-doctoral Fellowship, 1 to 2 years in length
When: Applications being evaluated now, until position filled. Start is negotiable.

Requirements

  • An PhD degree in computer science, psychology/neuroscience, software design or software engineering, or a completion date for such PhD within the next few months.
  • Evidence of ability to publish in their area of expertise.
  • Experience with at least one of the following methodologies (in no particular order of importance):
    • Qualitative observation and qualitative analysis (e.g., grounded theory).
    • Controlled experiment design, execution and analysis.
    • Advanced human-sensing methodologies. For example gaze-tracking, EEG, FNRIS, motion tracking.
    • Contextual analysis.
  • Ability to program.
  • A willingness to work with and mentor students at all levels (undergraduate, MSc, PhD).

Topics and Interests

The candidate will work with current research students, with the main supervisor (Dr Miguel Nacenta) on common projects, and will also have time to further their own research. Current research interests of Dr Nacenta include:

  • Supporting non-experts in complex cognitive tasks such as planning, estimation, prediction and problem solving through novel technologies.
  • Enabling groups and communities to work effectively together on complex cognitive tasks such as planning, estimation, prediction and problem solving.
  • Finding effective representations of problems and data to enable better communication and enhanced problem solving.
  • Reducing the friction imposed by current interfaces and input devices on complex cognitive tasks.
  • Novel interfaces and visualization techniques for reading and thinking.

You can access recent published work by Dr Nacenta through his Google Scholar Profile

What to do

If you are interested in becoming our partner in learning and research, send an e-mail to nacenta(at)uvic(dot)ca with the following information:

  • A CV or resumé which includes a list of publications.
  • A cover letter that describes why you’d like to work with us, what you main skills are, and your research area of interest going forward in your research career.
  • The names, positions, and e-mail of 2 referees.

What we offer

One to two year employment as a full member of our lab and the Department of Computer Science of the University of Victoria; Salary starting at CAD$50K, but negotiable based on merit and/or experience of the candidate; Opportunities to contribute to teaching (only if so desired); A supportive community of scholars and students.

Who we are

The Victoria Interactive eXperiences with Information (VIXI) group is a newly formed research group in the areas of Human-Computer Interaction, Visualization and Cognition. With three faculty (Sowmya Somanath, Charles Perin, Miguel Nacenta), and over 16 students at different levels, we aspire to be a diverse learning community that supports the growth of each member while also contributing to research at an international level of excellence and impact.

Where we are located

Victoria is the Capital of British Columbia, the westernmost province of Canada. Surrounded by water, at the southern tip of Vancouver Island, is part of a vibrant urban area of close to 400,000 inhabitants, yet surrounded by amazing nature and parks. The city has an extensive network of cycling paths (for commuting or leisure), great access to outdoor activities (kayaking, scuba diving, mountain biking, hiking, skiing – further north in Vancouver Island or across the Salish strait), and good connections through its International Airport and ferries to the mainland and the United States. The city is extremely child-friendly and has probably the mildest climate in Canada, with an average temperature in January of 5 degrees Celsius and mild summers. Average precipitation is about half that of nearby Vancouver (107km away as the crow flies) due to the rain shadow effect of the Olympic Mountains to its South.

We acknowledge and respect the lək̓ʷəŋən peoples on whose traditional territory the University of Victoria stands and the Songhees, Esquimalt and W̱SÁNEĆ peoples whose historical relationships with the land continue to this day.

St Andrews + UVic PhD Scholarship on Machine Learning and Visualization

We are advertising a unique cross-continental opportunity to carry out cutting-edge research on Machine Learning and Information Visualization across two continents at two leading institutions, the University of St Andrews (Scotland) and the University of Victoria (Canada).

For administrative details, conditions and an initial description of the research see: the official Scholarship Announcement.

Supervision is collaborative between Dr Juan Ye and Uta Hinrichs (St Andrews) and myself (Miguel Nacenta–University of Victoria). Applications are accepted until June 30th, 2020. Feel free to drop me a line at nacenta at uvic dot ca if you want to discuss your application informally with me.

 

Postgraduate Supervision in the COVID19 Era (for Supervisors and Students)

I moved to the University of Victoria (Canada) in January, so I have since been working with my St Andrews PhD students remotely who, for a number of reasons, preferred not to move continents to Victoria with me. This means that we are quite used at the moment to work remotely.

Remote PGR supervision has its challenges, yet I believe it is important to acknowledge that the new constraints imposed by the virus, quarantines, social distancing etc. add an additional layer of complexity to the whole situation. I also believe that postgraduate students are likely to suffer the extraordinary situation particularly hard because with the additional burden to move to online teaching, supervisor’s energy and time will be in shorter supply. Here are just a few of my thoughts regarding remote supervision (first), and regarding supervising during quarantine (second).

Remote Supervision

I think it is important to acknowledge that remote supervision is harder than in-person supervision. For a number of reasons:

  1. It is harder to read the mood of people through a remote connection, even if there is video (this cuts both ways… I know that my students can sometimes tell that I’m in a bit of a mood). Without the ability to judge mood and attitude accurately it is harder to make the right calls regarding next steps, tone etc.
  2. I find that it is just that bit harder to be compassionate, empathetic and understanding when you are separated by a long distance and, perhaps more importantly, by a few hours in our daily cycle. I meet my students in the morning, since I’m 8 or 9 hours behind. This means that my students are mostly at the end of their days when I’m still full of energy; this has a significant effect.
  3. The serendipitous and opportunistic contacts that one has at work are important for students; if you cross them in the hallway, they know you are here, you know they are here. A quick question or two minute talk, or even a sentence might not only give each other acknowledgement of each other’s needs (“yes, I’ll get to read your chapter soon! I have not forgotten!”), but it might also save a significant amount of time if they don’t have to wait until the next meeting to get a little bit of help.
  4. The opportunistic encounters with other members of staff are also important for the students and for the supervisor in order to support the students. For example, that little bit of awareness of the member of the Systems Support Team who tells you that certain service will have to be down soon, or that a certain machine needs replacement.
  5. It simply is harder to critique, point out issues, discuss ideas that have a graphical substrate when you are connecting over video conference. I cannot count the number of times that I had to sketch something on paper and awkwardly held it in front of the camera, trying to point at different areas of the sketch, or the number of times that I tried to scroll on a document which is really just a shared desktop from the other side. This is a real issue in Computer Supported Collaborative Work that has not really been solved yet in the mainstream, despite the efforts of many in the CSCW community, including my mentors Saul Greenberg and Carl Gutwin.

Supervision in COVID19 times

Everything in the previous section applies to the current quarantine situation, sometimes amplified. And some aspects are new:

  1. Both supervisors and students are anxious, even if they are often not ready to admit it to themselves, much less to others. Being a PhD student is more often than not a difficult thing, with the justifiable stress and anxiety of academia and trying to prove oneself. Now imagine how this feels when you add the uncertainty of not being able to run experiments, have access to your usual materials, or having to go through extra hoops to just be able to do what is expected of you. Anxiety and extra work can be particularly damaging for deep work.
  2. Loneliness can be a real issue. Most people rely on looser or tighter communities for support. Postgrads who work remotely tend to find it much harder to find the motivation and energy to sustain focus and work without a group of peers. Self-isolation and social distancing is much more likely to wipe out these sources of peer-support than many other practices, probably because the value and perception of these networks is easy to underestimate.
  3. Some people’s life circumstances are being affected more than others. Being away from family, having to care for dependents, or even trying to help out the communities one belongs to (e.g., elderly residents in the same apartment building) can take a very significant toll on people’s time and energy.

Strategies and tools worth thinking about (for remote, COVID or both)

I have never been a perfect supervisor, but I try hard to do right by my students. Despite knowing that I can get much better at this, I believe that there are some obvious and not so obvious things that can work:

  1. Remember that we are all, above anything else, people. With our vulnerabilities and needs, good and bad moments. It is surprisingly easy to forget to be human, and caring and compassionate and just adopt a role as the conscientious student or the wise and driven supervisor as we interact with each other. Although it sounds obvious, make sure to start every contact with a sincere effort to relate, connect and care. This applies to both students and supervisors.
  2. I believe that it helps to know that it is normal to not be as productive remotely as you imagine you have been in the past. This is even more important within the current unprecedented circumstances. Procrastination and lack of focus is not just a matter of pure will (no matter how many times we convince ourselves that we can just “power through”) and achieving sufficient progress in research work is a constant challenge that we fight everyday, a problem never definitively solved. Therefore, if you did not have a good day, forgive yourself a bit, practice a bit of self-compassion, and reassure yourself that it will get better tomorrow.
  3. It helps to know that for most institutions, the top allegiance is to their students. Despite many people’s cynicism, I have found this to be consistently true throughout my experience (UVic is my 8th institution, not counting Microsoft Research). As a student you might be feeling very insecure about deadlines, regulations and funding. It is good to have some pressure to make sure that the work keeps moving on but, in my experience, an overwhelming majority of people in academia understand Hofstadter’s law, and institutions tend to know to be flexible when they need to be. You still have to do your best, but you will get some leeway.
  4. Listen extra hard. This applies to both sides of the supervision relationship. It is particularly hard to listen and connect when one is stressed and overloaded, so it is particularly important to remember to listen in these circumstances, and give each other the opportunity to share the challenges, problems and feelings arising.
  5. Communicate to your supervisor. They can help you. One of the harder tasks for a supervisor is to assess the state of mind of many of the students. As a student, it is tempting to try to present a flawless appearance of invulnerability and performance, but it is much better to actually share the challenge and the feelings. This, of course, relies on the trust invested in the relationship, and it flows in both directions. Although difficult to do, I think it pays off to share the challenges and vulnerabilities that we experience as supervisors as well.
  6. For supervisors: It helps to have great colleagues (who can be proxies) and are physically closer to the students. This is more relevant to the more general issue of remote supervision than to the current quarantine situation, but it can help as well. I have been lucky to have good collaborators still in St Andrews (call out tothe  amazing Juan Ye, Ozgur Agkun, Alice Toniolo, Uta Hinrichs and Aaron Quigley) who are good points of contact for the students when they need to. They can also supply a bit of that co-located experience that is so reassuring.
  7. It is helpful for both student and supervisor to acknowledge that working remotely requires additional “meta-work” to work smoothly. That is, it takes time and work to figure out how to work together more efficiently. This can take the form of extra thinking about how to best schedule meetings, figuring out substitutes for support, or even spending some time learning and finding new tools and technology.
  8. Some new tools are actually quite amazing, and can help (and they keep evolving!) Although I personally find some of the new communication trends such as Slack quite overwhelming and difficult to keep up on top of (too many “channels” of information to keep track of, when considered on top of e-mail, which is still king for me), some other tools can be fantastic. Sometimes one has to even remind itself to use these tools, even if we know that they will work better. My two favourite examples right now are miro, a collaborative diagramming tool that works well when used synchronously with a source of audio on the side (typically Skype for me), and opening a shared Google Doc when brainstorming ideas, which I found can be transformative.

Some of you might have different tips and ideas. I’m sure I have missed a lot here, and I can learn a lot more. Even better, some of you might disagree with me. In any of these cases, I’ll be very happy if you let me know through a comment or by e-mail.

Book Light Review: Object-Oriented Ontology: A New Theory of Everything by Graham Harman.

This is a first blog review in a series for books that I finish reading for professional reasons, usually within the context of my research. I call them “light reviews” because they are not meant to be comprehensive and because the book might fall outside my direct domain of expertise (information visualization, Human-Computer Interaction, Infotypography).

[link to publisher’s site]

img_20200308_143838821

Why I got it/read it?

The title looked promising; I’m currently interested in how people model the world, and both ontologies and theories are good examples of forms of knowledge that represent the world for the human mind. Also, I cannot generally resist buying these kind of books at one of my favourite bookstores in St Andrews: Topping and Co. (I’ll miss you!).

What did I learn?

Object-Oriented Ontology belongs to a current trend of philosophical work that calls itself “realist”. It is quite contemporary and seems very influential in other areas such as Architecture and History. OOO relates to Latour’s philosophy (I’m generally a fan), and his Actor-Network Theory. OOO addresses the issues of truth, reality (not the same thing as truth), knowledge, causation, and perception.

A key part of the intent of this theory is to remove the human/mind/cognition as a central actor of any theory of the universe. It tries to create a theory that does not depend on humans or any other thinking being to explain reality and the world. Objects relate to objects, and humans, the mind, etc. are just other types of objects. In OOO if the proverbial tree falls without anyone noticing it, definitely still fell. At the same time, in a direct line from Ortega y Gasset’s philosophy, it denies the possibility of directly knowing real objects, since these are not directly accessible (even by other real objects), and instead only relate to other real objects through other kinds of objects (sensory objects), and their qualities (real qualities and sensory qualities). From the relationships between these four types of things, OOO derives, initially quite unintuitively, but also quite convincingly (at least for me) the concepts of space, time, and a full system that explains how do we actually get to access objects (surprise: through metaphor), what we can learn about them, and also new forms of analysis.

Objects in OOO are a very generic term that includes things that are not material, or even imagined etc. For example, a commercial company is an object, Spain is an object, a dream is an object and, of course, material objects are also objects. Combination of objects are also objects. Objects not being directly accessible is provided as an explanation of why a description, formal description, or collection of properties of a real object is never going to replace the real object itself (this is connected to Ortega’s perspectivism).

I found particularly useful the developed terms of undermining and overmining. This has to do with abstraction and compositability. Other existing theories are undermining if they try to reduce objects to its components, and overminining if they try to explain everything based only on the properties that it has. OOO provides a way of defining objects as a balance between overmining and undermining.

What did I like about the book?

The book is actually quite accessible to non-philosophers, and is a good read. It is also quite good at relating OOO to existing contemporary and non-contemporary theories and philosophies, which makes me feel a bit more confident about my knowledge and gives me a useful context within the realm of theory.

What did I have trouble with?

The mechanisms of “vicarious causation”, in which objects affect other objects through the creation of intermediate objects was difficult for me to digest. I’m not sure if this is a weakness of the theory, the book, or just something that is difficult to grasp.

How it can help (with my research)?

OOO seems like a useful lens to look and understand the role of humans in the larger systems where they inhabit, without having to reduce everything to the mechanistic, reductionistic or materialistic views of contemporary hard sciences. It might be particularly useful to explain interaction and the interface (although I haven’t worked this out yet), and it might enable a nice way to reconcile results and theories from the social and humanities side of the spectrum with more formal views from math, physics, data science and cognitive science.

Open questions and other thoughts.

In some ways, the inescrutability of real objects or “objects in themselves” remind me of the identity functions (self referential) in category theory (from Maths).

Worth reading (1-5)?

For it’s potential to be useful (to me and the field), how it made me think and see things in a different light, and how it helped me learn about OOO and other bits of contemporary philosophy, I think this deserves a 5 (highly recommendable)

Moving to Victoria, British Columbia, Canada

It has been a great 9 years in St Andrews, Scotland. Thanks Scotland for having been so welcoming, and thanks to the University of St Andrews for having supported my academic career. I will miss St Andrews and the East Neuk of Fife very much!

Although I keep working with my St Andrews friends/colleagues, and plan to do this for a long time, the University of Victoria (UVic), in the West Coast of Canada is now my new academic (and family) home. The city of Victoria is also a great place to live, with amazing views, nature and art, a growing Tech startup scene.

Aerial view of the University of Victoria

The University of Victoria is laid out around a circle (the Ring) and very close to the water.

If you are student and are interested in my research topics, I am actively searching for students, mostly in the following categories:

  • UVic honours project students
  • UVic independent study projects
  • future PhD students from UVic, Canada and overseas

I will soon refresh the research pages in this website; in the meantime, the most reliable indicator of my current research directions are my most recent papers. If you are interested in exploring possibilities working with me in Visualization, Problem Representation, Infotypography, Visual Language Interfaces or Human-Computer Interaction, just drop me a line at nacenta at uvic dot ca.

iVoLVER system wins Best Demo Jury Award at ACM ISS 2017

The iVoLVER system (iVoLVER.cs.st-andrews.ac.uk), created by Gonzalo Méndez and designed by Gonzalo and myself received on Thursday 19 the ACM ISS Best Demo Jury Award during the conference, which took place at Brighton, UK.

iVoLVER is a web-based visual programming environment that enables anyone to transform visualizations that the find in-the-wild (e.g., in a poster or a newspaper) into new visualizations that are more useful for them.

Because iVoLVER is a fully web-based visual tool you can try it out yourself (works best with Chrome). Just go to http://ivolver.cs.st-andrews.ac.uk and click on “try it”. We are also working on expanding it and we will be releasing an API version shortly.

The ACM Interactive Surfaces and Spaces conference takes place yearly in different locations. Next year it will take place in Tokyo, Japan. The conference is a premier venue for work that studies how people interact in smart spaces and surfaces and how to design and engineering solutions for novel interfaces.

Short-term Research Assistant Position

We are offering a Short-term Research Assistant position at the SACHI group, University of St Andrews.

The work is for the design and implementation of a digital dexterity measurement device.

The School of Medicine (Silvia Paracchini) in collaboration with the Computer-Human Interaction Group (Miguel Nacenta) is offering a short appointment to help design and implement a measuring device for hand dexterity.

Here are the conditions:

  • 3 to 4 month duration, depending of intensity.
  • Flexible between 20h to 36h per week. Please note that some non-UK students might not be legally allowed to work more than 20h/week. Your visa indicates the limit.
  • Starting at the beginning of February at the latest.
  • Students 2nd to 4th year and graduate students welcome (if you can spare the time)
  • Students and non students are welcome to apply, but the work needs to take place in St Andrews, UK.
  • Approx £13/h.

Requirements and Skill.

  • Candidates need to be able to program, preferably in Java.
  • (Preferable but not required) experience with Android device programming.
  • (Preferable but not required) experience with digital modelling, 3D printing or laser cutting.

The work is of a research nature and might result in authorship in subsequent publications in peer-reviewed journals.

To apply send an e-mail to Dr Miguel Nacenta before the end of Jan 22 (mans@st-andrews.ac.uk) indicating:

  • Programming experience.
  • Experience with Android or other mobile platforms (optional).
  • Experience with 3D modelling, 3D printing or laser cutting (optional).
  • Availability.
  • A bit about your academic/professional background.

Send any enquiries to mans@st-andrews.ac.uk.