About Jacqueline Kory

Jacqueline Kory – website N/A
MIT Media Lab, Personal Robots Group / MS1

Experience
Art: Although I haven't taken any formal art classes in years (exception: sculpture, three years ago), I sketch, draw, paint, and generally dabble in my free time. I've been told I'm good with colors. I've studied cognitive science, psychology, and philosophy. Programming: Best with C#. Decent with C++, Java, Lisp, Octave. Familiar with C, Haskell, Prolog. OSX/Windows/Linux; currently learning how to use Android phones as a platform. Familiar with AI, neural networks, OpenCV, behavior-based robotics, among others. Played with Arduinos before. Not an expert at electronic or mechanical tinkering, but I'm currently trying to learn. K'nex was my favorite toy as a kid.

Why
I want to take this class because it'll be fun. I'm excited about learning how to think about creating shared spaces and shared experiences, specifically in relation to learning-centric technologies. In the Personal Robots Group, we're developing social robots as learning companions and tutors. I think the visions of this class would be very beneficial to my research -- social robotics faces a lot of the same design challenges as any system in which people are interacting with digital information. How can this (human-robot) interaction be more natural? How can this (robotic) interface be more aesthetically pleasing and engaging? Even in our group, we have some robots in which the interaction is essentially point-and-click on a tablet. What new approaches are possible? I'm excited to learn about design principles in tangible interfaces/radical atoms, and to see how they can apply across to seamless interactions between humans as well as humans and robots. I look forward to bringing my ideas about interaction (human-human, human-robot, group interactions, etc), and a familiarity with studies of social cognition, perception, communication, and a whole lot of other cognitive science-related topics, to the class.

Art
Architecture
Craft/Fabrication
Design
DIY Electronics
Electrical Eng.
Mech. Eng.
Programming/CS

????
????
????
????
????
????
????
????

Wave Alchemy

Life is full of moments that come with obvious or subtle expressions of energy. It is common for us as human beings to attach different emotions to such expressions. And yet when we want to capture it and interact with it, we are often constrained to flat, 2D encapsulations of video, audio, or photographic recordings. Moreover, the way we would look back at a memory in this digital age is now often through a screen with hundreds of files digitally stored away, further removing the experience of the event’s emotion. What if we had a way to experience this emotional energy again, and dynamically interact with it in infinitely complex ways? Here we present a concept and prototype that explores a novel physical-visual language of dynamic, emotionally expressive waveforms, designed to transform the way we perceive different forms of energy as we go about our daily lives. With the power of computations hidden within the physical materials used in the interface, we create an interactive form made of Radical Atoms that can take one form of energy and transmute it into a waveform as its output, or Wave Alchemy.

Team

Dan Sawada – Ideation, physical prototyping, programming, interaction design, video production and editing
Anirudh Sharma – Ideation, video production and editing, programming, partial implementation of a concept that was abandoned
Sujoy Kumar Chowdhury – Ideation, physical prototyping, programming, research, video production
Christine Hsieh – Ideation, research, presentation, physical prototyping, video production, interaction design for a concept that was abandoned
Andrea Miller – Ideation, research, presentation, physical prototyping, video production

Final Paper

CHI-extended-abstract_wave FINAL

Final Presentation

Wave Alchemy presentation slides

 

 

Magonote

Magonote is a concept for a collaborative scratching experience. ‘Magonote’ (〜孫の手〜) is a Japanese word that refers to a backscratcher tool. The system we propose comprises of a Magonote enabled chair and a stuffed animal through which a remote person can participate in scratching.

Scratching is a reflex response to itches, for which we do not usually depend on others. It is easy to miss the casual bonding that happens through scratching interaction. In fact, it is also a common social grooming activity in a number of primates. From this observation, we wanted to design a novel experience that uses scratching as a social object and a medium for reconnecting with friends and family.

The above concept video demonstrates an example scenario. Arun could really use a good scratch now. He remembers that his friend Bill helped him out when he was around, particularly when Arun’s hands could not reach the itch-location very easily. Unfortunately Bill no longer lives in his city. Arun knows what to do in this situation. He comes across a Magonote chair nearby and decides to give it a try. At the same time, in a different city, Bill is reading a book. The stuffed koala that Arun gave him suddenly starts nodding its head. He fetches it closer to see why. He notices that there are some LED lights at the back of the koala, and they are blinking. From the pattern of blinking, he recognizes it as an incoming ‘scratch request’. He acknowledges the request by giving the koala a good scratch. Immediately, the Magonote attached to Arun’s chair gets activated. Arun realizes that it is Bill. Arun likes the way Bill scratches, but the scratch-location is slightly off from the itch location. Arun signals it by rubbing his back against the chair. Bill notices that the only one LED at the top-center position of the koala is now fading in and out. He starts scratching around that particular LED. Magonote arm changes the scratch position accordingly. After Arun is satisfied with the scratch session, he leaves the chair. At Bill’s end, no more lights are blinking. Bill puts the koala back to it’s original position.

Here we have used the scratch interaction as a metaphor for casual bonding. The stuffed animal is a ghost representation of someone dear to us and a metaphor for attention seeking. The dyadic interaction between the remote users takes place in personal physical spaces. The capabilities of the chair include transmission of initial presence information, actuation of robotic Magonote and scratch-location-gesture detection through pressure sensors. The features of the stuffed animal are: presence notification through nodding of head, scratch intent notification through LED blinking, scratch position notification through LED fading and a scratch sensing surface. We implemented the LED array controls using an embedded Arduino and simulated the rest using ‘Wizard of Oz’ technique.

Team

Dan Sawada
Research, Design and laser-cutting of Magonote, Prototyping (programming, electronics), Concept video production
Anirudh Sharma
Research, Concept video production, Prototyping (programming, electronics)
Sujoy Kumar Chowdhury
Research, Prototyping (programming, electronics), Interaction Design, Concept video production

Related work

  • Scratch Input by Chris Harrison, Scott Hudson, UIST 2008
  • inTouch by Scott Brave, Andrew Dahley, and Professor Hiroshi Ishii, 1998
  • Hug Shirt by CuteCircuit, 2006

 

Yet another hand gloves based interface

Slide deck: MAS834-Hand-Gloves-Interface-3D-Objects-Sujoy-Project-1

When I was a kid, I was introduced to the number system using the joints in my fingers. The finger joints, or the space between them, appear to me as a grid system that we can use for interacting with user interfaces. Of course, there have been a lot of work on using instrumented hands or hand gloves as user interfaces. Some of them depend on cameras or sophisticated gesture recognition devices like Kinect. Right after my presentation, I discovered this awesome Minority Report like UI from Oblong, which is developed by John Underkoffler, a Tangible Media alumnus. Clearly, there is little room for novel contribution in terms of gestural interaction. However, I am still looking for prior art that makes use of the number system metaphor, for applications like a simple calculator. During advanced stages of ideation, when we are working on 3D prototypes, such an interaction has the potential to be deemed as intuitive and efficient.