Thursday, July 17, 2008

This silent language ...

In his book The Silent Language, anthropologist Eward T. Hall analyzes the many aspects of non-verbal communication. He analyzes the way people "talk" to one another without the use of words. He proposes that the concepts of space and time are tools with which all human beings may transmit messages.

hall

As I focused on the chapter "how space communicates", I find intriguing the way Hall compares cultures and their reading of non verbal communication cues. He particularly states that the distance between individuals differs and can drastically affect the dynamics of space interaction. For instance, an American needs to take between 20 inches to 36 inches in a neutral conversation for a personal subject matter. Apparently in Latin America the interaction distance is much less. This claim was also proposed in his other book, The Hidden Dimension. This seems like a pretty large distance to me!

I was wandering, as we are becoming nomads, or neo-nomads --term created and analyzed by Dr. Yasmine Abbas, now that we travel constantly, I wander how these distances of interaction and non verbal communication cues have evolved. Is it possible that we absorb most of these social interactions in our everyday routines, and that after each travel, each interaction, we come back "socially transformed"? Would these non verbal communication cues become more obvious to us?

dance.png

In one of his other book, The Dance of Life: The Other Dimension of Time, Hall explores the way humans are intrinsically linked to the rhythm of life, how being unsynchronized can disturb them and even bring them into depression! He explains, based on observations, how people are tied together and yet isolated by hidden threads of rhythm and walls of time. Time is treated as a language, organizer, and message system revealing people's feelings about each other and reflecting differences between cultures. He claims that repetition is not appreciated or that Americans are not trained to appreciate repetition. Through repetition comes learning, comes depth of understanding, comes rhythm. He proposes that the invisible rhythm is not widely recognized, that rhythms are only presented on stage by talented performers! Hall assumes there is a relationship between rhythm and love. Basically it affects our entire being. Synchrony in life seems strangely related to rhythm in music. The pattern of our movements can translate into a beat. Without this rhythm, we are not synchronized and we loose our contact with life ...

Posted by Cati Vaucelle @ Architectradure

Wednesday, July 16, 2008

How to design a reconfigurable artificial sensate skin?

For the technical area of my general exams lead by Dr. Joe Paradiso, I read Gerardo Barroeta Pérez's very inspiring thesis in which he presents S.N.A.K.E.: A dynamically reconfigurable artificial sensate skin as well as a series of related work.

The idea is to design a device that inherits the characteristics of human skin. Surveying prior work in materials, flexible electronics, sensing matrices and sensor networks, Gerardo presents a new type of artificial sensate skin: low power, scalable, mechanically flexible, and that extracts a rich set of multi modal sensor data. Also each node in SNAKE is capable of changing its behavior by changing its code. One can use SNAKE as a scalable smart material that covers interactive surfaces!

This Skin is composed of one or many Skin Patches which in turn are composed of one or many Skin Nodes. Each node is able to measure Strain, Pressure, Ambient Light, Pressure, Sound and Mechano-reception. Each Skin Patch can either work as a stand-alone device or as a data extraction device if this is attached to a Personal Computer through a different type of device referred to as Brains. Each Skin Node and therefore each Skin Patch: is Dynamically Adaptable meaning that they can adapt to external stimuli by either modifying their behavior or by completely changing their code. Construction of a sensate skin in such a modular fashion promises intrinsic scalability, where peer-to-peer connections between neighbors can reduce local data, which can then be sent to the brain by the high-speed common backbone.

perez.png

Paradiso observed two general trends in sensor networks: Either the individual sensors are routed to a central processing unit or as completely decentralized sensor networks. So in SNAKE, data can be processed locally because each node is given processing power. Each node can also be connected to each other to create a skin like surface to react to the same kinds of stimuli that our skin encounters. The idea of a communication link between nodes is inspired by how our cells communicate with one another. When stimulated they generate an electrical pulse, informing our brain, while also releasing neurochemical transmitters received by neighboring cells.

Each skin patch in SNAKE is a sensor network composed by sensor nodes. Each node is made of a multi layer, flexible circuit substrate that sense six physical quantities: Stain/Bending by using two orthogonal custom made strain gages. Proximity/Activity by using a piezoelectric cantilever. Absolute pressure by using a quantum-tunneling effect material. Ambient light by adding an integrated sensor. Audio by adding a MEMS microphone. Temperature by using an integrated temperature sensor.

Related work in the field


Paintable Computer designed by William Butera for his PhD thesis at MIT. Paintable Computing is: "An agglomerate of numerous, finely dispersed, ultra miniaturized computing particles; each positioned randomly, running asynchronously and communicating locally -Butera".

Tribble designed by Josh Lifton is a tactile reactive interface built by linked elements assembled in a sphere made up of tiles. The advantage of this work is to be a completely decentralized network; each node is capable of processing its own generated data without the need of a centralized processing unit. The cons is probably its shape, fixed, preventing it of being a scalable smart surface. Also it is power hungry!

Tribbletribble2

Tribble

Pushpin Computing
The project developed by Josh Lifton & Michael Broxton consists of a hundred of peer-to-peer wireless sensor nodes freely distributed over a table-top interface.

pushpin.png

Pushpin

Recreating the sense of touch have been explored by many other researchers, but all of them rely on a centralized processing unit to process the data extracted from the sensors. For instance, Lumelsky's sensitive skin, a prototype of a skin patch with infrared lights and receivers used as proximity sensors. Hakozaki created a flexible robot skin to cover wide robot surfaces. Rekimoto presents a capacitive "smart skin" sensor for use in interactive surfaces.

Also prior work as shown artificial sensate skins not implemented as sensor networks but as sensor matrices: each sensor must be individually routed to a central processing unit. This is the case for instance for Takao Someya and his large flexible sensor matrix with organic field effect transistors or for M. Sergio's textile-based capacitive sensor array that can be used as sensitive skin.

takao.jpg

Takao Someya' sensor matrix

An artificial sensate skin needs to be flexible. The innovative work of Stephanie Lacour is probably the most prominent example. She has created a new conducting material that can be stretched and still retain their electronic properties this by depositing thin gold layers on elastic rubber substrates. Also one can refer to the work done on the e-paper by Jacobson, micro capsules, filled with electronically loaded white parts that were dissolved in a dark colored oil.

-> Link <- to the .pdf of Pérez thesis.

Posted by Cati Vaucelle @ Architectradure

Tuesday, July 15, 2008

Yard sale treasures

This summer is the perfect period for yard sales! I have a few secret collections that are building up! All of them related to my research of course. One of my recent find is this vintage electronic kit for children, "discover the magic and mystery of electronics in minutes". Working in a group that researches on a seamless and tangible relationship to digital information, I find this child's game particularly of interest.

img_2624.JPG



img_2623.JPG


Each block represents an electronic component. As the child assembles the blocks together, the child designs a circuit. All the pieces have a magnet underneath. They can be assembled on a metallic large plate, plate that works as the circuit ground. The game is about electronics, analog electronics, but the iteration process of electronics discovery is "tangible". The child can relate to the kit like a puzzle and by this is invited to experiment with each piece. Many authors have claimed that the understanding of electronics is hands-on. Making this process connected to the learning of electronic symbols + offering a puzzle based interaction to circuit design is very exciting! Now there is a consequence to the connection of the pieces, where the electronics knowledge starts and the children are empowered in the design, focusing essentially on their component and how they spatially fits. Later on they can move on to working directly with the components ...

I have a more recent version of an electronic kit that shows directly the components, not the symbols. The connection is made by inserting wires between each component. I much prefer the puzzle based approach that welcome easy improvisation and experimentation with circuit design.

Posted by Cati Vaucelle @ Architectradure

Friday, July 11, 2008

Film assembly using toy gestures

Picture This! Project by Cati Vaucelle

My full paper Picture This! Film assembly using toy gestures has been accepted as a full paper for the technical conference on ubiquitous computing: UbiComp 2008. With an acceptance rate of less than 19% for technical papers in the field, it is very encouraging!

Abstract
We present Picture This! a new input device embedded in children’s toys for video composition. It consists of a new form of interaction for children’s capturing of storytelling with physical artifacts. It functions as a video and storytelling performance system in that children craft videos with and about character toys as the system analyzes their gestures and play patterns. Children’s favorite props alternate between characters and cameramen in a film. As they play with the toys to act out a story, they conduct film assembly. We position our work as ubiquitous computing that supports children’s tangible interaction with digital materials. During user testing, we observed children ages 4 to 10 playing with Picture This!. We assess to what extent gesture interaction with objects for video editing allows children to explore visual perspectives in storytelling. A new genre of Gesture Object Interfaces as exemplified by Picture This relies on the analysis of gestures coupled with objects to represent bits.

Introduction

We connect to our world using our senses. Every one of our senses is a knowledge shopper that grounds us in our surroundings [1]: with touch, one feels the texture of life, with hearing one perceives even the subtlest murmurs of our existence, with vision one clarifies their instincts. But human senses are not only about perception. We use gesture to apprehend, comprehend and communicate. We speak to ultimately translate and exchange with others. We visualize, record, and playback events using our memory to reflect on our history and to be immersed in experience. We as children and adults are engaged in everyday pretense and symbolic play. We embed and later withdraw from the world, using imagination to project ourselves into situations [35]. Our mental constructs are necessary to reach a deeper understanding of our relationship with our environment [3]. Children are offered stories by adults and are driven into fantasy play. They use toys to externalize and elaborate their mental constructions [8]. With character toys they create interrelationships and plots, a means to expose their social knowledge: knowing about human beings and social relationships [33]. If the toy has an immediately accessible visual perspective, a new world is opened to the child. The toy brings her into exploring visual and narrative perspectives of character props, expanding the discovery of her environment.

We imagine a world in which people play, create and exchange visual narratives with ease and transparency. Motivated by the playful improvisational environment of child storytelling with toys, we have developed a new category of video editing tools progressing towards the child’s natural expression of play. In Picture This! we combine the activity of play with the video making process. Whereas play emphasizes spontaneity and improvisation, video making necessitates structure and composition. We were inspired by the theater play of Goethe’s childhood [35], investigating what technology could add to the narrative and play experience. We use technology to offer visual feedback regarding how the scene looks like from the point of view of an imaginary audience. The child storyteller enters the world of the movie maker. Cameras become part of a toy system showing how things look from a toy’s point of view. They can be integrated in Lego people, car drivers, and even coffee mugs! The video process, supported by gesture induced editing, benefits children in practicing social interrelationships and visual perspective taking.



More about the system ->here <-

Posted by Cati Vaucelle @ Architectradure

Wednesday, July 09, 2008

Light based communication networks

361px-gluehlampe_01_kmj.png

I attended the talk by the Talking Lights company at the MIT Media Lab. They work on light based communication networks associating information with specific locations in a building and then use that information to guide, monitor and get information to people as they move from place to place. I was fascinated by their inexpensive way to enable context aware computing and the idea of associating information in a building directly through the components already existing in the building, in this case a common light source.

So for instance, a person wears a box-link (basically a photodyode with Bluetooth) so that the system knows precisely where this person is located. The communication between the box-link and the building is created by modulating the light from an ordinary light fixture to encode information. Where GPS technology does not operate accurately and Wifi triangulation does not “detect” walls, the signal in Talking Light is constrained by walls, offering a more precise indoor localization. As the user moves in the building there is a discrimination between light sources in the area. It takes the maximum amplitude, e.g. last light, last amplitude. The light can also transmit radio quality audio, even thought this is can be done through power lines.

Also the company offers researchers the possibility to outfit lights with the communication capability or to create multi-light network for application -> here <-

Posted by Cati Vaucelle @ Architectradure

Sunday, July 06, 2008

The new MIT Media Lab under the 4th of July firework!

MIT Media lab

Happy independence Media Lab!

Posted by Cati Vaucelle @ Architectradure

Tuesday, July 01, 2008

What's next for fitness centers?

I read an issue of Art in America -featuring the amazing work of Janine Antoni on the cover and discovered a past work of Antal Lakner: home transporter (from the passive working devices series).

Skewering a vain leisure society that "labors" pointlessly on exercise equipment, Lakner designs workout machines like the "Forest Master" (a saw) and the "Home Transporter" (a wheelbarrow). Each is accompanied by a didactic photo of a worker using the prototype tool.

I find this work actually very marketable as a neat idea for making fitness centers more fun! I know it is not the point and the work is remarkable, but it is also an amazing interface design for transforming fitness centers. Instead of trying to hook up a rowing machine to a virtual boat in a video game, why not connecting the actions with meaningful activities!

lakner1.jpg

lakner2.jpg

Posted by Cati Vaucelle @ Architectradure