Project Demos

The project spans ten demos with six orangutan inviduals at Zoo Atlanta between October 2016 - February 2017.

Demo Timeline


Demo 1

October 7, 2016

Orangutan: Biji (46-year-old female)

Applications: painting demo with artistic brush

Biji was attentive during setup. She watched as staff and myself made interactions in front of the Kinect but did not participate herself.


Demo 2

October 13, 2016

Orangutan: Biji (46-year-old female)

Applications: painting demo with artistic brush (+ added jungle images) & face reveal

Added in jungle imagery per Biji's preference and music. Still, Biji mostly observed. Although she does seem to enjoy watching!


Demo 3

October 29, 2016

Orangutans: Biji (46-year-old female) and Dumadi (10-year-old male)

Applications: painting demo with artistic brush (+ added jungle images) + face reveal

Biji's behavior was the same, but we were able to try out the application with Dumadi. Dumadi was very active and was attentively watching the screen. Still unsure if the application and movement are correlating.


Demo 4

November 10, 2016

Orangutans: Miri (24-year-old female), Satu (13-year-old male), and Pelari (3-year-old male)

Applications: painting demo with artistic brush (+ music) & face reveal

Satu is considered one of the most intelligent individuals and took the reigns, while Pelari watched. Miri did not interact with it much. Lynn had the idea of giving the orangutans the paintbrush, which added in the touch sensory to the application. The paintbrush asked as a type of joystick.


Demo 5

November 17, 2016

Orangutans: Miri (24-year-old female), Satu (13-year-old male), and Pelari (3-year-old male)

Applications: painting demo with artistic brush (+ music + butterflies video) & face reveal

Iterated with the joystick and applications. Added in music and the butterflies. Orangutans enjoy picture books of animals, so butterflies were added as a dynamic component. The music acted as an interaction hot spot, but we did not notice any connection with the use of it and added interaction time.


Demo 6

November 25, 2016

Orangutans: Miri (24-year-old female), Satu (13-year-old male), and Pelari (3-year-old male)

Applications: painting demo with artistic brush (+ music + butterflies video) & face reveal

Iterated with the joystick and applications. Added in music and the butterflies. Orangutans enjoy picture books of animals, so butterflies were added as a dynamic component. The music acted as an interaction hot spot, but we did not notice any connection with the use of it and added interaction time.


Demo 7

December 1, 2016

Orangutans: Miri (24-year-old female), Satu (13-year-old male), and Pelari (3-year-old male)

Applications: painting demo with artistic brush (+ music + butterflies video) & night sky painting & face reveal

Lynn and Jodi, the assistant curator, thought to shine the projection in the orangutans' enclosure (my initial proposal). All of the orangutans were seen chasing the projected butterflies, trying to catch them, and interacting showing positive behaviors.


Demo 8

December 8, 2016

Orangutans: Chantek (38-year-old male) and Dumadi (10-year-old male)

Applications: painting demo with artistic brush (+ music + butterflies video + cats) & night sky painting & face reveal

Chantek did utilize the joystick and painting applications for a few minutes but signed that he preferred to work with his usual researcher who was visible from my setup. The other research provides Chantek snacks for his positive reinforcement and he is noted as being rewards driven. Dumadi interacted with the butterflies and objects by touching them on the walls and was quite physical. However most of the demo he placed his face close to the projection.


Demo 9

January 20, 2017

Orangutans: Miri (24-year-old female), Satu (13-year-old male), and Pelari (3-year-old male)

Applications: attempted new demos featuring falling objects.

The group did interact with the objects in their habitat. The keeper mentioned she thought the motion was going too fast and that I should place more adjustments on the controls. This did demonstrate that this was more to their liking and having a highly interactive space was a more successful approach.


Demo 10

February 10, 2017

Orangutans: Miri (24-year-old female), Satu (13-year-old male), and Pelari (3-year-old male)

Applications: Focused on the new application - leaves scatttering around shapes. Also demoed painting demo with artistic brush (+ music + butterflies video + cats), and night sky painting.

This application exhibited more controls for adjustment. The objects the orangutans were to interact with were leaves, as they’re familiar with leave piles as physical enrichment objects. The controls looked at how many leaves, motion, and the depth perception measured by the Kinect. The leaves would change color and be “moved” by interaction. The code was altered to be looking for blob detection. While this application was on the right track, more technical work could be done in developing the interaction’s feedback. The environment and time proved to be the largest constraint. More developments with this ideally would include specific locations for Kinect and projection installation and time to work on developing the interaction technology.


Code

Kinect and Processing was used to track the movement of the orangutan. Demos 1-7 used avearage point tracking. Find the average point code for OpenKinect and Processing on GitHub.

The Microsoft Kinect is a motion sensing input device which uses an RGB camera with a depth sensor and infrared projector. I used the first-generation Kinect.

Kinect and Processing was used to track the movement of the orangutan. Demos 1-7 used avearage point tracking. Watch tutorials on how to work with a Kinect in Processing by Daniel Shiffman.

Paint palette turtorial

Demos 8-10 explored looking at blob detection to track the orangutan and had better controls for looking at the minimum and maximum of the depth field. This was created in Processing 3. Information on depth threshold. Physics example (used in the leaf demo) on Open Kinect.

Becky Scheel

Atlanta, Georgia USA

©2016 Becky Scheel. All Rights Reserved.