Games for children with Autism

Short Description

Series of educational and movement based Kinect games for children with gross motor skill difficulties (like Autism, ADHD, Dyslexia etc.). This is ongoing project started from collaboration between Innovation Center at Faculty of Computer Science and medical institutions in Serbia and it is supported from Serbian Ministry of Education, Science and Technological Development. Also developed web application that tracks progress of children playing Games for Autism. It is used by parents and physiatrists working with children.

In Collaboration with

ICEF, Innovation Center from Faculty of Electrical Engineering University of Belgrade (Dr Milica Djuric-Jovicic, prof Dr Bosko Nikolic)
FASPER, Faculty of Special Education and Rehabilitation (Dr Mirjana Djordjevic)
ABA treatment for children with autism in Serbia

Press

First Serbian software for children with autism [Blic link]
Serbian software big help for kids with autism [RTS link]

My Role

Lead game development, game and graphic design, motion graphics, brainstorming ideas with physiatrists, development of custom gestures and poses, character rigging, character animations, custom physics, both front and server side for web application. Technologies used: Microsoft Kinect SDK, ActionScript 3, Adobe AIR, Photoshop, Illustrator, JavaScript, Bootstrap, PHP

Project Website and Download

Igrom Do Zdravlja [link]

Game Demos

Every level could be adjusted to individual player by parent or physiatrists via Game Admin Web application (see below).


Level 1-4: Sorting
How to play: Sort fruits in baskets; could be played with one or both hands
Goal: Control of impulse, encourages functionality of movement, exercise of patience


Level 5: Catching
How to play: Catch fruit in basket, avoid balls; played with one hand
Goal: Coordination exercise


Level 6 – 9: Math
How to play: Solve equations by putting fruits in the basket.
Equation is shown on the basket and possible results are shown on fruits.
Equations are either in form of basic math operations or in form of simple task with goal to continue sequence of numbers.
Could be adjusted to other educational purposes (alphabet, symbols…)
Goal: For both educational and coordination purposes


Level 10: Catching
How to play: Cath all bananas and eat them. Played with whole body movement; all child’s movements are directly mapped to monkey movements
Goal: Coordination exercise


Level 11: Imitation
How to play: Repeat movements and poses after monkey; played with whole body movement
Goal: Encouraging and improving gross motor skills through imitation


Level 12: Seek and Hide
How to play: Seek for the monkey by moving ove hand; could be played by both hands alternately
Goal: Coordination exercise

Game Admin App Demos

Web application that tracks progress of children playing Games for Autism. It is used by parents and physiatrists working with children


Game Admin Application – Sorting
Starting page containts list of all children playing game. For every child there is “folder” with basic personal informations and with links to Results and Settings for game parameters.


Game Admin Application – Sorting results
Graphs are grouped by game type (Sorting, Catching, Math…). Each bar on graph represents result for individual level. In this section physiatrist has brief insight into overall progress of child by game type.


Game Admin Application – Sorting details
This demo represents an example of page with detailed results for Sorting games. Some of tracked results shown on graphs are: average score per level, average score for every hand and average time of playing. Below graphs there is table with each row representing individual level with coresponding data.


Game Admin Application – Sorting details for every level
Tracked data for every level (in case of Sorting levels): Level Name, Score, Score for Left Hand, Score for Right Hand, Stars (computed based on Score, from 1 to 5), Is Level Completed, Start Time, End Time, Duration of Game, Total Fruits to collect, Number of Wrong Fruit Pickups, Correct Fruit Drops, Wrong Fruit Drops, Correct Fruit-Wrong Basket, Wrong Fruit-Wrong Basket, Correct Fruit-Correct Basket


Game Admin Application – Movement history
Besides graphs representing numerical results there is also very important representation of movements in form of visual player with precise history of every movement. In this example, physiatrist could easily see hand movements represented as green paths (path from fruit to basket) and red paths (path from starting point to fruit). Navigating through history back and forth is possible by using slider or buttons (next, previous)


Game Admin Application – Print mode
Second version of history player with white background suitable for printing


Game Admin Application – Heat maps
Third version of history player with Heat map graph view which represents areas where child’s hands are held longest: red color representing longest hold, blue color representing shortest hold. This is one of easiest ways for physiatrist to see where child is having problems


Game Admin Application – Imitation
Example for results of Imitation game types. Similar to Sorting game graphs, here we could see detailed statistics for every level played, average score, averare time needed to guess correct pose or gesture. By clicking on any level from list we get more detailed informations about that level.


Game Admin Application – Imitation details
Some of tracked data for Imitation games are: list of poses played and details for every pose and gesture, time of playing, result of guessing, estimate of correctness, average time of pose guessing, etc.


Game Admin Application – Player capture
Besides image of monkey whose pose need to be guessed, there is also an image of player in exact moment of pose guessing, which could be useful if there is need to visualy estimate correctness of pose.


Game Admin Application – Pose on/off
Every pose or gesture could be turn on or off in order to customize list of poses for every child that will be shown during game.

Presented at

– 59th International Technical Fair, Belgrade, May 2015
– NETSA Conference (Networking, Sciеnce and Application, Faculty of Business, Singidunum University, Valjevo), May 2015, [link]
– Presentation: System for interactive treatment and evaluation of children with autism, Faculty of Electrical Engineering, University of Belgrade, July 2015 [link]

DSC_0485
DSC_0489-2
59th International Technical Fair, Belgrade, May 2015

DSC_0032
20150705072831 (2)_fhdr
DSC_0026
DSC_0042
Presentation: System for interactive treatment and evaluation of children with autism, Faculty of Electrical Engineering, University of Belgrade, July 2015 [link]

11241029_907566462618625_7724786777863126444_o_fhdr
NETSA Conference (Networking, Sciеnce and Application, Faculty of Business, Singidunum University, Valjevo), May 2015, [link]