- Research article
- Open Access
The role of a virtual avatar in attention and memory tasks in Rett syndrome
BMC Neurology volume 21, Article number: 223 (2021)
Since subjects with Rett syndrome (RTT) focus their attention mainly on the faces of people with whom they interact, in this study the role of a human-like smart interactive agent (an avatar) in enhancing cognitive processes is examined. More in depth, this study aimed to understand if, and to what extent, the use of an avatar can improve attention and memory abilities in subjects with RTT.
Thirty-six subjects with RTT participated in the study. All participants performed over-selectivity and memory tasks, for a total of six trials. These trials were randomly presented in two different conditions: with and without virtual avatar.
The results indicated that the participants improved their attention and memory abilities when they performed the tasks with the avatar. There were no improvements when they performed the tasks without the avatar.
The results were discussed considering the relationship between motivation, attention and memory in RTT.
Rett syndrome (RTT) is a complex genetic neurological disorder, caused by mutations in the X-linked gene encoding for a regulator of epigenetic gene expression, methyl CpG binding protein (MeCP2). The clinical picture of RTT is defined by loss of hand use and language, with the development of gait abnormalities and hand stereotypies [1,2,3,4]. Thus, subjects with RTT often use their eyes to communicate [5,6,7]. Neurological abnormalities in RTT are reflected in several behavioral and cognitive impairments such as stereotypies, loss of speech and hand skills, gait apraxia, irregular breathing with hyperventilation while awake, and frequent seizures [1,2,3,4]. Clinical features of RTT suggest that this disorder is the result of a primary disturbance of neuronal development, resulting in maturation arrest in selected brain regions . For example, this maturation arrest could be caused by defective neurotransmitter systems that fail to provide normal trophic factors .
New promising approaches have recently shown that technology-aided programs for subjects with severe/profound and multiple disabilities are useful in enabling performance of daily tasks and improving cognitive abilities . Technology-aided programs together with cognitive rehabilitation can enhance neuroplasticity both with neuropsychological and neurophysiological parameters. Fabio et al. (2016)  investigated modifications in behavior and brain activity of patients with RTT by using eye-tracking technology during a discrimination task, while neurophysiological parameters were measured using quantitative EEG (QEEG) analysis. This study showed that patients with RTT become attentive and vigilant to the task and look at the target more quickly and for a longer time. This result was supported by QEEG analysis, that revealed a decrease of beta activity and an increase of right asymmetry. Hence, the study evidenced a positive effect of the application of eye-tracking technology to cognitive rehabilitation on behavioral and neurophysiological parameters in RTT.
Spaghero , in a study exploring virtual reality, demonstrated that subjects with intellectual disabilities can present a marked improvement in attention when interacting with virtual objects and events. Therefore, this new approach has been recognized, as it provides a safe environment in which any individual can enjoy pleasurable activities, music  and communicating with the family . Another major advantage in using technology-aided interventions is the possibility to acquire huge amounts of data, essential for advanced data analysis such as predictive analysis .
A new trend in current technologies is the presentation of a sequence of tasks within a environment, with an avatar giving positive feedback to the subjects on the correct completion of a task, thereby improving motivation [13,14,15,16]. Avatars, in the form of graphical characters, able to show human-like facial expressions and gestures, to speak and even react to users’ interaction by interpreting gestures, emotional states and speech, have been exploited for several applications in the past . Furthermore, virtual environments have often been combined with advanced human-computer interaction (HCI) technologies to facilitate user interaction in complex tasks .
The use of avatars has been shown to be effective in increasing attention in various disabilities [19,20,21], however, it has not yet been explored for people with RTT. For example, a study  investigated the emotion recognition ability in subjects with autism using an avatar able to recreate emotional facial expressions. Further evidence was provided by experimenting with an avatar in Attention Deficit/Hyperactivity Disorder (ADHD) [23,24,25,26,27,28]. These studies suggest that an avatar can be used as a computerized pedagogical agent with realistic characteristics; for example, it can appear on a computer screen and guide users through multimedia learning environments, designed to support learning and direct attention to relevant topics. In the study , a virtual avatar similar to a young male nerd was created for teaching ADHD subjects, providing options for solving mathematic and logic problems. Results of this study suggested that it could be possible to elicit greater attention in subjects with ADHD and highlight how the presence of a pedagogical agent may improve the performance of subjects.
The role of a computerized pedagogical agent is also supported by other theories. According to Computers Are Social Actors (CASA), for example, people respond to the media in the same way they would respond to humans, so the avatar would become a real social model [29, 30]. Wang, Wenjing and Heping  also states that people learn better from multimedia presentations in the presence of a pedagogical agent, recognizing social presence. For these reasons, the use of the avatar becomes effective for students to structure the appropriate processes and improve attention and learning  by strengthening their interests .
Other evidence on the role of the virtual avatar were provided in a study  in which subjects with ADHD underwent three experimental conditions. In the first condition, the avatar simply provided instructions; in the second condition the avatar presented the instructions and also provided feedback on the student’s attention; in the third condition the avatar was not presented. Results showed that the presence of the virtual avatar increased the problem-solving ability of the subjects. These benefits were also confirmed in the work of Shema-Shiratzky, Brozgol CornejoThumm . Summarizing, avatars showing behaviours that the users feel as familiar  can become real tutors, coaches, motivators, mentors, models to emulate .
This study aims to examine whether the use of an avatar can improve attention and memory abilities in subjects with RTT. The underlying logic is that the motivation process significantly affects some cognitive functions, such as attention and memory. Since subjects with RTT are very motivated to look at the face of therapists and parents, an avatar acting human-like gestures, speech, gaze and behaviors may be very motivating to join in the learning process.
Attention and memory tasks were presented with two conditions through eye tracking technology. In the first condition, the avatar gave the instructions and asked the patient to give the answer. In the second condition there was no avatar. A voice gave the instruction and solicited the replies. The hypothesis was open: on one hand it may be that the avatar, acting as a social motivational model  can induce subjects with RTT to focus and memorize more efficiently; on the other hand, based on the redundancy theory of Mayer , since the avatar is a third element it may be that it acts like a distractor and, not necessarily improve attention and memory.
Furthermore, since the eye tracking methodology helps to distinguish the encoding phase (with the registration of the length of fixations) and the retrieval phases (with the number of items recalled), in this study we want to understand if the avatar is effective in the encoding phase or in the retrieval phase or both. As shown in previous studies with ADHD children[21, 23] we expect that, if the subjects with RTT show a high level of length of fixation in the condition with the avatar, such a condition will produce benefits also in the retrieval phase.
Forty-one subjects with a diagnosis of RTT took part in the experiment. Forty were female and one was male. Their families had been contacted by the Italian association for Rett syndrome (AIRETT) that asked them to participate in the study. The families come from all over Italy. Five subjects were excluded from the study since they were not able to focus on the stimuli of the monitor. For this reason, finally, 36 subjects participated in the study. They ranged in age between 4 and 36 years. A general assessment was carried out by a psychologist through the Vineland Adaptive Behaviour Scale (VABS) and the Rett Syndrome Rating Scale (RARS) . Thirty-one subjects and one male attended schools or socio-educational centres; four subjects were assisted by an educator at home. All showed little or no purposeful hand use and pervasive hand stereotypies were striking. Ambulation was preserved in 19 subjects. Table 1 shows the chronological age of the participants, the RARS scores as well as the VABS Scores.
A Tobii Series-I eye-tracker was used to record the participants’ visual scanning. This tool records the following ocular movements: the location and duration of ocular fixations (pause of eye movement on an object of interest) and saccadic movements (rapid movements between fixations). Passive gaze tracing (LC Technologies, Sao Paulo, Brazil) software was used to generate gaze data during visuals scanning. It was possible to choice the areas of interest (AOI) within the images chosen for the statistical analysis of eye tracking. An AOI cluster can be defined as selected specific areas that are used for both attention and recalling details of the images.
The eye-tracker was used for both the overselectivity paradigm and the memory paradigm. The avatar was created using an educational platform “Voki for Education” (https://www.voki.com/). Voki is a free collection of customizable speaking avatars for teachers and educators that allows users to create a precise profile of a talking character. Voki is created by Oddcast and can be customized to look like humans, cartoons, and/or animals.
The characteristics selected for the creation of the avatar were chosen through a pre-calibration, carried out during the 2018 Airett Campus in which several subjects with RTT spent their holidays with family and educators. The pre-calibration was fundamental as it allowed to include the avatar that the RTT subjects prefer. Following, the materials of both paradigms will be presented.
The memory test was implemented. The story-cartoon presented with Tobii eye-tracker was easy to understand and remember, and the descriptions of facts were presented in a logical order. Four cartoon sequences were extracted, two from the “ant Bibi” and two from the “Pimpa on the beach” animation movies, respectively. They were chosen out of seven cartoon sequences presented to 31 3-year-old children and calibrated based on their comprehension of the story (> 90%) and on their recalling indices (> 90%). The questions have various levels of difficulty, from simple recognition of the main character of the story, to recognition of the emotional states of the characters, to identification of the actions within the story.
Each cartoon sequence contained 8 significant memory indices (Table 2). Both cartoon sequences “Ant Bibi” and “Pimpa on the Beach” lasted 2:30 min.
The test was carried out for each patient. After each cartoon was presented through the eye-tracker, the participants were asked to perform immediate recall of the cartoon with a recognition test with 8 questions regarding the story (Table 3).
For each of the relevant indexes two cards were presented on the screen, the correct response (CR) and the distractor answer. The scores were 1 or 0: if the response was corrected, 1 score, if the response was the distractor stimulus, 0 score.
In this paradigm, 2 cards of 10 cm × 30 cm, each one reporting a different complex stimulus composed of three familiar objects shown in black and white, were presented on the screen of the Tobii eye-tracker. In the second phase, individual stimuli, consisting of cards of about 10 cm × 10 cm, were presented on the screen. Each card represented a single familiar object previously included in the target complex stimulus (Fig. 1). The cards were calibrated in a previous study . In the condition with virtual avatar, the avatar presented both the complex stimuli and the individual stimuli between which the participant had to choose (Fig. 2, phase 1 and 2). In the condition without virtual avatar, no avatar was presented to participants.
Vineland adaptive behavior scales-interview second edition (VABS)
The VABS is subdivided into four domains: communication, daily living, socialization and motor skills. The interviewer asks general questions pertaining to the patient’s functioning in each domain and uses the responses to rate the examinee on each critical behaviour item (2: always present, 1: sometimes present, 0: seldom or never present). Typical interviews require approximately 1 h. A total score is computed by summing the individual ratings for each scale. The reliability of VABS was established as follows: split-half, 0.73–0.93 for the communication domain, 0.83–0.92 for daily living skills, 0.78–0.94 for socialization, 0.70–0.95 for motor skills, 0.84–0.98 for adaptive behaviour composite, 0.77–0.88 for maladaptive behaviour. The interrupter reliability coefficients for the survey and expanded forms ranged from 0.62 to 0.75. Standard error of measurement ranged from 3.4 to 8.2 over the four domains, and from 2.2 to 4.9 for the Adaptive Behaviour Composite, on the survey form. The VABS was obtained for use in this study because it was bought by the University of Messina.
Rett assessment rating scales (RARS)
The RARS is a standardized scale used to evaluate patients with RTT. It is organized into seven domains: cognitive, sensorial, motor, emotional, autonomy, typical characteristics of the disease and of behaviour. Typical characteristics of the disease and behaviour domains measure the following characteristics: mood swings, convulsions, dyspnoea, hyperactivity, anxiety, aggressivity, bruxism, oculogyric crises, epilepsy, aerophagia, muscle tension and food preferences. A total of 31 items was generated as representative of the profile of RTT. Each item is provided with a brief glossary explaining its meaning in a few words. Each item is rated on a 4-point scale, where 1 = within normal limits, 2 = infrequent or low abnormality, 3 = frequent or medium-high abnormality, and 4 = strong abnormality. Intermediate ratings are possible, for example, an answer between 2 and 3 points is rated as 2.5. For each item, the evaluator circles the number corresponding to the best description of the patient. After a patient has been rated on all 31 items, a total score is computed by summing the individual ratings. This total score allows the evaluator to identify the level of severity of RTT, conceptualized as a continuum ranging from mild symptoms to severe deficits (Mild = 0–55; Moderate = 56–81; Severe= > 81). The RARS was established by a standardization procedure, involving a sample of 220 patients with RTT, proving that the instrument is statistically valid and reliable. Skewness and kurtosis values, calculated for the distribution of the total score, are 0.110 and 0.352, respectively. Distribution is found to be normal. Cronbach’s alpha is used to determine the internal consistency for the whole scale and sub-scales. Total alpha is 0.912, and the internal consistency of the sub-scales is high (from 0.811 to 0.934).
The experiment was carried out in a quiet room during the 2019 Rett summer campus of the AIRETT. The examiner administered the VABS and the RARS through an interview with the parents of the subjects with RTT and the educators. Participants sat in a dimly lit room of the association in front of the eye-tracker screen at 30 cm and the direction of the gaze was determined according to the Pupil Centre/Corneal Reflection Method in low-intensity infrared light.
The eye tracker was positioned in such a way that ambient lighting did not affect the recordings. The eye tracking equipment was calibrated for each participant at the beginning of the experiment. Gaze fixations of at least 1000 ms within a region of 2°– 3° around each calibration point were considered accurate.
The two tasks of this experiment were presented randomly in two conditions with and without avatar, as given in Tables 4 and 5. All participants performed over-selectivity and memory tasks. There were six trials: four different stories-cartoon of “Pimpa” in the memory task, and two over-selectivity trials with different familiar stimuli. These trials were randomly presented in two conditions (with and without virtual avatar). The experiment lasted 30 min in total.
Memory task: fixation length (FL) of the correct stimuli related to the significant memory indices during the vision of the cartoon and the number of the recalled correct indexes. FL refers to the amount of time (seconds) spent by the subject when looking at the correct stimulus. Total fixation length refers to the sum of the time spent in looking at each significant index during the vision of the cartoon. Fixations were extracted using a threshold of 100 ms.
Overselectivity task: FL of the complex correct stimulus and the number of the individual correct recalled images.
The data were analysed using SPSS version 22.0 for Mac. The descriptive statistics of the dependent variables were tabulated and examined. Alpha level was set to 0.05 for all statistical tests. In the case of significant effects, the effect size of the test was reported. The relationship between continuous variables was evaluated by determining Pearson’s r; group comparisons were conducted using t-test for paired samples.
With reference to the memory paradigm, a preliminary analysis showed that the two cartoons “Ant Bibi” and “Pimpa on the Beach” showed no statistical differences either with reference to fixation length of the total correct stimuli, t (35)=1.1, p = .43, or the number of the correct recalled indexes, t (35)=0.76, p = .67; for this reason in the following statistical analysis the mean of indexes of both cartoons is used. Table 6 shows means and standard deviations of the two conditions.
With reference to the length of the total correct stimuli results show significant differences, t (35) = 4.55, p < .0001. This means that the time spent in looking at each significant index during the vision of the cartoon was higher when the avatar helped the subjects than when the avatar was not present. With reference to the number of the recalled correct indexes, results show significant differences, t (35) = 6.02, p < .0001. Subjects with RTT recall more significant indexes when the avatar is present than when it is absent.
With reference to the overselectivity paradigm, FL of the complex correct stimulus show significant differences, t (35) = 6.61, p < .001. This means that the time spent in looking at the correct complex stimulus was higher when the avatar was present than when the avatar was not present. With reference to the number of the individual correct recalled images, results show significant differences, t (35) = 7.01, p < .0001. Subjects with RTT recall more significant indexes when the avatar is present than when it is absent. Table 7 shows means and standard deviations of the parameters of the overselectivity task in the two conditions.
With reference to the second question here addressed, the avatar helps both encoding and retrieval phases. Pearson’s coefficient r was chosen as the measure of the strength of correlation. With reference to the memory task, the relationship between FL of the correct stimuli and the number of correctly recalled indexes is high, r (35) = .678, p < .001. By comparing the level of severity (RARS) with FL and the number of corrected response in the condition with avatar, they showed statistically significant differences correlations, r (35) = − .446, p < .001; r (35) = − .548, p < .001. No statistically significant correlations between memory parameters, age and VABS were found.
With reference to the overselectivity task, the relationship between FL of the complex correct stimulus and the number of the individual correct recalled images is high, r (35) = .52, p < .001. Compared with RARS, FL and CR showed statistically significant correlations in the condition with avatar, r (35) = − .404, p < .05; r (35) = − .478, p < .001. No statistically significant correlations between overselectivity parameters, age and VABS were found.
In the condition without avatar, no significant correlations between the two tasks, age, RARS and VABS were found.
This study addressed two questions: whether the avatar can act as a social motivational model and improve attention and memory and whether it is redundant acting like a distractor and disrupting attention and memory. Both results, related to the two paradigms here analysed, showed that subjects with RTT had a high level of length of fixation in the condition with the avatar and this produced benefits also in the retrieval phase. In addition, the results of the present study indicated that patients with RTT, when performing the two tasks in the condition with avatar, presented a statistically significant improvement in attention and memory abilities. Moreover, correlational analysis between the level of severity of RTT and the two tasks (memory and overselectivity paradigms) showed significant negative relationships. This indicates that at higher levels of severity, the performance of patients with RTT decrease. Thus, there is a relationship between the clinical status of the patients who participated in the study and the test results.
Taken together, these findings indicate that the avatar acts as a cognitive strengthener. Our results support the role of the avatar in learning environments and in the attention process, as social model. These results are in line with the CASA theory. This theory assumes that people respond to the media in the same way they would respond to humans . Wang’s theory also states that learning can be optimized by the presence of a pedagogical agent on the screen . For these reasons, the use of the avatar becomes effective for subjects with RTT to structure the appropriate processes and improve their attention and their learning [40,41,42,43,44,45,46].
In line with this [47,48,49], our avatar not only gives instructions on the relevant aspects of the coding phase but also helps the subjects to better recall the contents. Hence, our results indicate that an interactive avatar that helps subjects with RTT to better direct their attention can concretely improve cognitive performance.
The limitations of the present study are related to the graphical, behavioural, and technological characteristics of the avatar and the sample size. With reference to the characteristics of the avatar, they can affect the performance of subjects with RTT, so it is important to understand what technological, graphical and behavioural conditions are necessary to improve the performance. With reference to the size of the sample, there may be constraints to the generalizability of the results because the sample size is small. However, given that the effect size is adequate, the results can be considered reliable.
The present work can be considered a preliminary experiment. Future studies are needed to understand the conditions under which an avatar can improve the learning process of subjects with RTT. In addition, future research could consider the correlation found in this study, between the severity level of RTT and the cognitive performance of the subjects, as confounding factors. Furthermore, it could be interesting to replicate this study with neurological measurements, such as brain activity, in order to verify whether the avatar can also act as a social motivational model and improve attention and memory at neurological level.
We consider the findings reported in this article a relevant contribution to the introduction of a new generation of embodied interactive avatars aimed at supporting subjects with RTT in their everyday activities [50, 51]. These findings can help families and educators to identify what software can be effectively used to help children and girls with RTT, and also software designers to make good evidence-based choices to offer more focused software, capable of giving significant performance improvements [52,53,54,55,56,57,58,59,60].
Availability of data and materials
We enclosed the full data set as additional supporting file. We had the permission to use the VABS because it was bought by the University of Messina.
Areas of interest
Attention Deficit/Hyperactivity Disorder
Computers Are Social Actors
Italian association for Rett syndrome
Rett Syndrome Rating Scale
Vineland Adaptive Behaviour Scale
Djukic A, Rose SA, Jankowski JJ, Feldman JF. Rett syndrome: recognition of facial expression and its relation to scanning patterns. Pediatr Neurol. 2014;51(5):650–6. https://doi.org/10.1016/j.pediatrneurol.2014.07.022.
Fabio RA, Giannatiempo S, Caprì T. Attention and identification of the same and the similar visual stimuli in Rett Syndrome. Life Span Disabil. 2019;XXII(1):113–27.
Fabio RA, Giannatiempo S, Oliva P, Murdaca AM. The increase of attention in Rett syndrome. A pretest-post test research design. J Dev Phys Disabil. 2011;23(2):99–111. https://doi.org/10.1007/s10882-010-9207-z.
Romano A, Caprì T, Semino M, Bizzego I, Di Rosa G, Fabio RA. Gross motor, physical activity and musculoskeletal disorder evaluation tools for Rett syndrome: a systematic review. Dev Neurorehab. 2019;23(8):485–501. https://doi.org/10.1080/17518423.2019.1680761.
Fabio RA, Caprì T, Nucita A, Iannizzotto G, Mohammadhasani N. Eye gaze digital games to improve motivational and attentional ability in Rett Syndrome. J Spec Educ Rehab. 2018, 2019;9(3–4):105–26. https://doi.org/10.19057/jser.2019.43.
Fabio RA, Caprì T, Buzzai C, Pittalà V, Gangemi A. Auditory and Visual Oddball Paradigm Evaluated Through P300 in Five Subjects with Rett Syndrome. Neuroquant. 2019;17:40–9. https://doi.org/10.14704/nq.2019.17.07.2591.
Zhang B, Zhou Z, Zhou Y, Zhang T, Ma Y, Niu Y, et al. Social-valence-related increased attention in rett syndrome cynomolgus monkeys: an eye-tracking study. Autism Res. 2019;12(11):1585–97. https://doi.org/10.1002/aur.2189.
Armstrong D, Dunn JK, Antalffy B, Trivedi R. Selective dendritic alterations in the cortex of Rett syndrome. J Neuropath Exp Neur. 1995;54(2):195–201. https://doi.org/10.1097/00005072-199503000-00006.
Spanghero F, Ferrari V, Pozzobon V, Rebellato F. Tecnologie per l’inclusione robotica. Tecnologie per l’inclusione. 2016;17:37–9.
Fabio RA, Billeci L, Crifaci G, Troise E, Tortorella G, Pioggia G. Cognitive training modifies frequency EEG bands and neuropsychological measures in Rett syndrome. Res Dev Disabil. 2016;53-54:73–85. https://doi.org/10.1016/j.ridd.2016.01.009.
Fabio RA, Iannizzotto G, Nucita A, Caprì T. Adult listening behaviour, music preferences and emotions in the mobile context. Does mobile context affect elicited emotions? Cogent Eng. 2019;6(1):1–17. https://doi.org/10.1080/23311916.2019.1597666.
Caprì T, Gugliandolo MC, Iannizzotto G, Nucita A, Fabio RA. The influence of media usage on family functioning. Curr Psychol. 2019;(23):1–10. https://doi.org/10.1007/s12144-019-00204-1.
Nucita A, Bernava GM, Giglio P, Peroni M, Bartolo M, Orlando S, et al. Lecture notes in computer science. Int Conf Model Data Eng. 2013;8216:225–2363. https://doi.org/10.1007/978-3-642-41366-7_19.
Annaz D, Campbell R, Coleman M, Milne E, Swettenham J. Young children with autism spectrum disorder do not preferentially attend to biological motion. J Aut Dev Disord. 2011;42(3):401–8. https://doi.org/10.1007/s10803-011-1256-3.
Diehl JJ, Schmitt LM, Villano M, Crowell CR. The clinical use of robots for individuals with autism spectrum disorders: a critical review. Res Aut Spect Disord. 2012;6(1):249–62. https://doi.org/10.1016/j.rasd.2011.05.006.
Kumazaki H, Warren Z, Swanson A, Yoshikawa Y, Matsumoto Y, Yoshimura Y, et al. Brief report: evaluating the utility of varied technological agents to elicit social attention from children with autism Spectrum disorders. J Autism Dev Disord. 2019;49(4):1700–8. https://doi.org/10.1007/s10803-018-3841-1.
Pierno AC, Mari M, Lusher D, Castiello U. Robotic movement elicits visuomotor priming in children with autism. Neuropsychologia. 2008;46(2):448–54. https://doi.org/10.1016/j.neuropsychologia.2007.08.020.
Iannizzotto G, Lo Bello L, Nucita A, Grasso GM. A vision and speech enabled, customizable, virtual assistant for smart environments. Proceedings 11th. Int Conf Hum Syst Interact. 2018:50–6.
Iannizzotto G, La Rosa F, Costanzo C, Lanzafame P. A multimodal perceptual user interface for collaborative environments. Lecture Notes Comput Sci. 2005;3617:115–22. https://doi.org/10.1007/11553595_14.
Dautenhahn K. Socially intelligent robots: dimensions of human-robot interaction. Philos Trans R Soc Lond Ser B Biol Sci. 2007;362(1480):679–704. https://doi.org/10.1098/rstb.2006.2004.
Fabio RA, Caprì T, Iannizzotto G, Nucita A, Mohammadhasani N. Interactive avatar boosts the performances of children with attention deficit hyperactivity disorder in dynamic measures of intelligence. Cyberpsychol Behav Soc. 2019;22(9):588–96 https://doi.org/10.1089/cyber.2018.0711.
Mantziou O, Vrellis I, Mikropoulos TA. Do children in the spectrum of autism interact with real-time emotionally expressive human controlled avatars? Proced Comput Sci. 2015;67:241–51. https://doi.org/10.1016/j.procs.2015.09.268.
Mohammadhasani N, Fardanesh H, Hatami J, Mozayani N, Fabio RA. The pedagogical agent enhances mathematics learning in ADHD students. Educ Info Tech. 2018;23:1–11.
Mohammadhasani N, Fabio RA, Fardanesh H, Hatami J. The link between visual attention and memory in ADHD and normally developing students: seeing is remembering? Reti. Saperi e Linguaggi Ita J Cogn Scie. 2015;1(2):89–102.
Fabio RA. The study of automatic and controlled processes in ADHD: a reread and a new proposal. Med J Clin Psy. 2017;5:1–8.
Martino G, Caprì T, Castriciano C, Fabio RA. Automatic deficits can lead executive deficits in ADHD. Med J Clin Psychol. 2017;5(3):1–32. https://doi.org/10.6092/2282-1619/2017.5.1669.
Fabio RA, Caprì T, Mohammadhasani N, Gangemi A, Gagliano A, Martino G. Frequency bands in seeing and remembering: comparing ADHD and typically developing children. Neuropsychol Trends. 2018;24(24):97–116. https://doi.org/10.7358/neur-2018-024-fabi.
Fabio RA, Caprì T. Automatic and controlled attentional capture by threatening stimuli. Heliyon. 2019;5(5):17–52. https://doi.org/10.1016/j.heliyon.2019.e01752.
Mayer RE. Cognitive theory of multimedia learning. In: Mayer R, editor. The Cambridge handbook of multimedia learning. New York: Cambridge University Press; 2014. p. 34–71.
Kim Y, Baylor. A social-cognitive framework for pedagogical agents as learning companions. Educ Tec Res Dev. 2007;54:569–96.
Wang F, Wenjing LI, Heping XIE, et al. Is pedagogical agent in multimedia learning good for learning? A meta analysis. Adv Psyc Scie. 2017;25(1):12. https://doi.org/10.3724/SP.J.1042.2017.00012.
Kinnebrew J, Biswas G, Sulcer B, et al. Investigating self-regulated learning in teachable agent environments. In: Azevedo R, Aleven V, editors. International handbook of metacognition and learning technologies. Amsterdam: Springer; 2013. p. 451–70. https://doi.org/10.1007/978-1-4419-5546-3_29.
Lusk MM, Atkinson R. Animated pedagogical agents: does their degree of embodiment impact learning from static or animated worked examples? Appl Cogn Psychol. 2007;21(6):747–64. https://doi.org/10.1002/acp.1347.
Shema-Shiratzky S, Brozgol M, Cornejo-Thumm P, Geva-Dayan K, Rotstein M, Leitner Y, et al. Virtual reality training to enhance behavior and cognitive function among children with attention-deficit/hyperactivity disorder: brief report. Dev Neuroreha habil. 2019;22(6):431–6. https://doi.org/10.1080/17518423.2018.1476602.
Schroeder N, Adesope OO. A case for the use of pedagogical agents in online learning environments. J Teac Lea Tech. 2012;1:43–7.
Veletsianos G, Russell GS. Pedagogical agents. In: Spector JM, editor. Handbook of research on educational communications and technology. New York: Springer Science + Business Media; 2013. p. 759–69.
Sparrow SS, Cicchetti DV, Balla DA. Vineland adaptive behavior scales: second edition (Vineland II), the expanded interview form. Pearson Assessments: Livonia; 2008.
Fabio RA, Martinazzoli C, Antonietti A. Costruzione e standardizzazione dello strumento “R.A.R.S.” (Rett Assessment Rating Scale). Ciclo Evol Disabil. 2005;8:257–381.
Fabio RA, Giannatiempo S, Antonietti A, Budden S. The role of stereotypies in overselectivity process in Rett syndrome. Res Dev Disabil. 2008;30(1):136–45. https://doi.org/10.1016/j.ridd.2008.01.003.
Antonietti A, Fabio RA, Boari G, Bonanomi A. The“style of learning and thinking” (SOLAT) questionnaire: psychometric data for reliability and validity of Italian version. Test Psy Method. 2005;4:299–316.
Castelli I, Antonietti A, Fabio RA, Lucchini B, Marchetti A. Do Rett syndrome persons possess theory of mind? Some evidence from non-treated subjects. Life Span Disab. 2013;2:157–68.
Fabio RA. Attention measures of patients with rett syndrome need to overcome the challenges in evaluating the oculomotor function using electronystagmography. Eur J Paediatr Neurol. 2019;23(2):232. https://doi.org/10.1016/j.ejpn.2019.02.008.
Fabio RA, Caprì T. The executive functions in a sample of Italian adults with ADHD: attention, response inhibition and planning/organization. Med J Clin Psyc. 2017;5(3):1–17. https://doi.org/10.6092/2282-1619/2017.5.1636.
Fabio RA, Gangemi A, Caprì T, Budden S, Falzone A. Neurophysiological and cognitive effects of Transcranial direct current stimulation in three subjects with Rett syndrome with chronic language impairments. Res Dev Disabil. 2018;76:76–87. https://doi.org/10.1016/j.ridd.2018.03.008.
Fabio RA, Magaudda C, Caprì T, Towey G, Martino G. Choice Behavior in Rett Syndrome, the consistency parameter. Life Span Disabil 2018;XXXI (1): 47–62.
Fabio RA, Martino G, Caprì T, et al. Long chain poly-unsaturated fatty acid supplementation in Rett syndrome: a randomized placebo-controlled trial. Asian Clin Nutr. 2018;10(1):37–46. https://doi.org/10.3923/ajcn.2018.37.46.
Heidig S, Clarebout G. Do pedagogical agents make a difference to student motivation and learning? Educ Res Rev. 2011;6(1):27–54. https://doi.org/10.1016/j.edurev.2010.07.004.
Kim Y, Baylor A. Simulating instructional roles through pedagogical agents. I J Arti Intell Educa. 2005;15:95–115.
Payr S. The virtual university’s faculty: an overview of educational agents. Appl Arti Intell An. 2003;17(1):1–19. https://doi.org/10.1080/713827053.
Gangemi A, Caprì T, Fabio RA, Puggioni P, Falzone AM, Martino G. Transcranial Direct Current Stimulation (tDCS) and Cognitive Empowerment for the functional recovery of diseases with chronic impairment and genetic etiopathogenesis. In Kevin V. Urbano editors. Advances in Research. New York: Nova Science Publisher; 2018. ISBN: 978–153613265-6;978–153613264-9.
Fabio RA, Caprì T, Lotan M, Towey GE, Martino G. Motor abilities are related to the specific genotype in Rett Syndrome. In Kevin V. Urbano Editors. Advances in Genetics Research. New York: Nova Science Publisher; 2018. ISBN: 978–153613265-6;978–153613264-9.
Prosperi M, Min JS, Bian J, Modave F. Big data hurdles in precision medicine and precision public health. BMC Med Inform Decis Mak. 2018;18(1):139. https://doi.org/10.1186/s12911-018-0719-2.
Parker J, Mawson S, Mountain G, Nasr N, Zheng H. Stroke patients’ utilisation of extrinsic feedback from computer-based technology in the home: a multiple case study realistic evaluation. BMC Med Inform Decis Mak. 2014;46. https://doi.org/10.1186/1472-6947-14-46(1).
Iannizzotto G, Bello L, Nucita A, Grasso GM. A Vision and Speech Enabled, Customizable, Virtual Assistant for Smart Environments 11th International Conference on Human System Interaction (HSI) Gdansk 2018; 50–56. doi: https://doi.org/10.1109/HSI.2018.8431232.
Caprì T, Fabio RA, Iannizzotto G, Nucita A. The TCTRS project: A holistic approach for telerehabilitation in rett syndrome. Electronics (Switzerland). 2020;9:3.
Mohammadhasani N, Caprì T, Nucita A, Iannizzotto G, Fabio RA. Atypical visual scan path affects remembering in ADHD. J Int Neuropsychol Soc. 2020;26(6):557–66. https://doi.org/10.1017/S135561771900136X.
Iannizzotto G, La Rosa F, Costanzo C, Lanzafame P. A multimodal perceptual user interface for video-surveillance environments. Proceedings of the Seventh International Conference on Multimodal Interfaces, ICMI'05 2005; 45–52.
Iannizzotto G, Nucita A, Fabio RA, Capri T, Lo BL. Remote eye-tracking for cognitive telerehabilitation and interactive school tasks in times of COVID-19. Information. 2020;11(6):296–304. https://doi.org/10.3390/info11060296.
Capri T, Nucita A, Iannizzotto G, Stasolla F, Romano A, Semino M, et al. Telerehabilitation for improving adaptive skills of children and young adults with multiple disabilities: a systematic review. Rev J Autism Dev Disord. 2020:1–11. https://doi.org/10.1007/s40489-020-00214-x.
Lancioni G, Singh N, O'Reilly M, Sigafoos J, Boccasini A, La Martire ML, et al. People with multiple disabilities use assistive technology to perform complex activities at the appropriate time. Int J Disabi Hum Dev. 2016;15(3):261–6. https://doi.org/10.1515/ijdhd-2015-0012.
The authors thank the AIRETT and the CARI (Airett Center for innovation and Research) of Verona for the help in recruiting patients.
The authors received no funding for this work.
Ethics approval and consent to participate
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The study design was approved by the Human Ethics Committee of Cognitive Science, Psychological, Educational and Cultural Studies of the University of Messina (Protocol n. 20015_36). All the parents of the children who took part in the study signed a written consent form.
Consent for publication
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Fabio, R.A., Pergolizzi, G., Nucita, A. et al. The role of a virtual avatar in attention and memory tasks in Rett syndrome. BMC Neurol 21, 223 (2021). https://doi.org/10.1186/s12883-021-02212-w
- Rett syndrome