Research in Developmental Disabilities

Research in Developmental Disabilities 32 (2011) 693–698
Contents lists available at ScienceDirect
Research in Developmental Disabilities
What is the evidence for environmental causes of challenging behaviors
in persons with intellectual disabilities and autism spectrum disorders?
Johnny L. Matson *, Alison M. Kozlowski, Julie A. Worley, Mary E. Shoemaker,
Megan Sipes, Max Horovitz
Louisiana State University, USA
A R T I C L E I N F O
A B S T R A C T
Article history:
Received 1 October 2010
Accepted 29 October 2010
Available online 8 December 2010
An extensive literature on the causes of challenging behaviors has been developed,
primarily in the applied behavior analysis literature. One hundred and seventy-three
empirical studies were reviewed where functional assessment serves as the primary
method of identifying these causes. Most of the studies were able to identify a clear
function or functions. Most commonly established causes were attention, the efforts to
acquire tangibles, negative reinforcement in the form of escape from tasks or
environments, and sensory stimulation, also described as an alone condition. Examples
are provided regarding how these conditions are investigated across studies. Biological
and cognitive causes have also been demonstrated. However, to date the empirical
literature is limited with the bulk of studies being correlational. Considerably more
research is needed, but some causes and methods to identify them are beginning to
emerge.
! 2010 Elsevier Ltd. All rights reserved.
Keywords:
Challenging behaviors
QABF
Functional assessment
Experimental functional analysis
Maintaining variables
1. Introduction
Challenging behaviors (CB) occur in a range of developmental disabilities. A number of disorders are covered, but the two
most prevalent are intellectual disabilities (ID) and autism spectrum disorders (ASD) (Farmer & Aman, 2009; Matson &
Boisjoli, 2007, 2009a, 2009b; Matson & Nebel-Schwalm, 2007; Rojahn et al., 2009). Both of these problems are characterized
by deficits in social skills, adaptive functioning, and communication, which when present may further exacerbate CB (Cheng,
Chen, Tsai, Chen, & Cherng, 2009; Matson, Boisjoli, Gonza´lez, Smith, & Wilkins, 2007; Matson, Dempsey, & Rivet, 2009;
Matson, Rivet, Fodstad, Dempsey, & Boisjoli, 2009; Miniscalco & Gillberg, 2009; Wilkins & Matson, 2009). The overlap
between ID and ASD is also considerable, further compounding the problem (LoVullo & Matson, 2009; Matson, Dempsey, &
´ skarsdottir, & Gillberg, 2009).
Fodstad, 2009; Matson & Mahan, 2009; Matson & Shoemaker, 2009; Niklasson, Rasmussen, O
These problems are present at very early ages (Matson, Mahan, Hess, Fodstad, & Neal, 2010) and persist throughout the
lifetime (Embregts, Didden, Schreuder, Huitink, & Van Nieuwenhuijzen, 2009). These CB for persons with ID and/or ASD are a
primary impediment to independence, to community integration, and to how they are viewed by others (Emerson, 2005;
Gardner & Moffatt, 1990; Luiselli & Slocumb, 1983).
Intervention efforts have been largely conceptualized based on internal neurodevelopmental states associated with the
disorder or more overt environmental factors (Tenneij, Didden, Stolker, & Koot, 2009). In either case, obtaining accurate
* Corresponding author at: Department of Psychology, LSU, Baton Rouge, LA 70803, USA.
E-mail address: johnmatson@aol.com (J.L. Matson).
0891-4222/$ – see front matter ! 2010 Elsevier Ltd. All rights reserved.
doi:10.1016/j.ridd.2010.11.012
694
J.L. Matson et al. / Research in Developmental Disabilities 32 (2011) 693–698
information can be a challenge in and of itself and may require input from several care providers using standardized
measures (Lambrechts & Maes, 2009).
CB are among the most serious and studied problems in the field of developmental disabilities. Psychotropic medication
and applied behavior analysis are among the most frequently used treatments. The emergence of a functional assessment
literature has been helpful in identifying cases of CB that have environmental causes. These data are very important in
establishing whether an environmental or medical treatment would be the most appropriate. An analysis of current data on
type of CB, and patterns of causative factors are reviewed and discussed (de Leon, Greenlee, Barber, Sabaawi, & Singh, 2009;
Singh, Matson, Mouttapa, Pella, Hill, & Thorson, 2009; Soenen, Berkalaer-Onnes, & Scholte, 2009; Weeden, Ehrhardt, &
Poling, 2009).
2. Challenging behaviors: definition and prevalence
Several CB have been assessed with functional assessment. These include aggression, tantrums, handmouthing, property
destruction, stereotypies, and self-injurious behavior (Strachan, Shaw, Burrow, Horsler, Allen, & Oliver, 2009; Swender,
Matson, Mayville, Gonza´lez, & McDowell, 2006; Tiger, Fisher, Toussaint, & Kodak, 2009). These behaviors are socially
unacceptable and can be harmful to the persons, others, and/or the environment.
CB occur at very high rates in persons with developmental disabilities. Furthermore, these problems have proven to be
among the most frequent and hard to manage problems evinced by persons with developmental disabilities. For example,
94.3% of children on the autism spectrum have been reported to display some form of CB (Matson, Wilkins, & Macken, 2009).
CB are a frequent problem for persons with ID as well. Holden and Gitlesen (2006) reported rates of 10–15% in the United
States and Britain. Similarly, Jones et al. (2008) reported rates of 19–22% depending on the method of assessment used.
Conversely, other researchers have reported much higher rates. Murphy, Healy, and Leader (2009) found much higher rates
in their study focusing on individuals with ID in Ireland. They reported that 64% of their population evinced CB. Furthermore,
they note that many persons displayed multiple CB. Farmer and Aman (2010), in a United States study of CB in children with
ASD, found these problems in over half of their sample. In another study from the United States, Benson and Brooks (2008)
reported CB in over 50% of their ID sample. The variation in rates can be accounted for in large part by how CB are defined so
unevenly across studies. Thus, while debate exists on just how common these CB are in the ID and ASD populations, they
most certainly occur at high rates and are an issue deserving great attention.
3. Functions of challenging behaviors
By far the most commonly studied environmental factors have been via functional assessment methods. In a review of
SCOPUS, and a hand search of the Journal of Applied Behavior Analysis and Research in Developmental Disabilities, we identified
173 papers that used this methodology. In almost all cases, specifically 97% of those reviewed, one or more functions for the
CB were identified. The reader is undoubtedly aware that there is a marked bias in published research toward positive
findings. Thus, it is also likely that many papers did not find their way into print due to the inability to identify specific
functions. What that percentage is, relative to all studies conducted, however, is unknown and unknowable. What the
studies do reflect, however, are what the types of functions that are environmental look like, and the frequency with which
they appear when compared to other identified environment functions.
Functions of CB can be categorized into a few distinct categories. The traditionally reported maintaining variables as
described in the literature include attention, alone (i.e., self-stimulatory, non-social, or automatic reinforcement), escape,
and tangible. Pain or discomfort is also often discussed as a possible cause of CB, but this function has been rarely reported in
the experimental literature. In fact, within the current review, less than 5% of assessments resulted in a physical function
being identified. Furthermore, in cases in which a physical function was found to maintain the CB, it was commonly only one
of multiple functions identified where another function was determined to be the primary maintaining variable (e.g.,
Applegate, Matson, & Cherry, 1999). The most commonly reported functions are attention and escape. Attention and escape
functions were each found to maintain CB in nearly half of the papers reviewed. Tangibles were found to maintain CB in
nearly a quarter of papers reviewed, and alone conditions, also related to self-stimulatory behaviors, non-social functions,
and automatic reinforcement, were identified in just over a tenth of papers reviewed. Although the samples’ sizes and
characteristics, CB assessed, and methods of functional assessment were variable between papers, this information provides
a snapshot as to the relative frequency with which functions maintain CB overall.
Although single functions are often found to maintain CB, it is also relatively common for a CB to be maintained by
multiple functions. The most common co-occurring maintaining variables are attention coupled with either an escape or
tangible function (e.g., Kahng, Iwata, DeLeon, & Worsdell, 1997; O’Reilly et al., 2006; Tarbox, Wallace, & Williams, 2003),
although tangible and escape functions may also co-occur at relatively high rates as well (e.g., Mace, Shapiro, & Mace, 1998;
Wilder, Chen, Atwell, Pritchard, & Weinstein, 2006). In some circumstances, several functions are identified as maintaining
variables or the function is ambiguous (e.g., Carter, 2009; Smith, Iwata, Vollmer, & Pace, 1992). Such findings may indicate an
overall communication function for the CB (Carr & Durand, 1985), or perhaps that the CB appears to occur in nearly all
situations because it is automatically reinforced.
Within the literature, similar functions are consistently reported for specific CB following a functional assessment. From
the current review of 173 papers, the most commonly assessed CB were aggression and self-injurious behavior. For both of
695
J.L. Matson et al. / Research in Developmental Disabilities 32 (2011) 693–698
Table 1
Functions identified across all 173 studies.a
Attention
Alone
Escape
Tangible
Multiple functions
88
27
72
41
66
a
A list of complete references for papers reviewed and their functions identified is available upon request.
these behaviors, the most commonly identified maintaining variables were those providing social consequences, to include
attention, escape, and tangible functions. See Table 1 for a breakdown of number of studies that identified attention, escape,
alone, and tangible functions as well as how many studies found multiple functions.
4. Function descriptions
Variability of definition occurred occasionally for each function from study to study. Differences among definitions may
affect the generalizability of findings. Additionally, assessing the same function in different manners may also demonstrate
subtypes of functions. Examples of some of the components of these definitions should give researchers and clinicians a favor
of what is being reported, aid clinicians as they look for maintaining variables, and aid in developing treatment plans.
4.1. Attention
Attention refers to reciprocal social interactions between the person evincing the CB and another. Invariably the other is a
caretaker, parent, or teacher in the published literature. Rarely does the challenging individual seek out peers for attention via CB.
Perhaps the most common type of attention used during functional assessment involves reprimands. For example, Fisher,
DeLeon, Rodriguez-Catter, and Keeney (2004) instructed the therapist to read a magazine while the client was to play with
moderately preferred toys. Contingent on her CB, the therapist provided a brief verbal reprimand on a fixed-ratio schedule.
Kuhn and Triggs (2009) also delivered attention in the form of verbal reprimands. Dixon, Benedict, and Larson (2001)
describe attention in the form of 10 s of verbal attention such as ‘‘You know you should not say things like that.’’ Similarly,
Piazza et al. (1999) delivered attention in the form of a brief verbal reprimand contingent upon targeted CB. Likewise,
DeLeon, Arnold, Rodriguez-Catter, and Uy (2003) reinforced bizarre speech by providing verbal attention such as ‘‘Jeremy, it
doesn’t make sense to say [bizarre statement].’’ These authors use the same model as the previous authors, an effort by
therapists to provide an approximation of how care providers might react as the CB is actually occurring.
Other authors have taken a tact that is a bit different. Roane and Kelley (2008) defined physical attention as consisting of
holding onto a therapist following engagement in CB with no other form of attention being given. Anderson and Long (2002)
describe attention as noninstructional. Their verbal attention included reprimands, but also verbal statements toward the
child such as ‘‘You look nice today,’’ along with physical interactions in the form of hugs, pats on the shoulders, and the like.
Similarly, for Watson and Sterling (1998) parents made brief comments within 2–5 s after the target behavior. Attention
delivered in these fashions brings into play the possibility of specific forms of attention driving the CB. For example, in these
situations the idea of attention itself being delivered contingent on CB without the CB being acknowledged is assessed, as
opposed to contingent attention related to the CB (e.g., commenting on the CB).
4.2. Alone
The alone condition consists of no external prompts. Thus, the point is to determine if external environmental factors
versus other person-specific (referring to the client here) factors are driving the CB. Kennedy and Souza (1995) describe their
alone condition as no attention, which is the most common definition. In this phase, the client was seated at a table and
received no social interaction or activities. For Ellingson et al. (2000), the alone condition consisted of a child sitting in the
living room watching television without her mother present. Northup et al. (1999) describe their alone condition as a no
interaction condition where children were to stay in their classroom seated and work quietly. On the other hand, Piazza,
Adelinis, Hanley, Goh, and Delia (2000) describe their alone condition as the absence of social sequences where the client was
in the therapy room by him/herself. In most instances the person being assessed in the alone condition by him/herself, is not
given access to social interaction or tangibles. Having said that, the environments in which these conditions are presented
does vary widely.
The exception to the no attention paradigm is where clinicians are trying to pinpoint specific stimuli that may be the
primary self-stimulating reinforcer. This approach is in a gray area. Patel, Carr, Kim, Robles, and Eastridge (2000), for
example, provide different conditions to determine sensory stimuli that are driving the CB. They played a sound recording
that had been occurring simultaneously with the CB in the natural environment. When the client evinced the CB during the
experimental functional analysis, the therapist played the tape recording. They also employed two vibratory conditions; a
vibrating toothbrush and vibrating candy holder. For a second client, noncontingent forehead stimulation via a manual head
massager was provided.
Given the contingent access to sensory items which may be self-stimulating in the nature which they are used, this
method might also be viewed as a tangible function or a method of establishing replacement behaviors. No matter how this
696
J.L. Matson et al. / Research in Developmental Disabilities 32 (2011) 693–698
method is characterized, however, it is an important and useful approach. Rather than simply looking at automatic
reinforcement the individual might receive completely void of external components, this model assesses the possibility of
specific sensations reinforcing the CB.
4.3. Escape
Escape is defined as a negative reinforcement paradigm. The client displays CB and is able to get out of a task or
environment. A subtype of this condition is referred to as a demand condition. Butler and Luiselli (2007) describe a demand
condition for a child in a classroom. Instructions were delivered to the child, and the child was given 5 s to respond to the
demand. If the child did not begin to do schoolwork within the 5 s timeframe, the teacher demonstrated the correct response,
waited an additional 5 s, and if needed then guided the student using hand-over-hand prompts. Contingent on CB, tasks were
removed and the teacher turned away, thus fulfilling the escape function. Lalli et al. (1999) describe their condition as escape,
but it is very similar to Butler and Luiselli (2007). The therapist provided an instruction every 30 s using a graduated prompt
sequence with verbal directions, gestures, and physical prompts and an interprompt interval of 10 s. Each occurrence of CB
resulted in a 30 s break from the task. Horner, Day, and Day (1997) also use a similar methodology. Escape from an academic
task was awarded by removing the activity for 30 s contingent on CB.
O’Reilly, Lacey, and Lancioni (2000) also describe a demand condition. Preschool instructional tasks were presented by
the mother in what the authors describe as semirandom. Contingent on CB, tasks were removed for 5 s and then the task was
reintroduced. Similarly, Ervin, DuPaul, Kern, and Friman (1998) note that CB occurred for their client when he was presented
with a pencil-and-paper writing task; he would engage in off-task behavior. Thus, the bulk of the published research on
escape involved academic activities.
4.4. Tangible
This condition consists of presenting the client with an edible, toy, or other item contingent on CB. Ringdahl et al. (2009)
defined their tangible condition as therapist delivery of highly preferred items contingent on CB. Lindberg, Iwata, Roscoe,
Worsdell, and Hanley (2003) refer to a highly preferred leisure item as the factor maintaining CB for a client at the sheltered
workshop. Tangible items also maintained the CB of two children with developmental disabilities (Kang et al., 2010).
Mueller, Wiczynski, Moore, Fusilier, and Trahant (2001) gave access to a preferred book for 30 s each time the boy in their
study evinced CB. While Piazza et al. (2003) gave the child in their study preferred food or toys following inappropriate
behavior. Thus, the tangible condition is relatively consistent across studies compared to the other traditional functions.
5. Findings and conclusions
Biological, cognitive, and operant/environmental models have been proposed to explain CB and to drive treatments
(Holden & Gitlesen, 2009; Matson & Boisjoli, 2009b; Ringdahl et al., 2009). Having said this, surprisingly little research has
been focused on these factors in comparison to the vast amounts of assessment, treatment, and genetic research.
Additionally, for the research that has been published, the bulk of the efforts have centered on operant/environmental
explanations. And, the topography of the behavior in part determines the type of environmental precursor. So, for example,
with aggression, attention is the most commonly identified cause of problem behavior. Conversely, with self-injury, escape is
the most likely explanation.
Table 1 provides data from the studies we reviewed. We found attention and escape to be the most common functions
across the board, and for many studies researchers reported multiple functions.
Commonly identified causes for motivating and maintaining CB include attention, escape (often from demands), selfstimulation, and seeking tangible items such as food or toys. Often more than one function has been identified for a specific
CB. While these explanations for CB do not result in the identification of causes for all problem behaviors in the area of
developmental disabilities, they do explain the preponderance of these CB. Furthermore, validation studies have shown that
when treatments are tailored to identify environmental causes, the treatments proved to be more effective.
A second line of research has been more descriptive/correlational in nature. A number of studies have identified factors
that are predictive of CB. These variables include level of intellectual disability, presence and severity of autism, age, and
comorbid psychopathology, particularly impulse related disorders such as attention-deficit/hyperactivity disorder.
However, whether these disorders are the sole cause or more likely a contributing factor has yet to be studied extensively.
Issues such as intellectual disability result in poor attention seeking skills and other factors that could contribute to CB. In
these cases, intellectual disability may contribute in a more indirect fashion to the CB.
A third and much more rare cause of CB is biological determinants. Researchers know that very rare conditions such as
Lesch–Nyhan syndrome result in very serious self-injury that is largely caused by the syndrome (Anderson, Dancis, & Alpert,
1978). In such circumstances, the CB may present as if it were automatically reinforcing the individual due to the internal
mechanism driving the behavior. In such cases, the results of a functional assessment may help identify co-occurring
functions to further assist in identifying treatments.
Overall, the functional assessment literature continues to grow with more evidence accumulating to support its
effectiveness in producing valuable treatments. Although a number of functions may exist, the majority of maintaining
J.L. Matson et al. / Research in Developmental Disabilities 32 (2011) 693–698
697
variables relate to social consequences which can, relative to non-social variables, and can be easily treated if functions are
accurately identified. The current review demonstrates this heavy influence on social consequences with respect to CB,
especially with respect to specific challenging behaviors.
References
Anderson, L., Dancis, J., & Alpert, M. (1978). Behavioral contingencies and self-mutilation in Lesch–Nyhan disease. Journal of Consulting and Clinical Psychology, 46,
529–536.
Anderson, C. M., & Long, E. S. (2002). Use of a structured descriptive assessment methodology to identify variables affecting problem behavior. Journal of Applied
Behavior Analysis, 35, 137–154.
Applegate, H., Matson, J. L., & Cherry, K. E. (1999). An evaluation of functional variables affecting severe problem behaviors in adults with mental retardation by
using the questions about behavioral function scale (QABF). Research in Developmental Disabilities, 20, 229–237.
Benson, B. A., & Brooks, W. T. (2008). Aggressive challenging behaviour and intellectual disability. Current Opinion in Psychiatry, 21, 454–458.
Butler, L. R., & Luiselli, J. K. (2007). Escape-maintained problem behavior in a child with autism: Antecedent functional analysis and intervention evaluation of
noncontingent escape and instructional fading. Journal of Positive Behavior Interventions, 9, 195–202.
Carr, E. G., & Durand, V. M. (1985). Reducing behavior problems through functional communication training. Journal of Applied Behavior Analysis, 18, 111–126.
Carter, S. L. (2009). Use of treatment analysis following ambiguous functional analysis results. Behavioral Interventions, 24, 205–213.
Cheng, H.-C., Chen, H.-Y., Tsai, C.-L., Chen, Y.-J., & Cherng, R.-J. (2009). Comorbidity of motor and language impairments in preschool children of Taiwan. Research in
Developmental Disabilities, 30, 1054–1061.
DeLeon, I. G., Arnold, K. L., Rodriguez-Catter, V., & Uy, M. L. (2003). Covariation between bizarre and nonbizarre speech as a function of the content of verbal
attention. Journal of Applied Behavior Analysis, 36, 101–104.
de Leon, J., Greenlee, B., Barber, J., Sabaawi, M., & Singh, N. N. (2009). Practice guidelines for the use of new generation antipsychotic drugs (except clozapine) in
adult individuals with intellectual disabilities. Research in Developmental Disabilities, 30, 613–669.
Dixon, M. R., Benedict, H., & Larson, T. (2001). Functional analysis and treatment of inappropriate verbal behavior. Journal of Applied Behavior Analysis, 34, 361–363.
Ellingson, S. A., Miltenberger, R. G., Stricker, J. M., Garlinghouse, M. A., Roberts, J., Galensky, T. L., et al. (2000). Analysis and treatment of finger sucking. Journal of
Applied Behavior Analysis, 33, 41–52.
Embregts, P. J. C. M. , Didden, R., Schreuder, N., Huitink, C., & Van Nieuwenhuijzen, M. (2009). Aggressive behavior in individuals with moderate to borderline
intellectual disabilities who live in a residential facility: An evaluation of functional variables. Research in Developmental Disabilities, 30, 682–688.
Emerson, E. (2005). Challenging behaviour: Analysis and intervention with people with learning difficulties. Cambridge: Cambridge University Press.
Ervin, R. A., DuPaul, G. J., Kern, L., & Friman, P. C. (1998). Classroom-based functional and adjunctive assessments: Proactive approaches to intervention selection
for adolescents with attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis, 31, 65–78.
Farmer, C. A., & Aman, M. G. (2009). Development of the children’s scale of hostility and aggression: Reactive/proactive (C-SHARP). Research in Developmental
Disabilities, 30, 1155–1167.
Farmer, C. A., & Aman, M. G. (2010). Aggressive behavior in a sample of children with autism spectrum disorders. Research in Autism Spectrum Disorders
doi:10.1016/j.rasd.2010.04.014.
Fisher, W. W., DeLeon, I. G., Rodriguez-Catter, V., & Keeney, K. M. (2004). Enhancing the effects of extinction on attention-maintained behavior through
noncontingent delivery of attention or stimuli identified via a competing stimulus assessment. Journal of Applied Behavior Analysis, 37, 171–184.
Gardner, W. I., & Moffatt, C. W. (1990). Aggressive behaviour: Definition, assessment, treatment. International Review of Psychiatry, 2, 91–100.
Holden, B., & Gitlesen, J. P. (2006). A total population study of challenging behaviour in the county of Hedmark, Norway: Prevalence, and risk markers. Research in
Developmental Disabilities, 27, 456–465.
Holden, B., & Gitlesen, J. P. (2009). The overlap between psychiatric symptoms and challenging behaviour: A preliminary study. Research in Developmental
Disabilities, 30, 210–218.
Horner, R. H., Day, H. M., & Day, J. R. (1997). Using neutralizing routines to reduce problem behaviors. Journal of Applied Behavior Analysis, 30, 601–614.
Jones, S., Cooper, S. A., Smiley, E., Allan, L., Williamson, A., & Morrison, J. (2008). Prevalence of and factors associated with problem behaviors in adults with
intellectual disabilities. Journal of Nervous and Mental Disease, 196, 678–868.
Kahng, S. W., Iwata, B. A., De Leon, I. G., & Worsdell, A. S. (1997). Evaluation of the ‘‘control over reinforcement’’ component in functional communication training.
Journal of Applied Behavior Analysis, 30, 267–277.
Kang, S., Lang, R. B., O’Reilly, M. F., Davis, T. N., Machalicek, W., Rispoli, M. J., et al. (2010). Problem behavior during preference assessments: An empirical analysis
and practical recommendations. Journal of Applied Behavior Analysis, 43, 137–141.
Kennedy, C. H., & Souza, G. (1995). Functional analysis and treatment of eye poking. Journal of Applied Behavior Analysis, 28, 27–37.
Kuhn, S. A. C., & Triggs, M. (2009). Analysis of social variables when an initial functional analysis indicates automatic reinforcement as the maintaining variables
for self-injurious behavior. Journal of Applied Behavior Analysis, 42, 679–683.
Lalli, J. S., Vollmer, T. R., Progar, P. R., Wright, C., Borrero, J., Daniel, D., et al. (1999). Competition between positive and negative reinforcement in the treatment of
escape behavior. Journal of Applied Behavior Analysis, 32, 285–296.
Lambrechts, G., & Maes, B. (2009). Analysis of staff reports on the frequency of challenging behaviour in people with severe or profound intellectual disabilities.
Research in Developmental Disabilities, 30, 863–872.
Lindberg, J. S., Iwata, B. A., Roscoe, E. M., Worsdell, A. S., & Hanley, G. P. (2003). Treatment efficacy of noncontingent reinforcement during brief and extended
application. Journal of Applied Behavior Analysis, 36, 1–19.
LoVullo, S. V., & Matson, J. L. (2009). Comorbid psychopathology in adults with autism spectrum disorders and intellectual disabilities. Research in Developmental
Disabilities, 30, 1288–1296.
Luiselli, J. K., & Slocumb, P. R. (1983). Management of multiple aggressive behaviors by differential reinforcement. Journal of Behavior Therapy and Experimental
Psychiatry, 14, 343–347.
Mace, A. B., Shapiro, E. S., & Mace, F. C. (1998). Effects of warning stimuli for reinforcer withdrawal and task onset of self injury. Journal of Applied Behavior Analysis,
31, 679–682.
Matson, J. L., & Boisjoli, J. A. (2007). Multiple versus single maintaining factors of challenging behaviors as assessed by the QABF for adults with intellectual
disabilities. Journal of Intellectual and Developmental Disability, 32, 39–44.
Matson, J. L., & Boisjoli, J. A. (2009a). An overview of developments in research on persons with intellectual disabilities. Research in Developmental Disabilities, 30,
587–591.
Matson, J. L., & Boisjoli, J. A. (2009b). The token economy for children with intellectual disability and/or autism: A review. Research in Developmental Disabilities, 30,
240–248.
Matson, J. L., Boisjoli, J. A., Gonza´lez, M. L., Smith, K. R., & Wilkins, J. (2007). Norms and cut off scores for the Autism Spectrum Disorders Diagnosis for Adults (ASDDA) with intellectual disability. Research in Autism Spectrum Disorders, 1, 330–338.
Matson, J. L., Dempsey, T., & Fodstad, J. C. (2009). The effect of autism spectrum disorders on adaptive independent living skills in adults with severe intellectual
disability. Research in Developmental Disabilities, 30, 1203–1211.
Matson, J. L., Dempsey, T., & Rivet, T. T. (2009). The interrelationships of psychopathology symptoms on social skills in adults with autism or PDD-NOS and
intellectual disability. Journal of Developmental and Physical Disabilities, 21, 39–55.
Matson, J. L., & Mahan, S. (2009). Current status of research on childhood disintegrative disorder. Research in Autism Spectrum Disorders, 3, 861–867.
698
J.L. Matson et al. / Research in Developmental Disabilities 32 (2011) 693–698
Matson, J. L., Mahan, S., Hess, J. A., Fodstad, J. C., & Neal, D. (2010). Progression of challenging behaviors in children and adolescents with autism spectrum disorders
as measured by the autism spectrum disorders–problem behaviors for children (PBC). Research in Autism Spectrum Disorders, 4, 400–404.
Matson, J. L., & Nebel-Schwalm, M. (2007). Assessing challenging behaviors in children with autism spectrum disorders: A review. Research in Developmental
Disabilities, 28, 567–579.
Matson, J. L., Rivet, T. T., Fodstad, J. C., Dempsey, T., & Boisjoli, J. A. (2009). Examination of adaptive behavior differences in adults with autism spectrum disorders
and intellectual disabilities. Research in Developmental Disabilities, 30, 1317–1325.
Matson, J. L., & Shoemaker, M. (2009). Intellectual disability and its relationship to autism spectrum disorders. Research in Developmental Disabilities, 30, 1107–
1114.
Matson, J. L., Wilkins, J., & Macken, J. (2009). The relationship of challenging behaviors to severity and symptoms of autism spectrum disorders. Journal of Mental
Health Research in Intellectual Disabilities, 2, 29–44.
Miniscalco, C., & Gillberg, C. (2009). Non-word repetition in young school-age children in language impairment and/or neuropsychiatric disorder. Research in
Developmental Disabilities, 30, 1145–1154.
Mueller, M. M., Wilczynski, S. M., Moore, J. W., Fusilier, I., & Trahant, D. (2001). Antecedent manipulations in a tangible condition: Effects of stimulus preference on
aggression. Journal of Applied Behavior Analysis, 34, 237–240.
Murphy, O., Healy, O., & Leader, G. (2009). Risk factors for challenging behaviors among 157 children with autism spectrum disorders in Ireland. Research in Autism
Spectrum Disorders, 3, 474–482.
Niklasson, L., Rasmussen, P., O’skardo´Hir, S., & Gillberg, C. (2009). Autism, ADHD, mental retardation and behavior problems in 100 individuals with 22q11
deletion syndrome. Research in Developmental Disabilities, 30, 763–773.
Northup, J., Fusilier, L., Swanson, V., Huete, J., Bruce, T., Freeland, J., et al. (1999). Further analysis of the separate and interactive effects of methylphenidate and
common classroom contingencies. Journal of Applied Behavior Analysis, 32, 35–50.
O’Reilly, M. F., Lacey, C., & Lancioni, G. E. (2000). Assessment of the influence of background noise on escape-maintained problem behavior and pain behavior in a
child with Williams syndrome. Journal of Applied Behavior Analysis, 33, 511–514.
O’Reilly, M. F., Sigafoos, J., Edrisinha, C., Lancioni, G., Cannella, H., Choi, H. Y., et al. (2006). A preliminary examination of evocative effects of the establishing
operation. Journal of Applied Behavior Analysis, 39, 239–242.
Patel, M. R., Carr, J. E., Kim, C., Robles, A., & Eastridge, D. (2000). Functional analysis of aberrant behavior maintained by automatic reinforcement: Assessment of
specific sensory reinforcers. Research in Developmental Disabilities, 21, 393–407.
Piazza, C. C., Bowman, L. G., Contrucci, S. A., Delia, M. D., Adelinis, J. D., & Goh, H. L. (1999). An evaluation of the properties of attention as reinforcement for
destructive and inappropriate behavior. Journal of Applied Behavior Analysis, 32, 437–449.
Piazza, C. C., Adelinis, J. D., Hanley, G. P., & Delia, M. D. (2000). An evaluation of the effects of matched stimuli on behaviors maintained by automatic
reinforcement. Journal of Applied Behavior Analysis, 33, 13–27.
Piazza, C. C., Fisher, W. W., Brown, K. A., Shore, B. A., Patel, M. R., Katz, R. M., et al. (2003). Functional analysis of inappropriate mealtime behaviors. Journal of
Applied Behavior Analysis, 36, 187–204.
Ringdahl, J. E., Falcomata, T. S., Christensen, T. J., Bass-Ringdahl, S. M., Lentz, A., Dutt, A., et al. (2009). Evaluation of a pre-treatment assessment to select mand
topographies for functional communication training. Research in Developmental Disabilities, 30, 330–341.
Roane, H. S., & Kelley, M. E. (2008). Decreasing problem behavior associated with a walking program for an individual with developmental and physical
disabilities. Journal of Applied Behavior Analysis, 41, 423–428.
Rojahn, J., Matson, J. L., Mahan, S., Fodstad, J. C., Knight, C., Sevin, J. A., et al. (2009). Cutoffs, norms, and patterns of problem behaviors in children with an ASD on
the baby and infant screen for children with aUtIsm traits (BISCUIT- Part 3). Research in Autism Spectrum Disorders, 3, 989–998.
Singh, A. N., Matson, J. L., Mouttapa, M., Pella, P. D., Hill, B. D., & Thorson, R. (2009). A critical item analysis of the QABF: Development of a short form assessment
instrument. Research in Developmental Disabilities, 30, 782–792.
Smith, R. G., Iwata, B. A., Vollmer, T. R., & Pace, G. M. (1992). On the relationship between self-injurious behavior and self-restraint. Journal of Applied Behavior
Analysis, 25, 433–445.
Soenen, S., Van Berckelar-Onnes, I., & Scholte, E. (2009). Patterns of intellectual, adaptive and behavioral functions in individuals with mild mental retardation.
Research in Developmental Disabilities, 30, 433–444.
Strachan, R., Shaw, R., Burrow, C., Horsler, K., Allen, D., & Oliver, C. (2009). Experimental functional analysis of aggression in children with Angelman syndrome.
Research in Developmental Disabilities, 30, 1095–1106.
Swender, S. L., Matson, J. L., Mayville, S. B., Gonzalez, M. L., & McDowell, D. (2006). A functional assessment of handmouthing among persons with severe and
profound intellectual disability. Journal of Intellectual and Developmental Disability, 31, 95–100.
Tarbox, R. S. F., Wallace, M. D., & Williams, L. (2003). Assessment and treatment of elopement: A replication and extension. Journal of Applied Behavior Analysis, 36,
239–244.
Tenneij, N. H., Didden, R., Stolker, J. J., & Koot, H. M. (2009). Markers for aggression in inpatient treatment facilities for adults with mild to borderline intellectual
disability. Research in Developmental Disabilities, 30, 1248–1257.
Tiger, J. H., Fisher, W. W., Toussaint, K. A., & Kodak, T. (2009). Progressing from initially ambiguous functional analyses: Three case examples. Research in
Developmental Disabilities, 30, 910–926.
Watson, T. S., & Sterling, H. E. (1998). Brief functional analysis and treatment of a vocal tic. Journal of Applied Behavior Analysis, 31, 471–474.
Weeden, M., Ehrherdt, K., & Poling, A. (2009). Conspicuous by their absence: Studies comparing and combining risperidone and applied behavior analysis to
reduce challenging behaviors in children with autism. Research in Autism Spectrum Disorders, 3, 905–912.
Wilder, D. A., Chen, L., Atwell, J., Pritchard, J., & Weinstein, P. (2006). Brief functional analysis and treatment of tantrums associated with transition in preschool
children. Journal of Applied Behavior Analysis, 39, 103–107.
Wilkins, J., & Matson, J. L. (2009). A comparison of social skills profiles in intellectually disabled adults with and without ASD. Behavior Modification, 33, 143–155.