Children exhibit different skills in different contexts and when facing different situations, hence it is useful to gather information from the adults that spend the most time with them, as well as to collect information directly through systematic observation. For data collection, we used several methods (direct evaluation and observation, survey) and several measures (questionnaires, games and activities).
DIRECT ASSESSMENT
CONSTRUCT
TEST AND MATERIALS
Selective attention
In a A3 sheet of paper filled with varied figures, children were asked to find and stamp, as fast as they could, first just the bunnies, and then, in a second trial, just the cats (assuming that they would ignore the distractors figures)1
Inhibitory control
In a first game, children were told that we had a surprise for them to play with, but we still had to wrap the surprise. We asked children not to peek until we were finished wrapping the surprise. After, children were asked to wait a little bit while we wrote something on a paper, with the present in front of them. Finally, children were allowed to unwrap the present and freely play with the toy for a while, being then asked to return it.2
In a second
game, children were presented a little book, which showed one out of seven
animals on each page. The child was asked to ring a bell every time he/she saw
an animal, except if the animal was a pig. 3, 4
Working Memory
Six wooden animals were hidden in six boxes, and children were asked to find and retrieve each of the animal one by one (which meant remembering which boxes had already been opened and, therefore, were already empty).5
Language
Children
were evaluated concerning receptive and expressive language, among other
aspects. For example, children were asked to choose certain objects (receptive
vocabulary), to name these and other objects (expressive vocabulary) and to
describe a picture.6
OBSERVATION
CONSTRUCT
TEST AND MATERIALS
Children’s interactions with educators, peers and tasks
Through the videos recorded in the classrooms, we were able to observe children’s interactions with the educators, with peers and tasks.7
Educator-child interactions
Through the videos recorded in the
classrooms, we were able to observe educators’ interactions with the group of children
in two domains: Emotional and Behavioral Support and Engaged Support for
Learning.8
Relato do educador
CONSTRUCT
QUESTIONNAIRE
Structural variables
Questions regarding educator’s training, work experience, age group, and group composition of the current children’s group. There were also questions concerning educators’ job satisfaction, perception of self-efficacy, organizational climate, and professional development. The questionnaire also contained questions about the educator’s approach, in crèche, to domains such as children’s self-regulation, mathematics, language and literacy, science and dramatic play, as well as the way they organized space and materials.9
Children’s social skills
The questionnaire is composed of dimensions
such as “Cooperating skills” (e.g. Offers help to other children), “Empathy”
(e.g. Is sensitive to the feelings of others), “Impulsivity” (e.g. Has temper outbursts
or tantrums) and “Disruptive behavior” (e.g. Acts without thinking). The educator
was asked to evaluate the frequency each child displayed the behaviors described
in 13 items, using a 4-point scale (in which 1 meant “never” and 4 “very
frequently”).10
Children’s social-emotional skills
To evaluate children’s
social-emotional skills, 4 scales of the SEAM questionnaire were used – Independence
(e.g. The child tries new tasks before seeking help); Regulation of Attention and
Activity level (e.g. The child moves from one activity to another without
problems); Cooperation with Daily Routines and Requests (e.g. The child
cooperates with simple requests); Adaptative skills (e.g. The child accepts changes
in routines and settings). The educator was asked to think how each item
reflected the behavior of a specific child, using a 4-point scale (in which 1
represented “not true” and 4 represented “very true”).11
Children’s behaviour in the classroom (self-regulation)
From the CBRS scale, we only administered
the “Learning-Related Social Skills” subscale (17 items). Within this subscale,
we only used items related to children’s behavioral self-regulation (e.g. Takes
time to do his/her best on a task). The educator was asked to evaluate the
frequency of the described behaviors in each child, using a 5 points scale (in
which 1 represented “never” and 5 represented “always”).12
Children autonomy support in the classroom
From the TASC questionnaire, we only
used the “Autonomy Support” scale (12 items). This scale comprises the
following domains “cohersive/ autoritarian behavior” (e.g. I have to lead this
child through his/ her schoolwork step by step), “respect” (e.g. I let this
child make a lot of his/her own decisions regarding schoolwork), “choice” (e.g.
I try to give this child a lot of choices about classroom assignments) and
“relevance” (I explain to this child why we learn certain things in school).
The educator was asked to say how each item applied to each child’s autonomy,
using a 4 points scale (in which 1 represented “not true” and 4 represented
“very true”).13
Educator-child relationship
Educator-child relationship was
evaluated with a 22 items questionnaire with 3 domains: closeness (e.g. I share
an affectionate, warm relationship with this child), conflict (e.g. This child
easily becomes angry with me) and dependency (e.g. This child reacts strongly
to separation from me). The educator was
asked to analyse how each of the items reflected his/her relationship with each
child, using a 4 points scale (in which 1 represented “definitely does not
apply” and 5 represented “definitely applies”).14
1 Korkman, M., Kirk, U., & Kemp, S. (1998). NEPSY: A Developmental Neuropsychological Assessment. San Antonio, TX: Psychological Corporation.
2 Smith-Donald, R., Raver, C. C., Hayes, T., & Richardson, B. (2007). Preliminary construct and concurrent validity of the Preschool Self-Regulation Assessment (PRSA) for field-based research. Early Childhood Research Quarterly, 22(2), 173–187. doi: 10.1016/j.ecresq.2007.01.002
3 Vitiello,
V. E., & Greenfield, D. B. (2017). Executive functions and approaches to
learning in predicting school readiness. Journal
of Applied Developmental Psychology, 53, 1-9. doi: 10.1016/j.appdev.2017.08.004
4 Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Investigative Group (2010). The measurement of executive function at age 3 years: Psychometric properties and criterion validity of a new battery of tasks. Psychological Assessment, 22(2), 306–317. doi: 10.1037/a0018708.
5 Mulder, H., Hoofs, H., Verhagen, J., van der Veen, I., & Leseman, P. P. M. (2014). Psychometric properties and convergent and predictive validity of an executive function test battery for two-year-olds. Frontiers in Psychology, 5, [733]. doi: 10.3389/fpsyg.2014.00733
6 Griffiths, R. F. (2007). Griffiths - Escala de Desenvolvimento Mental de Griffiths (dos 2 aos 8 anos). Lisboa: CEGOC.
7 Slot, P. L., Bleses, D. & Downer, J. (2016). The Individualized Classroom Assessment Scoring System (inCLASS) [Unpublished pilot version for toddlers].
8 La Paro, K. M., Hamre, B. C., & Pianta, R. C. (2009). The Classroom Assessment Scoring System, Toddler Version. Charlottesville, VA: Teachstone.
9 Slot, P., Cadima, J., Salminen, J., Pastori, G., & Lerkkanen, M. (2016). Desenvolvido para o Projeto CARE
10 Junttila, N., Voeten, M., Kaukiainen, A., & Vauras, M. (2006). Multisource Assessment of Children's Social Competence. Educational and Psychological Measurement, 66(5), 874-895. doi: 10.1177/0013164405285546
11 Squires, J., Bricker, D., Waddell, M., Funk, K., Clifford, J., & Hoselton, R. (2014). Social-Emotional Assessment/Evaluation Measure (SEAM), Research Edition. Paul H. Brookes Publishing Co., Inc.
12 Bronson, M. B., Goodson, B. D., Layzer, J. I., & Love, J. M. (1990). Child Behavior Rating Scale. Cambridge, MA: Abt Associates
13 Wellborn J., Connell, J., Skinner, E., & Pierson, L. (1992). Teacher as Social Context (TASC) - Two Measures of Teacher Provision of Involvement, Structure, and Autonomy Support. Technical Report, University of Rochester, Rochester, NY.
14 Pianta R. C. (2001). Student-Teacher Relationship Scale: Professional Manual. Odessa, FL: Psychological Assessment Resources, Inc.