Logotipo Quality matters Ilustrações do cabeçalho

How?

Children exhibit different skills in different contexts and when facing different situations, hence it is useful to gather information from the adults that spend the most time with them, as well as to collect information directly through systematic observation. For data collection, we used several methods (direct evaluation and observation, survey) and several measures (questionnaires, games and activities).

DIRECT ASSESSMENT

CONSTRUCT

TEST AND MATERIALS

Selective attention

In a A3 sheet of paper filled with varied figures, children were asked to find and stamp, as fast as they could, first just the bunnies, and then, in a second trial, just the cats (assuming that they would ignore the distractors figures)1

Inhibitory control

In a first game, children were told that we had a surprise for them to play with, but we still had to wrap the surprise. We asked children not to peek until we were finished wrapping the surprise. After, children were asked to wait a little bit while we wrote something on a paper, with the present in front of them. Finally, children were allowed to unwrap the present and freely play with the toy for a while, being then asked to return it.2

In a second game, children were presented a little book, which showed one out of seven animals on each page. The child was asked to ring a bell every time he/she saw an animal, except if the animal was a pig. 3, 4

Working Memory

Six wooden animals were hidden in six boxes, and children were asked to find and retrieve each of the animal one by one (which meant remembering which boxes had already been opened and, therefore, were already empty).5

Language

Children were evaluated concerning receptive and expressive language, among other aspects. For example, children were asked to choose certain objects (receptive vocabulary), to name these and other objects (expressive vocabulary) and to describe a picture.6

OBSERVATION

CONSTRUCT

TEST AND MATERIALS

Children’s interactions with educators, peers and tasks

Through the videos recorded in the classrooms, we were able to observe children’s interactions with the educators, with peers and tasks.7

Educator-child interactions

Through the videos recorded in the classrooms, we were able to observe educators’ interactions with the group of children in two domains: Emotional and Behavioral Support and Engaged Support for Learning.8

Relato do educador

CONSTRUCT

QUESTIONNAIRE

Structural variables

Questions regarding educator’s training, work experience, age group, and group composition of the current children’s group. There were also questions concerning educators’ job satisfaction, perception of self-efficacy, organizational climate, and professional development. The questionnaire also contained questions about the educator’s approach, in crèche, to domains such as children’s self-regulation, mathematics, language and literacy, science and dramatic play, as well as the way they organized space and materials.9

Children’s social skills

The questionnaire is composed of dimensions such as “Cooperating skills” (e.g. Offers help to other children), “Empathy” (e.g. Is sensitive to the feelings of others), “Impulsivity” (e.g. Has temper outbursts or tantrums) and “Disruptive behavior” (e.g. Acts without thinking). The educator was asked to evaluate the frequency each child displayed the behaviors described in 13 items, using a 4-point scale (in which 1 meant “never” and 4 “very frequently”).10

Children’s social-emotional skills

To evaluate children’s social-emotional skills, 4 scales of the SEAM questionnaire were used – Independence (e.g. The child tries new tasks before seeking help); Regulation of Attention and Activity level (e.g. The child moves from one activity to another without problems); Cooperation with Daily Routines and Requests (e.g. The child cooperates with simple requests); Adaptative skills (e.g. The child accepts changes in routines and settings). The educator was asked to think how each item reflected the behavior of a specific child, using a 4-point scale (in which 1 represented “not true” and 4 represented “very true”).11

Children’s behaviour in the classroom (self-regulation)

From the CBRS scale, we only administered the “Learning-Related Social Skills” subscale (17 items). Within this subscale, we only used items related to children’s behavioral self-regulation (e.g. Takes time to do his/her best on a task). The educator was asked to evaluate the frequency of the described behaviors in each child, using a 5 points scale (in which 1 represented “never” and 5 represented “always”).12

Children autonomy support in the classroom

From the TASC questionnaire, we only used the “Autonomy Support” scale (12 items). This scale comprises the following domains “cohersive/ autoritarian behavior” (e.g. I have to lead this child through his/ her schoolwork step by step), “respect” (e.g. I let this child make a lot of his/her own decisions regarding schoolwork), “choice” (e.g. I try to give this child a lot of choices about classroom assignments) and “relevance” (I explain to this child why we learn certain things in school). The educator was asked to say how each item applied to each child’s autonomy, using a 4 points scale (in which 1 represented “not true” and 4 represented “very true”).13

Educator-child relationship

Educator-child relationship was evaluated with a 22 items questionnaire with 3 domains: closeness (e.g. I share an affectionate, warm relationship with this child), conflict (e.g. This child easily becomes angry with me) and dependency (e.g. This child reacts strongly to separation from me). The educator was asked to analyse how each of the items reflected his/her relationship with each child, using a 4 points scale (in which 1 represented “definitely does not apply” and 5 represented “definitely applies”).14

1 Korkman, M., Kirk, U., & Kemp, S. (1998). NEPSY: A Developmental Neuropsychological Assessment. San Antonio, TX: Psychological Corporation.

2 Smith-Donald, R., Raver, C. C., Hayes, T., & Richardson, B. (2007). Preliminary construct and concurrent validity of the Preschool Self-Regulation Assessment (PRSA) for field-based research. Early Childhood Research Quarterly, 22(2), 173–187. doi: 10.1016/j.ecresq.2007.01.002

3 Vitiello, V. E., & Greenfield, D. B. (2017). Executive functions and approaches to learning in predicting school readiness. Journal of Applied Developmental Psychology, 53, 1-9. doi: 10.1016/j.appdev.2017.08.004

4 Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Investigative Group (2010). The measurement of executive function at age 3 years: Psychometric properties and criterion validity of a new battery of tasks. Psychological Assessment, 22(2), 306–317. doi: 10.1037/a0018708.

5 Mulder, H., Hoofs, H., Verhagen, J., van der Veen, I., & Leseman, P. P. M. (2014). Psychometric properties and convergent and predictive validity of an executive function test battery for two-year-olds. Frontiers in Psychology, 5, [733]. doi: 10.3389/fpsyg.2014.00733

6 Griffiths, R. F. (2007). Griffiths - Escala de Desenvolvimento Mental de Griffiths (dos 2 aos 8 anos). Lisboa: CEGOC.

7 Slot, P. L., Bleses, D. & Downer, J. (2016). The Individualized Classroom Assessment Scoring System (inCLASS) [Unpublished pilot version for toddlers].

8 La Paro, K. M., Hamre, B. C., & Pianta, R. C. (2009). The Classroom Assessment Scoring System, Toddler Version. Charlottesville, VA: Teachstone.

9 Slot, P., Cadima, J., Salminen, J., Pastori, G., & Lerkkanen, M. (2016). Desenvolvido para o Projeto CARE

10 Junttila, N., Voeten, M., Kaukiainen, A., & Vauras, M. (2006). Multisource Assessment of Children's Social Competence. Educational and Psychological Measurement, 66(5), 874-895. doi: 10.1177/0013164405285546 

11 Squires, J., Bricker, D., Waddell, M., Funk, K., Clifford, J., & Hoselton, R. (2014). Social-Emotional Assessment/Evaluation Measure (SEAM), Research Edition. Paul H. Brookes Publishing Co., Inc.

12 Bronson, M. B., Goodson, B. D., Layzer, J. I., & Love, J. M. (1990). Child Behavior Rating Scale. Cambridge, MA: Abt Associates

13 Wellborn J., Connell, J., Skinner, E., & Pierson, L. (1992). Teacher as Social Context (TASC) - Two Measures of Teacher Provision of Involvement, Structure, and Autonomy Support. Technical Report, University of Rochester, Rochester, NY. 

14 Pianta R. C. (2001). Student-Teacher Relationship Scale: Professional Manual. Odessa, FL: Psychological Assessment Resources, Inc.