The Observer XT 12 Quick Start Guide Human
Transcription
The Observer XT 12 Quick Start Guide Human
The Observer® XT The neXT generation of observation software Quick Start Guide | Human Research Version 12 Innovative solutions for behavioral research Quick Start Guide The Observer XT Version 12 Using The Observer XT for the study of human behavior Information in this document is subject to change without notice and does not represent a commitment on the part of Noldus Information Technology b.v. The software described in this document is furnished under a license agreement. The software may be used or copied only in accordance with the terms of the agreement. Copyright © 2014 Noldus Information Technology b.v. All rights reserved. No part of this publication may be reproduced, transmitted, transcribed, stored in a retrieval system, or translated into any other language in whole or in part, in any form or by any means, without the written permission of Noldus Information Technology b.v. Documentation: Fabrizio Grieco, Patrick Zimmerman, Leanne Loijens, Olga Krips. The Observer is a registered trademark of Noldus Information Technology b.v. Other product names are trademarks of their respective companies. April 2014 Noldus Information Technology b.v. International headquarters Wageningen, The Netherlands Phone: +31-317-473300 Fax: +31-317-424496 E-mail: info@noldus.nl For addresses of our other offices and support, please see our web site www.noldus.com. 1 Up and running quickly Working with The Observer XT consists of three main steps. These three steps are visible in the main window of The Observer XT that opens once you have created a project. In step 1 you define all the necessary settings for your observations. In step 2 you collect all you data. And in step 3 you analyze your data. To open one of the tabs of The Observer XT overview window, click the folder Setup, Observations, or Analyses in the Project Explorer on the left side of your screen. 4 Up and running quickly This Quick Start Guide guides you through these main steps. Only the most basic features of The Observer XT are addressed. Inevitably, some features that may be vital to your application are not discussed. Where possible, the Reference Manual is referred to for additional information. video tutorial To get you going, you can also watch the video tutorial. You can open this tutorial within The Observer XT. From the Help menu, select Video Tutorial. Watch it to learn about how to set up an observational study in The Observer XT. Up and running quickly 5 2 Step 1 - Define all settings creating a new project To create a new project, press Ctrl+N or from the File menu select New Project, or click Create new blank project in the startup window. Then: 1. Create settings for your project. 2. Make your Coding Scheme with everything you want to observe. 3. Define Independent Variables, which are factors that remain constant throughout one observation, like temperature, or gender and age of your test participants. Click the option to create the settings for that part. Observation source Under Observation source, choose whether you want to observe offline from a video file, or carry out the observation directly while the behaviors occur. If you carry out a live observation, you can let The Observer XT simultaneously create a video file. Connect your camera to the computer with The Observer XT and click the Devices button to select your camera. 6 Step 1 - Define all settings Observation method Under Observation method, choose Continuous sampling. You get a full record of the absolute durations and frequencies of behaviors. Select one of the other options if you want to score at regular time intervals. You will then get frequencies of behaviors, not durations. Step 1 - Define all settings 7 create a coding scheme Subjects If you study only one person in each observation, do not define subjects in the coding scheme. Enter their identity in the independent variables list (see page 13). If you study more than one person in one observation, define their role as subjects in the coding scheme (see below) and their identity in the independent variables list (see page 13). Define Subjects in Coding Scheme You observe multiple persons and observe different people in each observation. Define the role of your persons as subjects in the coding scheme. For each observation, define the identity of the persons in the Independent Variables list. For example, you are interested in the interaction between a manager and an employee. In each observation you observe a different manager and employee. Define the roles Manager and Employee as subjects in the Coding Scheme. Enter the identity of the individual test persons for each observation in the Independent variables list. See page 13 how to create an independent variables list. 8 Step 1 - Define all settings Behaviors Define the behaviors that you are interested in and the key codes with which you want to score. The behaviors must be organized in groups. Step 1 - Define all settings 9 State events and Point events There are two types of behaviors, State events and Point events. State events are behaviors that have a duration, like Walking or Playing. Point events do not have a duration, or their duration is not important. Examples are Answer Yes, or User error.. Mutually exclusive and Start-Stop There are two types of groups with behaviors. A mutually exclusive group is the easiest to work with. In a mutually exclusive group the start of a new behavior automatically stops the previous behavior and always one behavior is active. You only have a key code for the start of each behavior. If there are gaps between the behaviors, define a behavior like Other behavior, to make sure always one behavior is active. If it is not possible to define a mutually exclusive group, or if you only have point Events, create a Start-stop group. In such a group you define a key code for both the start of a behavior and its stop. In such a group there may be time periods in which no behavior occurs or in which behaviors within the same group overlap. 10 Step 1 - Define all settings Modifiers Optionally define Modifiers. Modifiers define the behaviors more precisely. They can consist of text (nominal modifiers), or numbers (numerical). For nominal modifiers, you can calculate for example durations and frequencies. For numerical modifiers you can calculate additional statistics, like mean values. Since scoring modifiers requires pressing extra keys, which makes scoring slower, it is recommended not to define modifiers if it is not necessary. See below how to define only behaviors instead. Step 1 - Define all settings 11 However, in some cases it is necessary to define modifiers. When you want to calculate minimum, maximum and mean values of modifiers, you need numerical modifiers. Also the coding scheme may become impractically large if you define only behaviors and no modifiers. If the Modifiers column is not shown in your Coding Scheme, click View Settings on the upper-right part of your screen and select Modifiers. To specify for which behaviors you want to score the modifiers, double-click the modifier group name and select to which behavior the modifier must be linked. For more information on how to create a Coding Scheme, see Section 3.5 of The Observer XT Reference Manual. 12 Step 1 - Define all settings independent variables Independent Variables are factors that can potentially influence the observation, and are assumed to remain constant for a certain subject (like a test person’s ID) or an observation session (like temperature). Define the variables that are important for your study (for example, the experimental treatment or the social group size). Click Add Variable to enter your Independent Variables. For more information on Independent Variables, see Section 3.6 of The Observer XT Reference Manual. Step 1 - Define all settings 13 3 Step 2 - Acquire your data This chapter guides you through the steps to acquire your data. First, you create an observation. Then you carry out your observation. To create a new observation, click Create a new observation in the Observe tab of The Observer XT overview window. Give the observation a name and select your video/audio files. Position the video to where you want to start your observation. general procedure If you defined mutually exclusive behaviors, Initial State Events appear in the event log. If these behaviors are not the ones that are active when you start scoring, change them to correct ones. You can do this by pressing the key for the correct behaviors. If you have modifiers linked to your behaviors, score these as well. 14 Step 2 - Acquire your data Press the Start observation button to start observing. If you chose to enter the Independent Variables before your observation, the Independent Variables window now opens. Step 2 - Acquire your data 15 Enter the values and click OK. Score the observation by pressing the keys of your keyboard. In the Codes window you can see which of the elements you should score next, Subject, Behavior or Modifier. Once you scored the subject, the tab Behaviors opens. Similarly, once you scored behaviors that have modifiers attached to it, the tab Modifiers opens. To play the video at lower or higher speed, click the Speed down or Speed up button respectively. If you noticed you missed an event in the video, you can click the Quick Review button. The video then jumps back a few seconds and plays the event you missed at a lower speed. Click the Quick Review button multiple times to jump back more in time 16 Step 2 - Acquire your data To review a video fragment multiple times, click the Loop button and set the flags that appear to the start and end of the fragment. The Loop button is hidden by default. To show it on the Playback control window, click the Settings button on the toolbar and select Playback control options. Select the checkbox in front of Show loop button. To stop the observation, click the Stop observation button. To show more buttons on the Playback control window, click the Settings button on the toolbar and select Playback control options. scoring data in different runs If you have a large coding scheme, you are generally not able to score everything at once. It is common that you play the video once for every subject-behavior group combination. After you finished with one run, do not stop the observation, but go back to the start of your observation. To do so, click in the first row, that has time 0.00, and click the play button on the video playback control window. You can now score the next subject - behavior group combination. Step 2 - Acquire your data 17 If you stopped the observation after a run, you have to click the Start-observation button again to continue with the next run. If you defined multiple subjects in the Coding Scheme, use the Auto Record Subject feature. With this feature the subject scored in the last event is automatically scored in the next event. Run through the video one or more times for one subject. Then run through the video for the next subject. Once you pressed the key code for that subject, it is automatically scored for the next events. To switch on Auto Record Subject, open the Setup menu and select Project Settings. Open the tab Scoring Options. Select the checkbox in front of Auto-record Subject. other options Correcting scoring errors When you made a mistake, you can edit the event log. Click the cell you want to edit and press the key for the correct event. Entering free text For each event line you can enter up to 1024 characters. For example, to transcribe speech from an audio file. With the View Settings select Comment. Click the Comment cell in the event log that applies, and in the Comment window type in or paste your text. Note that free text is not analyzed, however it can be visualized. 18 Step 2 - Acquire your data Finding events You can search for specific events, for example when you want to correct errors. Press Ctrl+F. Enter the Subject, Behavior, Modifier and Observation you want to search for and click Find. A list with the specified events appears. Click the Open event button to jump to that event line in the event log and the associated position in the video. You can export the events from the Find window to a text file or to Excel. For more information on how to carry out an observation, see Chapter 4 of The Observer XT Reference Manual. Step 2 - Acquire your data 19 4 Step 3 - Analyze your data This chapter guides you through the main steps to analyze your data. 1. If wanted, make a selection of the data you want to analyze. 2. Visualize your data. 3. Analyze your data. select the data you want to analyze You may want to make a selection of the data, before you carry out an analysis. For example, you may want to analyze data for males and females separately. Or you may only want to analyze certain behaviors, or time fragments. To make a selection of your data, create a data profile. To do so, in the main Analyze window, click Select data. 20 Step 3 - Analyze your data Merging data To group behaviors or modifiers in your analysis, click the Merging button on the Start box of your Data profile and define your groups. For example, to merge the behaviors Slam, Beat, and Kick, and analyze them as Aggressive behavior. Click the Add button to create a group and drag and drop the three behaviors to this group. The merged group Aggressive behavior in the example below, is treated as one behavior in the analysis. In the visualization, the merged behaviors are not shown. Step 3 - Analyze your data 21 Filtering Use the filter option, to analyze only some observations, subjects, or behaviors. For example, to only analyze the behavior Gaze child. Click the box next to Filter Events by Behaviors and make your selection. Click OK and drag the box between the Start and the Result box. To see the result of your selection, click Visualize on the toolbar. 22 Step 3 - Analyze your data What is the effect of Filtering? Filtering gives you only those data you defined in your filter. In the example below the behavior Gaze child was filtered. Only this behavior is shown in the Visualization. Analyzing time intervals: Nesting With Nesting you define a time interval, based on the behavior (or behavior and its modifiers) of a certain subject. This way you can analyze what other subjects do in these intervals. For example, you want to know what the child was doing when it gazed at another child. To define these time intervals, nest over the behavior Gaze child. If you have multiple subjects in your Coding Scheme, define in which subject the behavior occurred. Step 3 - Analyze your data 23 What is the difference between Filtering and Nesting? Filtering is selecting only certain observations, subjects, or behaviors for further analysis. Use the filter option if you are only interested in the selected events. In the example below a filter on the behavior Gaze child was applied. Nesting is creating time intervals, based on a certain behavior. If you are interested what other behaviors occur while the child is gazing at another child, nest over this behavior and define in which subject this behavior occurs. The time fragments when the child was gazing at another child are selected. It is also possible to make time intervals based on a combination of behaviors and time, with Free Interval Selection. For more information on data selection, see chapter 6 of The Observer XT Reference Manual. visualization To visualize your data, on the main Analyze window, click Visualize data. 24 Step 3 - Analyze your data Select the observations that you want to visualize. Data from each subject is displayed in a different plot. To visualize a selection of the data, define your selection in a data profile and click the Visualize button on the toolbar. Always make sure that the correct data profile is active. The active data profile is highlighted in blue on the left side of your screen. For more information on Visualizing data, see Section 7.2 of The Observer XT Reference Manual. You can make a video of a selection of events. See sections 7.3 to 7.6 in The Observer XT Reference Manual for more information. Step 3 - Analyze your data 25 behavior analysis If you made data profiles, make sure that the correct one is highlighted on the left side of your screen. Open the Analyze menu and select Behavior analysis and then New. Next, click Calculate. To change the table layout, click the Layout button. Choose how you want to organize the layout of the analysis result. Double-click Statistics to choose which statistics you want in your analysis result. If you want to exclude observations, subjects, or behaviors from your analysis, double-click the category and de-select some of the items. 26 Step 3 - Analyze your data The effect of selecting and deselecting a category If you select the checkbox in front of Observations, Subject, Behaviors, Independent Variables, or Result Containers, you get separate analysis results for each item in that category. For example, if you have four observations and select the checkbox in front of Observations, you get separate analysis results for each observation. If you de-select the checkbox, all observations are grouped and you get one analysis result for all observations together. Step 3 - Analyze your data 27 For more information on Behavior Analysis, see Chapter 8 of The Observer XT Reference Manual. numerical analysis A numerical analysis can only be carried out if you have numerical modifiers in your coding scheme. A numerical analysis gives additional statistics above the ones obtained in the behavior analysis. For example if you defined Sound level as numerical modifier, you can calculate the minimum, mean and maximum sound level. The procedure is the same as for the Behavior Analysis. For more information on Numerical Analysis, see Chapter 8 of The Observer XT Reference Manual. charts You can make a graphic representation from the results of the behavior analysis and the numerical analysis. Select the data in the analysis results and click the Charts button on the toolbar. Choose the type of chart and customize it by, for example, adding titles. You can save, export and print the chart. 28 Step 3 - Analyze your data lag sequential analysis You may be interested in what precedes a certain behavior, or what happens after it. For example, you may want to know how many times a child starts playing after it gazed at a toy. Or how often functional use was preceded by instruction by the parent. For this purpose, carry out a Lag Sequential Analysis. Open the Analyze menu and select Lag Sequential Analysis. Click the Settings button on the toolbar. Choose whether you want to do a State Lag or a Time Lag analysis (see below). Step 3 - Analyze your data 29 Criteria are the first behaviors of a pair, the second ones is called Targets. If you use a Time lag, choose what to do with criteria, or targets that occur more than once in the specified time interval. If you follow more than one subject, you may only be interested in transitions between behaviors of the same subject. For example, you may want to know how often the behavior Playing with toy is followed by Destroying toy. If this is the case, select the checkbox Restrict lag to Subject-Behavior group combinations. In other cases you may especially be interested how the behavior of one subject affects the behavior of another subject. You may for example want to know how many times instruction by the parent is followed by functional use of a toy by the child. If this is the case, make sure the checkbox Restrict lag to Subject-Behavior group combinations is de-selected. 30 Step 3 - Analyze your data Choose whether you want the lags shown as frequencies or probabilities and in the Layout tab define the layout of your analysis results. In the example below the behavior No verbal was followed 6 times by Functional use. For more information on Lag Sequential Analysis, see Chapter 9 of The Observer XT Reference Manual. reliability analysis In a reliability analysis you look whether scoring the same observation several times gives the same results. You can look at your own consistency as a coder, for example by scoring a video again every month. Or you can let the same video be scored by different coders and look whether they score the same. From the Analyze menu select Reliability Analysis and select the pairs your want to compare. Step 3 - Analyze your data 31 Open the Settings tab. Choose the comparison method. With the default comparison method Frequency/Sequence the frequency and timing of the events is compared. The other options depend on the comparison method you choose. See Chapter 10 in The Observer XT Reference Manual for more information on the comparison methods and settings. The analysis result shows the number of agreements between the observations, number of disagreements and the two statistics Kappa and Rho with their significance levels. In general, the closer Kappa and Rho are to 1.0, the better the agreement between the observations is. For more information on Kappa and Rho, please see Section 10.7 Reliability Statistics in The Observer XT Reference Manual. If you want to know what exactly has been scored differently in the observations, click Confusion Matrix. The numbers in light-blue on the diagonals are agreements. The numbers outside the diagonal, which are marked with a red circle in the picture on the next page, are the disagreements. 32 Step 3 - Analyze your data To know at which time different events were scored in the observations, click Comparison list. The disagreements are marked with a red cross. Scroll to this time stamp in the video and look why different events were scored in the observations. The time stamp of the video is based on the first observation (left in the table).. Step 3 - Analyze your data 33 For more information on Reliability Analysis, see Chapter 10 of The Observer XT Reference Manual. 34 Step 3 - Analyze your data 5 Export to other programs You can export the raw data, a selection of the raw data, or the analysis results. To carry out a statistical analysis, you generally need to export the results of the behavior or numerical analysis. analysis results Carry out a behavior or numerical analysis. Click the Export button on the toolbar. Choose the format for the export file. If you want to import the exported file to SPSS, select the checkbox Merge header rows. You can also export the raw data or a selection of the raw data. See Chapter 11 of The Observer XT Reference Manual for more information. Export to other programs 35 6 Back up your data To back up your data, from the File menu select Make Backup. This makes a zip-file of your project. Make sure you create a backup at least once a day. Do not forget to create backups of your videos as well. Store the backups at a safe location, which is in a different building from The Observer computer. To open a backup of your project, open the File menu and select Restore Backup. Locate the file with the name of your project and the extension*.vpb. See step 2 below for the location of this file. transferring projects between computers Also use the File-Make Backup function to copy a project from one computer to another. See also the figure on the next page. 1. Open the File menu and select Make Backup. 2. Copy the file with the name of your project and the extension .vpb together with the video and audio files to the other computer. To look up the default locations of video, audio, and project file, open the File menu, select Preferences and open the File locations tab, where you can also change these locations. The backup files are present in the folder ~The Observer XT\Projects. Copy the files to those folders on the other computer to make sure The Observer XT can locate them. 3. To open the backup file on the other computer, first insert your license key into a USB port. Then in The Observer XT open the File menu and select Restore Backup. Locate the *.vpbfile and click Open. 36 Back up your data For more information on creating backups, see the paragraph Backing up a project in section 11.1 of The Observer XT Reference Manual. Back up your data 37 7 Technical support support database If you encounter a problem using The Observer XT, you can search through hundreds of entries in a database of questions submitted by our customers to the Noldus support department with answers by our support staff. You find the support database at our website (www.noldus.com/customer-support). help desk If you have any problems, questions, remarks or comments, please let us know. You can contact us via our website (www.noldus.com/helpdesk) and fill out a Support Request Form (preferred), or phone. We offer 24 hour support by help desks in various time zones. You can also contact us using the The Observer XT. From the Help menu choose Noldus Online and subsequently Contact Help Desk. If you encounter a problem with the program, you can also select Report an Issue. This opens a form on our website which is sent to the help desk. Please check the Reference Manual before contacting our support department. Press F1 to open the PDF of the Reference Manual, then search for the topic related to what you are having problems with. Before you contact Technical Support, please have the following information available. To find this information, go to the Help menu and select About....: z The version number of your copy of the program. z The name of the registered user (click User Info). z The license number of your copy of our software (click User Info). z The help desk may ask for a log file (*.log). You can find this file in the folder C:\ProgramData\Noldus\The Observer\XT 12\Log. Please refer to the Contact section on our website (www.noldus.com) for other contact information. 38 Technical support 8 Keyboard shortcuts Below are the most commonly used shortcut keys for carrying out and reviewing an observation. You find a complete list of available shortcut keys in Appendix C “Keyboard Shortcuts” of The Observer XT Reference Manual. observation New observation Start observation Stop observation project Save project Make backup Keyboard shortcuts 39 playback control Play forward Pause Play backward Speed up Speed down Jump to begin Jump to end Step forward Step backward Quick review Loop Loop start Loop end 40 Keyboard shortcuts