Term Definition
Accuracy
The degree of closeness an estimate has to the true value.
Hits - 352
Adaptation

Changing existing materials (e.g., management plans, contracts, training manuals, questionnaires, etc.) by deliberately altering some content or design component to make the resulting materials more suitable for another socio-cultural context or a particular population. In the context of questionnaire translation, the limits between translation and adaptation are difficult to define because almost every translation includes adaptation to a certain degree. Therefore, sometimes both terms are used in combination (“translation and adaptation”) to name the process of making a questionnaire fit for use in another language and culture. For a discussion of adaptation and, for instance, its different forms, see also (Behr & Shishido, forthcoming). See Adaptation for more information.

Hits - 821
Adaptive behavior
Interviewer behavior that is tailored to the actual situation encountered.
Hits - 214
Adjudication

The translation evaluation step at which a translation is signed off and released for whatever follows next such as pretesting or final fielding (the ‘A’ in the TRAPD method, see Translation). When all review and refinement procedures are completed, including any revisions after pretesting and copyediting, a final signing off/adjudication is required. Thus, in any translation effort there will be one or more signing-off steps ("ready to go to external assessment," "ready to go to client," "ready to go to fielding agency," for example).

Hits - 279
Adjudicator
The person who signs-off on a finalized version of a questionnaire (see Adjudication).
Hits - 250
Adjustment Error
Survey error (variance and bias) due to post data collection statistical adjustment.
Hits - 1081
Advance translation
A translation is made of a source questionnaire to try to find problems in the source text that only become apparent when translation is attempted. The insights are used to modify the source questionnaire or plan for adaptation. We recommend to carry out the advance translation using the team approach so as to receive input comparable to the one expected during the final translation phase. Comments made in the course of advance translation typically concern both linguistic / translation-related as well as intercultural issues (see Dorer (2011)).
Hits - 274
Anchoring vignettes
A technique used to adjust for noncomparability in self-assessment questions caused by differences in response scale usage across groups. It relies on a set of descriptions (usually brief) of hypothetical people and situations to which self-assessment is calibrated (King, Murray, Salomon, & Tandon, 2004).
Hits - 368
Annotation

Information appended to text in the source questionnaire to help clarify the intended meaning of a source text concept, phrase, or term. (See Appendix A-D for further detail and examples of the use of annotations.) ‘Annotations’ are also referred to as ‘footnotes’.

Hits - 276
Anonymity
Recording or storing information without name or identifier, so the respondent cannot be identified in any way by anyone. No one can link an individual person to the responses of that person, including the investigator or the interviewer. Face-to-face interviews are never anonymous since the interviewer knows the address (and likely, the name) of the respondent.
Hits - 266
Anonymization
Stripping all information from a survey data file that allows the re-identification of respondents (see confidentiality).
Hits - 205
ASCII files
Data files in American Standard Code for Information Interchange (ASCII) format.
Hits - 261
Ask different questions (ADQ)
An approach to question design where researchers collect data across populations or countries based on using the most salient population-specific questions on a given construct/research topic. The questions and indicators used in each location are assumed (or better, have been shown) to tap a construct that is germane or shared across populations.
Hits - 236
Ask the same questions (ASQ)

An approach to question design whereby researchers collect data across populations/countries by asking a shared set of questions. The most common way to do this is by developing a source questionnaire in one language and then producing whatever other language versions are needed on the basis of translation or translation and adaptation. Hence the description used in the chapter of "ASQ and translate (ASQT)". Decentering is a second way to “ask the same questions” but this procedure is differently organized.

Hits - 371
Ask the same questions and translate (ASQT)

An approach to question design whereby researchers collect data across populations/countries by asking a shared set of questions. The most common way to do this is by developing a source questionnaire in one language and then producing whatever other language versions are needed on the basis of translation or translation and adaptation. Decentering is a second way to “ask the same questions” but this procedure is differently organized.

Hits - 281
Attitudinal question

A question asking about respondents’ opinions, judgments, emotions, and perceptions. These cannot be measured by other means; we are dependent on respondents’ answers. Example: Do you think smoking cigarettes is bad for the smoker’s health?

Hits - 1516
Synonyms - attitudinal
Audio computer-assisted self-interviewing (A-CASI)

A mode in which the respondent in which the respondent uses a computer that plays audio recordings of the questions to the respondent, who then enters his/her answers. The computer may or may not display the questions on the screen.

Hits - 315
Synonyms - computer-assisted self-interviewing, audio computer-assisted self-interview (A-CASI), audio computer-assisted self-interview, computer-assisted self interviewing, CASI
Audit trail
An electronic file in which computer-assisted and Web survey software captures paradata about survey questions and computer user actions, including times spent on questions and in sections of a survey (timestamps) and interviewer or respondent actions while proceeding through a survey. The file may contain a record of keystrokes and function keys pressed, as well as mouse actions.
Hits - 294
Auxiliary data
Data from an external source, such as census data, that is incorporated or linked in some way to the data collected by the study. Auxiliary data is sometimes used to supplement collected data, for creating weights, or in imputation techniques.
Hits - 927
Base weight
The inverse of the probability of selection.
Hits - 197
Behavior codes

Behavior codes are information about the interviewer and respondent’s verbal behaviors during a survey interview’s question–answer process. They are developed and recorded by human coders, not automatically coded by computers. To obtain behavior codes, interviews are audio recorded (generally digitally today, but cassette tapes have been used in the past), transcribed, and then coded by a set of at least two coders to identify relevant behaviors” (Olson & Parkhurst, 2013).

Hits - 208
Behavior coding

Systematic coding of the interviewer-respondent interaction in order to identify problems and sometimes to estimate the frequency of behaviors that occur during the question-answer process.

Hits - 319
Synonyms - behavior coding
Behavioral question
A question asking respondents to report behaviors or actions. Example: Have you ever smoked cigarettes?
Hits - 262
Bias
The systematic difference over all conceptual trials between the expected value of the survey estimate of a population parameter and the true value of that parameter in the target population.
Hits - 378
Bid
A complete proposal (submitted in competition with other bidders) to execute specified jobs within prescribed time and budget, and not exceeding a proposed amount.
Hits - 322
Bilingual glossary
A glossary is a list of words or phrases used in a particular field alongside their definitions. Glossaries are often found at the back of a specialist or academic book as an appendix to the text. A bilingual glossary lists special terms used in a particular field in two languages. A key notion or concept present in one language for a given field may not have a ready single match in a given other language.
Hits - 1224
Bottom coding
A type of coding in which values that exceed the predetermined minimum value are reassigned to that minimum value or are recoded as missing data.
Hits - 305
Bridge language
A language, common to both interviewers and respondents, that is used for data collection but may not be the first language of either person.
Hits - 456
Cause and effect diagram
A fishbone-structured diagram for a process, used as a brainstorming tool to help understand or improve the process. The main bone represents the process (e.g., interviewer training), and bones coming off of the main bone are pre-identified factors (e.g., training materials) that may affect the quality of the process. From there potential causes (lack of resources and time) and effects (poor quality materials) can be discussed, and solutions identified. Also known as a fishbone or Ishikawa diagram.
Hits - 236
Certification

Objective assessment of performance. Based on pre-established criteria, the interviewer either meets the requirements and may proceed to conduct the study interview or does not meet the requirements and may either be permitted to try again or be dismissed from the study. Certification outcome should be documented and filed at the data collection agency.

Hits - 299
Synonyms - Certify
Closed-ended question

A survey question format that provides a limited set of predefined answer categories from which respondents must choose. Example: Do you smoke?

Yes ___

No ___

Hits - 836
Synonyms - Closed-ended
Cluster

A grouping of units on the sampling frame that is similar on one or more variables, typically geographic. For example, an interviewer for an in person study will typically only visit only households in a certain geographic area. The geographic area is the cluster.

Hits - 306
Synonyms - clusters
Cluster sampling
A sampling procedure where units of the sampling frame that are similar on one or more variables (typically geographic) are organized into larger groups (i.e. clusters), and a sample of groups is selected. The selected groups contain the units to be included in the sample. The sample may include all units in the selected clusters or a sub-sample of units in each selected cluster. The ultimate purpose of this procedure is to reduce interviewer travel costs for in person studies by producing distinct groups of elements where the elements within each group area are geographically close to one another.
Hits - 236
Code structure

List of descriptions of variable categories and associated code numbers. Also referred to as code frame, coding frame, or codes.

Hits - 347
Synonyms - codes
Codebook
A document that provides question-level metadata that is matched to variables in a dataset. Metadata include the elements of a data dictionary, as well as basic study documentation, question text, universe statements (the characteristics of respondents who were asked the question), the number of respondents who answered the question, and response frequencies or statistics.
Hits - 231
Coding

Translating nonnumeric data into numeric fields.

Hits - 308
Synonyms - coded
Coefficients of variation

a measure of dispersion of a probability distribution or frequency distribution, that describes the amount of variability relative to the mean.

Hits - 186
Cognitive interview
A pretesting method designed to uncover problems in survey items by having respondents think out loud while answering a question or retrospectively.
Hits - 269
Cohen’s kappa

A statistical measure that accounts for degree of chance of agreements between coders.

Hits - 225
Comparability

The extent to which differences between survey statistics from different countries, regions, cultures, domains, time periods, etc., can be attributable to differences in population true values (Johnson & Mohler, 2010). In other words, whether the concepts are comparable or not. It is often referred as “equivalence, functional equivalence, similarity, or some other frame of reference” (Johnson & Mohler, 2010). Improving comparability implies that error due to translation has to be minimized. In terms of questionnaire translation for multi-national, multi-cultural and multi-regional surveys the aim is to achieve the defined statistical level of comparability across all local versions (expressed in minimized translation error).

Hits - 445
Synonyms - comparable
Comparativist
A person who carries out comparative studies, especially a student of comparative literature or comparative linguistics.
Hits - 246
Complex survey data (or designs)

Survey datasets (or designs) based on stratified single or multistage samples with survey weights designed to compensate for unequal probabilities of selection or nonresponse.

Hits - 252
Synonyms - complex survey designs, complex survey data
Computer assisted recorded interviewing (CARI)

A system for audio recording of interviews (or interview parts) that allow for monitoring interviewer performance in the filed/call center and detection of data fraud.

Hits - 343
Synonyms - Computer-Assisted Recorded Interviewing (CARI), Computer-Assisted Recorded Interviewing
Computer assisted telephone interviewing (CATI)

A telephone interviewing mode in which a computer displays the questions on a screen, the interviewer reads them to the respondent over the phone, and enters the respondent’s answers directly into the computer.

Hits - 1240
Synonyms - CATI
Computer- assisted self interviewing (CASI)
A mode in which a computer displays the questions on a screen to the respondent and the respondent then enters his/her answers into the computer.
Hits - 309
Computer-Assisted Personal Interviews (CAPI)

A face-to-face interviewing mode in which a computer displays the questions onscreen, the interviewer reads them to the respondent, and enters the respondent’s answers directly into the computer.

Hits - 1596
Concurrent mixed mode

A mixed mode design in which one group of respondents uses one mode and another group of respondents uses another.

Hits - 202
Confidentiality
Securing the identity of, as well as any information provided by, the respondent, in order to ensure to that public identification of an individual participating in the study and/or his individual responses does not occur.
Hits - 463
Consent (informed consent)

A process by which a sample member voluntarily confirms his or her willingness to participate in a study, after having been informed of all aspects of the study that are relevant to the decision to participate. Informed consent can be obtained with a written consent form or orally (or implied if the respondent returns a mail survey), depending on the study protocol. In some cases, consent must be given by someone other than the respondent (e.g., an adult when interviewing children).

Hits - 379
Synonyms - informed consent, consent
Consistency
Consistency is achieved when the same term or phrase is used throughout a translation to refer to an object or an entity referred to with one term or phrase in the source text. In many cases, consistency is most important with regard to technical terminology or to standard repeated components of a questionnaire. Reference to "showcard" in a source questionnaire should be consistently translated, for example. The translation of instructions which are repeated in the source text should also be repeated (and not varied) in the target text.
Hits - 312
Construct validity

The degree to which a survey question adequately measures an intended hypothetical construct. This may be assessed by checking the correlation between observations from that question with observations from other questions expected on theoretical grounds to be related.

Hits - 352
Synonyms - validity
Constructed variable
A recoded variable, one created by data producers or archives based on the data originally collected. Examples are age grouped into cohorts, income grouped into 7 categories, Goldthorpe-Index, or the creation of a variable called POVERTY from information collected on the income of respondents.
Hits - 535
Contact attempt record

A written record of the time and outcome of each contact attempt to a sample unit.

Hits - 540
Contact rate
The proportion of all elements in which some responsible member of the housing unit was reached by the survey.
Hits - 293
Content management
The software and procedures used to capture, save, organize, and distribute information in digitalized form.
Hits - 255
Context effects
The effect of question context, such as the order or layout of questions, on survey responses.
Hits - 304
Contract
A legally binding exchange of promises or an agreement creating and defining the obligations between two of more parties (for example, a survey organization and the coordinating center) written and enforceable by law.
Hits - 341
Convenience sample
A sample of elements that are selected because it is convenient to use them, not because they are representative of the target population.
Hits - 294
Conversational interviewing
Interviewing style in which interviewers read questions as they are worded but are allowed to use their own words to clarify the meaning of the questions.
Hits - 304
Conversion process

Data processing procedures used to create harmonized variables from original input variables.

Hits - 203
Cooperation rate

The proportion of all elements interviewed of all eligible units ever contacted.

Hits - 286
Coordinating center
A research center that facilitates and organizes cross-cultural or multi-site research activities.
Hits - 401
Copyeditor
The person who reviews a text and marks up any changes required to correct style, punctuation, spelling, and grammar errors. In many instances, the copyeditor may also make the corrections needed.
Hits - 218
Coverage

The proportion of the target population that is accounted for on the sampling frame.

Hits - 406
Coverage bias
The systematic difference between the expected value (over all conceptual trials) of a statistic and the target population value because some elements in the target population do not appear on the sampling frame.
Hits - 432
Coverage error,

Survey error (variance and bias) that is introduced when there is not a one-to-one correspondence between frame and target population units. Some units in the target population are not included on the sampling frame (undercoverage), some units on the sampling frame are not members of the target population (out-of-scope), more than one unit on the sampling frame corresponds to the same target population unit (overcoverage), and one sampling frame unit corresponds to more than one target population unit.

Hits - 743
Synonyms - coverage errors, Coverage error,
Coverage rate
The number of elements on the sampling frame divided by the estimated number of elements in the target population.
Hits - 687
Coversheet
Electronic or printed materials associated with each element that identify information about the element, e.g., the sample address, the unique identification number associated with an element, and the interviewer to whom an element is assigned. The coversheet often also contains an introduction to the study, instructions on how to screen sample members and randomly select the respondent, and space to record the date, time, outcome, and notes for every contact attempt.
Hits - 262
Crosswalk
A description, usually presented in tabular format, of all the relationships between variables in individual data files and their counterparts in the harmonized file.
Hits - 302
Cultural schema

A conceptual structure, shared by members of a cultural group and created from common experiences, by which objects and events can be identified and understood.

Hits - 1707
Synonyms - Cultural schemas
Data capture

The process of converting data (e.g., from questionnaires, audio/visual recordings, samples, etc.) to an electronic file.

Hits - 249
Synonyms - capture, captured,
Data dictionary
A document linking the survey instrument (questionnaire) with the dataset, or more abstract question or variable-level metadata including question identifiers (variable names and labels); response category identifiers (value labels), and data types (e.g., F2.0, specifying that the response is a two-digit integer with zero decimal places.
Hits - 299
Data Documentation Initiative (DDI)
An international effort to establish a standard for technical documentation describing social science data. A membership-based Alliance is developing the DDI specification, which is written in XML.
Hits - 293
De-identification
Separating personally identifiable information (PII) from the survey data to prevent a breach of confidentiality.
Hits - 231
Decentering

An approach to designing questions in two languages in which neither of the languages nor cultures involved is allowed to dominate. A Ping-Pong-like process of formulation and comparison between the two languages is used to develop versions in each language. Any language or cultural obstacles met with are resolved, often by removing or changing wording in one or both languages. The question formulation in both languages then moves on from that modification. Since the process removes culture-specific elements from both versions, decentered questions may be vague and not especially salient for either target population.

Hits - 1025
Design effect
The effect of the complex survey design on sampling variance measured as the ratio of the sampling variance under the complex design to the sampling variance computed as a simple random sample of the same sample size.
Hits - 444
Differential item functioning (dif)

Item bias as a result of systematic differences in responses across cultures due to features of the item or measure itself, such as poor translation or ambiguous wording.

Hits - 357
Synonyms - differential item functioning
Diglossic linguistic contexts
Diglossic linguistic contexts exist in single language communities that use two or more markedly different varieties of a language or two different languages in different contexts. The variety used may be determined by whether the language is written or spoken in a given instance or by the relationships between participants in a discourse. Considerations such as age, gender, social status, and the topic under discussion may all contribute to the form chosen in any given instance.
Hits - 487
Direct cost
An expense that can be traced directly to (or identified with) a specific cost center or is directly attributable to a cost object such as a department, process, or product.
Hits - 238
Disclosure analysis and avoidance
The process of identifying and protecting the confidentiality of data. It involves limiting the amount of detailed information disseminated and/or masking data via noise addition, data swapping, generation of simulated or synthetic data, etc. For any proposed release of tabulations or microdata, the level of risk of disclosure should be evaluated.
Hits - 178
Disposition code

A code that indicates the result of a specific contact attempt or the outcome assigned to a sample element at the end of data collection (e.g., noncontact, refusal, ineligible, complete interview).

Hits - 3669
Synonyms - disposition codes
Document management system
A document management system (DMS) is a computer system (or a set of computer programs) used to track and store electronic documents and/or images of paper documents. The term has some overlap with the concept of Content Management Systems. It is often viewed as a component of Enterprise Content Management Systems (ECM, see http://www.aiim.org/What-is-ECM-Enterprise-Content-Management.aspx) and related to Digital Asset Management, Document imaging, Workflow systems and Records Management systems.
Hits - 255
Double-barreled (questions)

Survey questions that inadvertently ask about two topics at once.

Hits - 300
Synonyms - double-barreled
Editing

Altering data recorded by the interviewer or respondent to improve the quality of the data (e.g., checking consistency, correcting mistakes, following up on suspicious values, deleting duplicates, etc.). Sometimes this term also includes coding and imputation, the placement of a number into a field where data were missing.

Hits - 366
Synonyms - edited
element (Sample element)

A selected unit of the target population that may be eligible or ineligible.

Hits - 902
Eligibility rate
The number of eligible sample elements divided by the total number of elements on the sampling frame.
Hits - 455
Embedded experiments
Embedded experiments are included within the framework of an actual study.
Hits - 245
Ethics review committee or human subjects review board
A group or committee that is given the responsibility by an institution to review that institution's research projects involving human subjects. The primary purpose of the review is to assure the protection of the safety, rights and welfare of the human subjects.
Hits - 195
Event history calendar

A conversational interviewing technique designed to improve recollection of complex sequences of personal events by using respondents’ own past experiences as memory cues. This technique is sometimes referred to as life history calendar.

Hits - 293
Ex-ante
The process of creating harmonized variables at the outset of data collection, based on using the same questionnaire or agreed definitions in the harmonization process.
Hits - 310
Ex-post
The process of creating harmonized variables from data that already exists.
Hits - 226
Expectation question

A question asking about respondents’ expectation about the chances or probabilities that certain things will happen in the future.

Hits - 378
Eye-tracking

Eye tracker tracks the time, duration and location of our eyes’ fixations and the saccades between fixations. See Li (n.d.).

Hits - 174
Fact sheet
A sheet, pamphlet, or brochure that provides important information about the study to assist respondents in making an informed decision about participation. Elements of a fact sheet may include the following: the purpose of the study, sponsorship, uses of the data, role of the respondent, sample selection procedures, benefits and risks of participation, and confidentiality.
Hits - 234
Factual judgment question
A question that requires respondents to remember autobiographical events and use that information to make judgments. In principle, such information could be obtained by other means of observation, such as comparing survey data with administrative records, if such records exist. Factual judgment questions can be about a variety of things, such as figure-based facts (e.g., date, age, weight), events (e.g., pregnancy, marriage), and behaviors (e.g., smoking, media consumption).
Hits - 447
Factual question

A question that aims to collect information about things for which there is a correct answer. In principle, such information could be obtained by other means of observation, such as comparing survey data with administrative records. Factual questions can be about a variety of things, such as figure-based facts (date, age, weight), events (pregnancy, marriage), and behaviors (smoking or media consumption).

Example: Do you smoke?

Hits - 2578
Fitness for intended use
The degree to which products conform to essential requirements and meet the needs of users for which they are intended. In literature on quality, this is also known as "fitness for use" and "fitness for purpose."
Hits - 881
Fixed panel design

A longitudinal study which attempts to collect survey data on the same sample elements at intervals over a period of time. After the initial sample selection, no additions to the sample are made.

Hits - 777
Synonyms - fixed panel
Fixed panel plus birth

A longitudinal study in which a panel of individuals is interviewed at intervals over a period of time and additional elements are added to the sample.

Hits - 254
Flow chart
A method used to identify the steps or events in a process. It uses basic shapes for starting and ending the process, taking an action, making a decision, and producing data and documentation. These are connected by arrows indicating the flow of the process. A flow chart can help identify points at which to perform quality assurance activities and produce indicators of quality that can be used in quality control.
Hits - 213
Focus group
Small group discussions under the guidance of a moderator which can be used to explore topics, develop topics and items for questions.It is often used in qualitative research to test survey questionnaires and survey protocols.
Hits - 589
frame (Sampling frame)

A list or group of materials used to identify all elements (e.g., persons, households, establishments) of a survey population from which the sample will be selected. This list or group of materials can include maps of areas in which the elements can be found, lists of members of a professional association, and registries of addresses or persons.

Hits - 260
Frequency format

A response format requiring the respondent to select the option that best describes the frequency in which certain behaviors occur.

Hits - 360
Synonyms - frequency
Full translation (double/parallel translation)

Each translator translates all of the material to be translated. It stands in contrast to split translations. This refers to the first step in the TRAPD model, the ‘T’.

Hits - 1474
Synonyms - Full translation
Functional equivalence

It measures to what degree the hypothetical construct serves “similar functions” within each society or cultural group. See Johnson (1998b) for more information.

Hits - 335
Hadamard matrix

Hadamard matrix for 4 half samples image

Hits - 178
Hard consistency check
A signal warning that there is an inconsistency between the current response and a previous response; the interviewer or respondent cannot continue until the inconsistency is resolved.
Hits - 259
Hours Per Interview (HPI)
A measure of study efficiency, calculated as the total number of interviewer hours spent during production (including travel, reluctance handling, listing, completing an interview, and other administrative tasks) divided by the total number of interviews.
Hits - 257
Synonyms - hours per interview
Imputation variance
That component of overall variability in survey estimates that can be accounted for by imputation.
Hits - 196
Imputations

A computation method that, using some protocol, assigns one or more replacement answers for each missing, incomplete, or implausible data item.

Hits - 259
Synonyms - Imputation
Inconsistent responses

Inappropriate responses to branched questions. For instance, one question might ask if the respondent attended church last week; a response of "no" should skip the questions about church attendance and code the answers to those questions as "inapplicable." If those questions were coded any other way than "inapplicable,” this would be inconsistent with the skip patterns of the survey instrument.

Hits - 664
Indirect cost
An expense that is incurred in joint usage and difficult to assign to or is not directly attributable to a specific department, process or product.
Hits - 230
Informant

The person who supplies a list of the eligible elements within the selected unit. For example, many in-person surveys select a sample of housing units at the penultimate stage of selection. Interviewers then contact the housing unit with the aim of convincing the member of the housing unit who responded to the contact attempt to provide a list of housing unit members who are eligible for the study. The housing unit member who provides a list of all eligible housing unit members is called the informant. Informants can also be selected respondents as well, if they are eligible for the study and are chosen as the respondent during the within household stage of selection.

Hits - 291
Intention question
A question asking respondents to indicate their intention regarding some behavior.
Hits - 307
Interactive Voice Response (IVR)

A telephone interviewing method in which respondents listen to recordings of the questions and they respond by using the keypad of the telephone or saying their answers aloud.

Hits - 248
Interface design

Aspects of computer-assisted survey design focused on the interviewer’s or respondent’s experience and interaction with the computer and instrument.

Hits - 210
Interpenetrated sample assignment, interpenetration

Randomized assignment of interviewers to subsamples of respondents in order to measure correlated response variance, arising from the fact that response errors of persons interviewed by the same interviewer may be correlated. Interpenetration allows researchers to disentangle the effects interviewers have on respondents from the true differences between respondents.

Hits - 326
Synonyms - interpenetration, interpenetrations, interpenetrated
Interviewer design effect (Deffint)

The extent to which interviewer variance increases the variance of the sample mean of a simple random sample.

Hits - 309
Synonyms - interviewer design effect
Interviewer effect
Measurement error, both systematic and variable, for which interviewers are responsible.
Hits - 488
Interviewer falsification

Intentionally departing from the designed interviewer guidelines that could result in the contamination of the data. Falsification includes: 1) Fabricating all or part of an interview—the recording of data that are not provided by a designated survey respondent, and reporting them as answers of that respondent; 2) Deliberately misreporting disposition codes and falsifying process data (e.g., the recording of a respondent refusal as ineligible for the sample; reporting a fictitious contact attempt); 3) Deliberately miscoding the answer to a question in order to avoid follow-up questions; 4) Deliberately interviewing a nonsampled person in order to reduce effort required to complete an interview; or intentionally misrepresenting the data collection process to the survey management.

Hits - 336
Interviewer observations and evaluations

“In interviewer-administered surveys, interviewers have long been asked to make general assessments about how engaged, cooperative, hostile, or attentive the respondent was during the interview. Additionally, interviewers record information about the interview-taking environment, such as whether other individuals were present or whether the respondent used headphones during an ACASI component. Unlike the previous sources of paradata, these interviewer evaluations are questions asked directly of the interviewer and included as a few additional questions in the questionnaire” (Olson & Parkhurst, 2013).

Hits - 330
Synonyms - interviewer observations, interviewers’ observations
Interviewer variance
That component of overall variability in survey estimates that can be accounted for by the interviewers.
Hits - 271
Item nonresponse, item missing data

The lack of information on individual data items for a sample element where other data items were successfully obtained.

Hits - 215
Synonyms - , item nonresponse, item missing data, item-missing data
Item Response Theory (IRT)

A theory that guides statistical techniques used to detect survey or test questions that have item bias or differential item functioning (see dif). IRT is based on the idea that the probability of a response an individual provides is a function of the person's traits and characteristics of the item.

Hits - 426
Synonyms - item response theory, IRT
Keystrokes

Keystroke files, sometimes called audit trails or trace files” are recorded” when interviewers or respondents use specific keys during the survey. Keystroke files contain both response timing data and a record of the keystrokes pressed during the questionnaire administration” (Olson & Parkhurst, 2013).

Hits - 286
Synonyms - Keystroke
Latent class analysis (LCA)

Latent Class Analysis (LCA) is a subset of structural equation modeling, used to find groups or subtypes of cases in multivariate categorical data. These subtypes are called "latent classes"

Hits - 291
Synonyms - latent class analysis, LCA
Listing
A procedure used in area probability sample designs to create a complete list of all elements or cluster of elements within a specific set of geographic boundaries.
Hits - 327
Loaded questions/words

Questions that are worded in such a way that invite respondents to respond in a particular way.

Hits - 233
Synonyms - Loaded
Longitudinal study

A study where elements are repeatedly measured over time.

Hits - 385
Synonyms - longitudinal
Mean Square Error

The total error of a survey estimate; specifically, the sum of the variance and the bias squared.

Hits - 315
Synonyms - mean square error (MSE), mean square error
Measurement equivalence
Equivalence of the calibration system used in the questionnaire and the translation.
Hits - 375
Measurement error
Survey error (variance and bias) due to the measurement process; that is, error introduced by the survey instrument, the interviewer, or the respondent.
Hits - 391
Metadata

Information that describes data. The term encompasses a broad spectrum of information about the survey, from study title to sample design, details such as interviewer briefing notes, contextual data and/or information such as legal regulations, customs, and economic indicators. Note that the term ‘data’ is used here in a technical definition. Typically metadata are descriptive information and data are the numerical values described.

Hits - 274
Microdata
Nonaggregated data that concern individual records for sampled units, such as households, respondents, organizations, administrators, schools, classrooms, students, etc. Microdata may come from auxiliary sources (e.g., census or geographical data) as well as surveys. They are contrasted with macrodata, such as variable means and frequencies, gained through the aggregation of microdata.
Hits - 285
Minority country

A country with high per capita income (the minority of countries).

Hits - 236
Synonyms - minority countries
Mode

Method of data collection.

Hits - 459
Synonyms - modes, mode(s)
Mouse clicks

“Mouse click files record each action the respondent or interviewer takes using the computer’s mouse, ranging from the presence or absence of simple single mouse clicks to the position of the mouse cursor at a specified time interval on an x − y coordinate of the survey page” (Olson & Parkhurst, 2013).

Hits - 184
Multi-Trait-Multi-Method (MTMM)

A technique that uses the correlations between multiple methods (i.e. modes) and multiple traits (i.e. variables) to assess the validity of a measurement process. 

Hits - 563
Synonyms - multi-trait multi-method, MTMM, MTMM studies, Multi-trait-multi-method
Non-interview
A sample element is selected, but an interview does not take place (for example, due to noncontact, refusal, or ineligibility).
Hits - 254
Noncontact

Sampling units that were potentially eligible but could not be reached.

Hits - 260
Synonyms - noncontacts, non-contact, non-contacts
Nonresponse
The failure to obtain measurement on sampled units or items. See unit nonresponse and item nonresponse.
Hits - 378
Nonresponse bias
The systematic difference between the expected value (over all conceptual trials) of a statistic and the target population value due to differences between respondents and nonrespondents on that statistic of interest.
Hits - 295
Nonresponse error,

Survey error (variance and bias) that is introduced when not all sample members participate in the survey (unit nonresponse) or not all survey items are answered (item nonreponse) by a sample element.

Hits - 485
Synonyms - nonresponse errors, nonresponse error
Nonresponse follow-up
A supplemental survey of sampled survey nonrespondents. Nonresponse follow-up surveys are designed to assess whether respondent data are biased due to differences between survey respondents and nonrespondents.
Hits - 252
Open tendering
A bidding process in which all the bidders are evaluated and then chosen on the basis of cost and technical merit.
Hits - 242
Open-ended question

A survey question that allows respondents to formulate the answer in their own words. Unlike a closed question format, it does not provide a limited set of predefined answers.

Example: What is your occupation? Please write in the name or title of your occupation___________

Hits - 360
Synonyms - open-ended
Outcome rate

A rate calculated based on the study’s defined final disposition codes that reflect the outcome of specific contact attempts before the unit was finalized. Examples include response rates (the number of complete interviews with reporting units divided by the number of eligible reporting units in the sample.), cooperation rates (the proportion of all units interviewed of all eligible units ever contacted), refusal rates (the proportion of all units in which a housing unit or respondent refuses to do an interview or breaks-off an interview of all potentially eligible units), and contact rates (the proportion of all units are reached by the survey).

Hits - 385
Synonyms - Outcome rates
Outlier

An atypical observation which does not appear to follow the distribution of the rest of a dataset.

Hits - 228
Synonyms - Outliers
Overediting
Extensive editing that becomes too costly for the amount of error that is being reduced.
Hits - 202
Overlap in the split translations

A compromise solution between split and full translations is to ensure that some overlap exists between materials divided among translators. The material is split up the way cards are dealt in many games, everyone getting a spread of the material. Each translator could then receive the last one or two questions of another translator’s "piece". This allows the review team members to have an increased sense of differences in translating approaches between translators and their understanding of source text components at the draft production level.

Hits - 181
Overrun
The exceeding of costs estimated in a contract.
Hits - 237
Paradata

Couper first introduced the term “paradata” into survey research methodology field (Groves & Couper, 1998) and the definition of paradata has vastly expanded since then. Paradata now refers to additional data that can be captured during the process of producing a survey statistic (Kreuter, 2013). As discussed in the 2011 International Nonresponse Workshop (Smith, 2011), two main types of paradata are available. One is process paradata, which is collected during the process of data collection, such as time stamps and keystroke data. Another type is related with observational information, such as the observed demographic information of respondents and observed neighborhood conditions.

Hits - 981
Pareto chart
A bar chart that reflects the types of most errors in a process, by error type in descending order; for example, the five or six most frequent types of help desk calls from interviewers using computer-assisted interviewing.
Hits - 203
Performance measurement analysis
A technique used in quality control to determine whether quality assurance procedures have worked. For example, analysis of routine measures of interviewer or coder performance.
Hits - 177
Personally Identifiable Information (PII)

Information that can be used to identify a respondent that minimally includes name, address, telephone number and identification number (such as social security number or driver’s license number), but may include other information including biometric data.

Hits - 265
Pilot study

A quantitative miniature version of the survey data collection process that involves all procedures and materials that will be used during data collection. A pilot study is also known as a “dress rehearsal” before the actual data collection begins.

Hits - 319
Synonyms - pilot studies
Pledge of confidentiality
An agreement (typically in written or electronic form) to maintain the confidentiality of survey data that is signed by persons who have any form of access to confidential information.
Hits - 284
Portable file

A file that is coded in a non-proprietary format such as XML or ASCII and thus can be used by a variety of software and hardware platforms.

Hits - 214
Synonyms - 'Portable'
Post-survey adjustments
Adjustments to reduce the impact of error on estimates.
Hits - 260
Poststratification
A statistical adjustment that assures that sample estimates of totals or percentages (e.g. the estimate of the percentage of men in living in Mexico based on the sample) equal population totals or percentages (e.g. the estimate of the percentage of men living in Mexico based on Census data). The adjustment cells for poststratification are formed in a similar way as strata in sample selection, but variables can be used that were not on the original sampling frame at the time of selection.
Hits - 267
Poststratification adjustment
A statistical adjustment that assures that sample estimates of totals or percentages (e.g., the estimate of the percentage of men in living in Mexico based on the sample) equal population totals or percentages (e.g., the estimate of the percentage of men living in Mexico based on Census data). The adjustment cells for poststratification are formed in a similar way as strata in sample selection, but variables can be used that were not on the original sampling frame at the time of selection.
Hits - 369
Precision
A measure of how close an estimator is expected to be to the true value of a parameter, which is usually expressed in terms of imprecision and related to the variance of the estimator. Less precision is reflected by a larger variance.
Hits - 347
Precoding
When designing the questionnaire and survey instrument, determine coding conventions and formats of survey items (especially the closed-ended questions) based on existing coding frames or prior knowledge of the survey population.
Hits - 283
Prescribed behaviors

Interviewer behaviors that must be carried out exactly as specified.

Hits - 340
Synonyms - prescribed
Pretesting
A collection of techniques and activities that allow researchers to evaluate survey questions, questionnaires and/or other survey procedures before data collection begins.
Hits - 405
Primacy
Context effects in which the placement of the item at the beginning of a list of response options increases the likelihood that it will be selected by the respondent.
Hits - 239
Primary Sampling Unit (PSU)

A cluster of elements sampled at the first stage of selection.

Hits - 934
Synonyms - primary sampling unit, (PSU), PSU
Probability proportional to size (PPS)

A sampling method that assures that sample estimates of totals or percentages (e.g. the estimate of the percentage of men living in Mexico based on the sample) equal population totals or percentages (e.g. the estimate of the percentage of men living in Mexico based on Census data). The adjustment cells for postratification are formed in a similar way as strata in sample selection, but variables can be used that were not on the original sampling frame at the time of selection.

Hits - 385
Synonyms - probability proportional to size
Probability sampling
A sampling method where each element on the sampling frame has a known, non-zero chance of selection.
Hits - 347
Process analysis
The use of tools such as flowcharts to analyze processes, e.g., respondent tracking, computerized instrument programming and testing, coding, data entry, etc. The aim is and to identify indicators or measures of the quality of products. Process analysis also is used to identify improvements that can be made to processes.
Hits - 206
Process improvement plan
A plan for improving a process, as a result of process analysis. A process improvement plan may result from development of a quality management plan, or as a result of quality assurance or quality control.
Hits - 203
Process indicator

An indicator that refers to aspects of data collection (e.g., HPI, refusal rates, etc.).

Hits - 197
Processing error
Survey error (variance and bias) that arise during the steps between collecting information from the respondent and having the value used in estimation. Processing errors include all post-collection operations, as well as the printing of questionnaires. Most processing errors occur in data for individual units, although errors can also be introduced in the implementation of systems and estimates. In survey data, processing errors may include errors of transcription, errors of coding, errors of data entry, errors in the assignment of weights, errors in disclosure avoidance, and errors of arithmetic in tabulation.
Hits - 1135
Progress indicator

An indicator that refers to aspects of reaching the goal (e.g., number of complete interviews).

Hits - 206
Proxy interview

An interview with someone (e.g., parent, spouse) other than the person about whom information is being sought. There should be a set of rules specific to each survey that define who can serve as a proxy respondent.

Hits - 1215
Synonyms - proxy
Public use data files

An anonymized data file, stripped of respondent identifiers that is distributed for the public to analyze.

Hits - 323
Synonyms - public use files
Public-use data file
An anonymized data file, stripped of respondent identifiers that is distributed for the public to analyze.
Hits - 230
Quality
The degree to which product characteristics conform to requirements as agreed upon by producers and clients.
Hits - 424
Quality assurance

A planned system of procedures, performance checks, quality audits, and corrective actions to ensure that the products produced throughout the survey lifecycle are of the highest achievable quality. Quality assurance planning involves identification of key indicators of quality used in quality assurance.

Hits - 340
Quality audit
The process of the systematic examination of the quality system of an organization by an internal or external quality auditor or team. It assesses whether the quality management plan has clearly outlined quality assurance, quality control, corrective actions to be taken, etc., and whether they have been effectively carried out.
Hits - 411
Quality checklist
A checklist for quality identifies all the steps, procedures, and controls specified to ensure required procedures have been followed and their goals met. An example of a Translation Quality Checklist is the ESS Round 7 Translation Quality Checklist (European Social Survey, 2014c).
Hits - 261
Quality control
A planned system of process monitoring, verification, and analysis of indicators of quality, and updates to quality assurance procedures, to ensure that quality assurance works.
Hits - 378
Quality management plan
A document that describes the quality system an organization will use, including quality assurance and quality control techniques and procedures, and requirements for documenting the results of those procedures, corrective actions taken, and process improvements made.
Hits - 263
Quality profile
A comprehensive report prepared by producers of survey data that provides information data users need to assess the quality of the data.
Hits - 261
Question-by-question objectives
Text associated with some questions in interviewer-administered surveys that provides information on the objectives of the questions.
Hits - 245
Questionnaire adaptation
The deliberate technical or substantive modification of some feature of a question, response scales, or other part of a questionnaire to better fit a new socio-cultural context or particular target population (e.g., updating language: "radio" for "wireless", adapting an adult questionnaire for children: "tummy" for "stomach"; or tailoring for cultural needs: walk several blocks versus walk 100 yards).
Hits - 511
Quota sampling
A non-probability sampling method that sets specific sample size quotas or target sample sizes for subclasses of the target population. The sample quotas are generally based on simple demographic characteristics (e.g., quotas for gender, age groups, and geographic region subclasses).
Hits - 429
Random route (Random walk)

For each randomly-chosen sampling points (e.g., urban units, small cities, or voting districts), interviewers are assigned with a starting location and provided with instructions on the random walking rules – e.g., which direction to start, on which side of the streets to walk and which crossroads to take. Households are selected by interviewers following the instructions. The routes end when the predefined number of respondents (or households) is achieved (Bauer, 2016). Since the probability of the selected household is unknown, this method is categorized as non-probability sampling methods (Bauer, 2016)..

Hits - 1769
Synonyms - random walk, Random route
Random-digit-dialing (RDD)
A method of selecting telephone numbers in which the target population consists of all possible telephone numbers, and all telephone numbers have an equal probability of selection.
Hits - 594
Ranking format

A response format where respondents express their preferences by ordering persons, brands, etc. from top to bottom, i.e., generating a rank order of a list of items or entities.

Example: Listed below are possible disadvantages related to smoking cigarettes. Please enter the number 1, 2, 3, or 4 alongside each possible disadvantage to indicate your rank ordering of these.1 stands for the greatest disadvantage, 4 for the least disadvantage.

_____ Harmful effects on other people’s health

_____ Stale smoke smell in clothes and furnishings

_____ Expense of buying cigarettes

_____ Harmful effects on smoker’s health

Hits - 256
Synonyms - Ranking
Rating format

A response format requiring the respondent to select one position on an ordered scale of response scales. Example: To what extent do you agree or disagree with the following statement?

It is a good idea to ban smoking in public places.

Strongly agree
Somewhat agree
Neither agree nor disagree
Somewhat disagree
Strongly disagree
Hits - 404
Synonyms - Rating
Recency

Context effects in which the placement of the item at the end of a list of response options increases the likelihood that it will be selected by the respondent.

Hits - 163
Recontact

To have someone other than the interviewer (often a supervisor) attempt to speak with the sample member after a screener or interview is conducted, in order to verify that it was completed according to the specified protocol.

Hits - 274
Synonyms - recontacting
Refusal rate

The proportion of all units of all potentially eligible sampling units in which a respondent sampling unit refuses to do an interview or breaks off interviews of all potentially eligible sampling units.

Hits - 610
Synonyms - Refusal, refusal, Refusal rate
Reinterview
The process or action of interviewing the same respondent twice to assess reliability (simple response variance).
Hits - 214
Reliability

The consistency of a measurement, or the degree to which an instrument measures the same way each time it is used under the same condition with the same subjects.

Hits - 267
Reluctance aversion techniques

Techniques that can reduce reluctance to participate in potential respondents, thereby increasing the overall response rate.

Hits - 179
Synonyms - reluctance aversion
Repeated panel

A series of fixed panel surveys that may or may not overlap in time. Generally, each panel is designed to represent the same target population definition applied at a different point in time.

Hits - 294
Replicated question

A question which is repeated (replicated) at a later stage in a study or in a different study. Replication assumes identical question wording. Questions which were used in one study, then translated and used in another are also frequently spoken of as having been “replicated.”

Hits - 283
Synonyms - replicated
Replicates

Systematic probability subsamples of the full sample.

Hits - 253
Synonyms - replicate
Residency rule
A rule to help interviewers determine which persons to include in the household listing, based on what the informant reports.
Hits - 179
Response distribution
A description of the values and frequencies associated with a particular question.
Hits - 683
Response distributions
A description of the values and frequencies associated with a particular question.
Hits - 260
Response latency

A method of examining potential problems in responding to particular items, measured by the time between the interviewer asking a question and the response.

Hits - 213
Response options
The category, wording, and order of options given with the survey question.
Hits - 339
Response rate

The number of complete interviews with reporting units divided by the number of eligible reporting units in the sample.

Hits - 368
Synonyms - Response rate, response rates
Response scales
The category, wording, and order of options given with the survey question. See Questionnaire Design for more information.
Hits - 325
Response styles

Consistent and stable tendencies in response behavior which are not explainable by question content or presentation. These are considered to be a source of biased reporting. For example, extreme response style is the tendency to select the two extreme endpoints of a scale; midpoint response style refers the consistent selection of middle or neutral category of the scale; acquiescent response style is the tendency to agree with or to select the positive responses.

Hits - 1536
Synonyms - Acquiescence bias
Responsive designs

Responsive design was developed by Groves and Heeringa (2006). Usually the following steps are included: first, researchers pre-identify a set of design features that are of interest (e.g., tradeoff between cost and error); second, researchers identify and monitor these indicators; third, researchers provide intervention or alter the design features based on the pre-identified design decisions rules. Most recently, with the development of technology, real-time responsive design can be achieved in a single survey, such as prompting respondents who show signs of satisficing in web surveys.

Hits - 300
Synonyms - responsive design
Restricted tendering
A bidding process in which only bidders prequalified through a screening process may participate in bidding, in which they are evaluated and then chosen on the basis of cost and technical merit.
Hits - 630
Restricted-use data file

A file that includes information that can be related to specific individuals and is confidential and/or protected by law. Restricted-use data files are not required to include variables that have undergone coarsening disclosure risk edits. These files are available to researchers under controlled conditions.

Hits - 264
Synonyms - Restricted-use file,restricted use files
Reviewer
Person who participates in the review of translations in order to produce a final version (see Appendix A of Translation).
Hits - 315
Rotating panel design

A study where elements are repeatedly measured a set number of times, then replaced by new randomly chosen elements. Typically, the newly-chosen elements are also measured repeatedly for the appropriate number of times.

Hits - 730
Sample design
Information on the target and final sample sizes, strata definitions and the sample selection methodology.
Hits - 461
Sample element

A selected sampling unit of the target population that may be eligible or ineligible.

Hits - 385
Sample management system
A computerized and/or paper-based system used to assign and monitor sample units and record documentation for sample records (e.g., time and outcome of each contact attempt).
Hits - 304
Sample person
A person selected from a sampling frame to participate in a particular survey.
Hits - 239
Sampling bias
The systematic difference between the expected value (over all conceptual trials) of an unweighted sample estimate and the target population value because some elements on the sampling frame have a higher chance of selection than other elements.
Hits - 233
Sampling error
Survey error (variance and bias) due to observing a sample of the population rather than the entire population.
Hits - 334
Sampling error computational units (SECUs)

PSUs in ‘one PSU per stratum’ sampling designs that are grouped in pairs, after data collection, for purposes of estimating approximate sampling variances.

Hits - 163
Sampling frame
A list or group of materials used to identify all elements (e.g., persons, households, establishments) of a survey population from which the sample will be selected. This list or group of materials can include maps of areas in which the elements can be found, lists of members of a professional association, and registries of addresses or persons.
Hits - 875
Sampling units

Elements or clusters of elements considered for selection in some stage of sampling. For a sample with only one stage of selection, the sampling units are the same as the elements. In multi-stage samples (e.g., enumeration areas, then households within selected enumeration areas, and finally adults within selected households), different sampling units exist, while only the last is an element. The term primary sampling units (PSUs) refers to the sampling units chosen in the first stage of selection. The term secondary sampling units (SSUs) refers to sampling units within the PSUs that are chosen in the second stage of selection.

Hits - 286
Synonyms - sample units
Sampling variance
A measure of how much a statistic varies around its mean (over all conceptual trials) as a result of the sample design only. This measure does not account for other sources of variable error such as coverage and nonresponse.
Hits - 384
Satisficing

To answer survey questions optimally, four stages of cognitive processing are required:  (1) interpret the questions comprehensively, (2) retrieve information from memory, (3) form a judgment, and (4) map the judgment to the appropriate response category. However, to lower cognitive burden, instead of seeking to optimize, respondents may skip some steps when the answer survey questions. This behavior is called satisficing.

Hits - 257
Satisficing behaviors

Decision-making strategies that entail searching through the available alternatives until an acceptability threshold is met.

Hits - 189
Secondary Sampling Unit (SSU)

A cluster of sample elements sampled at the second stage of selection.

Hits - 753
Synonyms - secondary sampling units, (SSU), SSU, (secondary sampling units (SSUs))
Sequential mixed mode
A mixed mode design in which additional modes are offered as part of a nonresponse follow-up program.
Hits - 253
Shared Language harmonization

Shared language harmonization can be understood as the procedures and result of trying to harmonize as much as possible different regional varieties of a "shared" language across countries, e.g. in terms of vocabulary and/or structure. An example would be to harmonize translations into Italian between questionnaires used in Italy and in Switzerland.

Hits - 328
Synonyms - language harmonization
Silent monitoring

Monitoring without the awareness of the interviewer.

Hits - 224
Simple random sampling (SRS)
A procedure where a sample of size n is drawn from a population of size N in such a way that every possible sample of size n has the same probability of being selected.
Hits - 502
Social desirability bias
A tendency for respondents to overreport desirable attributes or attitudes and underreport undesirable attributes or attitudes.
Hits - 314
Socio-demographic question

A question typically asking about respondent characteristics such as age, marital status, income, employment status, and education.

Example: What year and month were you born?

Hits - 435
Soft consistency check
A signal warning that there is an inconsistency between the current response and a previous response. The soft consistency check should provide guidance on resolving the inconsistency, but the interviewer or respondent may continue the survey without resolving it.
Hits - 213
Source document
The original document from which other (target) documents are translated or adapted as necessary.
Hits - 257
Source instrument
The original instrument from which other (target) instruments are translated or adapted as necessary.
Hits - 241
Source language
The language in which a questionnaire is available from which a translation is made. This is usually but not always the language in which the questionnaire was designed.
Hits - 279
Source questionnaire

The questionnaire taken as the text for translation. The source questionnaire would normally not be intended to be fielded as such but would require local adaptation even if fielded in the source language: for instance, in the ESS, the source questionnaire is English, but the questionnaires fielded in Ireland and UK differ slightly from the source questionnaire.

Hits - 450
Synonyms - source questionnaires
Source variables
Original variables chosen as part of the harmonization process.
Hits - 217
Split panel

A design that contains a blend of cross-sectional and panel samples at each new wave of data collection.

Hits - 356
Split translation

Each translator translates only a part of the total material to be translated in preparation for a review meeting, in contrast to translating the entire text (see full translation).

Hits - 267
Stand-alone experiment

An experiment conducted as an independent research project.

Hits - 202
Synonyms - stand-alone
Standardized interviewing technique

An interviewing technique in which interviewers are trained to read every question exactly as worded, abstain from interpreting questions or responses, and do not offer much clarification.

Hits - 289
Synonyms - standardized interviewing, standardized question-asking
Statistical process control chart
A statistical chart that compares expected process performance (e.g., number of hours worked by interviewers in a week) against actual performance. For example, interviewers who perform outside upper and lower boundaries on this measure are flagged; if greater variation from expected performance for some interviewers in a certain location can be explained (e.g., a hurricane or a snow storm causing lower than expected hours worked), the process is in control; if not, corrective actions are taken.
Hits - 215
Straightlining
Clicking the same answer for each item in a multi-numeric list.
Hits - 266
Strata (stratum)

Mutually exclusive, homogenous groupings of population sample elements or clusters of elements that comprise all of the elements on the sampling frame. The groupings are formed prior to selection of the sample.

Hits - 328
Synonyms - stratum, Strata
Stratification

A sampling procedure that divides the sampling frame into mutually exclusive and exhaustive groups (or strata) and places each element on the frame into one of the groups. Independent selections are then made from each stratum, one by one, to ensure representation of each subgroup on the frame in the sample.

Hits - 241
Synonyms - Stratifications
Substitution
A technique where each nonresponding sample element from the initial sample is replaced by another element of the target population, typically not an element selected in the initial sample. Substitution increases the nonresponse rate and most likely the nonresponse bias.
Hits - 275
Survey lifecycle
The lifecycle of a survey research study, from design to data dissemination.
Hits - 519
Survey population
The actual population from which the survey data are collected, given the restrictions from data collection operations.
Hits - 1651
Survey weight
A statistical adjustment created to compensate for complex survey designs with features including, but not limited to, unequal likelihoods of selection, differences in response rates across key subgroups, and deviations from distributions on critical variables found in the target population from external sources, such as a national Census.
Hits - 318
Systematic sampling
A procedure that selects of every kth element on the sampling frame after a random start.
Hits - 220
Tailoring

The practice of adapting interviewer behavior to the respondent’s expressed concerns and other cues, in order to provide feedback to the respondent that addresses his or her perceived reasons for not wanting to participate.

Hits - 353
Synonyms - tailor
Target language
The language a questionnaire is translated into.
Hits - 300
Target population
The finite population for which the survey sponsor wants to make inferences using the sample statistics.
Hits - 428
Target variables
Variables created during the harmonization process.
Hits - 228
Task
An activity or group of related activities that is part of a survey process, likely defined within a structured plan, and attempted within a specified period of time.
Hits - 449
Taylor Series variance estimation
A commonly used tool in statistics for handling the variance estimation of statistics that are not simple additions of sample values, such as odds ratios. Taylor series handles this by converting a ratio into an approximation that is a function of the sums of the values.
Hits - 328
Team translation
Team approaches to survey translation and translation assessment bring together a group of people with different talents and functions in the team so as to ensure the mix of skills and discipline expertise needed to produce an optimal translation version in the survey context. Each stage of the team translation process builds on the foregoing steps and uses the documentation required for the previous step to inform the next. In addition, each phase of translation engages the appropriate personnel for that particular activity and provides them with relevant tools for the work at hand.
Hits - 324
Tender
A formal offer specifying activities to be completed within prescribed time and budget.
Hits - 287
Timestamps

Timestamps are time and date data recorded with survey data, indicated dates and times of responses, at the question level and questionnaire section level. They also appear in audit trails, recording times questions are asked, responses recorded, and so on.

Hits - 272
Synonyms - time stamps
Top coding
A type of coding in which values that exceed the predetermined maximum value are reassigned to that maximal value or are recoded as item missing data.
Hits - 220
Total Survey Error (TSE)

Total survey error provides a conceptual framework for evaluating survey quality. It defines quality as the precise estimation and reduction of the mean square error (MSE) of statistics of interest.

Hits - 421
Tracking

The process of attempting to locate a sample element that changed contact information (e.g. address, telephone number, email address) since the last time the element’s contact information was collected.

Hits - 300
Transformation algorithms
Changing the values of a variable by using some mathematical operation.
Hits - 200
Translatability assessment
Translatability assessment is a recently developed process which aims to identify potential problems in translation and adaptation in the initial instrument development stage in the source language (Conway, Acquadro, & Patrick, 2014; Sperber et al., 2014). It evaluates to which extent, a question of interest can be meaningfully translated.
Hits - 367
Translator
The person who translates text from one language to another (e.g., French to Russian). In survey research, translators might be asked to fulfill other tasks such as reviewing and copyediting.
Hits - 363
Trusted digital repository
A repository whose mission is to provide reliable, long-term access to managed digital resources to its designated community, both now and in the future.
Hits - 212
Undocumented code number
A code that is not authorized for a particular question. For instance, if a question that records the sex of the respondent has documented codes of "1" for female and "2" for male and "9" for "missing data," a code of "3" would be an "undocumented code."
Hits - 314
Unique Identification Number

A unique number that identifies an element (e.g. serial number). That number sticks to the element through the whole survey lifecycle and is published with the public dataset. It does not contain any information about the respondents or their addresses.

 

Hits - 220
Unit nonresponse
An eligible sampling unit that has little or no information because the unit did not participate in the survey.
Hits - 360
units (Sampling units)

Elements or clusters of elements considered for selection in some stage of sampling. For a sample with only one stage of selection, the sampling units are the same as the elements. In multi-stage samples (e.g., enumeration areas, then households within selected enumeration areas, and finally adults within selected households), different sampling units exist, while only the last is an element. The term primary sampling units (PSUs) refers to the sampling units chosen in the first stage of selection. The term secondary sampling units (SSUs) refers to sampling units within the PSUs that are chosen in the second stage of selection.

Hits - 474
Synonyms - Sampling units
Universe statement

A description of the subgroup of respondents to which the survey item applies (e.g., “Female, ≥ 45, Now Working”).

Hits - 359
Synonyms - universe
Unwritten language
An unwritten language is one which does not have a standard written form used by the native speakers of the language.
Hits - 902
Usability testing
Evaluation of a computer-assisted survey instrument to assess the effect of design on interviewer or respondent performance. Methods of evaluation include review by usability experts and observation of users working with the computer and survey instrument.
Hits - 275
Validity

The extent to which a variable measures what it intends to measure.

Hits - 205
Variance
A measure of how much a statistic varies around its mean over all conceptual trials.
Hits - 408
Vignettes

Brief stories/scenarios describing hypothetical situations or persons and their behaviors to which respondents are asked to react in order to allow the researcher to explore contextual influences on respondent’s response formation processes.

Hits - 238
Vocal characteristics

“Analysis of vocal characteristics, also called paralinguistic data (Draisma & Dijkstra, 2004), like behavior codes, examines audio recordings of interviews to identify notable traits of the interviewer’s voice itself, rather than behaviors during the interview. These vocal properties include pitch (higher or lower sounding voices), intonation (rising or falling pitch), speech rate, and loudness” (Olson & Parkhurst, 2013).

Hits - 2143
Weighting
A post-survey adjustment that may account for differential coverage, sampling, and/or nonresponse processes.
Hits - 282
Within-country language harmonization
The process of harmonizing language versions within one multilingual country, such as harmonizing the Ukrainian and Russian versions within Ukraine.
Hits - 154
Word list
Word lists can of course serve various purposes: When regional varieties of a language are to be accommodated, a word list can be created of the words that are required for specific varieties of a language. They can also be incorporated into computer applications of an instrument. A word list can be a useful resource for interviewers. They cannot, however, address challenges faced when regional varieties differ in more radical and structural ways from one another. A word list can also serve similar functions as a glossary.
Hits - 299
Working group
Experts working together to oversee the implementation of a particular aspect of the survey lifecycle (e.g., sampling, questionnaire design, training, quality control, etc.)
Hits - 247
XML (eXtensible Markup Language)
XML (Extensible Markup Language) is a flexible way to create common information formats and share both the format and the data on the World Wide Web, intranets, and elsewhere. XML documents are made up of storage units called entities, which contain either parsed or unparsed data. Parsed data are made up of characters, some of which form character data, and some of which form markup. Markup encodes a description of the document's storage layout and logical structure. XML provides a mechanism to impose constraints on the storage layout and logical structure.
Hits - 188