Self-report è Meglio delle Misure Implicite?

L’articolo “incriminato”

Misure implicite?

Indirect behavioral measures in which participants do not have to introspect and report on their thoughts and feelings”

“Today, there are more than two dozen implicit measures, including the implicit association test, the affect misattribution procedure, and the evaluative priming task. These measures have been used to assess a variety of constructs such as attitudes, stereotypes, self-esteem, motives, outcome expectations, values, self-harm ideation, and semantic relations between concepts

“First, mental contents are inferred from performance indicators (for example, response times, error rates or response frequencies) typically measured via computers. Second, responses on implicit measures are assumed to be driven by automatic processes (processes that are unintentional, unconscious, efficient, or uncontrolled)”

IAT (implicit) in a nutshell

La differenza in tempi di reazione Mapping 1-Mapping 2 dà la misura dell’associazione implicita, che dovrebbe riflettere l’atteggiamento (?)

L’alternativa “esplicita”?

Scale e questionari self-report

esempio inventato con scala Likert 1-4:

  • “Preferisco passare del tempo con persone giovani che con anziani”

  • “Affiderei un compito a un giovane piuttosto che ad un anziano”

  • “L’anzianità porta competenza e saggezza”

Presunti vantaggi misure implicite

  • No contamination (desiderabilità sociale, influenza del contesto)

  • No consciousness (accesso a pensieri/sentimenti che sfuggono all’introspezione)

  • Automaticity (accesso diretto a processi mentali automatici)

  • Simple associations (es. proposizionalmente so che l’associazione tra “vaccini” e “autismo” non esiste nella realtà, ma nella mia rete semantica i due concetti potrebbero essere associati)

  • Robustness (accesso a processi di apprendimento associativo molto radicati, stabili nel tempo)

  • Person vs. environment - teorizzazioni in realtà contrapposte (misurano caratteristiche individuali o dell’ambiente [es. stereotipi comuni]?)

No contamination: È vero?

  • Desiderabilità sociale in self-report è un problema ma 1) la rilevanza è inflazionata (totalità anonimità può anche peggiorare qualità ricerca); 2) il problema esiste anche nell’implicito (es. effetti cambiano in base a gruppo/minoranza sperimentatore)

“one study found that public (versus private) testing conditions reduced scores indicative of anti-gay prejudice on a gay/straight implicit association test to a larger extent (d = .40) than self-reported homophobia (d = .17) and heterosexism (d = .35)”

  • Inoltre, “implicit measures are notoriously sensitive to faking strategies. Social biases on implicit measures are lower when participants are told that their “job is to be as nonprejudiced as possible” compared to when they are not”

  • Infine, alti punteggi di desiderabilità sociale non sembrano portare a minori correlazioni implicito-esplicito.

No consciousness: È vero?

participants are able to predict their scores on implicit measures with a high level of accuracy (correlations between predicted and actual scores greater than .50) regardless of how much prior experience they have with implicit measures, how much information they receive about implicit measures”

Quindi “although it is true that self-report measures are suboptimal for capturing unconscious thoughts and feelings, there is no evidence that implicit measures capture unconscious thoughts and feelings either

Automaticity: È vero?

Le condizioni (“speeded”) facilitano processi automatici, ma questo si può ottenere anche nei self-report: “researchers interested in fast mental processes could request speeded self-reports

o anche con richieste dirette, instructing participants to avoid specific influences when providing their self-report response (for example, to avoid being influenced by the attractiveness of job candidates when judging their suitability for a position)”

Simple associations: È vero?

“meta-analytic evidence suggests that implicit measures are highly sensitive to truth and relational meaning (es. vaccini-autismo)

inoltre, anche i self-report possono riflettere simple associations, “responses on self-report measures are jointly shaped by propositional beliefs and simple associations (con pairings casuali?)

Robustness: È vero?

responses on implicit measures can change quickly in response to minimal information, including a single statement”

“there is no evidence that changes on implicit and self-report measures differ in terms of their relative stability over time at the individual level”

Person vs. environment: Cosa è vero?

“data from participants who reside in the same region are aggregated, and analyses test whether these aggregate scores are systematically related to characteristics of the region

Quale che sia la cosa vera “with few exceptions, aggregated responses on self-report and implicit measures at the regional level tend to be redundant, with correlations as high as r = .94

Vantaggi del self-report

Attendibilità

generalmente scarsa nelle misure implicite, “the implicit association test and the affect misattribution procedure are the only two instruments that show estimates of internal consistency that meet standard psychometric criteria with Cronbach’s alphas between .70 and .90. All other instruments suffer from substantial measurement error with modal Cronbach’s alphas around .50.”

“Moreover, even the two implicit measures that have shown acceptable estimates of internal consistency (the implicit association test and the affect misattribution procedure) show lower test-retest stability (rs = ~.50) than conceptually corresponding self-report measures (rs = ~.75)”

Vantaggi del self-report

Predittività comportamento reale

Considerando complessivamente tutte le meta-analisi disponibili, emergerebbe che le correlazioni tra misure e comportamento osservato siano più forti per misure self-report (r = .40 to r = .50) che implicite (r = .11 to r = .36), es. su dietary patterns, comportamenti health-related, safety behavior, condom use [come lo verificano?! 😱 lo chiedono self-report…]

Kaiser and Oswald (2022) - The scientific value of numerical measures of human feelings

Le correlazioni tra “single feeling integer” e outcome a distanza di un anno variano in base ad outcome e contesti, ma in media e mediana sono 0.15 e arrivano a 0.20, superando generalmente le variabili socioeconomiche

Vantaggi del self-report

Praticità e flessibilità

  • Risparmio di tempo, “why one should administer the same implicit measure multiple times when the same information can be obtained with a simple self-report measure—especially when self-report measures based on a single item can reasonably predict (r = ~.15) important life events (for example, job change or relationship dissolution) one year ahead of time” [cf. slide precedente]

  • Self-report non ha bisogno di basarsi su categorie contrapposte

  • Self-report può essere usato per concetti complessi (es. atteggiamento verso a proposed policy change) non facilmente rappresentabili in task impliciti

  • Self-report non richiede strumenti tecnologici e software

Structural-fit approach

Alternativa suggerita per isolare aspetti di processi automatici, es. intenzionalità

immaginate molti trial con numerosi volti giovani vs anziani; la differenza tra la condizione non-intenzionale e quella intenzionale potrebbe dare la misura dell’effetto dell’intenzionalità

Structural-fit approach

qui la differenza tra la condizione alto-carico e quella basso-carico potrebbe dare la misura dell’effetto del carico cognitivo