SciELO - Scientific Electronic Library Online

 
vol.41 número2Propriedades psicométricas do Inventário de Traços Problemáticos em Crianças numa amostra de crianças portuguesas índice de autoresíndice de assuntosPesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Não possue artigos similaresSimilares em SciELO

Compartilhar


Análise Psicológica

versão impressa ISSN 0870-8231versão On-line ISSN 1646-6020

Aná. Psicológica vol.41 no.2 Lisboa dez. 2023  Epub 31-Dez-2023

https://doi.org/10.14417/ap.2044 

Métodos e Instrumentos de Investigação

Psychometric properties of the Angolan version of the Reflective Functioning Questionnaire - 8 (RFQ-8): An exploratory study

Propriedades psicométricas da versão angolana do Questionário de Funcionamento Reflexivo - 8 (RFQ-8): Estudo Exploratório

Karina Martins1  , (Data curation, Formal analysis, Investigation, Methodology, Writing - Original draft
http://orcid.org/0009-0001-8778-4076

Luís Benedito1  , Data curation, Formal analysis, Writing - Original draft
http://orcid.org/0009-0005-4391-4237

Carlos Farate1  2  3  , Conceptualization, Writing - Review & editing
http://orcid.org/0000-0002-9246-0164

Fernanda Daniel1  4  , Conceptualization, Writing - Review & editing
http://orcid.org/0000-0002-2202-1123

Henrique Testa Vicente1  3  , Conceptualization, Methodology, Project administration, Supervision, Writing - Original draft, Writing - Review & editing
http://orcid.org/0000-0001-5571-9168

1 ISMT - Instituto Superior Miguel Torga, Coimbra, Portugal

2 SPP - Sociedade Portuguesa de Psicanálise, Lisboa, Portugal

3 CEPESE - Centro de Estudos da População, Economia e Sociedade, Porto, Portugal

4 Universidade de Coimbra, CEISUC - Centro de Estudos e Investigação em Saúde, Coimbra, Portugal


Abstract: The Reflective Functioning Questionnaire (RFQ-8) is a brief self-report psychometric instrument designed to assess an individual’s reflective functioning abilities. This study aimed to examine the psychometric properties of the Angolan version of the RFQ-8, namely, to assess its factor structure and to examine its correlations with related constructs and clinical variables in a sample of the general population of Angola.

A cross-sectional study was conducted with 132 participants (aged ≥18 years) with Angolan residency and nationality, recruited through non-probability, convenience and snowball sampling procedures. The online research protocol included a Portuguese translation of the RFQ-8 and a battery of self- report measures (Brief Symptom Inventory; Adult Attachment Scale - Revised; Beck Cognitive Insight Scale).

Consistent with previous research, results supported a two-factor structure for the RFQ-8 (assessing certainty and uncertainty about mental states; RFQc and RFQu subscales) with satisfactory internal consistency. RFQ-8 scores also showed significant correlations to psychopathological symptoms, suggesting a close relation between uncertainty about mental states and clinical problems, consistent with the mentalization framework; statistically significant relationships with different attachment patterns that support mentalization’s developmental schema; significant correlations with cognitive insight, a construct closely related to reflective functioning. Even though the RFQ-8 was designed to assess two impairments in reflective functioning (hypermentalization and hypomentalization), it seems that only hypomentalization is adequately addressed by this instrument. Further research is thus needed to analyze the probable unidimensionality of the RFQ-8 and the viability of different scoring procedures.

In conclusion, this study offers preliminary evidence on the reliability and validity of the Angolan version of this scale. Besides its usefulness in clinical assessment, it could also contribute to developing research on mentalization and the efficacy of psychotherapeutic interventions, including patients’ responses to mentalization-based treatments.

Keywords: Mentalization; Reflective functioning questionnaire; Psychometric properties; Factor structure.

Resumo: O Questionário de Funcionamento Reflexivo (RFQ-8) é um instrumento psicométrico de auto-relato breve, concebido para avaliar as capacidades de funcionamento reflexivo de um indivíduo. Este estudo teve como objetivo examinar as propriedades psicométricas da versão Angolana do RFQ-8, nomeadamente, avaliar a sua estrutura fatorial e examinar as suas correlações com constructos relacionados e variáveis clínicas numa amostra da população geral de Angola.

Foi realizado um estudo transversal com 132 participantes (idade ≥18 anos) com residência e nacionalidade Angolana, recrutados através de procedimentos de amostragem não probabilística, por conveniência e bola de neve. O protocolo de investigação online incluiu uma tradução portuguesa do RFQ-8 e uma bateria de medidas de auto-relato (Inventário de Sintomas Psicopatológicos; Escala de Vinculação do Adulto; Escala de Insight Cognitivo de Beck).

Em concordância com estudos prévios, os resultados suportaram uma estrutura bifactorial para o RFQ-8 (avaliando a certeza e a incerteza acerca de estados mentais; subescalas RFQc e RFQu) com consistência interna satisfatória. As pontuações do RFQ-8 também mostraram correlações significativas com sintomas psicopatológicos, sugerindo uma relação estreita entre a incerteza sobre estados mentais e perturbações clínicas, consistente com a teoria da mentalização; relações estatisticamente significativas com diferentes padrões de vinculação que reforçam o esquema desenvolvimental da mentalização; correlações significativas com o insight cognitivo, um constructo intimamente relacionado com o funcionamento reflexivo. Apesar de o RFQ-8 ter sido concebido para avaliar dois défices no funcionamento reflexivo (hipermentalização e hipomentalização), apenas a hipomentalização parece ser adequadamente analisada por este instrumento. Assim, é necessária investigação adicional para analisar a provável unidimensionalidade do RFQ-8 e a viabilidade de diferentes procedimentos de cotação.

Em conclusão, este estudo oferece evidências preliminares sobre a fiabilidade e validade da versão Angolana desta escala. Para além da sua utilidade na avaliação clínica, poderá também contribuir para o desenvolvimento da investigação sobre mentalização e sobre a eficácia de intervenções psicoterapêuticas, incluindo a resposta a tratamentos baseados na mentalização.

Palavras-chave: Mentalização; Questionário de funcionamento reflexivo; Propriedades psicométricas; Estrutura fatorial.

Introduction

The Reflective Functioning Questionnaire (RFQ-8) is a brief self-report psychometric instrument designed to assess an individual’s reflective functioning abilities (Fonagy et al., 2016). Reflective functioning or mentalizing refers to the ability to understand the self and others and to interpret behaviors in terms of underlying mental states, including emotions, desires, thoughts, and beliefs (Fonagy et al., 2002). Research suggests that reflective functioning plays a substantial role in typical and atypical development and in psychotherapeutic processes and outcomes (Badoud et al., 2015).

Until the development of the RFQ-8, the only well-validated measure that directly assessed reflective functioning was interview-based: the Reflective Functioning Scale (RFS) (Fonagy et al., 1998) applied to the Adult Attachment Interview (AAI) (George et al., 1996) and to the Parent Development Interview (Slade et al., 2004; Sleed et al., 2020). Even though some authors argue that the RFS remains the gold standard for measuring reflective functioning (Morandotti et al., 2018), it is time-consuming and requires highly trained administrators/raters, therefore limiting the scope of its applicability in most clinical and research contexts (Anis et al., 2020; Badoud et al., 2015). Recognizing the need for an instrument that could be deployed in large-scale epidemiological studies, Fonagy et al. (2016) devised a generic and easy-to-administer self-report measure of reflective functioning for adults, entitled the Reflective Functioning Questionnaire (RFQ-8).

The RFQ-8 has two subscales that assess uncertainty (RFQu) and certainty (RFQc) about mental states. It was hypothesized that higher scores on each subscale indicated impaired reflective functioning, namely hypomentalizing and hypermentalizing. Hypomentalizing refers to an inability or difficulty in considering the mental states of self and others, whereas hypermentalizing reflects an opposite tendency to develop excessively detailed models about the mind of oneself and others without appropriate empirical evidence to support them. Genuine mentalization, on the other hand, implies a certain degree of modesty and humility concerning the knowledge of mental states, recognizing their inherent opaqueness (Fonagy et al., 2016).

Since the development of the RFQ-8, other self-report tools for assessing mentalization have been developed: the Reflective Functioning Questionnaire - Youth (RFQ-Y; Sharp et al., 2009); the Mentalization Questionnaire (MZQ; Hausberg et al., 2012); the Parent Reflective Functioning Questionnaire (PRFQ; Rostad & Whitaker, 2016) and the Mentalization Scale (MentS; Dimitrijević et al., 2018). However, the RFQ-8 remains the most thoroughly analyzed and examined psychometric tool. It has been translated into several languages, and most validation studies highlight its reliability and capacity to identify deficits in reflective functioning (Table 1).

Table 1 Literature review concerning the validation and evaluation of psychometric properties of the RFQ-8 

The literature review on the psychometric proprieties of the RFQ-8 indicates that, although some validation studies include clinical and non-clinical samples (e.g., Morandotti et al., 2018), as suggested by Fonagy et al. (2016), most of them resort to the general population and/or to college students’ samples (e.g., Wozniak-Prus et al., 2022). Regarding statistical procedures for analyzing the RFQ-8 factor structure, most of the reviewed studies follow the indications of the authors of the scale, using Confirmatory Factor Analysis (CFA). However, it should be noted that some studies combine CFA with Exploratory Factor Analysis (e.g., Ruiz-Parra et al., 2023; Spitzer et al., 2020), while others use Principal Component Analysis (Griva et al., 2020; Morandotti et al., 2018). In congruence with the original study, bi-factor solutions (RFQu and RFQc) are prevalent, but more recent studies suggest a single-factor structure related to hypomentalization (Muller et al., 2022; Rueda et al., 2020; Ruiz-Parra et al., 2023; Wozniak-Prus et al., 2022).

In terms of internal consistency, the results indicate reliability between adequate and good, with Cronbach’s alpha values ranging from .65 to .86 for the RFQc subscale (Bizzi et al., 2021; Fonagy et al., 2016; Griva et al., 2020) and between .62 and .86 for the RFQu subscale (Mousavi et al., 2021; Paiva, 2021). Test-retest reliability was analyzed in some studies, with correlation values ranging from .59 to .81 for the RFQc subscale (Morandotti et al., 2018; Mousavi et al., 2021; Paiva, 2021) and between .55 and .85 for the RFQu subscale (Badoud et al., 2015; Morandotti et al., 2018), suggesting temporal stability. Finally, the convergent validity of the RFQ-8 was assessed using a wide range of psychometric instruments. Besides the expected significant relations to theoretical-clinical constructs closely related to reflective functioning, such as empathy, perspective-taking, and mindfulness, RFQ-8 scores also showed several associations with psychopathological symptoms and attachment styles. According to mentalization theory, the capacity to mentalize develops in the context of secure attachment relationships, and disruptions in reflective functioning processes were linked to vulnerability to various psychopathological conditions. However, as Muller et al. (2022) point out, the RFQc and RFQu subscales show opposing correlational patterns with these variables (e.g., Badoud et al., 2015; Fonagy et al., 2016). The RFQu was often negatively associated with mental health (an indicator that the subscale is effectively assessing hypomentalization), whereas the RFQc tends to show positive correlations, suggesting that, instead of assessing hypermentalization, it is capturing adaptive reflective functioning. Studies on the discriminant validity of the instrument also consistently found that the RFQu was better able to discriminate clinical cases from healthy controls (Fonagy et al., 2016; Morandotti et al., 2018). Another issue identified by Muller et al. (2022) refers to the inadequate coverage of the reflective functioning construct, as defined by the creators of the scale, in the RFQ-8. According to Fonagy et al. (2016), reflective functioning refers to the capacity to reflect on internal mental states concerning self and others, but item content analysis reveals that most refer to understanding oneself (only one item includes thinking about others).

Despite its limitations, the RFQ-8 has achieved broad acceptance and is used in a growing body of literature. Considering the promising properties of the RFQ-8 as a brief screening tool for clinical assessment and quantitative research, the contemporary relevance of mentalization-based theoretical models and therapeutic interventions, and taking into account the scarcity of validated psychological assessment instruments for the Angolan population, this exploratory study aims to translate and validate the Angolan version of the RFQ-8 and to analyze its psychometric properties in a sample of the general population of this country. More specifically, we aimed to examine the scale’s factor structure, explore its internal consistency and convergent validity, and analyze its correlations with sociodemographic variables.

Method

Participants

Approval from the Miguel Torga Institute of Higher Education research ethics committee was obtained (CE-P12-22). Inclusion criteria included: being 18 years of age or older; Angolan residency and nationality; absence of impairments and/or difficulties that compromised understanding of the evaluation protocol. Non-probability, snowball, and convenience sampling techniques were used. The research protocol was shared with a small number of participants residing in Luanda who met eligibility criteria, and these initial informants then shared the protocol with members of their social networks. Sample collection was also supported by the Instituto Politécnico Tundavala (Lubango, Angola), which shared the questionnaire among students and teachers of the institution.

The sample comprises 132 adults, 62.9% female (n=83). The mean age of participants is 30.48 years (SD=10.9), and most (69.7%) were single. Regarding educational level, 38.6% reported having an undergraduate degree, and most respondents (50.8%) were students. According to the Classification of Professions of Angola (Republic of Angola, 2016), 26.5% work in intellectual and scientific activities. The “insufficient information” category was created to encompass all subjects whose job descriptions were not specific enough to allow accurate classification (e.g., government employees) (Table 2). The sample size in this study allowed resorting to CFA (more than 5 cases per estimated parameter) (Bentler & Chou, 1987).

Table 2 Sociodemographic characteristics of the sample 

Note. M=Mean; SD=Standard Deviation; Min=Minimum value; Max=Maximum value.

Measures

Sociodemographic Questionnaire. All participants completed a brief questionnaire covering sociodemographic information: sex, age, marital status, education level, employment status, and occupation.

Brief Symptom Inventory (BSI; Derogatis & Melisaratos, 1983; Portuguese version by Canavarro, 1999). The BSI is a 53-item self-report instrument designed to assess psychological distress covering nine primary symptom dimensions (Somatization, 7 items, e.g., “Feeling weak in parts of your body”; Obsession-Compulsion, 6 items, e.g., “Having to check and double check what you do”; Interpersonal Sensitivity, 4 items, e.g., “Feeling that people are unfriendly or dislike you”; Depression, 6 items, e.g., “Thoughts of ending your life”; Anxiety, 6 items, e.g., “Suddenly scared for no reason”; Hostility, 5 items, e.g., “Having urges to beat, injure, or harm someone”; Phobic Anxiety, 5 items, e.g., “Feeling afraid to travel on buses, subways, or trains”; Paranoid Ideation, 5 items, e.g., “Feeling that people will take advantage of you if you let them”; and Psychoticism, 5 items, e.g., “The idea that someone else can control your thoughts”). Respondents are asked to rate the extent to which they have experienced each symptom during the last week on a 5-point Likert scale (0=Not at all; 4=Extremely). Regarding internal consistency, Cronbach’s alpha values of the subscales ranged from .71 to .85 (Derogatis & Melisaratos, 1983). In the Portuguese version, Cronbach’s alpha values ranged from .62 to .80 (Canavarro, 1999). In the present study, Cronbach’s alpha values ranged from .66 to .82.

Beck Cognitive Insight Scale (BCIS; Beck et al., 2004; Portuguese version by Pinho et al., 2021). The BCIS is a 15-item self-report instrument originally developed for assessing cognitive insight in psychotic patients, namely their self-reflectiveness and overconfidence in the interpretation of personal experiences. The BCIS has two subscales: Self-Reflectiveness (the capacity to reflect on their thoughts and beliefs and consider alternative perspectives; 9 items; e.g., “At times, I have misunderstood other people’s attitudes towards me”) and Self-Certainty (the level of confidence an individual has in their thoughts and beliefs; 6 items; e.g., “My interpretations of my experiences are definitely right”). Participants are asked to rate the extent to which they agree with a list of sentences describing how people think and feel using a 4-point Likert scale (0=Do not agree at all; 3=Completely agree). Regarding the internal consistency of the original version, Cronbach’s alpha values of the subscales mentioned above were .68 and .60, respectively. In the Portuguese version, Cronbach’s alpha values were .70 for both subscales and .63 for the total scale. In the present study, we obtained Cronbach’s alpha values of .76 (Self-Reflectivity) and .69 (Self-Certainty).

Adult Attachment Scale - Revised (AAS-R; Collins & Read, 1990; Portuguese version by Canavarro et al., 2006). The AAS-R is an 18-item self-report instrument that assesses adult attachment styles, namely aspects related to fear of abandonment or undesirability, trust towards others, and the degree of proximity and intimacy with them. The AAS-R includes three subscales, each composed of six items: Anxiety (e.g., “I want to get close to people, but I worry about being hurt”), Close (e.g., “I find it relatively easy to get close to people”), and Depend (e.g., “I find it difficult to allow myself to depend on others”). Participants are asked to register, using a 5-point scale (1=Not at all characteristic of me; 5=Extremely characteristic of me), the extent to which each sentence describes how they feel about the affective relationships they establish. Regarding internal consistency, Cronbach’s alpha values of the original version subscales were α=.72 (Anxiety), α=.69 (Close), and α=.75 (Depend) (Collins & Read, 1990). In the Portuguese version, Cronbach’s alpha values ranged from .54 to .84 (Canavarro et al., 2006). In the present study, we obtained Cronbach’s alpha values of .81 (Anxiety), .57 (Close), and .58 (Depend).

Reflective Functioning Questionnaire - 8 (RFQ-8; Fonagy et al., 2016; Portuguese version by Farate et al., 2019). The RFQ-8 is an 8-item self-report measure that assesses the capacity for reflective functioning, comprising two subscales, each containing six items: certainty (RFQc) and uncertainty (RFQu) about mental states. Participants must respond using a 7-point Likert scale (0=Strongly Disagree; 7=Strongly Agree). To capture extreme levels of certainty (hypermentalization) the items of the RFQc are rescored to 3, 2, 1, 0, 0, 0, 0. Responses to the items of the RFQu subscale are recoded as 0, 0, 0, 0, 1, 2, 3 (except item 7, which is rescored similarly to RFQc items) to capture extreme levels of uncertainty (hypomentalization) (Fonagy et al., 2016).

Procedures

The translation and adaption of the RFQ-8 followed the International Test Commission (ITC, 2017) recommendations. The back-translation method (Brislin, 1970) guaranteed content equivalence. This process was carried out by two independent translators fluent in English and with Portuguese as their mother tongue. Two independent versions of the RFQ-8 were thus created. These versions were compared, and the research project members discussed the differences. Data collection was done exclusively through an online platform (Google Forms). The first page of the protocol contained information about the research project: (i) goals and expected outcomes of the study; (ii) inclusion criteria; (iii) indication of the voluntary, anonymous and confidential nature of participation, assuring the exclusive use of data for research purposes. Respondents could only access the remaining protocol by providing informed consent. The questionnaire was available between January 28, 2022, and June 7, 2022.

Analytical procedures

Statistical analysis was conducted using the Statistical Package for the Social Sciences (IBM SPSS Statistics, v.28) and Jeffreys’s Amazing Statistics Program (JASP, v. 0.17.1; JASP Team, 2023). Descriptive statistics were used for the sample’s sociodemographic characterization, with means and standard deviations calculated for continuous variables and frequencies and percentages for categorical variables. The distribution was analyzed using asymmetry (Sk) and kurtosis (Ku) measures. Sk values<|3| and Ku<|10| confirmed the absence of severe deviations from a normal distribution (Kline, 2011). Mahalanobis Distance (MD) was used to identify possible outliers. To assess the RFQ-8 structure, a CFA was performed using the Diagonally Weighted Least Squares (DWLS) estimation method using JASP, which is more appropriate for categorical data (Mîndrilă, 2010). The ratio of 5 cases per estimated parameter, suggested by Bentler and Chou (1987), was considered. The model’s goodness of fit was estimated considering the following global fit indices: Chi-Square (χ 2 ), Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and Root Mean Squared Error of Approximation (RSMEA). Usually, for Maximum Likelihood estimation, the following cutoff criteria can be considered: χ 2 , p>.05; CFI and TLI≥0.90 (Kline, 2011; Marôco, 2010); RSMEA≤0.08 (Marsh et al., 2004). However, since no well-defined cutoff criteria apply to DWLS, we decided to consider the goodness of fit indices as diagnostic tools, following the suggestions of Xia and Yang (2019). Klusáček and colleagues (2022) also adopted a similar methodology for validating a scale using DWLS. The following cutoff criteria for factor loadings were considered: ≥.32 poor, ≥.45 fair, ≥.55 good, ≥.63 very good, and ≥.71 excellent (Comrey & Lee, 1992). In order to analyze internal consistency, Cronbach’s alpha (α) and composite reliability index (CR) were calculated. Cutoff criteria of Pestana and Gageiro (2020) for Cronbach’s alpha values were considered: <.60 unacceptable, ≥.60 weak, ≥.70 reasonable, ≥.80 good, ≥.90 very good. Hair et al. (1998) state that values ≥.70 are adequate for the composite reliability index. The convergent validity of the scale was assessed using Pearson’s product-moment correlations (Cohen et al., 2003). Pearson correlation coefficients between .10 and .29 were considered small, between .30 and .49 medium, and between .50 and 1.0 large (Cohen, 1988; Cohen et al., 2003). Student’s t-test for independent samples was conducted to analyze the relation between RFQ-8 scores and sociodemographic characteristics (education level and sex).

Results

Preliminary analysis

Data distribution was tested, confirming the absence of violations of the assumption of normality. Sk values varied between .04 and 1.34, and Ku values between -1.51 and .95. Items’ mean scores ranged from 2.41 (SD=1.7477) for item 2 to 4.11 (SD=2.213) for item 8. The existence of outliers was verified. However, in order to ensure ecological validity, these were not removed.

Confirmatory factor analysis

CFA was performed considering the eight original items distributed by two subscales (Model 1) proposed by Fonagy et al. (2016). As seen in Table 3, this two-factor model showed a good fit to the data. However, item 2 (“I don’t always know why I do what I do.”) and item 7 (“I always know what I feel.”), both belonging to the Uncertainty subscale, had poor factor loadings (Figure 1). Therefore, we decided to compare changes in the goodness-of-fit indices by removing item RFQu7 (Model 2) and items RFQu2 and RFQu7 (Model 3). For Model 2, there was a decrease in the values of χ 2 , CFI, and TLI and an increase in the value of RMSEA compared to Model 1. For Model 3, the values of χ 2 decreased when compared to Models 1 and 2. The CFI and TLI values slightly increased compared to Model 2. The RMSEA value slightly decreased compared to Model 2 but was still higher than Model 1. We considered Model 1 as the final adjusted model. Despite the poor factor loadings of some items, they still showed statistical significance (p<.001) and had theoretical relevance. Moreover, the CFA conducted with all the items showed higher CFI and TLI values and the lowest RMSEA value compared to the other CFAs (Table 3). Figure 1 shows a graphic representation of the factorial structure model of the Angolan version of the RFQ-8.

Table 3 Goodness-of-fit and discriminant validity indicators of the RFQ-8 

Figure 1 Factor structure model of the Angolan version of the RFQ-8 

Internal consistency

The Certainty subscale presented a Cronbach’s alpha of .71 and composite reliability of .80. The Uncertainty subscale, however, presented a Cronbach’s alpha of .66 and composite reliability of .75. Although the Cronbach’s alpha value is weak, the composite reliability value demonstrates internal consistency. It should be noted that excluding items would not improve the internal consistency, except for one item in the Uncertainty subscale. However, this increase would not be significant. As shown in Table 4, most item-total correlation values are above the established .3 cut-off point (Nunnally & Bernstein, 1994), except item 7, which nonetheless is within the .15 to .50 range proposed by Clark and Watson (2019).

Table 4 Descriptive statistics and corrected item-total correlations of the RFQ-8 items 

Note. M=Mean; SD=Standard Deviation.

Convergent validity

The convergent validity of the RFQ-8 was assessed by analyzing correlations between the two subscales (RFQu and RFQc) and three psychometric instruments (Table 5). Regarding cognitive insight, the correlations between the Certainty and Uncertainty subscales and “Self-reflexivity” were large, statistically significant, and negative and positive, respectively. On the other hand, the correlations between RFQ-8 scores and “Self-certainty” only showed a moderate, statistically significant, and negative relationship with the Certainty subscale.

Table 5 Correlations between RFQ-8 and BCIS, AAS-R and BSI 

Note. RFQc=Reflective Functioning Questionnaire Certainty Subscale; RFQu=Reflective Functioning Questionnaire Uncertainty Subscale; BCIS=Beck Cognitive Insight Scale; AAS-R=Adult Attachment Scale-Revised; BSI=Brief Symptom Inventory; **p<0,01. *p<0,05.

As for the relation between attachment styles and reflective functioning, moderate, statistically significant, and negative relationships were found between the “Anxiety” subscale and the Certainty subscale, and moderate, statistically significant, and positive relationships were found between the same AAS-R subscale and the Uncertainty subscale. For the subscale “Depend,” the correlation was weak yet statistically significant with the two subscales of reflective functioning (positive relation with the RFQc and a negative one with the RFQu). Correlation analysis between the RFQ-8 and the “Close” subscale was not statistically significant.

Finally, the correlational analysis between the RFQ-8 and BSI subscales revealed statistically significant associations between the reflective functioning subscales and all symptomatology subscales, ranging from weak to moderate associations. Negative and positive relationships were found in the Certainty and Uncertainty subscale correlations, respectively. The highest values, around -.40 and .40, were found in the Obsession-Compulsion, Interpersonal Sensitivity, Phobic Anxiety, and Anger-Hostility subscales. Lower magnitudes, around -.20 and -.20, were found in the relationship between the RFQ-8 and the BSI Somatization subscale.

Reflective functioning and sociodemographic characteristics

The Certainty and Uncertainty subscales of the RFQ-8 revealed weak but statistically significant correlations with age (r=.21, p=.017 and r=-.22, p=.011, respectively). No statistically significant differences in RFQ-8 scores were found according to sex and educational attainment.

Discussion

This study aimed to examine the psychometric properties of the Angolan version of the RFQ-8, namely, to assess its factor structure and its correlations with related constructs and clinical variables in a sample of Angola’s general population.

Consistent with previous research (Badoud et al., 2015; Bizzi et al., 2021; Fonagy et al., 2016; Mousavi et al., 2021) that followed similar statistical procedures, results supported a two-factor structure for the RFQ-8 (RFQu and RFQc subscales). We also obtained satisfactory internal consistency for both subscales. Following a similar procedure to Badoud et al. (2015) and considering the small number of items in the scale, item-total correlations were also considered to analyze internal consistency. Contrary to previous research (Bizzi et al., 2021; Spitzer et al., 2020), we did not find evidence that removing items would significantly improve internal consistency.

Similarly to previous studies (Badoud et al., 2015; Bizzi et al., 2021; Fonagy et al., 2016; Griva et al., 2020; Morandotti et al., 2018; Ruiz-Parra et al., 2023; Spitzer et al., 2020), RFQ-8 scores were unrelated with sociodemographic characteristics. However, both RFQ-8 subscales showed weak statistically significant associations with age. These results were also reported by Fonagy et al. (2016) and Griva et al. (2020), suggesting that uncertainty about mental states tends to decrease with age.

The RFQ-8 showed adequate construct validity, as most correlations were aligned with theoretical predictions. The two subscales tended to exhibit similar correlation patterns but with opposite signs. The RFQ-8 shows significant correlations with psychopathological symptoms, suggesting a close relation between uncertainty about mental states and clinical problems, consistent with the mentalization framework (Fonagy et al., 2016); it also shows statistically significant relationships with different attachment patterns, supporting mentalization’s developmental schema (Fonagy & Target, 2003); finally, it shows significant correlations with cognitive insight, a construct closely related to reflective functioning, which indicates convergent validity.

Both RFQ-8 subscales presented moderate statistically significant correlations with the Self-Reflexivity subscale of the BCIS (RFQu shows a positive sign correlation, and RFQc a negative sign correlation). These results show that uncertainty of mental states tends to increase with an individual’s ability and willingness to observe their mental productions and consider alternative explanations (Beck et al., 2004). However, the Self-Certainty subscale of the BCIS showed a negative correlation with the RFQc subscale, a result that indicates that increasing overconfidence in the validity of beliefs (Beck et al., 2004) is associated with decreasing certainty regarding mental states. These results deserve careful consideration. First, it is important to emphasize the definition of cognitive insight underlying the BCIS as the ability to distance oneself from erroneous beliefs and the ability to evaluate interpretations correctly with the help of feedback from other individuals (Beck et al., 2004). In this sense, self-reflexivity, as assessed by the scale, is associated with openness to feedback, objectivity, and reflection, whereas self-certainty relates to rushing to conclusions, feeling certain of being correct, and resisting correction. Cognitive insight is then positively associated with self-reflexivity and negatively associated with self-certainty. Thus, uncertainty of mental states is expected to increase concomitantly with increased self-reflexivity by the general attitude of openness to alternative explanations. Not so expected was the correlation between the certainty of mental states measured by the RFQ-8 and self-certainty, or the general attitude of being sure of being correct, as assessed by the BCIS. Such a result may be related to the fact that the RFQc subscale, rather than assessing an impaired ability to mentalize (hypermentalization), is associated with a more adaptive type of reflective functioning. Its correlations with attachment patterns and clinical symptomatology, detailed below, support this notion and help in understanding the negative relationship of this subscale with the attitude of self-certainty, which is a barrier to cognitive insight.

Regarding the relation between reflective functioning and attachment, both subscales of the RFQ-8 showed statistically significant associations with the subscales Anxiety and Depend of the AAS-R. Considering that the subscale Anxiety refers to the degree to which the individual feels worried about the possibility of abandonment or rejection (Canavarro et al., 2006), these results indicate that respondents who reported more insecure attachment also show greater uncertainty regarding their own and others’ mental states. This finding is consistent with the developmental schema of mentalization, which suggests that anxious or avoidant attachments associated with early experiences of living with emotionally and physically unavailable caregivers are related to deficits in reflective functioning in adulthood (Fonagy & Luyten, 2009; Mousavi et al., 2021). Conversely, the Depend subscale refers to the feeling of being able to depend on others in case of need, which is associated with higher levels of certainty and lower levels of uncertainty.

Finally, statistically significant correlations were found between all nine dimensions of the BSI and both RFQ-8 subscales. The generic pattern of associations between the RFQu subscale and the clinical variables suggests that mentalization problems, namely hypomentalization, may play an essential role in many mental disorders (Fonagy et al., 2016). However, the RFQc was related in the opposite direction with psychopathological symptoms, suggesting that a certain degree of certainty about mental states may sustain adaptive functioning (Badoud et al., 2015). In this sense, despite the scoring system being geared to capture extreme levels of certainty and uncertainty, thus reflecting two types of impaired reflective functioning (hypermentalization and hypomentalization), only hypomentalization is adequately addressed by this instrument. Further research is thus needed to analyze the probable unidimensionality of the RFQ-8 and the viability of different scoring procedures (Ruiz-Parra et al., 2023; Wozniak-Prus et al., 2022). Also, studies with clinical samples are relevant since previous validation studies indicate that the RFQu subscale has a greater discriminative capacity (Fonagy et al., 2016; Morandotti et al., 2018).

Limitations

Some limitations of the present study must be acknowledged. First, the absence of a clinical group didn’t allow the analysis of the RFQ-8 discriminant abilities. Also, a test-retest analysis was not included to ascertain the instrument’s temporal stability. The relationship between the RFQ-8 and other measures of mentalizing (self-report and interview-based) should also be addressed in future studies. Second, online data collection through convenience and snowball sampling procedures restricts participation to Internet users and might account for sample bias (in this case, the higher percentage of students and employed participants with high educational attainment). Further studies with larger, more representative samples of the Angolan population are thus needed.

Implications for practice and research

This study offers preliminary evidence on the reliability and validity of the Angolan version of the RFQ-8. Besides its usefulness in clinical assessment, particularly as a screening tool to identify difficulties in reflective functioning, the RFQ-8 could also contribute to developing research on mentalization and the efficacy of psychotherapeutic interventions, namely patients’ responses to mentalization-based treatments. Even though the RFQu subscale satisfactorily measures impairments in mentalization (hypomentalization), further studies are needed to develop a self-report measure that adequately captures hypermentalization.

References

Anis, L., Perez, G., Benzies, K. M., Ewashen, C., Hart, M., & Letourneau, N. (2020). Convergent validity of three measures of reflective function: Parent Development Interview, Parental Reflective Function Questionnaire, and Reflective Function Questionnaire. Frontiers in Psychology, 11, 574719. https://doi.org/10.3389/fpsyg.2020.574719 [ Links ]

Badoud, D., Luyten, P., Fonseca-Pedrero, E., Eliez, S., Fonagy, P., & Debbané, M. (2015). The French version of the Reflective Functioning Questionnaire: Validity data for adolescents and adults and its association with non-suicidal self-injury. PloS ONE, 10(12), e0145892. https://doi.org/10.1371/journal.pone.0145892 [ Links ]

Beck, A. T., Baruch, E., Balter, J. M., Steer, R. A., & Warman, D. M. (2004). A new instrument for measuring insight: The Beck Cognitive Insight Scale. Schizophrenia Research, 68(2-3), 319-329. https://doi.org/10.1016/S0920-9964(03)00189-0 [ Links ]

Bentler, P. M., & Chou, C.-P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16(1), 78-117. https://doi.org/10.1177/0049124187016001004 [ Links ]

Bizzi, F., Riva, A., Borelli, J., Charpentier‐Mora, S., Bomba, M., Cavanna, D., & Nacinovich, R. (2021). The Italian version of the Reflective Functioning Questionnaire: Validity within a sample of adolescents and associations with psychological problems and alexithymia. Journal of Clinical Psychology, 78(4), 503-516. https://doi.org/10.1002/jclp.23218 [ Links ]

Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1(3), 185-216. https://doi.org/10.1177/135910457000100301 [ Links ]

Canavarro, M. C. (1999). Inventário de Sintomas Psicopatológicos: BSI. In M. R. Simões et al. (Eds.), Testes e provas psicológicas em Portugal (vol. II, pp. 87-109). SHO/APPORT. [ Links ]

Canavarro, M. C., Dias, P., & Lima, V. (2006). A avaliação da vinculação do adulto: Uma revisão crítica a propósito da aplicação da Adult Attachment Scale-R (AAS-R) na população portuguesa. Psicologia, XX(1), 11-36. [ Links ]

Clark, L., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412-1427. https://doi.org/10.1037/pas0000626 [ Links ]

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates. [ Links ]

Cohen, J., Cohen, P., West, S., & Aiken, L. (2003). Applied multiple regression/correlation analysis for the behavioral (3rd ed.). Lawrence Erlbaum Associates. [ Links ]

Collins, N., & Read, S. (1990). Adult attachment relationships, working models and relationship quality in dating couples. Journal of Personality and Social Psychology, 58, 644-683. [ Links ]

Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis (2nd ed.). Lawrence Erlbaum Associates, Inc. [ Links ]

Derogatis, L. R., & Melisaratos, N. (1983). The Brief Symptom Inventory: An introductory report. Psychological Medicine, 13(3), 595-605. https://doi.org/10.1017/S0033291700048017 [ Links ]

Dimitrijević, A., Hanak, N., Altaras Dimitrijević, A., & Jolić Marjanović, Z. (2018). The Mentalization Scale (MentS): A self-report measure for the assessment of mentalizing capacity. Journal of Personality Assessment, 100(3), 268-280. https://doi.org/10.1080/00223891.2017.1310730 [ Links ]

Farate, C., Daniel, F., & Vicente, H. T. (2019). Versão portuguesa do Reflective Functioning Questionnaire-8 (RFQ-8). Unpublished manuscript. Instituto Superior Miguel Torga, Coimbra. [ Links ]

Fonagy, P., Gergely, G., Jurist, E. L., & Target, M. (2002). Affect regulation, mentalization, and the development of the self. International Journal of Psychoanalysis, 77, 217-234. [ Links ]

Fonagy, P., & Luyten, P. (2009). A developmental, mentalization-based approach to the understanding and treatment of borderline personality disorder. Development and Psychopathology, 21(4), 1355-1381. https://doi.org/10.1017/S0954579409990198 [ Links ]

Fonagy, P., Luyten, P., Moulton-Perkins, A., Lee, Y. W., Warren, F., Howard, S., Ghinai, R., Fearon, P., & Lowyck, B. (2016). Development and validation of a self-report measure of mentalizing: The Reflective Functioning Questionnaire. PLoS ONE, 11(7), e0158678. https://doi.org/10.1371/journal.pone.0158678 [ Links ]

Fonagy, P., & Target, M. (2003). Psychoanalytic theories. Perspectives from developmental psychopathology. Whurr Publishers. [ Links ]

Fonagy, P., Target, M., Steele, H., & Steele, M. (1998). Reflective Functioning Scale (RF) [Database record]. APA PsycTests. https://doi.org/10.1037/t03490-000 [ Links ]

George, C., Kaplan, N., & Main, M. (1996). Adult Attachment Interview. University College London. [ Links ]

Griva, F., Pomini, V., Gournellis, R., Doumos, G., Thomakos, P., & Vaslamatzis, G. (2020). Psychometric properties and factor structure of the Greek version of Reflective Functioning Questionnaire. Psychiatriki, 31(3), 216-224. https://doi.org/10.22365/jpsych.2020.313.216 [ Links ]

Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate data analysis (5th ed.). Prentice‐Hall. [ Links ]

Hausberg, M. C., Schulz, H., Piegler, T., Happach, C. G., Klöpper, M., Brütt, A. L., Sammet, I., & Andreas, S. (2012). Is a self-rated instrument appropriate to assess mentalization in patients with mental disorders? Development and first validation of the mentalization questionnaire (MZQ). Psychotherapy Research, 22(6), 699-709. https://doi.org/10.1080/10503307.2012.709325 [ Links ]

International Test Commission [ITC]. (2017). The ITC guidelines for translating and adapting tests (2nd ed.). https://www.intestcom.org/files/guideline_test_adaptation_2ed.pdfLinks ]

Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). Guilford Press. [ Links ]

Klusáček, J., Kundrnácová, M., & Soukup, P. (2022). Validation of CES-D8 among Czech university students during COVID-19 pandemic. Československá Psychologie, 46(4), 398-415. https://doi.org/10.51561/cspsych.66.4.398 [ Links ]

Marôco, J. (2010). Análise de equações estruturais: Fundamentos teóricos, software e aplicações. ReportNumber. [ Links ]

Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320-341. https://doi.org/10.1207/s15328007sem1103_2 [ Links ]

Mîndrilă, D. (2010). Maximum Likelihood (ML) and Diagonally Weighted Least Squares (DWLS) Estimation procedures: A comparison of estimation bias with ordinal and multivariate non-normal data. International Journal of Digital Society, 1(1), 60-66. https://doi.org/10.20533/ijds.2040.2570.2010.0010 [ Links ]

Morandotti, N., Brondino, N., Merelli, A., Boldrini, A., De Vidovich, G., & Ricciardo, S., Abbiati, V., Ambrosi, P., Caverzasi, E., Fonagy, P., & Luyten, P. (2018). The Italian version of the Reflective Functioning Questionnaire: Validity data for adults and its association with severity of borderline personality disorder. PLoS ONE , 13(11), e0206433. https://doi.org/10.1371/journal.pone.0206433 [ Links ]

Mousavi, P. S. S., Vahidi, E., Ghanbari, S., Khoshroo, S., & Sakkaki, S. Z. (2021). Reflective Functioning Questionnaire (RFQ): Psychometric properties of the Persian translation and exploration of its mediating role in the relationship between attachment to parents and internalizing and externalizing problems in adolescents. Journal of Infant, Child, and Adolescent Psychotherapy, 20(3), 313-330. https://doi.org/10.1080/15289168.2021.1945721 [ Links ]

Müller, S., Wendt, L. P., Spitzer, C., Masuhr, O., Back, S. N., & Zimmermann, J. (2022). A critical evaluation of the Reflective Functioning Questionnaire (RFQ). Journal of Personality Assessment , 104(5), 613-627. https://doi.org/10.1080/00223891.2021.1981346 [ Links ]

Nunnally, J., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill. [ Links ]

Paiva, A. (2021). Tradução, adaptação e contributo para a validação do Reflective Functioning Questionnaire e do Physical Health Questionnaire para o português europeu. Master’s Thesis, Universidade do Porto. Universidade do Porto Open Repository. https://hdl.handle.net/10216/137501Links ]

Pestana, M., & Gageiro, J. (2020). Análise de dados para Ciências Sociais: A complementaridade da SPSS (2nd ed.). Edições Sílabo. [ Links ]

Pinho, L. G., Sampaio, F., Sequeira, C., Martins, T., & Ferré-Grau, C. (2021). Cognitive insight in psychotic patients institutionalized and living in the community: An examination using the Beck Cognitive Insight Scale. Psychiatry Research, 295, 113586. https://doi.org/10.1016/j.psychres.2020.113586 [ Links ]

Rostad, W. L., & Whitaker, D. J. (2016). The association between reflective functioning and parent-child relationship quality. Journal of Child and Family Studies, 25(7), 2164-2177. https://doi.org/10.1007/s10826-016-0388-7 [ Links ]

Rueda, R., Alpi, S., Jimenez, Y., Vinasco, B., & Vidal, Y. (2020). Psychometric properties of the Reflective Functioning Questionnaire in a Colombian population sample. https://doi.org/10.31234/osf.io/a7wcm [ Links ]

Ruiz-Parra, E., Manzano-García, G., Mediavilla, R., Rodríguez-Vega, B., Lahera, G., Moreno-Pérez, A. I., Torres-Cantero, A. M., Rodado-Martínez, J., Bilbao, A., & González-Torres, M. Á. (2023). The Spanish version of the reflective functioning questionnaire: Validity data in the general population and individuals with personality disorders. PLoS ONE , 18(4), e0274378. https://doi.org/10.1371/journal.pone.0274378 [ Links ]

Sharp, C., Williams, L. L., Ha, C., Baumgardner, J., Michonski, J., Seals, R., Patel, A. B., Bleiberg, E., & Fonagy, P. (2009). The development of a mentalization-based outcomes and research protocol for an adolescent inpatient unit. Bulletin of the Menninger Clinic, 73(4), 311-338. https://doi.org/10.1521/bumc.2009.73.4.311 [ Links ]

Slade, A., Bernbach, E., Grienenberger, J., Levy, D. W., & Locker, A. (2004). The parent development interview and the pregnancy interview: Manuals for scoring. City College of New York and Yale Child Study Center. [ Links ]

Sleed, M., Slade, A., & Fonagy, P. (2020). Reflective functioning on the parent development interview: Validity and reliability in relation to socio-demographic factors. Attachment & Human Development, 22(3), 310-331. https://doi.org/10.1080/14616734.2018.1555603 [ Links ]

Spitzer, C., Zimmermann, J., Brähler, E., Euler, S., Wendt, L., & Müller, S. (2020). Die deutsche version des Reflective Functioning Questionnaire (RFQ): Eine teststatistische überprüfung in der allgemeinbevölkerung. PPMP - Psychotherapie Psychosomatik Medizinische Psychologie, 71(3-4), 124-131. https://doi.org/10.1055/a-1234-6317 [ Links ]

Woźniak-Prus, M., Gambin, M., Cudo, A., & Sharp, C. (2022). Investigation of the factor structure of the Reflective Functioning Questionnaire (RFQ-8): One or two dimensions?. Journal of Personality Assessment , 104(6), 736-746. https://doi.org/10.1080/00223891.2021.2014505 [ Links ]

Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51(1), 409-428. https://doi.org/10.3758/s13428-018-1055-2 [ Links ]

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Received: July 14, 2023; Accepted: October 09, 2023

Correspondence concerning this article should be addressed to: Henrique Testa Vicente, ISMT - Instituto Superior Miguel Torga, Largo da Cruz de Celas, nº1, 3000-132, Coimbra, Portugal. E-mail: henrique.t.vicente@gmail.com

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

All the authors read and approved the final manuscript.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License