SciELO - Scientific Electronic Library Online

 
vol.16The media regarding vaccination in modern times hesitation on childhood vaccination: a narrative review on the information published on socialHousing Vacancy Outlined with Delphi Survey. Contributions of Participatory Research to a Just Transformation Process on Trial author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • Have no similar articlesSimilars in SciELO

Share


New Trends in Qualitative Research

On-line version ISSN 2184-7770

NTQR vol.16  Oliveira de Azeméis Sept. 2023  Epub Sep 01, 2023

https://doi.org/10.36367/ntqr.16.2023.e786 

Original Article

Collaborative Analysis of Observational Data in Healthcare

1 University of Alberta, Canada


Abstract

Solving complex problems can be challenging as they often involve multiple layers of related issues and factors. Observational research is a helpful tool for understanding healthcare's complex and contextually dependent problems; however, observations can be time-consuming and resource-intensive, particularly when including the analysis process. As a result, researchers may utilize other qualitative methods, such as interviews or focus groups. However choosing a strategy different than observations could miss subtleties of care that happen in practice. It is easy to underestimate the value of data gathered through firsthand observations of patient-provider and team interactions. One solution to making observations a more convenient method in healthcare research is collaborating in the analysis process. Research collaboration involves establishing an interprofessional research team with diverse backgrounds and professional perspectives. In this way, the group comprises individuals from various roles and different professional backgrounds to ensure exhaustive findings and improve the reliability and accuracy of the results. The diversity in the team represents the intricate dynamics in the complex system of care. Although there are guidelines for collaborative analysis in a traditional ethnographic study, there must be more focus on healthcare research. This paper explains the concepts and features of collaborative analysis in interprofessional research. This approach offers a systematic way to construct a code book, which can produce comprehensive and valuable insights into the complex dynamic of care.

Keywords: Interdisciplinary research; Health services research; Research design; Observer variation; Qualitative research; Data analysis.

1. Introduction

Observational research has a long history, tracing back to Hippocrates in ancient Greece (Pappas et al., 2008). Despite its age, it remains a relevant method today to accurately capture real-life situations. While focus groups and interviews offer valuable insights, capturing the richness and complexity of real life needs to be observed to describe a more complete understanding (Kawulich, 2005). However, there are various reasons why the use of observational research in the health field is limited, including the need for more familiarity with this method by researchers and ethics boards, as well as a preference for quantitative research methods (Bowling, 2014; Cruz & Higginbottom, 2013).

While conducting a recent observational case study for a doctoral dissertation (under preparation), the researcher noted that relying on a single analyst to interpret qualitative data risked a limited understanding of intricate healthcare settings. It was also a challenge to find guidelines that were specifically made for healthcare researchers. As a result, as outlined in this paper, the researcher developed a collaborative analysis method as a practical guide for the research team based on coding methods that aligned with the search objectives (Hatch, 2002; Richards & Hemphill, 2018; Saldaña, 2021) as well as ontological perspectives of the teamwork and healthcare systems (Canadian Interprofessional Health Collaborative, 2010; Petticrew et al., 2019). The following guide enabled the researchers to work together and analyze observational data effectively, drawing on diverse perspectives and expertise to arrive at meaningful insights and conclusions. This collaborative analysis process contributes to interprofessional healthcare research and stresses the importance of incorporating multiple perspectives into healthcare research practices to support a better understanding of equity, diversity, inclusion, and accessibility in research (Gill et al., 2018).

2. Literature Review

Studies in various fields use collaborative approaches in their data analysis for multiple purposes (cf. Armstrong et al., 2023; Karakose et al., 2023; Matemba et al., 2023) The purpose and aims of a study can determine the rationale of using collaborative approaches. In healthcare, collaborative approaches can be beneficial in understanding the complexities that often arise in these specific environments, including particular contextual factors and unique viewpoints. However, more detailed guidance is needed for collaborative approaches in healthcare research. This includes capturing current trends in healthcare such as representing underrepresented groups (Gill et al., 2018), patient involvement (Manafo et al., 2018), and enhancing interprofessional research (Khalili et al., 2019). However, a literature search for guidance in collaborative healthcare approaches needs to be made more evident. What was found instead were reasons researchers opted for collaboration, including intercoder reliability and establishing codes and patterns.

Qualitative researchers highly recommend collaborative data analysis for its numerous benefits, including integrating multiple researchers' perspectives (Patton, 2015). One of the main advantages of this approach is that it aids in enhancing trustworthiness and reducing biases through triangulation (Olson et al., 2016; Patton, 2015). However, when researching healthcare contexts and exploring the perspectives of interprofessional members in teamwork-promoting environments, it is expected that varying perspectives exist. These differences can enhance understanding of complexity rather than detract from it while ensuring trustworthiness remains essential.

The topic of intercoder reliability has arisen naturally in collaborative analysis (Burla et al., 2008; Olson et al., 2016). The constant comparative method is one method researchers can use to improve intercoder reliability through grounded theory (Olson et al., 2016). While this is a valuable approach for disciplines that utilize grounded theory to constantly compare and achieve a consensus with the findings, in healthcare research, multiple perspectives highlight various similarities and differences that reflect the natural complexities in healthcare. For instance, healthcare organizations recommend collaborative strategies incorporating a patient's perspective and enhancing their participation in the research process (Hørder & Nielsen, 2020). These recommendations involve patients in all research stages, including analysis, as their contributions highlight what is important to them (Manafo et al., 2018), hence offering an additional perspective.

Analyzing data involves capturing patterns as similarities and differences (Saldaña, 2021). Hatch (2002) further explained other forms of patterns as frequencies, sequences, correspondence, and causation. In the context of healthcare teams, patterns can represent the various members of the interprofessional team and the different roles that these members represent, such as patient, administrator, researcher, educator, or clinician. In healthcare research, identifying various patterns provides a detailed description of the realities of care. Even though constant comparatives measure agreement between different coders, this approach is used when accuracy and consistency are key research objectives (Olson et al., 2016). Albeit useful for some research objectives, additional perspectives help to represent the complexity of healthcare practices and teamwork dynamics.

Healthcare research is increasing its recognition of equity, diversity, inclusion, and accessibility in team collaboration (Gill et al., 2018). To uphold these principles, people from various backgrounds should be on the research team to express underrepresented perspectives. This involves selecting researchers and participants from diverse backgrounds. However, although the limitation of individual biases exists (Connor & Evers, 2020), it is essential to allow the expression of underrepresented perspectives and experiences in research. The process of achieving this representation involves conducting a collaborative analysis. This approach entails working with others to analyze and evaluate data, ideas, and information to depict a particular concept accurately. This method combines different perspectives and insights, leading to a more comprehensive understanding of the topic at hand.

Given the absence of guidelines for collaborative analysis literature in healthcare research, a step-by-step approach was developed based on the key factors found in the literature. Richards and Hemphill (2018) produced a manual for analyzing qualitative data collaboratively in the education sector. Their guide helped highlight the intricacies of teamwork, a critical attribute of healthcare. By collaborating, the diversity of healthcare professionals was represented, including their various roles and the similarities and differences in ontologies across different health professions. The analysis process was solidified by utilizing interprofessional collaboration concepts to provide a foundational understanding of how teams operate and collaborate.

3. Methods

In 2022, a case study was conducted in a primary care setting with a team-based approach. Field notes and memos were recorded and transcribed daily during the data collection and then prepared for analysis. The study team developed and followed a collaborative analysis process explained in detail in this article. The research question guiding this method was: How does a collaborative approach to analyzing practice encounters between health providers and patients improve observational healthcare research findings?

3.1 Collaborative Analysis Process

Collaborative analysis is crucial in healthcare research and requires a few key characteristics. Scholars in the field, like Creswell and Clark (2017) and Saldaña (2021), have emphasized the importance of gathering diverse perspectives to ensure a well-rounded understanding of the research and healthcare context, which includes the interprofessional team of providers, patients, staff, administrators, and researchers. Our process included the following steps: 1) Developing a shared process, 2) Conducting blinded coding, 3) Creating code consensus, 4) Trialing the code book to the more extensive data set, and 5) Finalizing the code book (Fig. 1 shows the step-by-step approach). It was also essential to establish a shared understanding of the research coding method through reviewing and discussing previous work and coding practice that ensured consistency in coding as a team. Co-creating codes based on a sample data set was vital in ensuring that coding was both relevant and accurate based on differences in language use (Hsieh & Shannon, 2005). We maintained accurate records of the code book application and data analysis process for future reference, including insights and findings from the data analysis process that were discussed regularly to ensure that the research was moving in the right direction (Lewin et al., 2009).

Figure 1 Collaborative analysis step-by-step approach. 

Step One: Shared Process

The team held an initial meeting to review the coding process to ensure accuracy and consistency. Materials adapted from Saldaña (2021) were used, which emphasized the importance of understanding the varying patterns to establish themes (see Appendix A: Coding Concepts). Interestingly, it was also essential to highlight whether irregular patterns existed (Hatch, 2002). In this way, the researchers discovered diversity in the perspectives that emerged from the research. For example, recognizing that standard codes are not necessarily meaningful or essential but that the coding process should consider the topic and research being explored (Bruan & Clarke, 2012). In the case of healthcare research, this includes recognizing that emerging patterns from the data are related to the context in which the research is conducted.

After reviewing the coding background work, the team examined different subject matter codes and interpretive examples to establish a shared understanding of the process (see Appendix A: Coding Concepts). This process increased the team's confidence in offering various coding options based on diverse perspectives. The last step in the shared process was using a sample of the study's data as a practice, facilitating process discussions within the research team.

Step Two: Blinded Coding

The process of extracting a random sample from the research project was a critical component of collaborative coding. Care was taken to maintain context as much as possible while selecting data from one clinic to form the code book (Guest et al., 2012). A spreadsheet was used to collect and organize approximately three pages of sample data for the coding process (Hsieh & Shannon, 2005). A decision was made regarding the selection of the sample data set, specifically whether to extract data from one clinic or multiple clinics. If data was used from multiple clinics, it would become difficult to compare results across clinics retrospectively because the data would have already been mixed. Additionally, if the sample data was from multiple sites, the analysis could not have started during data collection and followed the iterative approach of collection, analysis, and further collection of data, as was part of the study design (Miles et al., 2020). However, selecting data from one clinic allowed for a more thorough analysis of gaps, similarities, and differences, informed by the research question being explored.

Despite the added time required for analyzing following clinics, this approach was beneficial for identifying areas of improvement and potential gaps in the data. For the purposes of the study design, using a sample of one site was chosen for the listed reasons. However, for researchers taking a different approach to their design, using data from multiple sites may be a justifiable choice depending on the research process (Patton, 2015).

Step Three: Code Consensus Building

Once the data was coded, codes were compared by one researcher (Miles et al., 2020). A crucial aspect of this process was that the researcher involved with observations in the field led this part of the process, and could provide contextual information to the group as needed (Saldaña, 2021). The team felt this was important because it would result in the refinement of the resulting codes (Saldaña, 2021). While referencing the column the team recorded their memos, and further clarity was provided (Saldaña, 2021). In order to compare the codes across the group, a variety of techniques were used to enhance meaning-making (Miles et al., 2020). First, a comparison across the codes was conducted in the spreadsheet. Then techniques to visualize the data were used (Braun & Clarke, 2019; Creswell & Poth, 2018). Finally, basic wordsmithing refined the codes into clearly identified words (Miles et al., 2020).

Code Comparisons

The data used for coding was a random sample of the dataset, thus some of the context was missing for the team. Because of this, the memos and comments made by individuals were considered during the analysis. This approach helped refine the codes before they were further interpreted together. The codes chosen by the researchers were compared in side by side columns in the sheet (Fig. 2 shows an example of comparing codes).

Code Brainstorming

In discussing the benefits of using visual aids in qualitative research, Braun and Clarke (2019) argue that "visual representations of data can help researchers to think creatively, and to explore the complexities and nuances of their data" (p. 27). They suggest that mind mapping, in particular, can be a useful tool for exploring connections between concepts and identifying patterns in the data. Similarly, Creswell and Poth (2018) advocate using visual tools such as diagrams, matrices, and maps to help researchers make sense of their data and communicate their findings clearly and concisely. As such, multiple brainstorming techniques helped the team represent various perspectives and reach an extensive breadth and depth of the findings. The brainstorming techniques used were word clouds, mind mapping, and wordsmithing (Appendix B outlines brainstorming techniques). The purpose was to enable the researcher to clean the data, uncover multiple word-choice meanings, and carefully consider whether one code sufficed to represent multiple perspectives. The brainstorming techniques resulted in a more transparent and accurate choice of code that reflected a comprehensive depiction of the data.

Group Consensus

Once the comparison of codes and brainstorming techniques had occurred, the team met to discuss the findings. The team reviewed the comparisons, in which codes and categories were suggested based on the brainstorming techniques (Table 1 shows an example) and provided individual perspectives, often related to the memos that they had taken beside the codes. There was an opportunity for discussion and notes were taken as memos. Some examples of the comparison across interpretations were described as well as the brainstorming techniques that were used to establish the list. The intention of this follow-up meeting was to discuss the findings including any discrepancies or inconsistencies in the codes (Saldaña, 2021), however at this point there were no major deviations.

Figure 2 Screenshot of comparing codes in a spreadsheet.  

Table 1 Example using de-identified data of the process and includes notes from researcher perspectives within a healthcare context. 

Saldaña (2021) also suggests that this meeting is an opportunity to use a conversational approach of consensus and understanding reached. Any additional codes or trends that emerged during this discussion would also be established by the end of the discussion. The initial code list was confirmed with the group (Fig. 3 shows an initial code list), and this process of reviewing, analyzing, and refining codes was essential in ensuring the accuracy and reliability of the data analysis (Saldaña, 2021).

Step Four: Code Trial

The initial codes were applied to the entire dataset using first and second passes for analysis (Saldaña, 2021). This iterative process of reviewing and refining the codes helped to ensure the accuracy and consistency of the analysis. Saldaña (2021) emphasizes the importance of a systematic approach to coding, which involves "constant comparison of codes to each other and to the data as a whole" (p. 52). This approach, he argued, helped to ensure that the codes were grounded in the data and that the analysis was both accurate and reliable. If any new codes or trends emerged, they were noted for discussion when the study team met next (Richards & Hemphill, 2018).

As the data analysis was completed using the list to the full dataset, code refinement and category development occurred. The new codes included Who? within roles, role-family, and role-outside immediate care team. As well as new codes developed for What and Why? within roles, including role- technology, role-change, readiness for change, patient satisfaction, technology utilization, and continuityof care. Furthermore, new concepts were established during the analysis that included family, technology utilization, the outside team, and role change: readiness and resistance. An example of a pattern that emerged from the data was that family was important to those providers who valued relational care. These findings highlight the importance of code refinement and category development in qualitative research, as they can help to uncover new patterns and themes within the data. This is also how the codes and categories started to display relationships between one another as the datasets were continually reviewed.

Figure 3 Initial code list. 

Step Five: Book Finalized

The iterative process of reviewing, categorizing, and analyzing the data helped identify the relationship between the collected data and the research question being explored (Johnson & Christensen, 2017). In a follow-up meeting, the research team reviewed the initial categorization of the codes as well as the individual codes that had emerged during the secondary coding process of the entire dataset, which were established in a flow chart (Fig. 4 shows the secondary coding process). The purpose of this meeting was to ensure that the codes were being applied consistently throughout the dataset and to discuss any differences between the codes that were identified in its’ application. By the end of the meeting, a finalized code book was established (Fig. 5 shows the final code book), which served as a reference for the subsequent analysis of the data.

4. Findings

The establishment of a finalized code book allowed the team to apply the codes uniformly throughout the dataset. This process helped to ensure consistency and accuracy in the analysis of the data (Saldaña, 2021). The team was able to review the initial codes for fit and identify discrepancies or inconsistencies for further discussion (Charmaz, 2014), which highlighted differences in perspectives based on not only professional background, but roles and personal experiences, including patient perspectives. The use of brainstorming and flowcharting were tools used that allowed the team to group the codes together more effectively and to refine the categorization of the codes. The result of this iterative process of revising and refining the codes was critical in establishing a reliable and accurate code book (Kumar & Sharma, 2020).

There were a total of 42 codes and six categories in the completed code book. The code book will be used as a reference for the subsequent analysis of the data, enabling the team to identify patterns, themes, and other outcomes of the overall analysis of the observational work. The establishment of a collaboratively created code book was an important step in the data analysis process, as it helped to ensure the accuracy and reliability of the findings by understanding and representing various healthcare perspectives. In this way, this process answered the research question regarding the method of a collaborative approach to analyzing observational practice encounters of teams of health providers and patients.

Figure 4 Flow charting new and existing codes into beginning categories in Miro® (Miro, 2021). 

Figure 5 Finalized code book. 

5. Discussion

It is necessary to have more literature that can offer improved methods to represent the complexity of healthcare research, practice, and experiences. This study demonstrates the advantages of using a qualitative method previously not explicitly applied to healthcare to uncover its' complexity. The paper emphasizes the importance of comprehending the benefits of including diverse perspectives from the healthcare team, such as those with different professional backgrounds, roles, and patient experiences. Although the study only focused on observational data, it is possible to use collaborative analysis in other methods to enhance the results.

The lead investigator documented reflective notes from the team. She had prior experience with qualitative coding and analysis and adapted guidelines for the researchers to follow. Her notes emphasized the significance of effective communication within the team. This was achieved by choosing a diverse research analysis team, creating a baseline understanding of the coding process, and utilizing various tools to brainstorm potential findings as a group.

The team's notes reflected the strengths of the collaborative, qualitative research process and the challenges and rewards it presented. Their honesty in expressing their struggles with coding, including feeling overwhelmed and questioning their coding ability, underscores the need for adequate support and guidance for those new to this research method. The feedback received indicated that the preparatory materials and examples helped the team understand the process of deriving codes, categories, and themes. The team also found reassurance that multiple perspectives could analyze the same text and describe different meanings with no wrong answers. It is crucial to support and guide researchers exploring new qualitative methods, especially in the health sciences.

This study and its initial guidelines provided valuable insights into collaboration in healthcare research. However, it only served as a pilot approach, and further evidence is needed to fully comprehend the nuances of collaboration in healthcare research by teams of researchers. To achieve this, straightforward questions should be established to create a codebook representing various perspectives through a consensus process. This would highlight the importance of multiple perspectives and interpretations. Differences in opinions can be understood through planned dialogues, clear objectives, and effective communication, including active listening and transparency. These skills and attributes are essential for any research team but have yet to be formally documented. Having diverse opinions in a group can lead to more robust findings and a richer understanding of the research. Understanding why these differences exist should be addressed in the literature, as it represents an essential purpose of collaboration and diversity in qualitative research. The investigator's reflective notes emphasized the importance of effective planning, communication, and collaborative nuances in qualitative research projects.

6. Strengths and Limitations

According to literature, group discussions are crucial for brainstorming and creating code books (Saldana, 2021). However, for this particular study, it was unexpected that there were only a few differences in the analyzed codes. We have taken into account a few potential reasons for this.

During our initial analysis, we reflected on the potential influence of shared mental models within our research team, given that all team members had academic backgrounds in health provision. This homogeneity in our perspectives may have limited the representativeness of our findings, calling for caution in generalizing our results to a wider population (Hubbell et al., 2005). In light of this, we recommend that future research teams aim for greater diversity by including practicing clinicians or patients to enrich the breadth of perspectives. Additionally, considering our team consisted of only three members, a larger team size may have facilitated a more comprehensive analysis. Finally, member checking (Birt et al., 2016) could serve as a useful tool to further validate our findings. Specifically, by engaging an additional member to analyze the code book after it was completed, we could have gained greater insight into any objective differences in our sample.

Another consideration is related to the sample size of the data that was used for the code book creation. Few resources discuss the amount of sample data to use when creating a codebook. The sample set that was used in the study totalled 75 lines out of a complete set of 305 lines.

This represented 25% of the entire dataset. And as previously discussed, because one clinic was chosen, the data consisted of 75 lines from a clinic pool of 137 lines. This represents 55% of one clinic's data. However in the literature, there is no specific percentage of sample data that should be used when creating a codebook. It is generally recommended to use a sufficient amount of data to ensure that the codebook is comprehensive and covers all relevant themes and topics in the data set (Braun & Clarke, 2019). According to Guest et al. (2012), a codebook should be developed using a representative sample of the data, which should be large enough to ensure that all relevant themes and topics are identified, but small enough to be manageable. However, these authors are suggesting that sample data should not be randomly selected but purposefully chosen to represent various issues that could arise. The limitations of this are leaving out context as well as opening up the risk of increased interpretation biases because there would be assumed themes and topics in the first place. Braun and Clarke (2019) further clarify that the sample size will depend on the nature the data and the research question, but that it is generally advisable to use a large enough sample to ensure that the codes are stable and reliable. Regardless, given that this study chose to base our codebook on one clinic, of which 55% of their data was represented, it is likely that the themes or topics would have come up. It is important to note in either case that there is an increased responsibility to continue to recognize new codes that emerge as the data is being analyzed, and not to think of the code book as something that cannot be changed. If a collaborative approach is used, the research team can be used to discuss any changes that should be implemented into the code book.

After exploring various brainstorming techniques and utilizing the code book to analyze the dataset, we have determined that the interpretations of the sample set were consistently accurate. It was reassuring to see that the code book was utilized throughout the entire analysis process and captured most of the data, except for a few new codes previously mentioned. Currently, there is no set percentage or size of sample data recommended for use. Instead, researchers are encouraged to exercise critical judgment and select a sample appropriate for their study's design and topic.

7. Conclusion

Collaborating when developing a codebook can strengthen the accuracy and dependability of data analysis by decreasing the likelihood of individual bias or subjectivity during coding (Saldaña, 2021). Therefore, establishing a thorough and collaborative process for developing and refining a codebook is crucial for trustworthy qualitative data analysis. As our study progresses, we anticipate gaining further insights and having more opportunities for discussion and collaboration. In healthcare research, collaboration is valuable and can bring together diverse perspectives from the healthcare team. Although our analysis did not involve patient perspectives, exploring ways to involve patients in future research may be beneficial. Additionally, this project provides an opportunity for interprofessional research, which can further broaden the scope and depth of our findings.

8. References

Armstrong, E., Maypilama, Ḻ., Bukulatjpi, Y., Gapany, D., Fasoli, L., Ireland, S., ... & Lowell, A. (2023). A flow that comes when we’re talking: Water metaphors for exploring intercultural communication during early childhood assessment interactions in a Yolŋu (First Nations Australian) community. Journal of Applied Communication Research, 19(2), 1-25. https://doi.org/10.1080/00909882.2023.2222163 [ Links ]

Birt, L., Scott, S., Cavers, D., Campbell, C., & Walter, F. (2016). Member checking: a tool to enhance trustworthiness or merely a nod to validation? Qualitative Health Research, 26(13), 1802-1811. https://doi.org/10.1177/1049732316654870 [ Links ]

Bowling, A. (2014). Research methods in health: Investigating health and health services (4th ed. ). McGraw-Hill Education. [ Links ]

Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health, 11(4), 589-597. https://doi.org/10.1080/2159676X.2019.1628806 [ Links ]

Braun, V., & Clarke, V. (2012). Thematic analysis. In Cooper, H., Camic, P. M., Long, D. L., Panter, A. T., Rindskopf, D., & Sher, K. J. (Eds.). (2012). APA handbook of research methods in psychology, Vol. 2. Research designs: Quantitative, qualitative, neuropsychological, and biological. (2nd ed., pp. 57-71). American Psychological Association. https://doi.org/10.1037/13620-000 [ Links ]

Burla, L., Knierim, B., Barth, J., Liewald, K., Duetz, M., & Abel, T. (2008). From text to codings: Intercoder reliability assessment in qualitative content analysis. Nursing Research, 57(2), 113-117. https://doi.org/10.1097/01.NNR.0000313482.33917.7d [ Links ]

Canadian Interprofessional Health Collaborative. (2010). A national interprofessional competency framework. https://www.cihc.caLinks ]

Charmaz, K. (2014). Constructing grounded theory (2nd ed.). Sage Publications. [ Links ]

Connor, P., & Evers, E. R. K. (2020). The bias of Individuals (in crowds): Why implicit bias is probably a noisily measured individual-level construct. Perspectives on Psychological Science, 15(6), 1329-1345. https://doi.org/10.1177/1745691620931492 [ Links ]

Creswell, J. W., & Clark, V. L. (2017). Designing and conducting mixed methods research. Sage Publications. [ Links ]

Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches. Sage publications. [ Links ]

Cruz, E. V., & Higginbottom, G. M. A. (2013). The use of focused ethnography in nursing research. Nurse Researcher, 20(4), 36-43. https://doi.org/10.7748/nr2013.03.20.4.36.e320 [ Links ]

Gill, G. K., McNally, M. J., & Berman, V. (2018). Effective diversity, equity, and inclusion practices. Healthcare Management Forum, 31(5), 196-199. https://doi.org/10.1177/0840470418773785 [ Links ]

Guest, G., MacQueen, K. M., & Namey, E. E. (2012). Applied thematic analysis. Sage publications. [ Links ]

Hatch, J. A. (2002). Doing qualitative research in education settings. SUNY Press. [ Links ]

Hsieh, H.-F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288. https://doi.org/10.1177/1049732305276687 [ Links ]

Hørder, M., & Nielsen, M. K. (2020). Patients as partners in research: The challenges for researchers of patient involvement. Research Outreach, 117, 90-93. https://doi.org/10.32907/RO-117-9093 [ Links ]

Hubbell, F. A., Luce, J. K., Amezcua, C. A., Salinas, R. D., & Krone, M. R. (2005). The importance of diversity in research: Perspective from cancer and other health disparities. American Journal of Public Health, 95(S1), S9-S12. https://aacrjournals.org/cancerdiscovery/article/12/6/1428/699128?casa_token=PICrUk_RaL8AAAAA:mbK4fsIavy5n9mk7XnmayXJ90lIfxjkzlF59PmUouQNxJm7njydnQVWWg5-Ln172EMVT_gLinks ]

Johnson, R.B., &Christensen, L. (2017). Educational research - International student edition: Quantitative, qualitative, and mixed approaches (6th ed.). SAGE Publications. [ Links ]

Karakose, T., Demirkol, M., Aslan, N., Köse, H., & Yirci, R. (2023). A conversation with ChatGPT about the impact of the COVID-19 pandemic on education: Comparative review based on human-AI collaboration. International Journal, 12(3), 7-25. https://www-ceeol-com.login.ezproxy.library.ualberta.ca/search/article-detail?id=1134493Links ]

Kawulich, B. B. (2005). Participant observation as a data collection method. Forum: Qualitative Social Research, 6(2), Article 43. https://doi.org/10.17169/fqs-6.2.466 [ Links ]

Khalili, H., Thistlethwaite, J., El-Awaisi, A., Pfeifle, A., Gilbert, J., Lising, D., MacMillan, K., Maxwell, B., Grymonpre, R., Rodrigues F., Snyman, S.,Xyrichis, A. (2019). Guidance on global interprofessional education and collaborative practice research: Discussion paper. A joint publication by InterprofessionalResearch.Global, & Interprofessional.Global. http://www.research.interprofessional.globalLinks ]

Krippendorff, K. (2018). Content analysis: An introduction to its methodology. Sage publications. [ Links ]

Kumar, R., & Sharma, M. K. (2020). Exploring the role of mind mapping in qualitative research. Journal of Education and Practice, 11(19), 41-47. https://journals.sagepub.com/doi/pdf/10.1177/160940690900800307 [ Links ]

Lewin, S., Glenton, C., & Oxman, A. D. (2009). Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: Methodological study. BMJ, 339, b3496. https://doi.org/10.1136/bmj.b3496 [ Links ]

Manafo, E., Petermann, L., Mason-Lai, P., & Vandall-Walker, V. (2018). Patient engagement in Canada: A scoping review of the ‘how’ and ‘what’ of patient engagement in health research. Health research policy and systems, 16(1), 1-11. https://doi.org/10.1186/s12961-018-0282-4 [ Links ]

Matemba, E., Smith, L., Wolff, K., Inglis, H., Mogashana, D., Jansen, L., ... & Nyamapfene, A. (2023). Reflecting on a community of practice for engineering education research capacity in Africa: Who are we and where are we going? Australasian Journal of Engineering Education. Advance online publication. https://doi.org/10.1080/22054952.2023.2233340 [ Links ]

Miles, M. B., Huberman, A. M., & Saldaña, J. (2020). Qualitative data analysis: A methods sourcebook. Sage Publications. [ Links ]

Miro. (2021). Miro: The online collaborative whiteboard platform to bring teams together, anytime, anywhere. https://miro.com/Links ]

Olson, J. D., McAllister, C., Grinnell, L. D., Walters, K. G., & Appunn, F. (2016). Applying constant comparative method with multiple investigators and inter-coder reliability. The Qualitative Report, 21(1), 26-42. https://doi.org/10.46743/2160-3715/2016.2447 [ Links ]

Pappas, G., Kiriaze, I. J., & Falagas, M. E. (2008). Insights into infectious disease in the era of Hippocrates. International Journal of Infectious Diseases, 12(4), 347-350. https://10.1016/j.ijid.2007.11.003 [ Links ]

Patton, M. Q. (2015). Qualitative research and evaluation methods (4th ed.). Sage. [ Links ]

Petticrew, M., Knai, C., Thomas, J., Rehfuess, E. A., Noyes, J., Gerhardus, A., ... & McGill, E. (2019). Implications of a complexity perspective for systematic reviews and guideline development in health decision making. BMJ Global Health, 4(Suppl 1), Article e000899. http://dx.doi.org/10.1136/bmjgh-2018-000899 [ Links ]

Richards, K. A. R., & Hemphill, M. A. (2018). A practical guide to collaborative qualitative data analysis. Journal of Teaching in Physical Education, 37(2), 225-231. https://doi.org/10.1123/jtpe.2017-0084 [ Links ]

Saldaña, J. (2021). The coding manual for qualitative researchers (4th ed.). SAGE [ Links ]

Appendix A: Coding Concepts

Figure 6.  From Coding to Concepts Model for Qualitative Analysis. (adapted from Saldaña, 2021) 

Step One: Understanding a Code

A code in qualitative analysis consists of a word or phrase that symbolically captures the essence of the data (Saldaña, 2021). In order to build understanding, typically coding of data is not simply done once, but the data is returned a number of times. Saldaña (2021) described two rounds of coding, during which the first pass assigns codes from a single word to a paragraph. The second pass includes the coded section of data along with longer text passages, analytic memos, or simply a rewording of the codes (Saldaña, 2021).

Step Two: Moving from Codes to Categories

Moving through the steps of analysis involves synthesizing individual codes into meaning (Saldaña, 2021). Unlike quantitative methods, there is no formula to do this but rather involves methods of grouping and applying meaning to the data. These meanings are the categories, themes, or concepts emerging from the scripts (Saldaña, 2021). Word clouds and other brainstorming techniques are a popular tool for visualizing and analyzing textual data in qualitative research. They allow researchers to quickly and easily identify the most commonly occurring words in a dataset, which can provide valuable insights into the underlying themes and patterns in the data (Creswell & Poth, 2018; Krippendorff, 2018).

Step Three: Understanding Patterns

Saldaña (2021) described a pattern as a “repetitive, regular, or consistent [occurrence] of action or data that [appears] more than twice” (p. 44). This includes capturing any deviations from the regularity of a pattern. Hatch (2002) offered a description of various forms of patterns: “similarity” are when things happened the same way, “difference” is when they happened in predictably different ways, “frequency” is if they happened often or seldom, “sequence” is if they happened in a certain order, “correspondence” is if they happened in relation to other activities or events, and “causation” is if one appeared to have caused another (p. 155).

Step Four: Reviewing Examples from Other Fields

An example of descriptive coding as presented by Saldaña (2021) highlighted a transcription about the prevalence of chain link fences in front of the vast majority of homes in an area, with multiple signs warning visitors of dogs, primarily German Shepherds. The assigned descriptive code for this excerpt was security. Another example of coding provided by Saldaña (2021) showed how several codes could be extracted from a data set. His example described an interview in which a high school senior talks about his favorite teacher, specifically that the student expressed that his favorite teacher cared about him, even though the teacher has not said it directly. Additionally, the teacher had been a constant source of support in the student's life, especially when his parents were not available. The resulting codes represented the students' feeling of self-worth, stability, and comfort. With his examples, it is important to recognize that codes chosen may or may not align with all interpretations of the data (Saldaña, 2021). He gives reassurance that it is acceptable to have different choices since coding is not a precise science and involves subjective interpretation. This reflects the researcher's creativity, background knowledge, and thinking processes, and although codes may seem to emerge spontaneously, they are actively constructed, formulated, created, and revised by the researcher, not through some vague process (Saldaña, 2021).

Appendix B: Brainstorming Techniques

Word Clouds and Word Frequencies

To support the use of word clouds and frequencies, various sources were consulted, including Creswell and Poth (2018) and Krippendorff (2018). Word clouds and frequencies were assessed using free online software tools. The use of word clouds and frequencies has been widely recognized as a way to visually present information in a concise and understandable way, allowing for the identification of important themes and patterns in the data (Creswell & Poth, 2018; Krippendorff, 2018). After the codes were reviewed in the spreadsheet, they were copied and pasted into a Word document for data cleaning and wrangling. This involved cleaning the words to make the visualizations more coherent and meaningful, as suggested by previous research (Creswell & Poth, 2018). In the present study, Word Clouds were created to visualize the data and identify the most frequently occurring words (Figure 6 shows an example Word Cloud). This allowed the researcher to visually see which words were most significant in the dataset, and to interpret their significance qualitatively. Overall, Word Clouds provide a powerful and flexible tool for data visualization and analysis in qualitative research (Krippendorff, 2018; Saldaña, 2021).

Figure 7 Word Cloud from the data. 

Several sources were consulted to develop a comprehensive list of data cleaning steps, including Saldaña (2021) and Miles et al. (2020). These steps were informed by the nuances of healthcare as experienced by the researcher. Data cleaning ensured consistency, accuracy, and clarity in the word cloud and frequency analysis. Differences in word usage were made consistent, so long as this did not take away the meaning of the word (health care was replaced with healthcare). Spelling errors were corrected, and differences in spelling chosen were made consistent. For example, choosing physician as the word rather than having various words that meant the same thing like GP, doctor, or family provider. Plural and singular forms of words were also made consistent (roles versus role), and multiple words that described a concept were grouped together using a dash (-) to ensure the meaning was not lost through a separation of the words. Some phrases were truncated, which removed extra words. For example, patient involvement in healthcare became patient engagement. And at times, a general code was placed first, followed by the verb to make the analysis more coherent. For example, if there were many references made to guidelines but they had a clear association with a person, the word would be listed as guidelines-provider. Overall, the use of frequencies and word clouds provided the researcher with valuable insights into the underlying themes and patterns in the data. This allowed the researcher to gain a deeper understanding of the data and identify relationships that might not have been apparent otherwise. By analyzing the most frequently occurring words, the researcher was able to gain a deeper understanding of the underlying themes and patterns in the data, and to develop new insights and ideas based on these findings (Creswell & Poth, 2018).

Mind Mapping

The use of Mind Mapping in the coding process is supported by various sources (Kumar & Sharma, 2020; Saldaña, 2021). In this study, the Miro® program was utilized to aid in the creation of a visual representation of the coding process (Miro, 2021). The use of color-coding systems and sticky notes in the coding process has also been recognized as a useful tool in qualitative research (Charmaz, 2014; Kumar & Sharma, 2020). The researcher used Miro's mind mapping feature during the coding process to review collaborative notes side by side and to come up with an overall code for the code book (Figure 7 shows an example). As the coding process progressed, similar codes were grouped together, and additional sticky notes were created to identify if they would be appropriate for future discussions. The color-coding system was also utilized, with green and blue sticky notes used to indicate the emergence of initial categories, and pink stickies used to indicate areas where further research was needed to build on the understanding of the initial category. Moreover, pink stickies were also used to indicate any relationships between the codes that were found. The use of these visual tools helped in creating a clear and organized representation of the coding process and allowed the researcher to easily identify patterns and relationships between the codes.

Figure 8 Screenshot of Mind Mapping in Miro®. (Miro, 2021) 

An iterative process occurred between the coding book and the Mind Map. This helped the researcher keep context in mind while grouping codes together and determining the ultimate best words. Some categories emerged from the initial analysis.

Wordsmithing

The final step to analysis techniques that were used was a simple process of Wordsmithing to help refine and enhance the language used (see Table 2). This iterative process of revising and refining the codes was essential to ensure the accuracy and reliability of the analysis. Constant comparison and categorization of codes are essential for identifying themes and patterns within the data (Miles et al., 2020; Saldana, 2021). Miles et al. (2020) highlighted the iterative process of reviewing and refining codes as an essential aspect of qualitative data analysis. They argue that this process allows researchers to "test the validity of the codes, eliminate redundancy, and refine categories" (p. 121). In order to facilitate this process, they suggest the use of data display tools such as charts, diagrams, and matrices, which can help researchers to visualize patterns in the data and to identify areas where further analysis is needed. The results of these techniques generated the initial list that would be reviewed by the team.

Table 2 Wordsmithing codes using a thesaurus. 

Received: February 28, 2023; Accepted: March 30, 2023

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License