SORT IT operational research and training

SORT IT operational research and training

Overview

Many public health programmes in low- and middle-income countries “are data rich but information poor” implying that much data is generated at a country level but the full potential to use these data to inform improvements in public health is rarely achieved.

The Structured Operational Research and Training IniTiative (SORT IT) seeks to make countries “data-rich, information-rich and action-rich” thereby contributing to improving health care delivery and outcomes. SORT IT is a global partnership coordinated by TDR and implemented with partners. SORT IT supports countries and institutions to: conduct operational research around their own priorities; build sustainable operational research capacity; and make evidence-informed decisions for improving programme performance. Participants conduct operational research on various topics such as multidrug-resistant tuberculosis, malaria, HIV/AIDS, neglected tropical diseases, maternal and child health, outbreaks and emergencies, antimicrobial resistance and noncommunicable diseases.

Key facts

Since 2009, the SORT IT initiative has enrolled 1015 participants from 94 countries .

 

SORT IT outputs and coverage

Since 2009, the SORT IT initiative has enrolled 1015 participants from 94 countries . Close to 90% complete all milestones and publish in a peer-reviewed scientific journal with 68% of studies self-reporting to have contributed to a change on policy and/or practice. Publications included 53 journals (impact factor 0.4-19), were done in five languages with individuals from LMICs constituting 94% of first authors, 93% of corresponding authors and 62% of last authors. 43% of first authors were women.

To ensure quality of evidence, TDR routinely assesses the quality of reporting of SORT IT publications according to international standards. The last assessment showed that 90% of publications (n-392) involving 72 countries, and 24 thematic areas showed excellent reporting quality.

 
  View SORT IT coverage map

 

SORT IT approach

SORT IT targets implementers such as doctors, nurses, paramedical officers, data analysts, and programme officers, often with little or no prior research experience. Participants undergo training and conduct their research simultaneously. Each participant uses a relevant research project to learn the practical skills of how to write a study protocol, how to ensure quality-assured data capture and analysis, how to publish in a peer-reviewed journal and how to use the study findings to foster evidence-informed decision-making in public health. Participants must achieve milestones to move from one stage to the next and SORT IT courses are expected to achieve targets. Participants are supported with hands-on mentorship provided by experienced mentors.

Classic structure and milestones for a SORT IT course

  • Module 1: Operational research and protocol development
  • Milestone 1: Submission of protocol and the ethical review form within three weeks of completing module 1
  • Module 2: Quality-assured data entry and analysis
  • Milestone 2: Submission of the data documentation sheets within two weeks of completing module 2
  • Milestone 3: Submission of proof of study completion and data collection about six weeks before module 3
  • Module 3: Scientific manuscript writing
  • Milestone 4 Submission of a paper to a peer-review journal within four weeks of end of module 3
  • Module 4: Effective research communication for decision makers
  • Milestone 5: Submission of a stakeholder map, evidence brief, power point presentations and elevator pitch within two weeks of completing module 4


Target scores for a SORT IT course

IndicatorTarget
Aggregate participant satisfaction score for each module80%
Participants complete all course milestones80%
Papers published within 12 months of submission80%
Papers assessed for effects of policy and practice within 15 months of submission80%

 

The SORT IT cycle

The AMR- SORT IT project is geared to catalyze the evidence-to-action cycle from defining the most relevant research in countries to ensuring uptake of research findings. We train those who are embedded and retained within health systems and seek to enable the structures and processes needed for evidence-informed decision-making. SORT IT thus embraces the ‘Train, Embed, Retain and Enable’ strategy for individuals working within health systems. This approach is in line with WHO’s Thirteenth General Programme of Work, 2019–2023. 

   

     View SORT IT cycle

 

SORT IT recognition

SORT IT is unique in being adaptable, output-oriented, striving for gender balance and having built-in metrics for accountability. It has been recognized by a  DFID independent evaluation and by  ESSENCE good practice guidelines. Several WHO documents refer to SORT IT including the World Health Report 2013, the Global action framework for TB research and the WHO European Action plan to strengthen the use of evidence for policy-making. Several NGOS and academic institutions have adopted the SORT IT approach.

 

 

SORT IT collaborating institutions

LMIC-LMIC collaboration (72 institutions):

  • Armenia: Tuberculosis Research and Prevention Center NGO
  • BrazilThe Universidade Federal de Ciencias de Saude de Porto Alegre; Universidade de Brasilia
  • Chile: Universidad de Concepcion 
  • Colombia: Universidad de los Andes; Universidad Pontificia Bolivariana; Universidad Pedagógica y Tecnológica; Ministry of Health
  • Ecuador: The Central University
  • Egypt: Ministry of Health of Egypt (Central laboratories and infection prevention control programme)
  • Ethiopia: Bahir Dar University
  • Ghana: CSIR–Water research institute; Environmental Protection Agency; Institute of Statistical, Social and Economics Research (ISSER); Kintampo Health Research Center 
  • Guinea: Africa Centre of Excellence for Prevention and Control of Transmissible Diseases, University Gamal Abdel Nasser of Conakry; University National Centre for Training and Research in Rural Health.
  • India: All India Institute of Medical Sciences- New Delhi, Nagpur, Bibinagar and Deoghar; Academy for Public Health, Kozhikode; Bangalore Medical College and Research Institute, Bengaluru; GMERS Medical College, Vadodara; ICMR–National Institute of Epidemiology, Chennai; Jawaharlal Institute of Postgraduate Medical Education & Research, Puducherry; Government Medical College, Baroda; Narotam Sekhsaria Foundation, Mumbai; Sri Manakula Vinayagar Medical College, Puducherry;  The Union South East Asia office (The USEA), New Delhi
  • Iran: University of Medical Sciences, Tehran, Food and Drug Administration; Ministry of Health and Medical Education
  • Kenya: AMPATH; Madhira Institute; The Kenya Snakebite Research and Intervention Centre; University of Nairobi; Respiratory Society of Kenya
  • Malawi: Lighthouse Trust
  • Mexico: The Autonomous University of Yucatán
  • Myanmar: Department of Medical Research
  • Nepal: Damien Foundation; School of Public Health; B.P. Koirala Institute of Health Sciences; Patan Academy of Health Sciences; National Public Health Laboratory; KIST Medical College and Teaching Hospital; Ministry of Agriculture and Livestock; Dhulikhel Hospital, Kathmandu University School of Medical Sciences
  • Nigeria: Ministry of Health
  • Pakistan: Ministry of Health; Common Management Unit for AIDS, TB & Malaria
  • RDC: Médecins Sans Frontierès  
  • Sierra Leone: Food and Agriculture Organization; Sustainable Health Systems; Ministry of Health; Ministry of Agriculture and Livestock; University of Sierra Leone, Ministry of Defense
  • South Africa: Stellenbosch University
  • Tunisia: Ministry of health, Charles Nicolle Hospital, Tunis, Tunisia/Faculty of Medecin; Hedi Chaker University Hospital; Sahloul University Hospital of Sousse
  • UAE: United Arab Emirates University; Abu Dhabi Public Health Center; Abu Dhabi Agriculture and food safety Authority; Union 71 
  • Uganda: Makerere University; Lire University; Ministry of Health
  • Uzbekistan: National TB Programme
  • Zambia: Zambart, National TB Programme, Center for Infectious Diseases Research (CIDRZ)
  • Zimbabwe: Ministry of Health

HIC–LMIC collaboration: (15 institutions):

  • Belgium: Institute of Tropical Medicine 
  • Canada: University of Toronto; Public Health, Ontario
  • France: Centre for Operational Research (COR), International Union Against Tuberculosis and Lung Disease
  • Hungary: National Public Health Center
  • Luxembourg: Médecins Sans Frontières
  • Sweden: Public Health Agency
  • Scotland: University of Saint Andrews 
  • United Kingdom: Public Health England; University of Liverpool; The Quadram Institute Bioscience, Norwich; Cheshire and Wirral Partnership NHS Foundation Trust, Chester, England; University of Chester
  • USA: University of Washington; California State University of Fullerton

SORT IT for participants

You can expect to complete your research in about a year, develop a manuscript ready for submission to a peer-reviewed journal. SORT IT has a web-based alumni network that links up all SORT IT participants. Furthermore, alumni who are embedded within disease control programmes and/or NGOs also have an opportunity to become operational research fellows and can pursue a PhD using their operational research work.

Participant eligibility criteria

Participant selection is guided by eligibility criteria which include the following:

  • Must be actively involved in a disease control programme at the national, state, NGO, or health institution level.
  • Outline a half-page of text that a) describes a relevant problem that the candidate has identified within a given programme and b) formulates a research question that is proposed to be developed into an operational research project. Please note that research questions using routine programme data are preferred.
  • Provide a written statement from the programme manager or relevant authority confirming the relevance of the research question and granting the applicant permission to have time and opportunity to carry out and publish his/her operational research.
  • Must provide written commitment to attend all modules of SORT IT, return to their programme or institution after the course and implement course knowledge at programme level for a minimum of 18 months.
  • Provide a written statement from a mentor (if available) or referee describing how the mentor knows the candidate and if he/she will be suitable for the course.
  • If applicable, the ability to mobilize the funding required to carry out the operational research.
  • Master of Public Health (MPH) or an equivalent, or a strong recommendation.
  • Fluent in written and spoken English and/or the language of the course.
  • Computer literate.
        

SORT IT for interested organizations

SORT IT is growing—expanding to new regions, addressing new areas of public health, adopting more complex study designs, and piloting innovative delivery methods. We actively promote partnerships and national leadership. You can support these tailored training opportunities in your country or institution by sponsoring a workshop. Partner with TDR to host a SORT IT workshop that aligns with the global health challenges addressed in the TDR Strategy 2024-2029 and/or help train new facilitators and bring world-class operational research capacity to your country or institution. 

Criteria for SORT IT or adapted SORT IT courses, use of logos

  1. TDR-led and/or funded (or co-funded) courses.

    These SORT IT programs are fully aligned with TDR standards and protocols. They carry both the TDR and SORT IT logos, reflecting their official endorsement and funding.

  2. Partner-led courses.
    These courses are organized and funded by partner institutions, with oversight from an experienced mentor (or mentors) from the TDR-recognized pool (contact: zachariahr@who.int).  Use of TDR logo is not authorized.  However, the SORT IT logo can only be used in funding proposals, course briefs and training materials when the following criteria are met.

Criteria for maintaining quality and outcomes in SORT IT Courses

To ensure the quality and impact of SORT IT and adapted SORT IT courses, the following criteria must be met:

  1. Course Structure
    Courses must include at least three of the four modules, based on/or adapted from the SORT IT curriculum.
  2. Milestones and Targets
    Progress must be systematically tracked by the implementing partner institution throughout implementation and reported to the SORT IT focal point. Registration in the TDR database is only possible after formal reporting and verification of Milestones 1 and 2 of the SORT IT cycle. Until these milestones are achieved, courses cannot be branded as SORT IT.
    Course coordinators may meanwhile, use the following statement in the course briefs or calls for applications:

“This course is structured in line with the SORT IT curriculum and requirements, and liaison with TDR will be maintained to obtain SORT IT recognition after completion of Module 2 of the operational research course.”

  1. Mentorship
    Institutions conducting a SORT IT course for the first time must have an experienced, TDR-accredited SORT IT mentor on-site to ensure quality oversight.
  2. Target Monitoring
    The 80–80–80–80 target scores of SORT IT must be monitored and reported. These ensure rigorous quality control—from defining a research question to influencing evidence-informed decision-making.
  3. Administrative Updates
    The course coordinator from the implementing partner must provide regular updates to the TDR focal point, according to a standard reporting and archiving template. This should include:
    -Participant information and research titles
    -Module evaluation scores
    -Course performance relative to the 80–80–80–80 targets
    -Archives of study protocols, manuscripts, and publications

Contact for Registration
Institutions meeting these criteria should contact Dr. Rony Zachariah (zachariahr@who.int) for formal registration.

Additional notes:

-Final Certification
Final SORT IT certification for a course cycle is granted only after all course milestones have been reported, the rigorous SORT IT processes have been followed, and performance targets have been pursued. Certification is awarded after Module 3 (for three-module courses) or Module 4 (for four-module courses).

-Reappraisal
If the 80-80-80-80 performance criteria are not met, a reappraisal phase may be initiated. Following this, the course may lose its designation as a SORT IT course.

-Standard Operating Procedures
Standard Operating Procedures (SOPs) are available to guide institutions in planning and organizing SORT IT courses. These will be provided to interested institutions upon request.

Applications for funding of adapted SORT IT courses 
For SORT IT programs seeking funding and aspiring to meet TDR–SORT IT standards, early engagement with TDR is essential. This ensures:

-Oversight of quality and adherence to standards
-Timely decision on eligibility to use the TDR and/or SORT IT logos

When WHO country offices or WHO collaborative centers are involved, TDR must be engaged, as it hosts the SORT IT Secretariat at WHO.

SORT IT online resources

Flyers

Videos

Watch technical presentation

How findings from operational research convinced policy-makers in Sierra Leone to contribute more resources for improving monitoring of antimicrobial use in the agricultural sector, presented by Dr Amara Leno.

 

AMR SORT IT

News

All >>

6 August 2021
12 participants from the surveillance and research institutions of the government of Colombia and Ecuador completed two training modules of the Operational Research course to tackle antimicrobial resistance (AMR)
Read more in English or Spanish

Watch

Interested in establishing or supporting SORT IT?

General information, contact Dr Rony Zachariah: zachariahr@who.int


TDR Global profile

View all >