Open Access Research

Thailand special recruitment track of medical students: a series of annual cross-sectional surveys on the new graduates between 2010 and 2012

Weerasak Putthasri1*, Rapeepong Suphanchaimat1, Thitikorn Topothai1, Thunthita Wisaijohn1, Noppakun Thammatacharee12 and Viroj Tangcharoensathien1

Author Affiliations

1 International Health Policy Program (IHPP), Ministry of Public Health, Tivanond Road, Nonthaburi 11000, Thailand

2 London School of Hygiene and Tropical Medicines, University of London, London, Keppel St, London WC1E 7HT, United Kingdom

For all author emails, please log on.

Human Resources for Health 2013, 11:47  doi:10.1186/1478-4491-11-47


The electronic version of this article is the complete one and can be found online at: http://www.human-resources-health.com/content/11/1/47


Received:14 March 2013
Accepted:12 September 2013
Published:24 September 2013

© 2013 Putthasri et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Comprehensive policies for rural retention of medical doctor and other health professional, including education strategy and mandatory service, have been implemented in Thailand since the 1970s. This study compared the rural attitudes, intention to fulfil mandatory rural service and competencies between medical graduates’ from two modes of admission, normal and special tracks.

Methods

Three cross-sectional, self-administered questionnaire surveys were conducted in April 2010, 2011 and 2012. The questionnaire was distributed to all new medical graduates in the annual Ministry of Public Health meeting to allocate workplaces for the 3-year mandatory service.

Findings

The majority of students were recruited through the normal track (56 to 77%) from medical schools in Bangkok (56 to 66%), having mostly attended secondary schools in Bangkok. A majority of special track graduates came from secondary schools in provincial cities (76 to 79%). All three batches came from well-educated parents.

A slight difference in rural attitudes was observed between tracks. Univariable analysis found statistical associations between the intention to fulfil the 3-year obligation and special track recruitment and attributes on rural exposure. Multivariable analysis showed that graduates recruited through the special track had a 10 to 15% higher probability of fulfilling the mandatory service.

Special track graduates scored higher on four out of five competencies, notably procedural skills, but normal track graduates had higher competency on clinical knowledge in major clinical subjects.

Conclusion

Since special track recruitment resulted in a higher probability of fulfilling mandatory service and competency, increasing the proportion of special track recruitment and improving the effectiveness of policies addressing physician shortage were recommended.

Keywords:
Physicians; Medical graduate; Medical education; Supply and distribution; Professional competence; Attitude of health personnel

Introduction

Shortage and maldistribution of the health workforce, a key component of health systems, has shown limited progress, especially among the critical shortage countries [1,2], far below the recommended threshold of 2.28 per 1,000 population [3]. Density of the health workforce contributed to health achievement [4,5]. Shortage and maldistribution are two major bottlenecks facing lower- and middle-income countries [6]. Inequitable distribution aggravates shortages in rural and hard-to-reach areas.

Empirical evidence suggests that having medical students with rural backgrounds has a positive influence on rural primary care practices and retention. In the US, the Physician Shortage Area Program demonstrated that a student’s rural background contributed to rural primary care practice and retention [7]; similar findings were reported from Canada and Japan [8-10]. Studies in Australia and South Africa confirmed that early rural exposure supported students gaining knowledge and skills necessary for future work in rural areas [11-14].

Five out of sixteen interventions to improve health workforce retention in rural areas, as recommended by the World Health Organization, were education strategies such as recruiting students from rural backgrounds, locating health professional schools outside major cities and clinical rotations in rural areas during studies [15]. In Thailand, a mix of these policy interventions were gradually introduced since the 1970s [16-18].

There are two distinct modes of admission for medical students in Thailand. Under the normal track, any grade-12 student can apply to sit the national entrance examination; based on competency, they are recruited to study medicine for 6 years (1 year basic science, 2 years preclinical and 3 years clinical) in one of the 19 faculties of medicines operating under the Ministry of Education. Prior to the national entrance examination, some faculties convene their own recruitment (so-called direct admission) based on competitiveness and competency, judged by their institution-specific examination papers.

Under the special track, two ongoing national programs are the ‘Collaborative Project to Increase Production of Rural Doctors (CPIRD)’ launched in 1995 and ‘One District One Doctor (ODOD)’ launched in 2005. Any grade-12 students residing in a provincial area (for CPIRD) or in a non-provincial city (for ODOD) are eligible to sit an examination jointly convened by all 19 faculties of medicine, using a single examination paper. Students are then recruited based on competency. Students on the CPIRD and ODOD tracks take the first 3 years jointly with normal track students in universities, but during their 3 clinical years they are trained by clinical staff in the 34 accredited regional and provincial hospitals of the Ministry of Public Health (MOPH), affiliated with relevant faculties of medicine [19,20]. Their diplomas are granted by their individual university, not the affiliated MOPH institutes.

Medical students from all tracks are exposed to rural services in their clinical years and are subject to a national license examination to obtain their medical license. Graduates from all tracks are liable for mandatory service (3 years for normal track students and CPIRD, and 12 years for ODOD), with a financial penalty of US$ 13,000 for non-adherence by normal track and CPIRD graduates, and five times higher (US$ 65,000) for ODOD graduates. The difference in choosing workplace between normal track and CPIRD/ODOD is that, upon graduation, students in CPIRD/ODOD track are obliged to work in certain severe shortage provinces where allocations are mostly their hometown or neighboring districts/provinces while the choice of workplace for normal track graduates are more flexible, depending on their own choice given the availability of vacant posts [20].

Despite the implementation of a national program to solve the health worker shortage, there has not been a comprehensive study to assess the impact of the special track in relation to normal track recruitment. This study seeks to fill this knowledge gap by comparing CPIRD/ODOD with normal track graduates on their rural attitudes, intention to fulfil the 3-year mandatory service, and competency.

Methods

Study design

Three consecutive, cross-sectional surveys were conducted with all new medical graduates who gathered at the meeting convened by the MOPH to choose hospitals for their mandatory rural services on 2 April 2010, 1 April 2011, and 1 April 2012, respectively.

Population and sample size

The target population was all the 1,545, 1,479 and 1,679 new medical graduates in 2010, 2011, and 2012 who gathered in the meeting convened by MOPH to choose their work place. The questionnaire was distributed to all these new graduates along with their registration documents. Having given verbal consent, a total of 576 (37.2%), 872 (59.0%) and 754 (44.9%) graduates from each year anonymously responded to the questionnaire. Confidentiality of information was strictly kept according to the standard operating procedure of health science research. The National Ethical Review Committee waived ethical clearance for this study.

Questionnaire design

The questionnaire was developed from a consultative meeting in the MOPH. Content validity was checked by canvassing the opinions of senior officers in the MOPH. A reliability test was performed through a pilot test on the final-year medical students in KhonKaen University (Cronbach’s alpha = 0.64; considered acceptable reliability). There were four parts in the questionnaire: (1) demographics of graduates including age, gender, mode of admission to medical education(normal admission track through competitive national entrance examination or direct admission, and special tracks under CPIRD and ODOD), location of their medical school (in Bangkok or outside), location of residence for the ages 1 to 15 years, location of current residence, location of secondary school, and education profile of parents; (2) attitudes toward rural practice measured by level of attitude using the Likert scale, ranging from one (least positive) to five (most positive) arranged in five questions indicating ‘peers in rural settings are supportive’, ‘working in rural areas provides greater opportunity in meeting professional colleagues’, ‘amenities and facilities are available in rural areas’, ‘people in rural areas are generous and friendly’, and ‘working in rural areas can maintain close contact with friends and families; (3) intention to complete the 3-year mandatory service and the plans thereafter; and (4) confidence in medical and public health competency using fourteen questions and self assessment using the Likert score ranging from one (least confident) to five (most confident). All the four parts were arranged in a single attachment.

The fourteen competency questions cover: (1) public health; (2) health administration; (3) communication; (4) inter-professional collaboration; (5) internal medicine care; (6) obstetric and gynecologic care; (7) pediatric care; (8) surgical care; (9) general disease care; (10) difficult labor management; (11) patient referral management; (12) overall clinical competency; (13) clinical knowledge; and (14) clinical skill. The questionnaire was tested on the content validity, then redesigned and finalized. Completed questionnaires were dropped in a collecting box anonymously.

Data analysis

Analyses were performed using Stata Version 11 (STATA Corporation, College Station, TX, USA). The analysis consisted of four parts: (1) descriptive statistics were used to understand the socio-demographic profiles of graduates and their parents, and Pearson’s Chi-square test was used to explain the association between modes of admission and location of secondary school; (2) average rural attitude scores were compared between two modes of admission; (3) Pearson’s Chi-square was used to explain association between various attributes and the intention to fulfil the 3-year mandatory service; furthermore, multivariable logistic regression with marginal effects was conducted to determine the association between the intentions to fulfil the 3-year obligations and the significant attributes identified by the univariable analysis; and (4) a composite competency score was produced using exploratory factor analysis of the fourteen competency questions. Principal component analysis was applied to identify factors which addressed around at least 75% of variance. Varimax rotation was executed to group the fourteen questions into each factor. The composite score of each factor was calculated using Bartlett’s formula [21]. The competency composite score was assessed against the mode of admission.

Results

Profile of samples

Across the three batches, graduates were on average 24 years old and more were female than male. It was noted that the majority of graduates came from normal track recruitment and graduated from medical schools located in Bangkok (Table 1). Opportunities for students from secondary schools located outside provincial cities to enrol in medical education was small, around 11.5 to 15.0% of total graduates, while a majority of graduates were students from secondary schools located either in Bangkok (33.0 to 53.2%) or in a provincial city (35.3 to 52.0%). A majority of all three batches of medical graduates came from well-educated parents; more than two-thirds had at least one parent with at least a bachelors degree, while the other third did not have a parent with a degree.

Table 1. Profiles of new medical graduates: 2010, 2011 and 2012 batches

Modes of admission and location of secondary school

Modes of admission were significantly related to the location of the secondary school where these graduates studied at grade 12. In 2010, most graduates who were recruited via the normal track came from secondary schools located in Bangkok (65.3%), followed by those located in a provincial city (23.1%). Only 11.6% of graduates came from secondary schools outside a provincial city.

Among graduates recruited through the special track, most of them (76.0%) came from secondary schools in a provincial city; a small proportion (10.5%) came from outside a provincial city. Despite the intention of offering more opportunities for students living in either provincial or non-provincial cities through special track recruitment, a meaningful portion of graduates (13.5%) came from secondary schools in Bangkok. Similar findings emerged across the three batches (Table 2).

Table 2. Association between mode of admission and location of secondary school

Modes of admission and attitudes towards working in rural areas

Across the three batches of graduates, there is a slight difference in rural attitudes between those recruited through the normal track and the special track. Graduates from the special track scored higher on attitude (four out of five) on the impression that people in rural areas are generous and friendly and there is good professional peer support in rural settings. However, on the lack of amenities and facilities in rural areas, and inadequate meetings with professional colleagues they got a lower attitude score, less than 3 out of 5 (Figure 1).

thumbnailFigure 1. Attitudes towards rural health services by mode of admission. PEERS_SUPPORT, peers in rural settings are supportive; INTRA-PROFESSION, workers in rural areas have greater opportunity in meeting professional colleagues; AMENITY, amenities and facilities are available in rural areas; FRIENDLY, people in rural areas are generous and friendly; FAMILY, workers in rural areas can maintain close contact with friends and families.

Modes of admission and intention to fulfil the 3-year compulsory rural service

The univariable analysis in Table 3 shows the association between seven attributes and the intention to fulfil their obligations. Despite all graduates being subject to mandatory rural service, a number of them chose not to adhere to this and instead paid the financial penalty.

Table 3. Graduate attributes and intention to fulfil the 3-year mandatory service: a univariable analysis

From the analysis, four out of seven attributes have a statistical association with the intention to fulfil the 3-year compulsory rural service. Medical graduates across the three batches who were recruited through the normal track, who spent their childhood life in Bangkok, whose current residence was in Bangkok and whose secondary school was located in Bangkok had a lower intention to fulfil the 3-year compulsory service with statistical significance. It is noted that graduates from medical schools outside Bangkok in the 2012 batch had a higher intention to fulfil their obligations with statistical significance, but this was not the case in the other two studied batches.

Furthermore, when multivariable analysis was conducted using the five attributes having significant influence on the intention to fulfil the 3-years compulsory service, the odds of having the intention to fulfil the 3-year compulsory service among graduates recruited thorough the special track were 2.23-, 2.45-, and 2.46-fold larger than graduates recruited through the normal track in the three batches with statistical significance. Meanwhile the other four attributes showed no significance (Table 4).

Table 4. Key attributes and odds ratio of intention to fulfil the 3-year mandatory service: a multivariable logistic regression with marginal effects

Modes of admission and competency

When Principal Component Analysis was applied, the fourteen questions were regrouped into five main domains, namely ‘COMMUNICATE’ (including communication and inter-professional collaboration), ‘PUB_HEALTH’ (including health administration and public health competency), ‘PROCEDURE’ (including management of referral cases, clinical competency, clinical knowledge and clinical skill), ‘MAJ_CLINIC’ (including competencies in internal medicine care, pediatric care, surgical care and general disease care), and ‘OB_GYN’ (including managing difficult labor and obstetric and gynecologic care).

Figure 2 clearly shows that graduates recruited by special track across the three batches had higher scores in COMMUNICATE by showing an average score of 0.06, 0.06, and 0.03 in 2010, 2011, and 2012, respectively. A similar pattern was also observed in PUB_HEALTH (0.09, 0.03, and 0.08), and PROCEDURE (0.27, 0.35, and 0.31 in the three corresponding batches). The level of confidence among graduates recruited by special track in obstetric and gynecologic skill (OB_GYN) also increased between 2011 and 2012. While graduates recruited by special track had higher competency in four domains, those recruited by normal track had higher competencies in major clinical subjects (MAJ_CLINIC) with an average score of 0.03, 0.04, and 0.02, respectively.

thumbnailFigure 2. Composite score for each category of competency, classified by mode of admission. COMMUNICATE, communication skill; PUB_HEALTH, public health and administrative skill; PROCEDURE, procedural skill; MAJ_CLINIC, clinical knowledge in major subjects; OB_GYN, obstetric and gynecologic skill.

Discussion

The MOPH resignation records indicated that there were increased numbers of doctor who did not complete their rural service obligations. Lower workloads and higher incentives in the private sector were among several main reasons given [17]. The existing financial incentive regimes alone may not be able to overcome stronger pull factors; policymakers need to revisit the question of what are effective interventions for sustaining rural retention.

Graduates from the CPIRD and ODOD programs had slightly better rural attitudes than those from the normal track, albeit medical students from all tracks were exposed to rural health services such as preventive or community medicines, as required by the curriculum, for a few months in their clinical years.

The significantly higher intention to fulfil their compulsory service among graduates from the special track can be explained by a few factors: greater satisfaction when posted in their hometown, in neighboring districts or in provinces which shared the same culture, dialect and social network. Graduates from CPIRD and ODOD were trained in MOPH-affiliated hospitals during clinical years which can provide professional peer support later in their career. This study confirmed previous findings that, after 3 years of mandatory service, 83% of graduates from CPIRD and 52% from the normal track continued in rural practice [21]. Graduates from CPIRD track served for a longer period with a median of 10 years in the public sector; this contrasted with a median of 6.5 years for graduates from the normal track [22,23].

Clinical competencies among CPIRD and ODOD graduates were clearly higher than those from the normal track; this likely came from the greater opportunities to handle cases for students in affiliated MOPH provincial or regional hospitals. By contrast, between normal track medical students and patients, there were layers of first- to third-year residents undertaking their specialty training in university medical faculties; this meant that opportunities to handle cases by medical students were reduced. In addition, patients in affiliated MOPH hospitals presented with more common complaints, like those found in clinical practice after graduation (for example, patients in university hospitals tend to present with more complicated problems, or are referred from elsewhere); they therefore commonly require specialist services, not easily handled by medical students.

Based on the two merits of the special track (higher intention to complete the mandatory 3-year public service, and better clinical competencies) policymakers should expand the proportion of enrolment from CPIRD and ODOD. Unfortunately, the proportion of students recruited through the special track was less than 20% of the total annual medical student enrolment over the past decade, though this had improved recently (30% of new students graduating in the 2013 academic year were recruited through the special track [23,24]).

The ODOD program is more effective at solving shortages than the CPIRD scheme; the districts with chronic shortages are targets for ODOD enrolment and placement upon graduation and ODOD enrolment comes with a longer period of mandatory service. The ODOD design precisely addresses the problem of districts with chronic shortage. Problems have arisen because most students from these remote districts have not been able to pass the special track examination, while medical faculties maintain education standards. Between 2007 and 2009, the balance between the two special track programs saw CPIRD at 63% and ODOD at 37% [23]. The potential merits of ODOD justify seeking to increase the proportion of students recruited through this program.

Higher commitment to rural work among graduates recruited from rural areas was reported from Japan, while Canadian doctors with rural backgrounds had higher interests in rural family practice once they graduated [8-10]. In Australia, students who spent their clinical years in non-traditional medical schools had higher confidence and were better prepared than those who studied in traditional medical schools; this was the result of more hands-on experience and closer patient contact [11].

A few limitations of this study have been identified. Compared with a case–control or cohort design, multiple cross-sectional surveys cannot document causal relationships [25]. It was recognized that the graduates who gathered on the survey date did not represent the whole population; some 20% of total graduates chose to work in non-MOPH hospitals such as military or psychiatric hospitals [26,27] and they therefore did not show up on the survey date. It should be noted that variations in curriculum and pedagogy between universities resulted in variations in competencies. It should be remembered that the intention to work in rural areas is influenced by various contextual environments. Since the recovery from the 1997 economic crisis in early 2000, the private sector’s demand for physicians has grown significantly and contributed to a domestic brain drain of physicians from the public sector [18]. In the context of the upcoming 2015 inauguration of the Association of Southeast Asian Nations Economic Community [28], the growth in economic centers may also stimulate losses of medical professionals from rural areas. The intention to fulfil the mandatory service can be very subjective and unreliable; however, the intention not to fulfil can be very reliable.

Conclusion and policy recommendations

Evidence suggests that special track recruitment is better than normal track recruitment in terms of the intention to fulfil the mandatory rural service and higher clinical competency. Furthermore, ODOD provides a more precise method of solving chronic shortage in certain districts than CPIRD. Based on this evidence, it is recommended to expand the proportion of recruitment from the special track, while reducing normal track recruitment. Within the special track, efforts should be given to increase the proportion of students recruited through the ODOD program.

Ethics approval

The National Ethical Review Committee waived ethical clearance as this is a regular monitoring work conducted by the Government, confirmed by ethical review committee: IHRP 47.2/2553 date 28 January 2553 BE (2010 AD). However, informed consent was sought and the protection of confidentiality was strictly followed.

Abbreviations

CPIRD: Collaborative Project to Increase Production of Rural Doctors; MOPH: Ministry of Public Health; ODOD: One District One Doctor.

Competing interests

The authors declare that they have no competing interest.

Authors’ contributions

The study was designed by WP, RS, NT, and VT, TW, NT, and TT reviewed the literature. Data collection and analysis was performed by WP, RS, NT and TT. All authors contributed to drafting and revision and approved the final version of the manuscript.

Acknowledgements

This is a collaborative study conducted by the International Health Policy Programme (IHPP) and Praboromarajchanok Institute for Health Workforce Development of the MOPH. Contributions by all medical graduates who participated in the three surveys are recognized and appreciated; without them this study would not have been possible.

Funding

This study is funded by IHPP core resources.

References

  1. Global Health Workforce Alliance: Reviewing Progress, Renewing Commitment: Progress Report on the Kampala Declaration and Agenda for Global Action. Geneva: World Health Organization; 2011. OpenURL

  2. Prince Mahidol Award Conference: Report on the Prince Mahidol Award Conference 2011: 2nd Global Forum on Human Resources for Health 25–29 January 2011. Bangkok, Thailand; 2011.

    [cited 2013 March 4]. Available from: http://www.pmaconference.mahidol.ac.th/index.php?option=com_content&view=article&id=584&Itemid=185 webcite

    OpenURL

  3. World Health Organization: Global Atlas of the Health Workforce. Geneva: World Health Organization; 2010.

    Available from: http://www.who.int/hrh/fig_density.pdf webcite - accessed on 24 May 2012

    OpenURL

  4. Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH: Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction.

    JAMA 2002, 288(16):1987-1993. PubMed Abstract | Publisher Full Text OpenURL

  5. Anand S, Barnighausen T: Human resources and health outcomes: cross-country econometric study.

    Lancet 2004, 364(9445):1603-1609. PubMed Abstract | Publisher Full Text OpenURL

  6. Lehmann U, Dieleman M, Martineau T: Staffing remote rural areas in middle- and low-income countries: a literature review of attraction and retention.

    BMC Health Serv Res 2008, 8(1):19. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  7. Rabinowitz HK, Diamond JJ, Markham FW, Paynter NP: Critical factors for designing programs to increase the supply and retention of rural primary care physicians.

    JAMA 2001, 286(9):1041-1048. PubMed Abstract | Publisher Full Text OpenURL

  8. Chan BT, Degani N, Crichton T, Pong RW, Rourke JT, Goertzen J, McCready B: Factors influencing family physicians to enter rural practice: does rural or urban background make a difference?

    Can Fam Physician 2005, 51:1246-1247. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Matsumoto M, Inoue K, Kajii E: Characteristics of medical students with rural origin: implications for selective admission policies.

    Health Policy 2008, 87(2):194-202. PubMed Abstract | Publisher Full Text OpenURL

  10. Inoue K, Hirayama Y, Igarashi M: A medical school for rural areas.

    Med Educ 1997, 31(6):430-434. PubMed Abstract | Publisher Full Text OpenURL

  11. Eley DS: Postgraduates’ perceptions of preparedness for work as a doctor and making future career decisions: support for rural, non-traditional medical schools.

    Educ Health (Abingdon) 2010, 23(2):374. OpenURL

  12. Eley DS: Junior doctors’ perceptions of their preparedness for hospital work: support for the rural clinical school model as a key to better preparation.

    Med J Aust 2010, 192(2):109. PubMed Abstract | Publisher Full Text OpenURL

  13. Wilson N, Bouhuijs P, Conradie H, Reuter H, VanHeerden B, Marais B: Perceived educational value and enjoyment of a rural clinical rotation for medical students.

    Rural Remote Health 2008, 8(999):1-13. OpenURL

  14. Henry JA, Edwards BJ, Crotty B: Why do medical graduates choose rural careers?

    Rural Remote Health 2009, 9(1):1083. PubMed Abstract | Publisher Full Text OpenURL

  15. World Health Organization: Increasing Access to Health Workers in Remote and Rural Areas through Improved Retention: Global Policy Recommendations. Geneva: World Health Organization; 2010. OpenURL

  16. Patcharanarumol W, Tangcharoensathien V, Limwattananon S, Panichkriangkrai W, Pachanee K, Poungkantha W, Gilson L, Mills A: Why and how did Thailand achieve good health at low cost? In ‘Good Health at Low Cost’ 25 Years on What Makes a Successful Health System?. 1st edition. Edited by Balabanova D, McKee M, Mills A. London: London School of Hygiene & Tropical Medicine; 2011:193-223. OpenURL

  17. Wibulpolprasert S, Pachanee C: Addressing the internal brain drain of medical doctors in Thailand: the story and lesson learned.

    Global Social Policy 2008, 8(1):12-15. Publisher Full Text OpenURL

  18. Wibulpolprasert S, Pengpaibon P: Integrated strategies to tackle the inequitable distribution of doctors in Thailand: four decades of experience.

    Hum Resour Health 2003, 1(1):12. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  19. Lertsukprasert S: Collaborative project to increase production of rural doctor to tackle physician shortage problem of Ministry of Public Health.

    Journal of Health Science 2008, 17(7):1906-1914. OpenURL

  20. Collaborative Project to Increase Production of Rural Doctor (CPIRD):

    List of affiliated teaching centers.

    [cited 2013 March 7]. Available from: http://cpird.in.th/main/node/10 webcite

    OpenURL

  21. Ledesma RD, Valero-Mora P: Determining the number of factors to retain in EFA: an easy-to-use computer program for carrying out parallel analysis.

    Practical Assessment, Research & Evaluation 2007, 12(2):1-11. PubMed Abstract OpenURL

  22. Pagaiya N, Kongkam L, Worarach W, Srirattana S, Wongwinyu K: Rural retention of medical graduates trained by the collaborative project to increase rural doctors (CPIRD).

    Journal of Health Systems Research 2012, 6(2):219-227. OpenURL

  23. Kongkam L, Pagaiya N, Srirattana S: Production of Graduates from the Collaborative Project to Increase Production of Rural Doctor (CPIRD). Nonthaburi: Human Resources for Health Research and Development Office; 2011. OpenURL

  24. Office of Collaborative Project to Increase Rural Doctor Production: Number of Students in ODOD by Teaching Hospitals in 2012. Nonthaburi: Ministry of Public Health; 2012. OpenURL

  25. Mann CJ: Observational research methods. Research design II: cohort, cross sectional, and case–control studies.

    Emerg Med J 2003, 20(1):54-60. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. The Medical Council of Thailand:

    Physician Statistics.

    Online at http://www.tmc.or.th/pdf/Summary2555_Graph_forTMCWebsite.pdf webcite (accessed 16 February 2013)

    OpenURL

  27. Suphanchaimat R, Topothai T, Thaichinda C, Pagaiya N, Kasemsub V, Wisaijohn T: Newly medical graduates’ confidence in medical and public-health competency: exploratory factor analysis and multiple regression.

    Journal of Health Systems Research 2012, 6(4):455-466. OpenURL

  28. Association of Southeast Asian Nations: Implementing the roadmap for an ASEANsean community 2015. In ASEAN Annual Report 2008–2009. Jakarta: ASEAN Secretariat; 2009. OpenURL