IAMRA Logo

Assessment Resource

Committees > Exam Review Working Group > Assessment Resource

Purpose of this site

The International Association of Medical Regulatory Authorities (IAMRA) provides this site as a resource for those seeking information on the assessment requirements and practices of Medical Regulatory Authorities (MRAs) from around the world. The information, primarily intended for those with responsibilities in the MRA community, is regularly updated and should provide a general sense for common practices by international colleagues. The individual physician who is seeking information that may impact a career decision is cautioned that the information at this site may not be the most recent nor provide appropriate detail. Such individuals are strongly encouraged to make direct contact with the MRA in the jurisdiction of interest.

Information provided at this site

The site contains recent information on the assessment requirements for medical practice in several MRAs that are members of IAMRA. It is the desire of IAMRA to add information for MRAs not currently represented. MRAs seeking to add information to this website should contact the IAMRA Secretariat.

The site provides information on the assessment requirements for graduates of:

  • Domestic Medical Schools. Referred to as Domestic Medical Graduates or DMGs, these are individuals seeking to practice in the same country where they received their primary medical education, and

  • International Medical Schools. Referred to as International Medical Graduates or IMGs, these are individuals seeking to practice in a country different from the one in which they received their primary medical education.

The site also provides:


Back to Top

Domestic Medical Graduates (DMGs) – Assessment Requirements

Below is a brief description of the approach of each country to the assessment of individuals trained domestically who are seeking to practice medicine in the same country. Links to related websites are provided. Detailed information about the assessment programs noted below can be found at the information on assessment programs section of this website.

Country
Description
Related Links
Australia

Australia
Licensure to practise (registration) is a legal requirement in each state and territory of Australia and, prior to 1 July 2010 was administered through separate medical boards in each state. From 1 July 2010 a new national registration system commenced in Australia and when fully implemented (anticipated to be October 2010) medical practitioners will only be required to register once with the Medical Board of Australia and will be able to practise in all states and territories. Medical Board of Australia
Canada

Canada
All thirteen medical regulatory authorities in Canada are working towards common licensing criteria. This is a work in progress with expected finalization of Full Licensure criteria by Sept 2010. Provisional Licensure criteria continue to be negotiated. Inquiries should be submitted directly to the medical regulator of the jurisdiction where the candidate intends to practice. Final licensing decisions are the responsibility of the medical regulator of that jurisdiction.

Canadian Standard for Full Licensure

  • have a medical degree from a medical school listed in the FAIMER’s International Medical Education Directory (IMED) or the WHO's World Directory of Medical Schools (WDMS); and
  • be a Licentiate of the Medical Council of Canada;
  • have satisfactorily completed a discipline-appropriate postgraduate training program and evaluation by a recognized authority; and
  • be certified by the College of Family Physicians

National Standards for Provisional Licensure

The national standard for the issuance of a provisional license requires the physician to:

  • have a medical degree from a medical school listed in the FAIMER’s IMED or the WHO’s WDMS,
  • satisfactorily complete a discipline-appropriate postgraduate training program and evaluation by a recognized authority,
  • have passed the Medical Council of Canada Evaluating Exam or other acceptable screening exam, and
  • satisfactorily complete a practice assessment as a condition of continued practice.

OR:

  • have a medical degree from an acceptable medical school listed in the FAIMER IMED or the WHO’s WDMS, and
  • satisfactorily completed a discipline-appropriate postgraduate training program and evaluation by a recognized authority, and
  • enter into appropriate licensure terms, limitations, conditions or restrictions, as agreed by FMRAC and its members.
Medical Regulatory (licensing) Authorities in Canada:

College of Physicians & Surgeons of British Columbia

College of Physicians and Surgeons of Alberta

College of Physicians & Surgeons of Saskatchewan

College of Physicians & Surgeons of Manitoba

College of Physicians & Surgeons of Ontario

Le Collège des médecins du Québec

College of Physicians & Surgeons of Nova Scotia

College of Physicians & Surgeons of New Brunswick

College of Physicians and Surgeons of Newfoundland & Labrador

College of Physicians and Surgeons of Prince Edward Island

Yukon Medical Council

Northwest Territories Medical Regulatory Authority

Nunavut Territory Medical Regulatory Authority

Medical Council of Canada

Ireland

Ireland
If a medical practitioner wishes to practise medicine in Ireland, they are required by law to be registered with the Medical Council.

Graduates of one of the approved programmes in Ireland (and graduates of recognised medical schools within EU member states) are entitled to apply for Registration. Interns are still identified as such but are now registered in the Trainee Specialist Division. Registration as an Intern allows a doctor to undertake internship training in an individually numbered, identifiable intern training post which has been approved by the Council for the purpose of intern training. They must satisfactorily complete a minimum aggregate period of twelve months' internship training in order to be eligible for a Certificate of Experience on completion of internship training. There are specifications about the type of recognised rotation.

The Medical Council recommends that medical practitioners enroll in and complete specialist training programmes, where possible. Medical practitioners holding Internship Registration should normally apply for Trainee Specialist registration when they are nearing completion of their internship training. Medical practitioners holding Trainee Specialist registration who have not completed their specialist training but wish to be transferred to the General Division should establish in the Registration Rules whether or not they may be eligible for General Registration.

Medical Council

New Zealand

New Zealand
The licence to practice medicine is granted by the Medical Council of New Zealand (MCNZ) and allows a practitioner to practice throughout New Zealand. A requirement is to hold a medical degree from either the University of Auckland or the University of Otago. Candidates must also successfully complete 12 months of specified hospital based runs after graduation to obtain general registration. Medical Council of New Zealand
United Kingdom

United Kingdom
The licence to practise medicine in the United Kingdom (UK) is granted by the General Medical Council and allows the practitioner to practise anywhere within the UK. DMGs have to successfully complete a primary UK medical degree, the content and delivery of which is subject to the GMC's quality assurance procedures, and a 12-month period of postgraduate clinical training in order to gain full registration. The General Medical Council
United States

United States
The license to practice medicine in the United States is granted by the state in which the individual intends to practice. Typically, states require individuals to pass the Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA) if they are a graduate of an osteopathic medical school that grants the Doctor of Osteopathic Medicine, or DO degree, or the United States Medical Licensing Examination (USMLE) if they are a graduate of a US medical school that grants the MD degree. Additional, non-assessment requirements can be imposed by the state and these may vary by location. Federation of State Medical Boards (FSMB)

National Board of Medical Examiners (NBME)

National Board of Osteopathic Medical Examiners (NBOME)

COMLEX-USA

United States Medical Licensing Examination (USMLE)


Back to Top

International Medical Graduates (IMGs) – Assessment Requirements

Below is a brief description of the approach of each country to the assessment of individuals, seeking to practice medicine locally, who were trained outside the country. Links to related websites are provided. Detailed information about the assessment programs can be found at the information on assessment programs section of this website.

Country
Description
Related Links
Australia

Australia
Separate Assessment Pathways have been implemented in Australia for International Medical Graduates with formal specialist and non-specialist qualifications. In addition, in July 2007 a new advanced standing pathway has been implemented for IMGs seeking non-specialist registration that provides recognition of prior licensure examination from a number of designated examination authorities. This assessment pathway is known as the Competent Authority model. In summary the assessment pathways are:

Non-specialist:

  • The Competent Authority Pathway
  • The Australian Medical Council Examination

Specialists:

  • Assessment by the relevant Specialist Medical College against the standards required for an Australian trained specialist in the same specialty field.
Medical Board of Australia
Canada

Canada
All thirteen medical regulatory authorities in Canada are working towards common licensing criteria. This is a work in progress with expected finalization of Full Licensure criteria by Sept 2010. Provisional Licensure criteria continue to be negotiated. Inquiries should be submitted directly to the medical regulator of the jurisdiction where the candidate intends to practice. Final licensing decisions are the responsibility of the medical regulator of that jurisdiction.

Canadian Standard for Full Licensure

  • have a medical degree from a medical school listed in the FAIMER’s International Medical Education Directory (IMED) or the WHO's World Directory of Medical Schools (WDMS); and
  • be a Licentiate of the Medical Council of Canada;
  • have satisfactorily completed a discipline-appropriate postgraduate training program and evaluation by a recognized authority; and
  • be certified by the College of Family Physicians

National Standards for Provisional Licensure

The national standard for the issuance of a provisional license requires the physician to:

  • have a medical degree from a medical school listed in the FAIMER’s IMED or the WHO’s WDMS,
  • satisfactorily complete a discipline-appropriate postgraduate training program and evaluation by a recognized authority,
  • have passed the Medical Council of Canada Evaluating Exam or other acceptable screening exam, and
  • satisfactorily complete a practice assessment as a condition of continued practice.

OR:

  • have a medical degree from an acceptable medical school listed in the FAIMER IMED or the WHO’s WDMS, and
  • satisfactorily completed a discipline-appropriate postgraduate training program and evaluation by a recognized authority, and
  • enter into appropriate licensure terms, limitations, conditions or restrictions, as agreed by FMRAC and its members.
Medical Regulatory (licensing) Authorities in Canada:

College of Physicians & Surgeons of British Columbia

College of Physicians and Surgeons of Alberta

College of Physicians & Surgeons of Saskatchewan

College of Physicians & Surgeons of Manitoba

College of Physicians & Surgeons of Ontario

Le Collège des médecins du Québec

College of Physicians & Surgeons of Nova Scotia

College of Physicians & Surgeons of New Brunswick

College of Physicians and Surgeons of Newfoundland & Labrador

College of Physicians and Surgeons of Prince Edward Island

Yukon Medical Council

Northwest Territories Medical Regulatory Authority

Nunavut Territory Medical Regulatory Authority

Medical Council of Canada

Ireland

Ireland
If a medical practitioner wishes to practise medicine in Ireland, they are required by law to be registered with the Medical Council.

The Register of Medical Practitioners comprises four Divisions of the Register - General Division, Specialist Division, Trainee Specialist Division, and Visiting EEA Practitioners Division. There are four main Categories of applicant depending upon where applicants graduate from (For more information refer to the related link). IMGs should establish which Division they are eligible to apply and their Category.

Category 4 applicants are required to pass the Pre-Registration Examination System (PRES) unless exempt.

Applicants for Trainee Specialist, General or Specialist Registration who are not EU/EEA/Swiss citizens are required to pass or be exempted from the Academic International English Language Testing System (IELTS).

Amendments to the current Medical Council of Ireland Registration Rules are under public consultation, and if adopted by Council, the criteria for Registration Rules and Rules relating to the Pre-Registration Exams and Exemption from the Pre-Registration Exams may change. The new Rules will not be made for another couple of months at least. Contact should be made directly with the Medical Council regarding the changes.

Medical Council
New Zealand

New Zealand
There are four recognised pathways for IMGs:
  1. Those who hold a primary medical degree from an Australian university medical school
  2. Those who hold a primary medical degree from a medical school accredited by a competent authority and who have a year of general medical experience.
  3. Those who hold a degree from an approved medical school, have met requirements to sit the New Zealand Registration Examination (NZREX) and who successfully pass NZREX (or other examination approved by the MCNZ) within 5 years of eligibility.
  4. Hold a primary medical degree from a medical school approved by the MCNZ, have worked for a minimum of 36 months in a comparable health system during the previous 4 years with full registration or is participating in training with an American Board or Canadian specialist college.
Medical Council of New Zealand
United Kingdom

United Kingdom
IMGs who wish to practise in the UK must pass the test conducted by the Professional and Linguistic Assessments Board (the PLAB test). IMGs may be registered without passing the PLAB test if they:
  • are sponsored under an arrangement approved by the GMC
  • hold an approved postgraduate qualification
  • are a trained GP or specialist

All IMGs must provide objective evidence of their proficiency in English, either by achieving our minimum required scores in the International English Language Testing System (IELTS) assessment, or by providing us with alternative evidence.

Doctors who qualify inside the European Economic Area and who are 'exempt persons' (i.e. have exercised their right to freedom of movement within the EU) are covered by European legislation which provides an assurance that their qualification and experience has met a minimum standard and are therefore eligible for full registration without further testing of knowledge and skills.

The General Medical Council:

Registration for international medical graduates

English language requirements

United States

United States
IMGs who are seeking postgraduate training opportunities in the United States (who may or may not intend to seek a license to practice) must complete the certification program established by the Educational Commission for Foreign Medical Graduates (ECFMG). One of the requirements for receiving the ECFMG certificate is successful completion of the USMLE Steps 1 and 2 examinations. IMGs seeking a license to practice in the United States must hold an ECFMG certificate and must successfully complete the USMLE Step 3 examination. There are additional, non-assessment requirements for the ECFMG certificate and there may be additional requirements in the state where the IMG seeks postgraduate training and/or licensure. Those seeking an ECFMG certificate should contact that organization. Those seeking a license to practice medicine must contact the state in which they wish to practice. Contact information for each state is provided by the Federation of State Medical Boards (FSMB). Federation of State Medical Boards (FSMB)

National Board of Medical Examiners (NBME)

Educational Commission for Foreign Medical Graduates (ECFMG)

United States Medical Licensing Examination (USMLE)


Back to Top

Information about Assessment Programs – Introduction

This section provides detailed information on the assessment programs used by the participating MRAs. Included is a description of the major characteristics of the programs including: 1) purpose of the assessment, 2) eligibility requirements, 3) design and construction methods, 4) content coverage, 5) structure and format, and 6) longevity of results. This information is organized by assessment program characteristic, which allows the reader to compare the approaches of each country on individual characteristics of their program.

Back to Top

Information about Assessment Programs – by Program Characteristic

Characteristic 1: Purpose of the assessment

Country
Description
Related Links
Australia

Australia
AMC Examination (AMC)

The AMC examination is intended to assess for the purposes of general (or non-specialist) registration, the medical knowledge and clinical skills of IMGs whose basic (non-specialist) medical qualifications are not recognised under the Health Practitioner Regulation National Law Act.

IMGs who complete the AMC exam are eligible for Provisional Registration by the Medical Board of Australia and, unless exempted by the Board, must complete 12 months supervised training at PGY1(intern) level prior to being granted general registration (unconditional licensure).

Australian Medical Council
Canada

Canada
MCC Evaluating Examination (MCCEE)
National Assessment OSCE

MCC Evaluating Examination (MCCEE)
The MCCEE's purpose is to evaluate an International Medical Graduate’s (IMG) or an International Medical Student’s (IMS) readiness to enter the MCC Qualifying Examination Part I and/ or further his/her medical education experience in Canada.

National Assessment OSCE - the purpose is to evaluate the critical clinical skills, clinical decision making especially in therapeutics and communication skills necessary to enter postgraduate education.

MCC Evaluating Examination (MCCEE)
Ireland

Ireland
Pre-Registration Examination System (PRES)

The PRES is primarily a test of clinical skills, knowledge and attitude necessary to practise as a medical practitioner in Ireland.

Only candidates from Category 4* applying for Trainee Specialist Registration and General Registration are required to pass the Pre-Registration Examination System (PRES). (*who are Medical practitioners who have graduated from a medical school in a third country (outside EU/EEA/Switzerland) and have their qualification listed in WHO/IMED, who have completed recognised internship training, hold full/general registration in another jurisdiction (other than Ireland) and do not meet the criteria for any of the other categories).

IMGs who are successful in PRES are eligible for Trainee Specialist/General Registration.

Pre-Registration Examination System (PRES)
New Zealand

New Zealand
New Zealand Registration Examination (NZREX)

The stated purpose of NZREX is "to ensure that candidates are competent to enter of period of registration in a provisional general scope of practice in New Zealand during which time they will be further assessed". COMMENT: The medical degree course in New Zealand is 6 years duration. The final year students (6th year) are termed ‘Trainee Interns' and have limited clinical responsibility. They cannot prescribe. At the end of the trainee intern year, New Zealand graduates should be of a comparable standard to successful NZREX candidates. This is a useful guide for the NZREX examiners who are usually experienced teachers of clinical medicine and therefore have considerable knowledge concerning appropriate standards.

The registration awarded to successful candidates (registration within a provisional general scope) allows them to work in a restricted hospital setting. During such hospital work the standard and progress of the doctor is monitored by consultants. Reports are forwarded to the Medical Council every 3 months. Registration in a general scope of practice (i.e., no longer required to work under supervision) requires satisfactory performance over a 12-month period.

New Zealand Registration Examination (NZREX)
United Kingdom

United Kingdom
Professional and Linguistic Assessments Board (PLAB)

To assess that international medical graduates (doctors who qualify outside the European Economic Area and who are not 'exempt persons' i.e. have exercised their right to freedom of movement within the EU) have the knowledge and skills necessary to practise medicine in the UK.

Professional and Linguistic Assessments Board (PLAB)
United States

United States
United States Medical Licensing Examination (USMLE)

The USMLE is taken by all domestic graduates of medical schools granting the MD degree, and by all IMGs seeking postgraduate training and practice opportunities in the United States. It can also be taken by graduates of US schools granting the DO degree, if the individual desires, but the primary assessment route for DO students and graduates is the COMLEX program. USMLE is produced by the Federation of State Medical Boards and the National Board of Medical Examiners. The program, which consists of three parts ("Step" examinations), assesses a physician's ability to apply knowledge, concepts, and principles, and to demonstrate fundamental patient-centered skills that are important in health and disease and that constitute the basis of safe and effective patient care.

United States Medical Licensing Examination (USMLE)
United States

United States
Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)

The COMLEX-USA is taken by domestic graduates of medical schools that grant the Doctor of Osteopathic Medicine degree. The multi-part examination is produced by the National Board of Osteopathic Medical Examiners and consists of Level 1, Level 2 Cognitive Evaluation, Level 2 Performance Evaluation and Level 3.

The examination tests for the knowledge and clinical skills of those candidates who seek to be licensed as osteopathic physicians, and it is the primary pathway by which osteopathic physicians apply for licensure to practice osteopathic medicine. A passing score verifies the candidate’s adequacy of medical knowledge and clinical skills and facilitates assessment of the candidate’s competency as a physician about to enter practice. The COMLEX-USA is recognized and accepted for licensure with full practice rights, including osteopathic manipulative treatment, in all fifty states (U.S.) and a number of international jurisdictions.

Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)


Back to Top

Characteristic 2: Eligibility Requirements

Country
Description
Related Links
Australia

Australia
AMC Examination (AMC)

To be eligible for the AMC examination an IMG must:

  • have been awarded a degree of Medicine and Surgery after an approved course of study conducted by a University listed in the WHO World Directory of Medical Schools or in the International Medical Education Directory of FAIMER
  • Have satisfied the English Language Proficiency requirement of the Medical Board of Australia (an overall Band 7 score and Band 7 scores in each of the test components or its equivalent)

The standard of the AMC exam is set at the level of medical knowledge and clinical skills expected of a graduate of an Australian medical school at the commencement of intern training.

Competent Authority Assessment
An IMG must have satisfactorily passed one of the following specified examinations AND have completed at least 12 months rotating internship or equivalent in a Competent Authority country to be eligible to proceed through this pathway:

  • The UK PLAB examination PLUS Foundation Year 1 or equivalent in a Competent Authority country.
  • The MCCQE Parts I and II including the period of supervised training prior to the MCCQE II.
  • The USMLE Parts 1,2 and 3 PLUS the required residency program or equivalent.
  • The NZREX PLUS the required rotations for general registration.
  • Graduates of GMC accredited medical schools PLUS Foundation Year 1.
  • Graduates of Medical Council of Ireland accredited medical schools PLUS a rotating internship in a Competent Authority country.

IMGs who are eligible to proceed through this pathway are required to complete a workplace-based performance assessment prior to general registration.

Specialist Assessment
To be eligible for assessment through the Specialist Assessment pathway and IMG must have completed postgraduate specialist training and be recognised as a specialist in the country in which the training was provided.

Australian Medical Council
Canada

Canada
MCC Evaluating Examination (MCCEE)

An International Medical Graduate (IMG), for the purpose of eligibility for the MCC examinations, must have completed all of the requirements for the final medical diploma in a university outside of Canada or the United States which is listed in either the International Medical Education Directory or the World Health Organization World Directory of Medical Schools.

Eligibility for the Licentiate of the Medical Council of Canada
Requires a pass standing on both MCCQE Part I and II plus an acceptable medical degree and postgraduate education

Language Proficiency
Most Canadian provincial and territorial regulatory bodies (except Québec and New Brunswick) require that IMGs who have graduated from a medical school where English is not the language of instruction pass the TOEFL. Most regulatory bodies require a minimum TOEFL score of 250. Newfoundland also requires that IMGs obtain a score of 50 on the TSE (Test of Spoken English). Québec requires applicants who have graduated from a medical school where French is not the language of instruction pass a French language proficiency test. Newfoundland also requires that IMGs obtain a score of 50 on the TSE.

MCC Evaluating Examination (MCCEE)
Ireland

Ireland
Pre-Registration Examination System (PRES)

In order to be eligible to sit the PRES examination an IMG Category 4 applicant must have:

  • been awarded a basic (primary) medical qualification which was received on the day that one was conferred, clearly displaying the full date of conferral. In general, the Medical Council recognises basic medical qualifications awarded by schools listed in the current edition of the World Health Organisation ("WHO") Directory of Medical Schools and/or the Foundation for Advancement of International Medical Education and Research ("FAIMER") International Medical Education Directory ("IMED").
  • been awarded an Internship Certificate or Certificate of Experience or equivalent.
  • obtained the English Language Requirement of Academic IELTS Certificate with required minimum scores (7.0 in each band and overall band score of 7.5) dated within the last 21 months (unless exempt).

Only doctors who satisfy the above requirements may be admitted to sit the Pre-Registration Examination System (PRES).

Pre-Registration Examination System (PRES)
New Zealand

New Zealand
New Zealand Registration Examination (NZREX)

Applicants must: hold a primary medical degree from a university medical school listed in the WHO Directory of Medical Schools or the ECFMG FAIMER Directory; and have passed either USMLE Steps 1 and 2(CK), or PLAB (Part 1) or AMC MCQ within the last five years.

English Language Testing Requirement
Although there may be some exceptions to the English language requirement for graduates of medical schools where English is the sole language of instruction and English is the graduate’s first language, doctors applying to sit NZREX Clinical, and doctors applying for registration, will be required to achieved the required standard in the academic module of IELTS (or been exempt from this requirement) within two years before applying to sit NZREX Clinical. The minimum standard is: Speaking 7.5, Listening 7.5, Writing 7.0, Reading 7.0 or above in the academic module of International English Language Testing System (IELTS), within the last two years. A minimum band of 7 is required in each of the four individual components of the test (listening, reading, writing and speaking).

The Test of English as a Foreign Language (TOEFL) and Occupational English Test (OET) are not accepted by the Council as alternatives to IELTS.

New Zealand Registration Examination (NZREX)
United Kingdom

United Kingdom
Professional and Linguistic Assessments Board (PLAB)

An acceptable primary medical qualification is from the World Directory of Medical Schools (WHO), published by the World Health Organisation (now the Avicenna Database). There are a few other primary medical qualifications that are not on the former WHO list but are nevertheless acceptable and these are listed on the GMC website as is the full detail of the GMC's criteria for an acceptable overseas primary medical qualification.

English Language Proficiency
Acceptable scores in the International English Language Testing System (IELTS) test. These are the minimum scores required: Overall 7, Speaking 7, Listening 6, Academic reading 6, Academic writing 61.

The IELTS certificate is valid for two years. If the certificate has expired, the doctor can send in evidence that he or she has maintained his or her English language skills. Candidates are recommended to have 12 months' postgraduate clinical experience (Foundation year 1 (F1)/internship post) from a teaching or other hospital approved by the medical registration authorities in the appropriate country. Those who pass the test without this experience have to seek employment in Foundation Year 1 (the grade occupied by new medical graduates).

General Medical Council:

Acceptable primary medical qualification

Professional and Linguistic Assessments Board (PLAB)

United States

United States
United States Medical Licensing Examination (USMLE)

Step 1, Step 2 CK, and Step 2 CS: To be eligible, an examinee must be in one of the following categories at the time of application and on the test day:

  • a medical student or graduate of a US or Canadian medical school program that is accredited by either the Liaison Committee on Medical Education or the American Osteopathic Association, or
  • a medical student or graduate or a medical school outside the United States and Canada who is eligible for examination by the Educational Commission for Foreign Medical Graduates (ECFMG) for its certificate (see note below).

Step 3: To be eligible for Step 3, the examinee must:

  • meet the Step 3 requirements set by the state licensing authority to which they are applying,
  • obtain the MD degree (or its equivalent) or the DO degree,
  • pass Step 1, Step 2 CK and CS
  • obtain certification by the ECFMG

English Language Proficiency
Currently, there are no English Language Proficiency requirements to be eligible to take Step 1, Step 2 CK, or Step2 CS. However, examinees must pass the Spoken English Proficiency subcomponent of Step 2 CS in order to become eligible to register for Step 3.

United States Medical Licensing Examination (USMLE)
United States

United States
Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)

The following are eligibility requirements for each Level of the COMLEX-USA:

COMLEX-USA Level 1
To be eligible, the osteopathic medical student or physician must have satisfactorily completed the first academic year of study at an osteopathic medical school accredited by the American Osteopathic Association’s Commission on College Accreditation (AOA COCA); be in good standing as a matriculated student in an accredited osteopathic medical school, and receive approval from the school’s dean, or if the candidate has graduated, provide a verified copy of his or her diploma.

COMLEX-USA Level 2-CE (Cognitive Evaluation) and Level 2-PE (Performance Evaluation)
To be eligible, the osteopathic medical student or physician must have passed the COMLEX-USA Level 1 examination, satisfactorily completed the second academic year of study at an osteopathic medical school accredited by the American Osteopathic Association’s Commission on Osteopathic College Accreditation (AOA COCA), be in good standing as a matriculated student in an accredited osteopathic medical school, and receive approval from the school’s dean, or if the candidate has graduated, provide a verified copy of his or her diploma.

COMLEX-USA Level 3
To be eligible, the osteopathic physician must have passed the COMLEX-USA Level 1, COMLEX-USA Level 2-CE and Level 2-PE examinations, have graduated from an osteopathic medical school accredited by the American Osteopathic Association's Commission on Osteopathic College Accreditation (AOA COCA), and provide verification of graduation.

English Language Proficiency
COMLEX-USA Level 2-Performance Evaluation incorporates the assessment of basic spoken and written English language proficiency in the context of clinical encounters with standardized patients.

Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)


Back to Top

Characteristic 3: Design and construction methods

Country
Description
Related Links
Australia

Australia
AMC Examination (AMC)

The format and standard of the AMC examination is set by the full, Council which includes members drawn from each of the State Medical Boards, Medical Schools, the Specialist Medical Colleges, State and Federal Government, the Australian Medical Association and health consumers and community representatives.

The content and administration of the AMC examination, including confirmation of results, is determined by a Board of Examiners which consists of registered (licensed) medical practitioners drawn from each of the major discipline areas covered by the exam, who have expertise in teaching and assessment at both the undergraduate and postgraduate levels. Membership of the Board includes individuals with expertise in assessment methodology, medical education and psychometrics.

Individual examinations are constructed from banks of items and structured clinical scenarios, which are regularly reviewed to ensure that they reflect current best practice. Each MCQ item and clinical scenario is linked back to assessment objectives based on presenting clinical conditions. These are published in the Anthology of Medical Conditions.

The results of each examination administration are also reviewed by panels of MCQ and clinical examiners, to ensure that examinations performed in accordance with the prescribed performance criteria and standards for the examination.

Australian Medical Council
Canada

Canada
MCC Evaluating Examination (MCCEE)

The Evaluating Examination Composite Committee (EECC) is responsible for preparing the examination. The EECC shall in accordance with the evaluation objectives adopted by the MCC, prepare a balanced examination, including test items and clinical problems that are pertinent to:

  • assessment of the candidate's knowledge, understanding, clinical skills and ability to make use of current medical knowledge in a subject;
  • frequency of disease and injury;
  • prevention of health hazards and rehabilitation;
  • maintenance of psychological, physical and social well-being and good health;
  • essential interpersonal skills with patients, family and other members of the health care system and the community;
  • knowledge of gender, moral, ethical and legislative issues that are relevant to the needs of society; and
  • self-learning autonomy and maintenance of competence.
MCC Evaluating Examination (MCCEE)
Ireland

Ireland
Pre-Registration Examination System (PRES)

The Pre-Registration Examination System (PRES) came into effect on 16th March 2009 with the implementation of Registration Rules the Medical Practitioners Act 2007. The PRES replaces the TRAS which had come into effect in 1996. The PRES examination is currently going through a major restructure. A number of short-term changes have been implemented. It is anticipated that long-term changes will be implemented and come into operation towards 2011.

Governance
The format and standard of the PRES examination is governed by the Medical Council's Professional Development Committee and approved by the Council. The results and report of each examination is brought to the Professional Development Committee for approval and is noted by Council.

Question and station writing/Blueprint
An Examination Development group has been formed to develop the longer term changes to the PRES. A formal blueprinting process and questions/station writing sessions will also be undertaken. An audit of the exams and review of content also takes place. Council has approved part-time assessment advisers.

Pre-Registration Examination System (PRES)
New Zealand

New Zealand
New Zealand Registration Examination (NZREX)

The examination is a 16 station OSCE with each station lasting 10 minutes. The examination is driven from a blueprint. The competencies examined are communication skills, ability to take a history, ability to undertake a physical examination, managing acute serious deterioration, problem prioritisation and knowledge of both tests and procedures. A process of continuous quality improvement is used to analyse the performance of stations and improve those with less ability to discriminate between candidates.

New Zealand Registration Examination (NZREX)
United Kingdom

United Kingdom
Professional and Linguistic Assessments Board (PLAB)

Governance
The development and quality assurance of the test is overseen by a Board, which reports to the Registration Reference Group of the GMC. Each examination is developed and run by an Examination Panel, which reports to the Board.

Blueprint
A blueprint was constructed from data detailing what doctors do in hospitals and general practice.

Question and station writing
Question and OSCE station writing workshops are held regularly at which practising clinicians write in pairs on topics chosen for them from the blueprint. Questions and stations are peer reviewed by another pair at the workshop. Examination Panel members oversee the process. Panel members (clinicians from a range of specialties) edit questions and stations.

Creating question papers and OSCE circuits
Papers and OSCE circuits are created using a sampling grid and Panel members approve the selection.

Review
Questions and stations are regularly reviewed to ensure that they are up-to-date to match a changing evidence base.

Professional and Linguistic Assessments Board (PLAB)

 

United States

United States
United States Medical Licensing Examination (USMLE)

The overall design and test construction blueprints are guided by committees of physicians and scientists who bring perspectives from the medical education, licensing and practice communities. Test content is developed by additional groups of physicians who have expertise in the content areas being addressed. New members to these groups complete a special item-writing workshop before beginning their term. Members are given assignments for the creation of test material; the assignments being based upon their expertise/interest and upon requirements for meeting a prescribed test blueprint. All newly written material must then be reviewed by a full committee of experts. If acceptable, this test content is included in the examination as a pre-test (not used for scoring). After pre-testing, the test content goes through another round of review, by a different committee, which decides if the material can be used in the live examination. All live test content goes through a further review, approximately every three years, to make sure that the material is still appropriate and accurate.

United States Medical Licensing Examination (USMLE)
United States

United States
Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)

The NBOME utilizes an extremely rigorous process to construct the COMLEX-USA licensing examination. First, the blueprint is developed based on review of national data indicative of osteopathic medical practice and focused on the manner in which patients present for care. Consideration is also given to current curricula in the osteopathic medical schools with particular emphasis on evidence-based medicine and clinical competencies.

Test items and clinical cases are elicited from a broad base of content experts from all geographic regions of the country through assignments determined from the blueprint of specifications. Content experts are selected for their expertise within a discipline or subject area, their academic experience in undergraduate or post-graduate medical education or within the licensure community, or by virtue of the type and scope of their practice. Item writers and case authors receive training on best practices.

Each COMLEX-USA cognitive examination test item goes through five independent committee reviews and is pre-tested before use in an actual examination. After pre-testing, items are selected based on statistical quality (test item performance) and content. All such items are then reviewed by the separate committee, coded for use and edited for content, correctness, grammar, clarity and adherence to the specifications of the blueprint. Once the committee has approved the examination, it is ready to publish for computer-based delivery.

The COMLEX-USA Level 2-Performance Evaluation (Level 2-PE), the clinical skills component, undergoes a similar process. The Level 2-PE uses the same blueprint for its clinical presentations as is utilized by the COMLEX-USA cognitive examinations. Cases are further developed in workshops where authors observe case portrayals by standardized patients. All cases used in the PE examination are pre-tested. The PE examination uses standardized patients (SPs) in all of the clinical encounters.

Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)


Back to Top

Characteristic 4: Content Coverage

Country
Description
Related Links
Australia

Australia
AMC Examination (AMC)

The AMC examination is a comprehensive test of medical knowledge and clinical competency across a wide range of topics and disciplines, involving and understanding of the disease process, clinical examination, diagnosis, investigation, therapy and management. It also assesses the IMGs ability to exercise discrimination, judgment and reasoning. The clinical component of the examination assesses an IMG's capacity to take a history, conduct a physical examination, formulate diagnostic and management plans, and communicate with patients, their families and other health workers.

IMGs on completing the AMC examination are required to complete 12 moths supervised practice (at the level of an internship) in a position approved by a State Medical Board. For this reason the standard of the AMC examination is formally defined as the level of knowledge, clinical skills and attitudes which is required of newly qualified graduates of Australian medical schools who are about to commence intern training.

Australian Medical Council
Canada

Canada
MCC Evaluating Examination (MCCEE)

The MCCEE assesses the candidate's basic medical knowledge in Child Health, Maternal Health, Adult Health, Mental Health, and Population Health and Ethics.

The Objectives for the Qualifying Examination, third edition (2004), published by the MCC and available as an on-line resource, serve as the basis for the development of examination questions. The general objectives deal with data gathering, clinical reasoning and the principles of management, which are applicable, in part or in whole, to all clinical situations faced by physicians.

Medical Council of Canada:

Objectives for the Qualifying Examination

Ireland

Ireland
Pre-Registration Examination System (PRES)

The PRES is primarily a test of clinical skills, knowledge and attitude in the main clinical disciplines of Obstetrics & Gynaecology, Paediatrics, Psychiatry, Surgery, Medicine and General Practice.

The Level 2 exams factual knowledge. The Level 3 exams three types of clinical skills.

i) Communication skills
These stations assess the candidate's ability to obtain a history, to demonstrate interviewing and communication skills and/or to apply clinical management skills. This may include:

  • Breaking bad news to a patient
  • Communication with patients/relatives/children/healthcare professionals
  • Ethics
  • Explaining diagnosis, investigation and treatment
  • Patient management plan/education exercises
  • Seeking/obtaining informed consent
    • Taking a history

ii) Interpretation skills
It is expected that the candidate will be able to interpret results from tests and procedures. These stations may involve the candidate interpreting:

  • an electrocardiogram (ECG)
  • laboratory tests
  • paediatric growth charts
  • photographs, or
  • X-rays

iii) Practical skills
These stations are practical and include skills such as performing a physical examination, demonstrating a practical procedure, or examination of someone’s mental state. These practical skills may include:

  • Assessment of a patient’s mental state
  • Injection Techniques
  • Inserting a cannula
  • Pharmacology and Prescribing Medication
  • Physical examination of an adult or child on simulated patient or anatomical model.
  • Suturing/dressing change
  • To demonstrate the ability to respond to emergency situations Emergency Cardiovascular Care (i.e. cardiopulmonary resuscitation (CPR), BLS, ACLS, AED - this list is not exhaustive)
Pre-Registration Examination System (PRES)
New Zealand

New Zealand
New Zealand Registration Examination (NZREX)

The blueprint informs the content of the examination. Stations can be drawn from any cross section of domains and competencies found in the blueprint. Domains are arranged into broad clinical categories. Subcategories are used to describe clinical presentations in which candidates are required to display competence. The blueprint is available on the NZREX web site.

New Zealand Registration Examination (NZREX)
United Kingdom

United Kingdom
Professional and Linguistic Assessments Board (PLAB)

The test is designed to assess the knowledge, skills and attitudes relating to conditions commonly seen in a first appointment in Foundation Year 2 (i.e. the second year after graduating), the management of life- threatening situations and rarer, but important, medical problems.

In Part 1, candidates must show that they are capable of applying knowledge to the care of patients. Four skill areas will be tested:

  • Diagnosis;
  • Investigations;
  • Management/Treatment;
  • The context of clinical practice

In Part 2 (OSCE) the skills assessed are:

  • History Taking
  • Clinical Examination
  • Practical Skills
  • Communication Skills
Professional and Linguistic Assessments Board (PLAB)

 

United States

United States
United States Medical Licensing Examination (USMLE)

Step 1
Step 1 includes test items in the following content areas: anatomy, behavioural sciences, biochemistry, microbiology, pathology, pharmacology, physiology, and interdisciplinary areas such as nutrition. Step 1 is a broadly based, integrated examination. Test items commonly require performance of one or more of the following tasks: interpret graphic and tabular material, identify gross and microscopic pathologic and normal specimens, apply basic science knowledge to clinical problems.

Step 2 Clinical Knowledge (CK):
Step 2 CK includes test items in the following content areas: internal medicine, obstetrics and gynaecology, paediatrics, preventive medicine, psychiatry, surgery, and other areas relevant to provision of care under supervision. Most Step 2 CK test items describe clinical situations and require that the examinee provide one or more of the following: a diagnosis, prognosis, indication of underlying mechanisms of disease, or the next step in medical care, including preventive measures.

Step 2 Clinical Skills (CS):
Step 2 CS assesses whether an examinee can demonstrate the fundamental clinical skills essential for safe and effective patient care under supervision. The subcomponents of Step 2 CS include the Integrated Clinical Encounter or ICE (data gathering and documentation), Communication and Interpersonal Skills or CIS (questioning skills, sharing information, and professional manner/rapport), and Spoken English Proficiency or SEP.

Step 3
Step 3 is organized along two principal dimensions: clinical encounter frame and physician task. Encounter frames capture the essential features of circumstances surrounding physicians’ clinical activity with patients. They range from encounters with patients seen for the first time for non-emergency problems, to encounters with regular patients seen in the context of continued care, to patient encounters in (life-threatening) emergency situations. Each test item in an encounter frame also represents one of six physician tasks. Step 3 also includes computer-based case simulations which assess the examinees ability to provide care for a series of simulated patients.

United States Medical Licensing Examination (USMLE)
United States

United States
Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)

COMLEX-USA is a comprehensive examination covering a broad scope and depth of medical knowledge and clinical skills as required for the practice of osteopathic medicine. COMLEX-USA is a bi-dimensional examination. Dimension I addresses the clinical presentations of patients. Dimension II deals with the tasks a physician uses to assist patients with these presentations. Osteopathic principles and practices, including the use of osteopathic manipulative treatment (OMT), are integrated throughout all of the examinations in the COMLEX-USA series.

COMLEX-USA Level 1 is a cognitive evaluation that emphasizes medical science concepts and principles necessary for understanding patients in health and disease. Level 1 integrates the medical sciences of anatomy, behavioral science, biochemistry, microbiology, osteopathic principles, pathology, pharmacology, physiology and other areas necessary to solving clinical problems and promoting and maintaining health.

COMLEX-USA Level 2-Cognitive Evaluation is an examination that emphasizes the concepts and principles necessary for making appropriate medical diagnoses through patient history and physical examination findings. Level 2-CE integrates the clinical disciplines of emergency medicine, family medicine, internal medicine, obstetrics/gynecology, osteopathic principles, pediatrics, psychiatry, surgery, and other areas necessary to solve medical problems and promote and maintain health.

COMLEX-USA Level 2-Performance Evaluation is a standardized patient-based clinical skills examination that assesses fundamental clinical skills, including patient-physician communication, interpersonal skills and professionalism; medical history-taking and physical examination skills; osteopathic principles and osteopathic manipulative treatment; and written communication skills, including synthesis of clinical findings, integrated differential diagnosis, and formulation of a diagnostic and treatment plan.

COMLEX-USA Level 3 is a cognitive evaluation that emphasizes the medical concepts and principles required to make appropriate patient management decisions. Level 3 integrates the clinical disciplines of emergency medicine, family medicine, internal medicine, obstetrics/gynecology, osteopathic principles, pediatrics, psychiatry, surgery, and other areas necessary to solve medical problems and promote and maintain health.

Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)


Back to Top

Characteristic 5: Examination structure and format

Country
Description
Related Links
Australia

Australia
AMC Examination (AMC)

The AMC examination is currently sequential test, consisting of 2 stages. The first stage must be passed before an IMG may proceed to the second.

The format of the AMC computer-administered MCQ examination will change from January 2011 to a Computer Adaptive Test (CAT). The test will consist of:

  • 150 type A format (1 correct out of 5 responses) items - 120 scored and 30 pilot (non-scored) items
  • 1 examination session or 3.5 hours
  • Assessment domains:
    • Pathogenesis
    • Clinical features
    • Investigative findings
    • Differential diagnosis
    • Management and treatment
  • Subject components (and numbers of scored items):
    • Adult Health [Medicine] (35 items)
    • Adult Health [Surgery] (25 items)
    • Women's Health (15 items)
    • Child Health (15 items)
    • Mental Health (15 items)
    • Population Health (15 items)

An integrated 16 component multi-station structured clinical assessment, with provision for an 8 component retest for marginal candidates, covering

  • Subject components:
    • Medicine
    • Surgery
    • Paediatrics
    • Obstetrics and Gynaecology
    • General Practice (Family Medical Practice)
    • Psychiatry
  • Assessment domains:
    • History taking
    • Physical examination
    • Investigations
    • Diagnosis/differential diagnosis
    • Therapeutics/management
    • Counseling/patient education
    • Clinical procedures
Australian Medical Council
Canada

Canada
MCC Evaluating Examination (MCCEE)

The Evaluating Examination is a four-hour computer-based examination comprised of 175 multiple-choice questions (MCQ).

MCC Evaluating Examination (MCCEE)
Ireland

Ireland
Pre-Registration Examination System (PRES)

The structure of the PRES
The PRES is structured to assess the candidate’s knowledge, clinical skills, attitude and clinical judgment in Obstetrics & Gynaecology, Paediatrics, Psychiatry, Surgery, Medicine and General Practice. The assessment is also designed to ensure that a candidate has good communication skills and the ability to make accurate clinical judgments.

There are two components to the PRES and, to be successful, a candidate is required to pass both components. Candidates must pass Level 3 within two years from the date of passing Level 2.

Level 2
Level 2 tests factual knowledge in the main clinical disciplines. Level 2 comprises of a computer based written examination at test centres in Ireland, Egypt, India, and Pakistan. This currently takes place in the form of a Multiple Choice Questions (MCQ) examination of 2½ hours (150 minutes) duration. There are 60 questions in total. Each question consists of a stem followed by five statements (giving 300 questions in total). The Level 2 is negatively marked.

Level 3
Level 3 is a clinical based assessment. This currently takes place in the form of an Objective Structured Clinical Examination (OSCE). Level 3 is usually offered in a centre in Ireland, either in Dublin or in a major provincial centre. The Level 3 examination currently has a minimum of seventeen stations in total. This currently includes 15 "active" stations and a minimum of two "rest" stations. The number of rest stations may be increased at the discretion of the Medical Council. It is possible that there may be up to twenty stations in total, which would include five rest stations. Each station is currently six minutes in duration.

Pre-Registration Examination System (PRES)
New Zealand

New Zealand
New Zealand Registration Examination (NZREX)

NZREX is an objective, structured clinical examination (OSCE). The emphasis of the examination is to test the application of knowledge and clinical decision-making. There is no written component as this has been included in the 'entry requirements.' There are a total of 16 stations based on the competencies of communication, prioritisation of management, recognition of acute serious deterioration and its management, history taking, physical examination and interpretation of tests and procedures.

New Zealand Registration Examination (NZREX)
United Kingdom

United Kingdom
Professional and Linguistic Assessments Board (PLAB)

The test is in two parts. Candidates must pass Part 1 before entering Part 2.

Part 1 is a written paper consisting of extended matching questions (EMQs) and single best answer (SBA) questions. The paper contains 200 questions and may contain photographic material. It lasts three hours and is machine markable.

Part 2 is an Objective Structured Clinical Examination (OSCE). It takes the form of 14 clinical scenarios or 'stations', a rest station and one or two pilot stations. Each station lasts five minutes.

Professional and Linguistic Assessments Board (PLAB)
United States

United States
United States Medical Licensing Examination (USMLE)

Step 1: One day examination (8 hours). Item format: multiple choice question items (MCQ), one best answer, in single item presentations.

Step 2 CK: One day examination (9 hours). Item format: MCQ items, one best answer, in single item presentations and multiple item sets.

Step 2 CS: One day examination (8 hours). Item format: Encounters with standardized patients (15 minute standardized patient encounters; 10 minutes for writing a patient note after the encounter).

Step 3: Two day examination (16 hours). Item format: MCQ items, one best answer in single item presentations and multiple item sets, and computer-based case simulations (CCSs).

United States Medical Licensing Examination (USMLE)
United States

United States
Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)

COMLEX-USA Level 1, Level 2-CE, and Level 3 are computer-based, cognitive examinations administered at professional testing centers across the United States and at a limited number of international locations. These are one-day examinations (8 hours) containing 400 test questions, predominantly of the multiple-choice (single best answer) items. Questions can be single-item presentations, or in multiple-item sets.

The COMLEX-USA Level 2-Performance Evaluation (Level 2-PE), the clinical skills portion of the examination, is a 12-station examination utilizing standardized patients (SPs) in each of the clinical encounters. The examination is a one-day test (8 hours) administered at NBOME’s National Center for Clinical Skills Testing. Candidates are permitted to evaluate and treat the standardized patient for 14 minutes, and to synthesize and document their findings, a differential diagnosis, and a treatment plan for the remaining 9 minutes in each station. The SPs are trained to document the candidate’s performance in certain clinical skills using standardized checklists, and to evaluate doctor-patient communication skills, interpersonal skills, and professionalism. Specially trained and certified osteopathic physician examiners score the candidates’ ability to use osteopathic principles and osteopathic manipulative treatment (OMT), and another specially trained group of physician examiners scores the post-encounter SOAP (Subjective Objective Assessment and Plan) notes.

Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)


Back to Top

Characteristic 6: Longevity of results

Country
Description
Related Links
Australia

Australia
AMC Examination (AMC)

Currently, under the legislation in force in Australia, there are no time limits on the validity of the AMC examination results. Previous time limits were removed on the basis of legal advice.

Australian Medical Council
Canada

Canada
MCC Evaluating Examination (MCCEE)

There is no longer a limit to the validity period.

MCC Evaluating Examination (MCCEE)
Ireland

Ireland
Pre-Registration Examination System (PRES)

The Medical Council currently imposes a limit of three attempts at any Level (Level 2/Level 3) of the PRES. Any candidate wishing to re-attempt an examination, having failed it three times or more, must apply in writing to the Medical Council.

Level 2
Candidates attempting Level 2 have a two years period of eligibility from the date when they are declared eligible to sit PRES. If unsuccessful in the Level 2, candidates may attempt the Level 2 up to and including a maximum of three times, until they either pass, they fail three times or their eligibility expires.

If a candidate is unsuccessful in either their first or second attempt of the Level 2 examination, they must allow six weeks to lapse from their previous attempt before they are eligible to schedule/book their next Level 2.

Level 3
Candidates attempting Level 3 have a two years period of eligibility from the date when they passed Level 2. If unsuccessful in the Level 3, candidates may attempt the examination up to and including a maximum of three times, until they either pass, they fail three times or their eligibility expires.

After Level 3
IMGs who are successful in PRES are eligible for Trainee Specialist/ General Registration.

Pre-Registration Examination System (PRES)
New Zealand

New Zealand
New Zealand Registration Examination (NZREX)

A pass in NZREX is valid for 3 years. There is no limit on the number of attempts for a candidate.

New Zealand Registration Examination (NZREX)
United Kingdom

United Kingdom
Professional and Linguistic Assessments Board (PLAB)

Part 1 - Candidates can have an unlimited number of attempts but must pass Part 1 within two years of the date of their IELTS certificate, or the date we specify when accepting alternative evidence.

Part 2 - If they wish to register with the GMC they must do so within three years of passing Part 2 of the test. Candidates must pass Part 2 within three years of passing Part 1. They can have four attempts at

Part 2. If they fail at the fourth attempt they have to retake IELTS (unless they are exempt) and both parts of the PLAB test.

Professional and Linguistic Assessments Board (PLAB)
United States

United States
United States Medical Licensing Examination (USMLE)

Although there is no limit imposed by the USMLE program on the total number of times an examinee can retake a Step or Step Component, USMLE does recommend to medical licensing authorities that they require the dates of passing the Step 1, Step 2, and Step 3 examinations to occur within a seven-year period; and allow no more than six attempts to pass each Step or Step Component without demonstration of additional educational experience acceptable to the medical licensing authority. These requirements are at the discretion of the state licensing authority and most of the authorities impose some form of time limit or number of attempt limit. Information on specific requirements can be obtained by contacting the Federation of State Medical Boards. Once all USMLE examinations have been successfully completed, the “validity period” for USMLE is currently indefinite.

United States Medical Licensing Examination (USMLE)

Federation of State Medical Boards

United States

United States
Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)

All states in the U.S. use COMLEX-USA scores, as well as other criteria, for granting initial medical licensure for osteopathic physicians. Most states require successful completion of the COMLEX-USA series, in addition to the equivalence of three (3) years of postgraduate training. Candidates who pass any COMLEX-USA examination are not permitted to retake that examination for a higher score. In addition, candidates who are unsuccessful in passing any COMLEX-USA examination are permitted to retake that examination on an unlimited basis, provided they remain eligible. However, the NBOME strongly recommends that any jurisdiction consider requiring any candidate applying for licensure to have successfully completed the entire three-level COMLEX-USA sequence within seven (7) years from the date when the Level 1 examination was successfully passed.

Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA)


Back to Top

Best Testing Practices with References

One of themes that emerged from these efforts to compile information on MRA requirements and practices was that the factors that influence the design of assessment systems are complex. Alongside variations in interpretation of best testing practices are issues of feasibility, historical precedent and legislative requirements. An increasing focus on the defensibility of examination results against legal or other challenges further complicates the picture. Although many of these factors are country specific, best testing practices for designing fair, meaningful, high-quality examination programs have emerged as part of this review. These practices are generalizable and worthy of further discussion. A more detailed discussion of assessment methodology in medicine, including workplace-based evaluation, can be found elsewhere(1-3).

Examination development

Relevant constructs and the examination blueprint. As a starting point for the development process, consideration should be given to the decisions that will be made based upon the examination results and the inferences that will follow(4;5). In the case of a medical licensing or credentialing examination, this suggests a need to consider what a “pass” or “fail” imply about the readiness of the candidate to provide safe and effective patient care. Particular emphasis should be placed on describing the nature of the work that a successful candidate will undertake as well as the level of supervision required by the registration authority. With the help of individuals who have the relevant expertise and experience, these deliberations should help identify the knowledge and skills that are the focus of the examination. These discussions can sometimes be informed by a formal analysis of what qualified physicians know and do(6-9). Overall, this process should also help in identifying the testing methodology that is most appropriate for the target knowledge and skills and for the level of training obtained by the candidates(10).

Examination construction. It is impossible to assess all components of the knowledge and skills identified as important to safe and effective care, so a clear strategy should be adopted for organizing and establishing the sampling rules that will allow development of the examination. These decisions can help to define a "blueprint" for examination construction(11;12).

Generally, for the construction process to produce the desired results, there should be a group of subject matter experts available to develop the content needed to meet the blueprint. These developers should be appropriately trained and given frequent feedback on the quality of their efforts.

Examination Scoring

The scoring and scaling of examinations can take many forms. The chosen measurement model will necessarily depend on the purpose of the assessment, the form of the exercises (e.g., multiple-choice questions - MCQs, clinical or computer-based simulations, portfolios), and the desired properties of the summary test score(s). For many examinations, the overall score is simply the sum, or weighted sum of the individual item scores. For other examinations, often where more than one construct is being measured, a conjunctive, as opposed to compensatory, framework is adopted. Here, examinees might need to achieve acceptable scores in a number of domains, or individual competencies, to meet the required standards. Likewise, for certification or licensure decisions, acceptable performance across a number of different assessments, administered longitudinally, may be necessary.

Setting Standards. One of the most important components to a high-quality and defensible examination program is the adoption of a fair and reasonable approach to identifying a "cut" score – the score above which a candidate is deemed to have passed(13;14). All of the licensure examinations surveyed by IAMRA thus far utilized criterion-referenced methods for selecting cut scores Generally, the most widely accepted approaches to selecting cut scores on MCQ examinations involved some variation of the Angoff method(15), although there are a number of other approaches that have been used with MCQs(16-19). For other formats, such as OSCEs and standardized patient examinations, variations on the contrasting group method are typically employed(20), although several modifications to this technique also exist(21;22).

The examinations surveyed by IAMRA thus far accorded well with what could be considered 'best practice'. The Angoff procedure and variations of it, often referred to as 'test-centered'’ methods, were the predominant method utilized for establishing cut scores on selected response examinations. Here, standard setting panelists make judgments based on test content (e.g., the expected performance of a minimally qualified examinee on a given test item). For clinical skills, clinical decision making, and other performance-based examinations, ‘contrasting’ or ‘borderline’ group techniques, referred to as ‘examinee-centered’ methods, are most often employed. Here, panelists involved in the standard setting process make judgments based on actual examinee performances, or suitable proxies. A detailed overview of standard setting methodologies and procedures can be found elsewhere(23).

Test Equating. For programs that administer more than one form of an examination, whether it be during the same time period or across time, an appropriate equating process should be identified(24;25). Equating will help to ensure that the same standard is applied to all candidates, regardless of which form is taken, and that examination results are comparable from year to year.

Reliability and Validity

Reliability. One of the goals of an examination program should be to produce scores that are a relatively precise reflection of the true knowledge level or skill of the candidates - scores that would vary little if there was an opportunity to test the same candidates repeatedly with similar test content(26-28). The format and structure of the examination can contribute to the reliability of scores. Generally, because one can sample more broadly from the content domain, it is easier to attain high reliability with simpler testing formats (e.g., selected response items such as MCQs) than it is with more complicated formats (e.g., computer simulations, standardized patient encounters). The disadvantage of relying solely on MCQs, however, is that this highly reliable format is not always as useful as the more clinically authentic formats for assessing higher order knowledge and patient-centered skills. Recognizing that the more authentic formats may make it difficult to obtain an acceptable level of reliability, there is literature that suggests a target length for the non-MCQ formats(29-31). Although there are many reliability coefficients, including those focusing in on the consistency of scores over tasks (or items), and those specifically concentrating on rater agreement, generalizability theory has been adopted as a more robust method to quantify the individual and combined sources of measurement error in test scores(32;33).

Validity. Generally, validity relates to the appropriateness of the decisions and inferences made about the candidate by the score user(34). Support for validity does not typically come from a single study or analysis but rather from the carefully planned and documented operational or research plan intended to lend support for the series of inferences that occur from beginning to end in the testing process(35). Demonstration of the clinical relevance of test content, the reproducibility of standard setting decisions, and the comparability of examination results to related measures are all examples of evidence in support of validity. For medical licensing bodies, where patient safety is of primary concern, it is important that data be gathered to support the accuracy of any competency decisions that are being made based on test performance.

References

(1) Norcini JJ. Current perspectives in assessment: the assessment of performance at work. Med Educ 2005; 39(9):880-889.

(2) Epstein RM. Assessment in medical education. N Engl J Med 2007; 356(4):387-396.

(3) Norcini JJ, McKinley DW. Assessment methods in medical education. Teaching and Teacher Education 2007; 23:239-250.

(4) American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for Educational and Psychological Testing. 1999. Washington, DC, American Educational Research Association.

(5) Linn RL. The standards for educational and psychological testing: Guidance in test development. In: Downing SM, Haladyna TM, editors. Handbook of Test Development. Mahweh, New Jersey: Lawrence Erlbaum Associates; 2006. 27-38.

(6) LaDuca A. Validation of professional licensure examinations. Professions theory, test design, and construct validity. Eval Health Prof 1994; 17(2):178-197.

(7) Kane M. Model-based practice analysis and test specifications. Applied Measurement in Education 1997; 10(1):5-18.

(8) Raymond M. Job analysis and the specification of content for licensure and certification examinations. Applied Measurement in Education 2001; 14(4):369-415.

(9) Raymond MR. An NCME instructional module on developing and administering practice analysis questionnaires. Educational Measurement: Issues and Practice 2005; 24(2):29-42.

(10) Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990; 65(9 Suppl):S63-S67.

(11) Downing SM. Twelve steps for effective test development. In: Downing SM, Haladyna TM, editors. Handbook of Test Development. Mahweh, New Jersey: Lawrence Erlbaum Associates; 2006. 3-26.

(12) Newble D, Dauphinee WD, Macdonald M, Dawson B, Page G, Swanson DB et al. Guidelines for assessing clinical competence. Teaching and Learning in Medicine 1994; 6(3):213-220.

(13) Kane MT, Crooks TJ, Cohen AS. Designing and evaluating standard-setting procedures for licensure and certification tests. Advances in Health Sciences Education 1999; 4(3):195-207.

(14) Downing SM, Tekian A, Yudkowsky R. Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med 2006; 18(1):50-57.

(15) Angoff WH. Scales, norms and equivalent scores. In: Thorndike RL, editor. Educational Measurement. Washington, DC: American Council on Education; 1971. 508-600.

(16) Boulet JR, De Champlain AF, McKinley DW. Setting defensible performance standards on OSCEs and standardized patient examinations. Med Teach 2003; 25(3):245-249.

(17) Livingston SA, Zieky MJ. Passing scores: A manual for setting standards of performance on education and occupational tests. Princeton, New Jersey: Educational Testing Service; 1982.

(18) Hambleton RK, Pitoniak MJ. Setting performance standards. In: Brennan RL, editor. Educational Measurement. 4 ed. Westport, CT: Praeger Publishers; 2006. 433-470.

(19) Cusimano MD. Standard setting in medical education. Acad Med 1996; 71(10 Suppl):S112-S120.

(20) Boulet JR, Murray D, Kras J, Woodhouse J. Setting performance standards for mannequin-based acute-care scenarios. Sim Healthcare 2008; 3(2):72-81.

(21) Wood TJ, Humphrey-Murto SM, Norman GR. Standard setting in a small scale OSCE: a comparison of the Modified Borderline-Group Method and the Borderline Regression Method. Adv Health Sci Educ Theory Pract 2006; 11(2):115-122.

(22) McKinley DW, Boulet JR, Hambleton RK. A work-centered approach for setting passing scores on performance-based assessments. Eval Health Prof 2005; 28(3):349-369.

(23) Cizek GJ, Bunch MB. Standard setting: A guide to establishing and evaluating performance standards on tests. London, United Kingdom: Sage Publications Ltd.; 2007.

(24) Kolen MJ, Brennan RL. Test equating, scaling, and linking: Methods and practices. 2 ed. New York: Springer-Verlag; 2004.

(25) Holland PW, Dorans NJ. Linking and equating. In: Brennan RL, editor. Educational Measurement. 4 ed. Westport, CT: Praeger Publishers; 2006. 187-220.

(26) Haertel EH. Reliability. In: Brennan RL, editor. Educational Measurement. 4 ed. Westport, CT: Praeger Publishers; 2006. 65-110.

(27) Clauser B.E., Margolis MJ, Swanson DB. Issues of validity and reliability for assessments in medical education. In: Holmboe ES, Hawkins RE, editors. Practical Guide to the Evaluation of Clinical Competence. 1st ed. Philadelphia, PA: Mosby/Elsevier; 2008. 10-23.

(28) Downing SM. Reliability: on the reproducibility of assessment data. Med Educ 2004; 38(9):1006-1012.

(29) Vu NV, Barrows HS. Use of standardized patients in clinical assessments: Recent developments and measurement findings. Educational Researcher 1994; 23(3):23-30.

(30) van der Vleuten C, Swanson DB. Assessment of clinical skills with standardized patients: state of the art. Teaching and Learning in Medicine 1990; 2(2):58-76.

(31) Swanson DB, Norcini JJ. Factors influencing reproducibility of tests using standardized patients. Teaching and Learning in Medicine 1989; 1(3):158-166.

(32) Thompson B. A brief introduction to generalizability theory. In: Thompson B, editor. Score reliability: contemporary thinking on reliability issues. Thousand Oaks, California: Sage Publications, Inc.; 2003. 43-58.

(33) Boulet JR. Generalizability theory: Basics. In: Everitt BS, Howell DC, editors. Encyclopedia of Statistics in Behavioral Science. Chichester: John Wiley & Sons, Ltd; 2005. 704-711.

(34) Kane MT. Validation. In: Brennan RL, editor. Educational Measurement. 4 ed. Westport, CT: Praeger Publishers; 2006. 17-64.

(35) Kane MT. Validating interpretive arguments for licensure and certification examinations. Eval Health Prof 1994; 17(2):133-159.


Back to Top

Bilateral and multi-lateral agreements

The following is a brief summary of agreements among MRAs concerning the acceptability of assessments by other jurisdictions.

Country
Agreement
Coverage
Comments
Australia

Australia
n/a
n/a
n/a
Canada

Canada
Canada is made up of 10 provinces and three territories which each form a separate medical regulatory jurisdiction. Some accept a registration/licensing examination other than the MCCE (Medical Council of Canada Qualifying Examination). New Brunswick will accept the PLAB for GPs and specialists, TRAS for specialists, and USMLE for both GPs and specialists.

Nova Scotia will accept USMLE for both GPs and Specialists and a number of other (non-cited) examinations.

Ontario will accept USMLE for both GPs and specialists and in some cases COMLEX.

Prince Edward Island will accept NZREX for GPs and AMC for both GPs and specialists.

Quebec will accept USMLE for both GPs and specialists and a number of other (non-cited examinations).

Saskatchewan will accept USMLE for both GPs and specialists.

For independent practice registration with no conditions, all Canadian regulators require the Licentiate of the Medical Council of Canada. Graduates of Canadian medical schools and American medical schools accredited by the Liaison Committee on Medical Education obtain the LMCC by passing the Medical Council of Canada Qualifying Examinations Part I (written) and Part II (OSCE) and are exempt from the Evaluating Exam.

Some jurisdictions accept COMLEX in the case of Osteopaths.

In some jurisdictions there may be further requirements to be fulfilled prior to registration such as a language test.

Ireland

Ireland
If a medical practitioner has been awarded a Basic Medical Qualification in the EU/EEA/Swiss, or they have established European Union rights in another country, or they are eligible for direct entry to Specialist Registration, medical practitioner are exempt from PRES.

For further information regarding exemptions from PRES please refer to the Rules Specifying Pre-Registration Exams and Exemptions

The Medical Council recognises formal medical qualifications awarded within the EU/EEA/Switzerland under EU/EEA legislation. These doctors are eligible for registration and are exempt from PRES. As a result of the implementation of the Medical Practitioners Act 2007, the historical reciprocity agreements with a number of countries/provinces have been discontinued.
New Zealand

New Zealand
Most doctors must sit the New Zealand Registration Exam (NZREX) in order to obtain registration. A prerequisite for eligibility for sitting NZREX can be any one of the following:
  • USMLE Step 1 and 2 (CK)
  • Australian Medical Council MCQ
  • General Medical Council PLAB Part 1
Some international medical graduates can register in New Zealand without sitting NZREX (or any other exam):
  • those who have a qualification recognised by Council (i.e. graduated from a medical school in Australia, the UK and Ireland)
  • those who have worked for a minimum of three years in a country with a comparable health system (i.e. UK, US, Canada, Belgium, Hong Kong, ect)
  • and those who are qualified specialists with an appropriate postgraduate qualification.
NZREX is the only exam accepted for those applying through the exam pathway for registration - no exemption from NZREX is available for those who have completed another authority's clinical examination as the Medical Council of New Zealand is not currently accepting any other authority's examination.
United Kingdom

United Kingdom
If a doctor's medical qualification was obtained outside the EEA, they are not a specialist or a GP, do not hold a recognised postgraduate qualification, and/or are not sponsored under a GMC approved scheme they will be required to take the PLAB Test (Professional Linguistic Assessment Board test). Under EC law EEA trained doctors are eligible for full registration without taking the PLAB if they hold a 'recognised' medical qualification.  
United States

United States
The United States consists of 50 states and several territories, each retaining the right to independently accept or reject candidates for licensure to practice medicine in that jurisdiction. In addition, within many of the states there are separate licensing authorities for graduates of schools of allopathic medicine (MD or MD-like degree) versus graduates of schools of osteopathic medicine (DO degree) so that, in total, there are approximately 70 different licensing authorities in the United States. These licensing authorities do not have formal agreements with international jurisdictions, however, some US licensing authorities will accept or consider endorsement of certification by the Licentiate of the Medical Council of Canada (LMCC). In 2008, 48 of the US licensing authorities accept or consider for endorsement the LMCC. However, there may be some variation from authority to authority on further restrictions (e.g., the authority may only accept LMCC if the candidate went to a US or Canadian medical school). Because of the variation of policies among the US licensing authorities, and the potential for policy changes by each, it is recommended that the particular authority of interest be contacted directly to confirm current policies. The Federation of State Medical Boards maintains a directory of US licensing authorities at its website (www.fsmb.org). With the exceptions noted for candidates possessing the LMCC - the licensure status, credentials, or assessment results from other countries are not accepted in lieu of the educational and assessment requirements that are imposed for all individuals seeking a license in the United States.


Back to Top

Additional references

The following is a list of references related to medical licensure

References

[Laws of Puerto Rico]. (1978). Boletín De La Asociación Médica De Puerto Rico, 70(8), 238-94.

Andrade, P. J. N. D. (2005). [Some comments on the inverted pyramid of medical qualification in Brazil and how it affects training in cardiology]. Arquivos Brasileiros De Cardiologia, 85(6), 428-31.

Baker, R. (2006). Developing standards, criteria, and thresholds to assess fitness to practise. BMJ, 332(7535), 230-2.

Bushong, S. C. (1995). History of standards, certification, and licensure in medical health physics. Health Physics, 69(5), 824-36.

Drion, R., & Drion, B. (1978). [History of legislation in the field of medical education, medical examination and medical licensure]. Nederlands Tijdschrift Voor Geneeskunde, 122(36), 1334-7.

Ebenius, A. M., & Gudmundsson, L. (1994). [The EES agreement. The free mobility of physicians surrounded by regulations]. Läkartidningen, 91(18), 1787-9.

Eklöf, M. (2001). [The first physicians' rules are interesting documents of the time]. Läkartidningen, 98(37), 3938-9.

Elger, B. S. (2008). Medical ethics in correctional healthcare: an international comparison of guidelines. The Journal of Clinical Ethics, 19(3), 234-48; discussion 254-9.

Fitzgerald, R. (2008). Medical regulation in the telemedicine era. Lancet, 372(9652), 1795-6.

Gupta, R., Singh, I., & Vaidya, A. (2006). Medical regulation: promoting excellence and safety. British Journal of Hospital Medicine, 67(11), 564-5.

Haave, P. (2007). [When state authorisation was introduced for medical doctors in Norway]. Tidsskrift for Den Norske Lægeforening: Tidsskrift for Praktisk Medicin, Ny Række, 127(24), 3267-71.

Heffron, M. G., Simspon, D., & Kochar, M. S. (2007). Competency-based physician education, recertification, and licensure. Wisconsin Medical Journal, 106(4), 215-8.

Irvine, D. (1997a). The performance of doctors. I: Professionalism and self regulation in a changing world. BMJ, 314(7093), 1540-2.

Irvine, D. (1997b). The performance of doctors. II: Maintaining good practice, protecting patients from poor performance. BMJ, 314(7094), 1613-5.

James, A. E., Heller, R. M., Chapman, J. E., Hernanz-Schulman, M., & Jacobson, H. (1989). Does a medical qualification provide public protection? Journal of the Royal Society of Health, 109(6), 193-6.

Jones, R. S. (1993). Organized medicine in the United States. Annals of Surgery, 217(5), 423-9.

Kamps, H. (1984). [Licensing for x-ray studies and nuclear medicine in private and insurance practice. I]. Der Radiologe, 24(6), 249-55.

Lee, H. J., Jin, J., & Shen, S. (2002). [A study of the licensing system in Korean Oriental medicine]. Zhonghua Yi Shi Za Zhi, 32(2), 78-81.

Lee, Y. K. (1983). The origins of medical registration in Singapore (Part II). Singapore Medical Journal, 24(6), 383-90.

Lichter, P. R. (1994). Confusing licensure with education: medicine's slippery slope. Ophthalmology, 101(11), 1767-70.

Nohr, L. E. (2000). Global medicine and licensing. Journal of Telemedicine and Telecare, 6 (Suppl 1), S170-2.

Pringle, M. (2006). Regulation and revalidation of doctors. BMJ, 333(7560), 161-2.

Race, G. J. (1979). Continuing medical education. Current legal implications. The Journal of Legal Medicine, 1(3), 312-33.

Rooney, A., & van Ostenberg, P. (1999). Licensure, Accreditation, and Certification: Approaches to Health Services Quality. Quality Assurance Methodology Refinement Series. Bethesda, MD: Quality Assurance Project. Retrieved from http://www.qaproject.org/pubs/PDFs/accredmon.pdf

Salter, B. (2001). Who rules? The new politics of medical regulation. Social Science & Medicine, 52(6), 871-83.

Samanta, A., & Samanta, J. (2004). Regulation of the medical profession: fantasy, reality and legality. Journal of the Royal Society of Medicine, 97(5), 211-8.

Silverman, R. D. (2000). Regulating medical practice in the cyber age: issues and challenges for state medical boards. American Journal of Law & Medicine, 26(2-3), 255-76.

Slynn, L. (1996). The impact of European Law on medical practice. The Medico-Legal Journal, 64(Pt 1), 23-40.

Southgate, L., & Dauphinee, D. (1998). Maintaining standards in British and Canadian medicine: the developing role of the regulatory body. BMJ, 316(7132), 697-700.

Stemmler, E. J. (1999). Ensuring physician competence. Transactions of the American Clinical and Climatological Association, 110, 1-13.

Sutherland, K., & Leatherman, S. (2006). Does certification improve medical standards? BMJ, 333(7565), 439-41.

Thomas, D. (2004). The co-regulation of medical discipline: challenging medical peer review. Journal of Law and Medicine, 11(3), 382-9.

Tian, X. (2002). [Strengthening process of the licensing system for physicians in the Republic of China]. Zhonghua Yi Shi Za Zhi, 32(2), 73-7.

Vilmar, K. (1990). [The system of self-administration by the General Medical Council of the Federal Republic of Germany]. Zeitschrift Für Ärztliche Fortbildung, 84(20), 1061-5.

Walshe, K., & Benson, L. (2005). Time for radical reform. BMJ, 330(7506), 1504-6.

Wass, V., Van der Vleuten, C., Shatzer, J., & Jones, R. (2001). Assessment of clinical competence. Lancet, 357(9260), 945-9.

Witek, E. (1990). [On medical chambers]. Czasopismo Stomatologiczne, 43(10), 633-8.

Wright-St Clair, R. E. (1977). Medical registration in New Zealand. The New Zealand Medical Journal, 85(584), 229-31.

Journals

International Digest of Health Legislation, World Health Organization
http://www.who.int/idhl-rils/frame.cfm?language=english

Journal of Medical Licensure and Discipline, FSMB
http://www.journalonline.org/

Organization Websites

AVICENNA Directories
http://avicenna.ku.dk/

Foundation for Advancement of International Medical Education and Research
http://www.faimer.org/

HLSP Institute – Understanding Medical Regulation: A Guide to Good Practice, Elinor Thompson
http://www.hlspinstitute.org/projects/?mode=type&id=18652

International Association of Medical Regulatory Authorities (IAMRA)
http://www.iamra.com

World Association for Medical Law
http://waml.haifa.ac.il/

World Federation for Medical Education (WFME)
http://www.wfme.org/


Back to Top