2021-11-12T12:25:44-08:00 2020-12-31 990 2020-01-01 231352238 National Board of Medical Examiners NATI 2155909500 3750 Market Street Philadelphia PA 19104 Peter J Katsufrakis President & CEO 2021-11-12 Peter J Katsufrakis 999009999 0 AAL1 IAL1 FAL1 2020 2022-09-23 18:48:47Z 3750 Market Street Philadelphia PA 191043102 260757133 false X www.nbme.org X 1915 DC The mission of NBME is to protect the health of the public through state of the art assessment of health professionals. 12 11 575 547 0 0 169167743 129643354 11126292 17883167 411127 435338 180705162 147961859 640676 622967 0 89749769 90136894 0 0 87224842 68001872 177615287 158761733 3089875 -10799874 397806467 396621143 251131566 231284700 146674901 165336443 X The mission of NBME is to protect the health of the public through state of the art assessment of health professionals. While centered on assessment of physicians, this mission encompasses the spectrum of health professionals along the continuum of education, training, and practice and includes research in evaluation as well as development of assessment instruments. false false 86902042 86916816 The United States Medical Licensing Examination (USMLE) is a three-step examination for medical licensure in the United States and is sponsored by the Federation of State Medical Boards (FSMB) and NBME. The USMLE program supports medical licensing authorities in the United States through its leadership in the development, delivery, and continual improvement of high-quality assessments across the continuum of physicians' preparation for practice. It assesses a physician's ability to apply knowledge, concepts, and principles, and to demonstrate fundamental patient-centered skills, that are important in health and disease and that constitute the basis of safe and effective patient care.Note: The expenses reflected above do not include management and general expenses. 17401469 27272831 The Medical School and Student Services program provides assessment services to domestic and international medical schools, students, and residents. Assessments include the subject examination program, self-assessment services, and web-based examination programs and pilot projects. Subject exams measure achievement in the traditional basic and clinical science disciplines and are used to compare student performance with a national reference group. A series of web-based self-assessments are available to help students assess their readiness to take USMLE. Faculty services include item-writing workshops, and medical school liaison activities include the Advisory Committee for Medical School Programs.Note: The expenses reflected above do not include management and general expenses. 14791429 13441900 The Health Profession Services program provides comprehensive assessment, educational, consultative, and research services for healthcare organizations. During 2020, NBME's Health Profession Services worked with a variety of organizations to administer examinations for purposes of licensure, certification, maintenance of certification, evaluation of special competence, in-training, and self-assessment. These organizations included allied health professional associations, members of the American Board of Medical Specialties, and medical societies. Examinations are administered worldwide, where applicable.Note: The expenses reflected above do not include management and general expenses. 10425153 476143 2011807 129520093 true false false false false false false false false true true true false false true true false true false false true true true false false false false true false true true false false false false false false false false false false false false false false false true true true true false true 490 0 true 575 true false false false false false false false 0 false false false false false false false false false false X 12 11 false false false false true true true true true false false true true true true true true true true false X X John J Hinke Jr 2155909500 3750 Market Street Philadelphia PA 191043102 Peter J Katsufrakis President & CEO 45.00 0.00 X X 681431 0 292126 Brian E Clauser VP, Cen Adv Assmt 45.00 0.00 501963 0 158862 Craig N Mills SVP, SD&D 45.00 0.00 X 487579 0 98398 Elizabeth D Azari SVP, COO 45.00 0.00 X 402969 0 143391 Agata P Butler VP, Academic & Prof Prgms 45.00 2.00 290008 0 197833 Lisa M Rawding SVP, Mktg & PM 45.00 2.00 X 352758 0 131293 John J Hinke Jr CFO 45.00 2.00 X 333653 0 143325 Thomas A Rebbecchi Medical Advisor 45.00 2.00 353248 0 119711 Linda Gadsby VP & Gen Couns 45.00 0.00 X 358731 0 112798 Michael A Barone VP, Licensure Programs 45.00 0.00 371992 0 99298 Miguel Paniagua Medical Advisor 45.00 0.00 359238 0 107165 Margaret B Anderson VP, Med Ed Global 45.00 0.00 349192 0 116230 Michael G Jodoin VP, Psychometrics 45.00 0.00 310895 0 130604 Andrew F Farella SVP & CIO 45.00 0.00 X 282593 0 134916 Kenneth W Ridgely VP, Test Development Svcs 45.00 0.00 293949 0 91700 Christopher A Feddock Executive Director, CSEC 45.00 0.00 266452 0 107213 Susan A Deitch Secretary 45.00 0.00 X 160842 0 124306 Stephen G Clyman Former SVP, R&D 0.00 0.00 143722 0 0 Alfred F Tallia Chair 4.00 0.00 X X 10000 0 0 Reena Karani Director 3.00 0.00 X 6250 0 0 Paul M Wallach Vice Chair 4.00 0.00 X X 3550 0 0 Latha Chandran Treasurer 4.00 0.00 X X 3000 0 0 Donna Elliot Mills Director 3.00 0.00 X 3000 0 0 Marie Foley Director 3.00 0.00 X 2900 0 0 Patricia M Mastors Director 3.00 0.00 X 2450 0 0 Kamili A Wilson Director 3.00 0.00 X 2300 0 0 David A Milling Director 3.00 0.00 X 2150 0 0 Suzanne T Anderson Past Chair 4.00 0.00 X X 0 0 0 6336815 2309169 244 true true false MissionStaff LLC 100 N 18th Street Suite 810 Philadelphia PA 19103 Employment Services 845004 Perkins Coie LLP Client Accounting PO Box 24643 Seattle WA 98124 Legal Services 616585 Cerebro Consulting LLC Suite 2609 1815 John F Kennedy Blvd Philadelphia PA 19103 Consulting Services 604600 Beacon Hill Staffing Group LLC 152 Bowdoin Street Boston MA 02108 Employment Services 574839 Charlotte Foreshaw 675 North Highland Ave 423 Atlanta GA 30306 Consulting Services 430504 17 0 Health Profession Srvs 13441900 13441900 Medical School Services 27272831 27272831 Other 2011807 2011807 USMLE 86916816 86916816 129643354 4909460 4909460 0 0 928059 492721 435338 435338 435338 121539352 3736908 110296623 2005930 11242729 1730978 12973707 5423 12968284 0 0 0 0 147961859 134558237 13403622 495856 495856 0 127111 127111 0 4487205 1541480 2945725 0 54869463 42948679 11920784 19646581 15067172 4579409 7192305 5282879 1909426 3941340 2952573 988767 0 869571 869571 108200 108200 0 0 292700 292700 9098199 8356914 741285 36440 36440 895927 594844 301083 9313673 7500596 1813077 0 1458296 1119028 339268 278996 215667 63329 0 954558 866766 87792 821643 630490 191153 0 4551797 3492836 1058961 536971 440233 96738 Vendor Computer Delivery Fees 21601211 21601211 Clinical Skills Collaboration 13307293 13307293 Temporary Resources 1564316 1171875 392441 Other Project/Admin 1186836 681345 505491 1125245 1125245 158761733 129520093 29241640 0 0 14227046 13212901 0 6520024 7123215 0 0 0 0 3089655 3708718 124718550 65832399 62598686 58886151 288980210 283432374 13874551 21281239 0 0 8516295 8976545 397806467 396621143 14559111 11034454 52864090 37929037 32033913 30304390 151674452 152016819 251131566 231284700 X 146674901 165336443 146674901 165336443 397806467 396621143 X -10799874 17159248 12302168 X false true X true false X 0 151101701 153939975 158617802 169167744 129643354 762470576 0 0 0 151101701 153939975 158617802 169167744 129643354 762470576 0 0 762470576 6051262 6571824 8087215 6620573 4909460 32240334 0 6051262 6571824 8087215 6620573 4909460 32240334 0 0 157152963 160511799 166705017 175788317 134552814 794710910 0.95940 0.95850 0.04060 0.04150 X 36396935 4585319 417143 96530 40468581 30617040 6914072 456385 677792 36396935 33673294 -2185451 295899 574904 30617040 8901457 20000000 5187319 351478 64004 33673294 8480397 718605 297545 8901457 1.00000 false false false 1992585 1228893 3221478 9413309 75981881 36523374 48871816 8680411 6984834 1695577 29703 27391768 22324191 5097280 58886151 21281239 Accrued Pension Cost 143536616 Deferred Compensation Plans 7031188 Finance Lease Obligation 115930 Line of Credit 1000000 Post-retirement Health Benefits Payable 333085 152016819 X Part V, Line 4: Intended uses of the endowment fund. THE EDWARD J. STEMMLER, MD MEDICAL EDUCATION RESEARCH FUNDIn 1995, NBME established the Edward J. Stemmler, MD Medical Education Research Fund. The Fund makes grants to support research in topics relevant to the mission of NBME. The initial sum of $5,000,000 was invested and professionally managed with the goal of maintaining the corpus of the Fund over time while providing total annual grants up to 5% of the trailing three-year average of the fund balance. As with all NBME invested funds, the Finance Committee monitors performance and recommends to the Executive Board any changes to the principal balance of the Fund.THE STRATEGIC EDUCATOR ENHANCEMENT FUNDIn 2017, NBME established the Strategic Educator Enhancement Fund to foster professional development for its community of volunteers and other stakeholders. The initial amount of $20,000,000 was designated within NBMEs investments as a quasi-endowment fund. The maximum annual authorized disbursement from the quasi-endowment fund for 2017 through 2019 was an average of $600,000 per year. Beginning in 2020, the maximum annual disbursement in any year is equal to 5% of the average of the trailing three-years ending balance of the investments. Part X : FIN48 Footnote The Internal Revenue Service has classified NBME as exempt from federal income taxes under Section 501(c)(3) of the Internal Revenue Code (IRC).U.S. GAAP requires management to evaluate tax positions taken and recognize a tax liability, if NBME has taken uncertain tax positions that more likely than not would not be sustained upon examination by a government authority. Management has analyzed the tax positions taken by NBME, and has concluded that as of December 31, 2020 and 2019, there were no uncertain positions taken or expected to be taken that would require recognition of a liability or disclosure in the consolidated financial statements.NBME recognizes accrued interest and penalties associated with uncertain tax positions, if any. There were no tax related interest or penalties recorded for either of the years ended December 31, 2020 or 2019. true Europe 0 0 Program Services See Part V 14301 North America 0 0 Program Services See Part V 551 East Asia/Pacific 0 0 Program Services See Part V 9413 South America 0 0 Program Services See Part V 5432 Cent Amer/Caribbean 0 0 Program Services See Part V 4396 Sub-Saharan Africa 0 0 Program Services See Part V 289 34382 34382 North America See Part V 25000 Wire Cash North America See Part V 25000 Wire Cash North America See Part V 80611 Wire Cash 3 Sponsorship Europe 1 -3500 Wire Cash true false false true true true true Cincinnati Childrens Hosp 3333 Burnet Avenue Cincinnati OH 45229 310833936 501(c)(3) 65719 0 Grant - See Part IV Hofstra University 128 Hofstra University Hempstead NY 11549 111630906 501(c)(3) 70940 0 Grant - See Part IV Jefferson Medical College 130 S 9th Street Suite 1700 Philadelphia PA 19107 231352651 501(c)(3) 10000 0 Contribution - See Part IV Northwestern University 633 Clark Street Evanston IL 60208 362167817 501(c)(3) 57254 0 Grant - See Part IV Rutgers Robert Wood Medical 125 Patterson Street New Brunswick NJ 08903 226001086 501(c)(3) 40000 0 Contribution-See Part IV Temple University PO Box 827651 Philadelphia PA 19182 231365971 501(c)(3) 10000 0 Contribution - See Part IV Trustees of U Penn 3535 Market Street Suite 750 Philadelphia PA 19104 231352685 501(c)(3) 10000 0 Contribution - See Part IV Univ City District 3940-42 Chestnut Street Philadelphia PA 19104 232913784 501(c)(3) 59574 0 Contribution-See Part IV Univ City Science Ctr 3711 Market Street 8th Fl Philadelphia PA 19104 231645908 501(c)(3) 9000 0 Contribution-See Part IV University of Illinois 28395 Network Place Chicago IL 60673 376000511 501(c)(3) 73952 0 Grant - See Part IV University of Miami 1600 NW 10th Avenue Miami FL 33136 590624458 501(c)(3) 7000 0 Contribution - See Part IV University of Utah 201 Presidents Circle Rm 416 Salt Lake City UT 84112 876000525 501(c)(3) 74124 0 Grant - See Part IV 12 0 Additional Supplemental Information Form 990, Schedule I, Part II, Line 1a - GrantsEach school is listed with the approved grant as follows:1. The University of Illinois at Chicago Proposal #1920-2777, "Medical Spanish Proficiency Assessment: Evaluating Student Physician Communication with Spanish-speaking Patients in Medical Education Settings "2. Northwestern University Feinberg School of Medicine Proposal #1819-2523, "Using Natural Language Processing to Unleash the Potential of Narrative Data to Assess a Student's Readiness to Progress in a Competency-Based Curriculum"3. Hofstra University Proposal #1920-2805, "Automated Scenario Generation from Public Datasets for Simulation-Based Training in Surgery"4. University of Utah Proposal #1920-2823, "Longitudinal Assessments of Multiple Competencies During Training and their Association with Patient Care Outcomes in Practice. 5. Cincinnati Children's Hospital Proposal #1819-2511, "Assessing Residents' Clinical Performance Using Resident-Sensitive Quality Measures"Note that the University of Minnesota's reimbursement of unused funds of $5,457 is not listed on the schedule in Part II.Contributions:NBME periodically makes contributions to organizations and/or community programs in order to assist in furthering the exempt purpose of those organizations. NBME also gives the Executive Board Chair and Treasurer the option of contributing their honoraria to their respective places of employment. The total amount of contributions made in 2020 was $159,324.In response to the testing delays and other uncertainties associated with the COVID-19 pandemic, NBME offered seven complimentary NBME self-assessments between April 3 and September 30, 2020 as a free resource to medical students and examinees to supplement their medical knowledge and preparation for USMLE. More than 400,000 free self-assessments were ordered during this time. The value and cost of providing these self-assessments are not included as a contribution on Schedule I. Grantmaker's Description of How Grants are Used THE EDWARD J. STEMMLER, MD MEDICAL EDUCATION RESEARCH FUND OF THE NATIONAL BOARD OF MEDICAL EXAMINERS (NBME)The purpose of the Stemmler Fund is to provide support for research or development of innovative evaluation methodology or techniques, with the potential to advance assessment in medical education or practice at eligible medical schools. Also see description of Stemmler Fund in Schedule D, Part V, Line 4 Intended Uses of Endowment Fund. The eligible applicants for Stemmler Fund grant awards are the medical schools accredited by the LCME or the AOA, and the number of Letters of Intent submitted by any eligible school is not limited. The Stemmler Fund Committee evaluates each application on the extent to which the proposed research is innovative or will advance assessment in medical education or practice, and will address an important problem or issue in medical education or practice. The Committee selects a subset of applications and invites them to submit full proposals. Peer reviewers with expertise in measurement, research design and methodology evaluate invited proposals on the relevance and significance of the proposal to the purpose and goals of the Stemmler Fund, the adequacy of the research design or methodology, and the qualifications of the principal investigator and project staff. The Stemmler Fund Committee reviews all proposals and peer reviews, also considering the budget, timetable, and other key project resources in each proposal, and selects awardees. Grant recipients are required to submit an interim and final report which includes a final project narrative and a final project fiscal report. X X true true X X X X X X true true false false false false false false false Agata P Butler VP, Academic & Prof Prgms 285560 400 4048 173562 24271 487841 Andrew F Farella SVP & CIO 285321 -2728 106016 28900 417509 Brian E Clauser VP, Cen Adv Assmt 305266 54290 142407 134529 24333 660825 Christopher A Feddock Executive Director, CSEC 252980 15400 -1928 90521 16692 373665 Craig N Mills SVP, SD&D 414811 72768 74246 24152 585977 Elizabeth D Azari SVP, COO 340251 62718 119120 24271 546360 John J Hinke Jr CFO 308012 25641 113118 30207 476978 Kenneth W Ridgely VP, Test Development Svcs 299211 400 -5662 61607 30093 385649 Linda Gadsby VP & Gen Couns 271615 50000 37116 103745 9053 471529 Lisa M Rawding SVP, Mktg & PM 347999 4759 120428 10865 484051 Margaret B Anderson VP, Med Ed Global 317988 400 30804 104785 11445 465422 Michael A Barone VP, Licensure Programs 375803 400 -4211 69167 30131 471290 Michael G Jodoin VP, Psychometrics 315873 400 -5378 101357 29247 441499 Miguel Paniagua Medical Advisor 345717 400 13121 77047 30118 466403 Peter J Katsufrakis President & CEO 676600 4831 280751 11375 973557 Stephen G Clyman Former SVP, R&D 143722 143722 Susan A Deitch Secretary 150252 400 10190 113075 11231 285148 Thomas A Rebbecchi Medical Advisor 330929 400 21919 89478 30233 472959 Part I, Line 1a: Relevant information in regards to selections on 1a. First Class Travel and Travel for CompanionsNBME's Business Travel policy states that the most cost effective options available based on the traveler's requested itinerary should be made. First-class travel and travel for companions are not specifically authorized in the policy. In limited circumstances, certain NBME Officers and Key Employees may be permitted first-class travel if authorized by the President. First-class travel and companion travel for the President are included in the compensation package. The cost incurred for travel for companions is included in the employee's taxable earnings. Part III, Additional Information The amounts reflected on Schedule J, Column C Retirement and other deferred compensation include an estimate of the annual increase in the actuarial present value of each employees benefit to be received at retirement under NBMEs defined benefit plan for each employee. In addition, column C includes the amount contributed by NBME to an eligible employee's defined contribution plan, as well as earnings accrued under the Exective Deferred Compensation Plan where applicable. The amount in column C does not represent an actual cash payment to the employee during the year, but an estimate of the accrued benefit during the year to be received at a later date or at the time of retirement. A Phila Auth for Ind Dev 232237287 71781XBU6 2016-08-17 38013614 Refunding of 08/2008 Bonds false false false A 4890000 38399627 523810 37875817 false true true true A false false false false false false A false true false false false false false false false A true Part VI Part II, Line 3 - Total Proceeds of IssueThe total proceeds of issue listed in Part II, line 3 does not match the issue price in Part I, column (e) as a result of investment earnings associated with proceeds deposited in a refunding escrow account in conjunction with the advance refunding of the 2008A Series Bonds.Part IV, Line 2, Column A - ArbitrageArbitrage calculation is due in 2021. Client Note 1 Client Note 1 - Note 1 - Form 990 Part I, line 6 - VolunteersNBME utilizes an extensive network of volunteers, many of whom are medical school faculty members and practicing physicians, to accomplish its mission. These volunteers contribute the highest levels of expertise in their profession to a range of activities including test development and governance. They receive a small honorarium in recognition of their service.Note 2 - Form 990 Part VI, line 1b - The President of NBME is an ex officio member of the NBME Executive Board. Form 990, Part III, Line 4d: Other Program Services Description OTHER PROGRAM SERVICES 4: The Post-Licensure Assessment System (PLAS) is a joint activity of NBME and the Federation of State Medical Boards (FSMB). PLAS comprises two programs: the Special Purpose Examination (SPEX) Program and the Assessment Center Program (ACP). SPEX is a one-day, multiple-choice examination of current knowledge requisite for the general, undifferentiated practice of medicine and is intended to be used for reasons of endorsement or reciprocity of licensure. The ACP provides comprehensive objective and personalized assessments of physicians for whom there is a question regarding clinical competence. Together, the PLAS programs have assessed thousands of physicians over the past decade for reasons that range from endorsement of licensure to license reactivation after disciplinary action.Solution Design and Delivery units include the Office of Research and the Center for Advanced Assessment. The Office of Research supports NBMEs research enterprise by coordinating NBMEs research efforts across the organization and ensuring that NBMEs research portfolio is consistent with institutional priorities. In addition to these defined programs of research and development, each program area and service unit is charged to carry on a program of research and development relevant to the work of the program or unit, for example, development of new item formats for USMLE, exploring relationships between prior measures and certifying exam performance for our clients and developing new testing methods for clients. These research and development activities result in the publication of dozens of research reports in scientific journals and presentations at scientific meetings each year.The Center for Advanced Assessment (CAA) is responsible for conducting research related to improving the quality and efficiency of NBME products, services, and procedures. It is also aimed at developing capabilities that allow NBME to expand its range of assessments both geographically and across the health professions. In addition to this work, the CAA provides non-routine technical support to other organizational divisions and subunits and conducts research to contribute to the field of measurement.In aggregate, these units deliver information vital for planning strategy related to innovative assessments to meet stakeholder needs. They support conception and market testing of product ideas and the research to investigate and sustain products and services.NBME and the National Board for Health & Wellness Coaching collaborate to provide the Health and Wellness Coach Certifying Examination. The collaboration provides an opportunity to draw upon the unique capabilities of each organization to provide a high-quality assessment for health and wellness coaches. Exam content is developed by nationally recognized leaders in the field of health and wellness coaching and covers areas such as coaching structure and process, health and wellness, and ethics. OTHER PROGRAM SERVICES 5: Form 990, Part VI, Line 6: Explanation of Classes of Members or Shareholder The members of NBME are responsible for electing its board of directors, the Executive Board, recommending policy for the organization proposed to the Executive Board, receiving reports on the annual budget, and approving amendments to the by-laws of the organization. The members of NBME include its Executive Board, up to twenty-two representatives of the test committees, twenty-two representative members nominated by key constituent medical organizations, elected members-at-large including members of the public, and honorary members. The members of NBME meet annually. The officers and members of the Executive Board, elected by NBME membership, meet four or five times a year. Form 990, Part VI, Line 7a: How Members or Shareholders Elect Governing Body See Schedule O - Form 990, Part VI, line 6. Form 990, Part VI, Line 7b: Describe Decisions of Governing Body Approval by Members or Shareholders See Schedule O - Form 990, Part VI, line 6. Form 990, Part VI, Line 11b: Form 990 Review Process The Form 990 is reviewed by the NBME President, Chief Financial Officer, and General Counsel prior to filing the return with the Internal Revenue Service (IRS). The review is completed to ensure appropriate and complete disclosure. A copy of the Form 990 was provided to the NBME Executive Board and Audit Committee members prior to filing the return with the IRS. Form 990, Part VI, Line 12c: Explanation of Monitoring and Enforcement of Conflicts NBME has a written Conflict of Interest Policy for its members as well as a Fiduciary Duty and Conflict of Interest Statement for its Officers, Key Employees and Executive Board Members. These individuals are required to review and sign the applicable policy annually. Submission of completed statements by Officers, Key Employees, and Executive Board Members is enforced and annual disclosures of interests that could give rise to conflicts are monitored by the Secretary of the Board. Potential or real conflicts of interest are required to be reported to the Secretary of the Board or its President. If deemed appropriate, the party will be recused from the relevant proceedings. Form 990, Part VI, Line 15b: Compensation Review and Approval Process for Officers and Key Employees Periodically, typically every three years, a Compensation Survey of Peer Organizations is conducted by an outside independent compensation consulting firm. The recommendations resulting from the survey are reviewed by NBME Human Resources and the Compensation Subcommittee of the NBME Executive Board. Officer employees and Key Employee compensation is reviewed and confirmed annually by the Compensation Subcommittee. Payments to non-employee officers are reviewed and approved by the Executive Board with interested officers recused. In setting CEO compensation, the Compensation Subcommittee uses the Compensation Survey of Peer Organizations and the results of the detailed annual CEO Evaluation of performance report from the CEO Evaluation Subcommittee of the Executive Board. The CEO compensation is set and approved by the Compensation Subcommittee of the Executive Board which then reports to the Executive Board that it has reviewed the relevant information and made a decision. Form 990, Part VI, Line 19: Other Organization Documents Publicly Available NBME governing documents, Conflict of Interest Policy, and financial statements are available upon request to the NBME Secretary of the Board. Other Changes In Net Assets Or Fund Balances - Other Decreases NBHWC Equity Pickup = -$164262 Other Changes In Net Assets Or Fund Balances - Other Increases Pension-related Changes other than Net Periodic Pension Cost = $12440301 Other Changes In Net Assets Or Fund Balances - Other Increases Post-retirement Plan Health Benefits Payable Adjustment = $76122 Other Changes In Net Assets Or Fund Balances - Other Decreases Settlements = -$49993 NBHWC PO Box 16307 San Diego CA 92176 815064011 Health & Wellness Coaching DE 501(c)(6) N/A true Computer-Based Testing & Learning Corp 3750 Market Street Philadelphia PA 19104 232447706 Comp-based Testing PA NBME C Corp 1.00000 true false true false false false false false false false false false false false false false false false false false NBHWC b 115000 Cash