Q: What is the passing rate of the proctored exam?

A: On average about 6% fail the proctored exam.

The data for the 2007 proctored exam won't be compiled until after February 2008.

Q: How about the case study pass rates? How many people pass this part the first time?

A: As of September 30, 2007: 57% of the candidates passed both exams in 2004, 60% of the candidates passed both exams in 2005, 54% of candidates passed both exams in 2006, although 22% of the applicantswere still in process of working on their scenario-based exams.

Q: Where did the questions come from on the proctored exam?

A: The questions on the proctored exam come from many places. The general membership provides the bulk of the questions. Periodically, NACVA contracts with experienced (5 years or more in valuation practice) valuers to read a resource and generate multiple choice questions. Questions also come from The Value Examiner authors. Once the questions are received by NACVA, two contracted exam Q&A consultants gather them together, and with their team of 20+ subject matter experts (SME), review each question. Each question must be documented—where, if readily identifiable, is the concept discussed in the literature, do the multiple choice responses reflect enough difference so there is one correct choice, is the answer clear and correct, where does the question fit within the Body of Knowledge, etc.? After the Exam Development Team has completed its work, the new questions go to the Valuation Credentialing Board (VCB) for approval and potential inclusion into the Exam Database. The VCB accepts or rejects questions.

Q: Who decides what questions are in the proctored exam?

A: The VCB, with psychometric input on question validity.

Q: How do we know the proctored exam is valid?

A: The psychometric analysis of the current exam shows it to have a validity of 0.940 (out of a possible 1.0 rating), which is considered very reliable in the testing industry.

Q: I went to NACVA's Business Valuation Training Center (TC), and some of the things on the proctored exam were not mentioned by the instructors. Why are we tested on things not taught in class?

A: The knowledge exam, usually referred to as the proctored exam, tests knowledge of the general field of valuation, the Body of Knowledge, not just what might be discussed in a class on theory or practice. It is impossible for instructors to address every nuance of valuation theory and practice in 40 hours. That is why NACVA’s texts provide recommended reading and incorporate appendices a valuer needs to be familiar with. It takes both knowledge and the application of that knowledge to perform a business valuation.

Q: Where did NACVA’s Body of Knowledge (BOK) come from?

A: In 1997, NACVA HQ and TC instructor team (TCIT) (18 SMEs who taught NACVA’s 5-day course) set for itself two goals: (1) to be consistent in what was taught in the TCs so that one instructor could step in for another without any knowledge loss, and (2) ensure that a participant who sat for NACVA courses could pass any competitor’s valuation certification exam. The TCIT came up with an outline of valuation knowledge which they would use in 1998. This outline began to evolve as it was used, modified, debated, checked and rechecked and agreed upon. In addition to defining what the core concepts were that should be shared in the TCs, the TCIT began to note how much time they gave each topic. In early 2003, when the TCIT had an outline of concepts, complete with the time to be spent, the document/outline was given to the VCB for its input (and approval) with regard to certification. Did it hit the mark? The VCB and its Exam & Grading Committee (EGC) began its debate, working with the TCIT outline, comparing it to the MC proctored exam and scenario-based exam, and came up with the final outline. The VCB then deliberated what percentage of the proctored exam should be on a given topic. In September 2004, the VCB agreed to use the resulting document as NACVA’s Body of Knowledge. All in all, about 35 different SMEs worked on the BOK.

Q: Why two exams? Why isn’t the proctored exam sufficient by itself?

A: The proctored exam tests what the candidate knows about all the various aspects of valuation theory. This is often referred to as "book knowledge." What is missing from that concept is determining that the candidate can apply that knowledge to a live situation. It takes both the knowledge and the application of that knowledge in the field of business valuations to be proficient.

Q: Why does NACVA use a standard case study for the scenario-based exam?

A: When all candidates perform a valuation using the same set of facts, NACVA’s Exam and Grading Team can more easily judge whether or not the candidate can apply the book knowledge he or she has demonstrated. The same fact pattern also makes the exam more statisically valid, allows statistical analysis in greater depth, as one element of uncertainty is reduced: the degree of subjectivity in the grading process.

Q: Will the exam change significantly in the near future?

A: The VCB has determined the next major review (which does not automatically mean change) of the proctored exam will be in 2008. The review schedule approved by the VCB is: 2008—proctored exam, 2009—scenairo-based exam, and 2010—recertification.

Q: What is the process the VCB plans to use to change the proctored exam?

A: A psychometric option analysis will be performed, using historical data for 2004-2006. This analysis will determine what percentage of candidates chose each answer and where they fit into the overall score pattern. Such analysis identifies questions which are most often missed (perhaps too hard?) and which are always answered correctly (perhaps too easy?), and which questions appear to be confusing (equal responses to all answer choices). This information will be used by the VCB SMEs to review each question, and to decide what should be done.

Q: SME — what is that?

A: SME stands for subject matter expert. There are several ways to qualify a SME. Earning a PhD is one way. Having earned an MBA, CPA, CFA, CVA/AVA, JD, or other credential/advanced university degree is another. When one adds a level of experience to the aforementioned credentials or licenses, credibility increases. NACVA has found, since its inception in the early 90s, that persons with 5 years or more experience in performing business valuations provided them the savvy to share working knowledge and applications of that knowledge with others. These individuals were initially sought out for advice and for assistance in the "tough" valuation issues. As an organization, NACVA began to hire these people to help others with less experience or even no experience. After time, NACVA’s teams (both the teaching side and testing side) determined that 5 or more years of experience was a common denominator that worked well for the organization. NACVA currently identifies its SMEs as credentialed practitioners with 5 or more years of active experience in valuing closely held businesses. "Active" equates to about 10-15 valuations per year. And today, many of these SMEs perform valuations (which includes litigation support) full time. Many of them teach in their local universities and societies and are active in NACVA Chapters. These are the individuals who assist NACVA in keeping our training top notch, our proctored exam at 0.940 reliability, our scenario-based exam on target, and help NACVA offer advanced seminars in a wide variety of fields.

Q: Who decides what is passing?

A: The VCB.

Q: What is passing?

A: The VCB has accepted the psychometric analysis and report recommending a passing score be placed either within 1 standard error of measurement (SEM) of the mean of 70-75% correct, or within 2 SEM of the mean 67-77%; 72% falls within the middle of both ranges, and is considered passing.

Q: Why does NACVA charge me another fee when I want to know more specifically what and how I performed on the case study?

A: The fee is used to offset copy costs, shipping costs, phone costs, etc., to forward your case to a grader/mentor. The bulk of the fee, however, is to compensate the grader/mentor for his/her time spent with you.