Insights from 5 1/2 years of California MFT license exam data: A defense of underperforming programs

by

Some MFT programs’ graduates perform poorly on California’s MFT licensing exams. Don’t assume that means the program is of poor quality; there may be good reasons.

Graduation hat1We’ve seen that there are huge differences in performance on the California marriage and family therapy licensing exams based on what graduate program the test-takers attended. We’ve also seen that for-profit MFT programs should not be dismissed simply because they aim to make money; Argosy graduates do particularly well on the exams, while University of Phoenix graduates do not. I’ve said before, though, that there are lots of things to consider when choosing a graduate program in MFT, and that graduates’ exam performance should only be one of many such considerations. Indeed, there are some major problems with putting too much stock in exam data.

If you are looking at graduate programs, and are concerned about your prospective MFT program’s exam pass rate, here are three reasons why you may want to ignore the exam data:

  • Programs can and do improve. Exam data reflects students who graduated years earlier. Remember, it takes the average MFT intern in California more than four years to move from graduation to the licensing exams. That number is a bit lower for graduates of COAMFTE-accredited programs, primarily because they do more practicum hours while still in school. Nonetheless, if you are looking at MFT licensing exam data from 2009 and earlier, you will find very little information on anyone who graduated much past 2005, and nothing to tell you which programs have gotten better or worse since then. Consider the recently-COAMFTE-accredited programs at Chapman University and Hope International University. Their national accreditation should arguably make them more appealing (and thus competitive) programs for prospective students and faculty alike. That’s important, and simply is not reflected in currently-available exam data.
  • Programs seek to give students opportunities. Consider for a moment the state’s worst-performing program, according to a table that appeared in Part I of this series: Pacific Oaks College. Based on the pass-rate statistic alone, one might presume that the Pacific Oaks program is not very good. But that conclusion can’t safely be made from that data. Pacific Oaks, over the past few years, has specifically sought to provide opportunities to historically underserved populations, creating cohorts specifically for African-American Family Therapy and Latino Family Therapy. (This outreach is vital: Lots of evidence suggests that the mental health workforce is not meeting the needs of minority populations, either in California or around the US.) Students in these cohorts may lack the family, economic, and social support, as well as the earlier educational opportunities, that other students often have. Pacific Oaks goes to great length to remediate these earlier deficits, and may be doing more, with less, than programs who start with more economically- and educationally-advantaged students. When financial and accreditation concerns threatened to close the Pacific Oaks in 2009, I was one of many who stood up in defense of keeping the program alive, and have no reservations about having done so.
  • Programs have no control over what students do after graduation. A program can really only control what happens from the time students are in the program to the time they graduate — and even then, programs have limited control over how well their students prepare themselves. A great supervisor can help an MFT Intern/Associate make up for deficiencies in their education, and help get them ready for licensing exams. Poor supervision may leave the Intern/Associate on their own to prepare, or even offer incorrect information that ultimately harms one’s chance of passing the exams. And of course, programs have no control over whether their graduates use MFT exam prep programs, although there is little evidence that these prep classes actually impact MFT exam pass rates.

Of course, before you do go dismissing a program’s exam pass rate, take some steps to get reassurance that you are making that decision wisely. If you are considering attending a program whose graduates have not performed well on recent licensing exams, ask the program (1) why, (2) what they’re doing about it, and (3) what evidence they have that they’re getting better. If the program can’t pass that test, then it’s time to wonder whether you would be able to pass yours.

Ruling mixed in CAMFT-BBS “gap exam” lawsuit

by

Court finds the BBS must consult with Office of Professional Examination Services to determine whether a “gap exam” is needed for MFTs seeking LPCC licensure.

JudgesTools IconAt 11:00 this morning, the California Superior Court for Sacramento County issued a tentative ruling in the CAMFT-BBS lawsuit over MFTs who wish to be grandparented into LPCC licensure. It leaves hanging the question of whether there will actually be such an exam — though it appears highly likely.

I’ve previously written about the issue here and here, the first of which offers a better review of the details.

Today’s ruling is mixed, siding with the BBS on two key questions and with CAMFT on one:

  1. The BBS was within its authority in determining that “the profession” and “the practice of the profession” mean effectively the same thing.
  2. The BBS was within its authority (and reading the law reasonably) in determining that those seeking grandparenting into LPCC licensure must be tested on any differences between the professions.
  3. The BBS went beyond its authority by determining that a “gap exam” was necessary without adequate consultation with the state’s Office of Professional Examination Services (OPES), as required by law.

Ultimately, the court orders that the decision to require a “gap exam” be set aside until the OPES consultation has taken place (which must be within 60 days) and the BBS makes a determination based in part upon the results of that consultation. Since the BBS and its contracted consultant both previously concluded that there were meaningful differences between the professions, the court ruling on the first two questions above suggests a strong likelihood that the BBS will go forward with an exam, but it is not fully certain.

You can read the ruling in full here.

===

Updated 1-30-2011: The court heard oral argument on Friday, to no effect — it adopted what had been the tentative ruling. The BBS now has 60 days to consult with OPES and make a final determination on the need for a gap exam.

===

Update 2-6-2011: CAMFT has released their spin on the Gap Exam ruling, which seems sure to mislead at least some readers. There’s nothing there that’s technically incorrect, but it takes a fair amount of reading to get the full picture. People who just read the headline, or even the headline and the first couple of paragraphs, will likely come away believing there will be no Gap Exam. Since CAMFT lost on the two substantive arguments that would suggest the exam is unnecessary, it still seems likely that an exam will be given.

Also updated the headline, as the court adopted its tentative ruling.

CAMFT changing therapist-referral site to “Counseling”

by

CAMFT is rebranding their therapist-referral site as CounselingCalifornia.com. The change, and how it was announced, continue CAMFT’s pattern of treating MFTs and LPCCs as indistinguishable.

In an announcement on November 1, the California Association of Marriage and Family Therapists (CAMFT) said it would be re-branding its therapist-referral web site as CounselingCalifornia.com. While their email described this as an effort largely to improve search engine optimization, it also fits their pattern of making marriage and family therapy (and the MFT license) indistinguishable from counseling (and the LPCC license). The change will take effect on January 4, exactly three days after the Board of Behavioral Sciences begins accepting applications for LPCC licensure through grandparenting.

Notably, not once in CAMFT’s email announcement did they refer to their own clinical members as what they are by licensure: “marriage and family therapists.” Instead, the clinicians who would gain referrals through the site (limited to CAMFT’s Clinical Members, which at this time means just MFTs) were referred to only as “therapists” or “licensed therapists.” The words “marriage” and “family” were nowhere to be found. The name change for the referral site, and the announcement of that change, certainly leave the door open for the site to be a referral site for both MFTs and LPCCs.

I can understand that, from an organizational-numbers point of view, it may benefit CAMFT to be as welcoming as possible to LPCCs as that license opens in California. However, CAMFT’s continuing efforts to make MFTs and LPCCs indistinguishable work against the best interests of both professions, who should collaborate effectively when it benefits us (lobbying for Medicare reimbursement, for example) and be able to advance our unique professions when it benefits us (publishing journals or holding conferences, for example). The constant push to make us indistinguishable, culminating in a lawsuit against the BBS, was enough for me to finally cancel my CAMFT membership. It will be interesting to see how other MFTs who value the MFT title will respond, especially if this pattern continues.

===

Another reason CAMFT likely changed the name: The existing name has earned them the unlucky honor of being regularly counted among the unintentionally worst company URLs on many a list.

===

CAMFT is separate and independent from both AAMFT and its California Division.

Teen texting study an example of a researcher misleading the media

by

A new study connects the texting habits of teenagers with drug use and other risky behavior. Contrary to media reports, the study did not show texting to cause the teens’ risk-taking.

Teenagers who send more than 120 text messages a day are more likely than their peers to engage in a variety of risky behaviors, including sexual activity, smoking, drinking, and drug use. That much we can agree on. It was the key finding of a Case Western Reserve University School of Medicine study presented this week.

Media coverage was predictably breathless:

But there is a big problem with each of the stories linked above. As compelling as these stories are, texting did not cause poor health or risky behaviors in this study. More precisely, the study did not show a cause-effect relationship. It found correlations — associations between certain behaviors that tend to rise and fall together. It did not say what causes what.

If we know that one behavior (texting, in this case) is more common among people who also do another behavior (let’s use drinking), then we can say the two behaviors are correlated. But that leaves at least three very different possibilities when it comes to cause and effect:

  1. Texting causes drinking.
  2. Drinking causes texting.
  3. Some other thing (lack of parental supervision, maybe?) causes both drinking and texting.

A correlational study (like this one) does not tell us which of those three possibilities is most likely (the third strikes me as by far the most plausible). And reporters understand that conclusions about correlation are not especially enticing news stories. “This one thing is related to this other thing, but we do not really know what causes either one of them” makes for a lousy article.

So reporters sometimes go beyond what a study actually shows, and pull a cause-effect relationship out of thin air. In essence, they pick their favorite out of the three possibilities listed above, and run with it. They do this in spite of a complete lack of data supporting their conclusion over the other cause-effect possibilities.

That seems to be what happened here. What is unusual in this case is the degree to which the study’s lead author actively promoted the made-up conclusion.

Even though the press release about the teen-texting study largely uses the right terms in describing the results (labeling behaviors as being “associated with” each other), Scott Frank, the lead author of the study, was remarkably cavalier in determining a cause-effect relationship his study did not demonstrate. He is quoted in that same press release as saying

“When left unchecked, texting and other widely popular methods of staying connected can have dangerous health effects on teenagers.”

The medical school where the study was conducted is also encouraging this unsupported conclusion. The link to this study from the Case Western School of Medicine home page currently reads “Hyper-texting and Hyper-Networking Pose New Health Risks for Teens.”

Frank’s promotion of a conclusion his own data does not support prompted an unusually direct rebuke from John Grohol, the CEO of PsychCentral, whose own site had reported on the study earlier. Grohol wrote that Frank’s conclusions about texting having negative health effects are (emphasis Grohol’s)

all pure crap. You could just as easily write the following headlines:

Teens Who Smoke, Drink Also Text a Lot
Outgoing Teens Like to Do Things Outgoing Teens Like to Do
Teens Who Enjoy Sex Like to Text Too!

Scott Frank, MD, MS should be ashamed of himself.

I’m with Grohol on this. For Frank to say that texting can have negative health effects is, as Grohol put it, “sloppy at best, and unethical at worst.” Frank is promoting a conclusion his study simply does not support. And some media outlets appear to be all too happy to run a story confirming parents’ worst fears about teenagers and technology, even when the story and the data do not match.

===

In deference to my journalist friends, it must be noted that the examples of poor media coverage above are far outweighed, in both quantity and quality, by the many stories covering this study that ignored Frank’s quotes and reported his results accurately. Search “teenagers texting drinking” on Google’s news site and you will find far more headlines using phrases like “linked to” or “associated with” than you will find “causes.” Kudos to those writers (of both the stories and the headlines, since they are often not the same person) who understand the difference.

Quitting CAMFT

by

CAMFT’s LPCC “gap exam” lawsuit against the BBS is a waste of resources that, if CAMFT “wins,” would eliminate California’s legal recognition of the distinctiveness of the MFT license. I refuse to let my member dues support it.

As I reported here recently, the California Association of Marriage and Family Therapists (CAMFT, which is independent of AAMFT and its California Division) has filed suit against the Board of Behavioral Sciences, alleging that their decision to require a “gap exam” for MFTs seeking grandparenting into LPCC licensure amounts to an illegal restraint of trade.

If CAMFT loses, it would mean they wasted thousands of dollars of member dues on outside counsel and court fees.

But if they “win,” the outcome would be far worse: It would eliminate legal recognition of any distinction between the practices of MFT and professional clinical counseling — and pave the way for the MFT license to disappear completely. (Here’s why.)

And either way, CAMFT’s conduct around the issue has already damaged the organization’s ability to work collaboratively with the BBS. [Page 50, item III on the linked PDF.]

Why CAMFT would want to win this argument, I do not know. But I know my member dues cannot support it.

===

I have been an active and supportive member of CAMFT for several years. As I have talked with students and colleagues around the state, I have been able to honestly say that there is much to be proud of in the work CAMFT has done — even this year, legislation CAMFT sponsored to clarify MFTs’ roles and responsibilities around child abuse reporting has been good for the profession. Their in-house attorneys are wonderful resources, available any time. And at the chapter level, the overwhelming majority of CAMFT members simply want to be able to make a living providing providing the most effective services possible to their clients. They’re great people and often outstanding therapists.

The organizational decisions CAMFT has made, though, have too often been in direct conflict with the best interests of the profession. CAMFT’s struggle around same-sex marriage is well-worn territory here, and it speaks to larger structural problems that were apparently never meaningfully addressed. CAMFT has stopped publicly advocating for the complete elimination of the MFT license, but they continue to make decisions that lead in that direction — like this lawsuit — and I do not believe most members know just how close they have come to making it happen.

This lawsuit over a gap exam, if successful, would put the state on the record as determining there are no differences in practice between MFT and LPCC. Not only is that fundamentally wrong, but it also would virtually force the BBS to consolidate the MFT and LPCC licenses. (If there is no difference in practice, there is no need for independent licensure.) It would not happen immediately — the process would take years — but with a CAMFT “victory” in this case, it would be almost impossible to prevent.

I am a marriage and family therapist. Not a professional clinical counselor. There is a difference. Even the counselors say so. [See currently-third item, “AMHCA lauds…”] I should never have to remind a professional association of MFTs that this is true. And I cannot support one more dime of my money being used to chip away at what makes this profession unique and valuable.

So I am, with a great deal of disappointment, resigning my membership in CAMFT. I hope they get back on the right track at some point in the future. My letter resigning my membership, which largely repeats these same points, follows in its entirety.

===

November 1, 2010

Dear CAMFT,

Effective immediately, please cancel my membership.

Over the past several years, I have gradually lost my faith that the organization’s goals and actions are truly in the best interest of the MFT profession. Your lawsuit against the BBS over the “gap exam” for MFTs seeking grandparenting into LPCC licensure only confirms that you are actively working against what is best for the field of marriage and family therapy.

If unsuccessful, this lawsuit will be a massive waste of members’ dues in a misguided cause. If successful, the outcome would be even worse: A legal determination that there is no difference in practice between MFT and LPCC (and perhaps LCSW as well) would pave the way for license consolidation. While this may be in the best interest of CAMFT as an organization (you could add LPCC members under one umbrella), it is quite clearly not in the best interest of marriage and family therapy as a profession. Independent licensure provides valuable legal recognition of the distinctiveness of our skill set and body of knowledge. A short “gap exam” for grandparenting appropriately balances the need to recognize this distinctiveness with the desire among some experienced MFTs who are otherwise prepared for LPCC licensure to obtain that distinct license.

Regardless of its outcome, the lawsuit has harmed CAMFT’s ability to effectively work collaboratively with the BBS. This was made clear when, at the September BBS meeting, several board members openly and publicly expressed their disappointment with CAMFT’s conduct.

I cannot in good conscience allow my dues money to be used for efforts that work against the best interests of the profession of marriage and family therapy. I will happily rejoin if and when CAMFT (1) drops this misguided lawsuit; (2) makes a clear and public statement that it recognizes the practice of marriage and family therapy is distinct from other mental health professions; and (3) outlines and follows through on clear steps to protect, preserve and advance the distinctiveness of our profession.

Sincerely,

 
Benjamin Caldwell, PsyD