Preview Mode Links will not work in preview mode

Dec 12, 2022

How Skillful is your Shrink! Now you can find out!

The Exciting Recovery Coefficient--

and the FEAR the grips the hearts of the therapists who are afraid to use it!

People often wonder how skillful or effective their therapist is, but until now, there was no very valid or precise way to know. But now there is, and it has fantastic implications for psychotherapy.

Today, we feature an interview with Kevin Cornelius, a therapist at the Feeling Good Institute in Mountain View, California.  Kevin Cornelius is a Licensed Marriage and Family Therapist in private practice at Feeling Good Institute, with in-person counseling for teens .Kevin is a Certified Level 4 Advanced TEAM-CBT Therapist and Trainer.

I asked Kevin to write a brief description of his evolution from a career in acting to his career as a shrink. Here’s what he wrote:

After many years of working as an actor I was ready for a change. After some painful personal events, I saw a therapist who was quite helpful to me. She helped me see that changing to a career as a therapist could be a great thing for me.

I went to school and got my Master's in Marriage and Family Therapy. Just before I began applying for internships to complete licensure, I learned that the children's theatre group I had grown up in was looking for a new supervisor to lead the group following the death of its beloved founder and leader. This was a wonderful opportunity for me to use my theatre skills and my desire to help young people in their growth and development.

I was very fortunate to be hired and worked as the director of the children's theatre group for 19 years. Towards the end of my years with the children's theatre, I was ready for a change and thought it might be time for me to finish getting my therapy license.

It had been 15 years since I had worked with a patient in a therapy session, so I had a lot to learn! I was so lucky to discover David Burns and his amazing TEAM-CBT. The testing element of TEAM enabled me to see right away where I needed to improve so I could focus my efforts on improving specific skills.

Being able to study with David in his Tuesday group at Stanford was a golden opportunity. Here was a framework designed to make therapy as effective as possible being taught (for free!) by one of the world's greatest therapists.

I'm so happy I followed David's advice to get involved at Feeling Good Institute while I was still pre-licensed. Learning TEAM while I was completing the process to earn my license as a therapist enabled me to start my career in private practice with confidence and a stable foundation. Now, I get to continue learning from mentors at Feeling Good Institute, from the wonderful Feeling Good Podcast, and the valuable lessons I get from my patients.

I'll sum up my good fortune with a theatre reference and quote the Gershwins: "Who could ask for anything more?"

Kevin recently made the courageous decision to find out exactly how he was doing as a therapist. And the results surprised him tremendously.

Background Information for today’s podcast

Outcome studies with competing schools of psychotherapy in the treatment of depression have been disappointing. They all seem to come out about the same, slightly better than placebos, but not much. For example, in the British CoBalT study of 469 depressed patients treated with antidepressants vs antidepressants plus CBT, only 44% of the patients treated with antidepressants plus CBT experienced a 50% improvement in depression after six months of treatment, and the multi-year follow-up results weren’t any better. This was better than the patients treated with antidepressants alone, (only 22% experienced a 50% improvement), but still—to my way of thinking—very poor. We see more improvement than that in just one day in patients using the Feeling Good App.

Here are just two of many online references to that landmark study:

Because of the disappointing results of research on the so-called "schools" of psychotherapy, the focus is switching, to some extent, to the effects of individual therapists, since even within a school of therapy, there can be huge differences in therapists’ effectiveness. Some therapists seem to have the proverbial “green thumb,” with many patients improving rapidly, while others seem much less effective.

Is there a way to measure this? Now there is!

And do patients have a right to know how effective their shrinks are? That’s what I’m proposing!

For at least twenty years or more, I’ve been trying to sell therapists on my Brief Mood Survey with every patient at every session. That’s because you can see exactly and immediately how depressed, anxious, or angry, etc. your patient was at the start and end of today’s session.

This allows therapists to see, for the first time, exactly how much the patient improved in various dimensions within the session, as well as how much the patient relapsed or continued to improve between sessions.

Here’s a simple example. To make things really clear, let’s imagine that your depression test goes from 0 (not at all depressed) to 100 (the worst depression imaginable, and your patient has an 80 at the start of today’s session. That would indicate a horrendously severe depression, similar to patients hospitalized with depression.

And yet, your patient might be functioning effectively, and might appear reasonably happy. So, bonus #1, you can see exactly how your patient was feeling at the start of the session. You might think of the BMS as an “emotional X-ray machine.”

Now, let’s assume you have an excellent session, and feel like you’re clicking with the patient, and the patient scores 40 on the end-of-session BMS. That would be a phenomenal 50% improvement. Of course, a score of 40 means that the patient is still moderately depressed, and has a way to go, still the goal is a score of 0 on the depression test and a huge boost in the patient’s score on the happiness test on the BMS.

Keep in mind that in the dozens of psychotherapy outcome studies that have been published worldwide, the very highest levels of improvement in months and months of therapy are  never higher than this.

So, I call this the Recovery Coefficient (RC), and it is a very precise measure of any therapist’s effectiveness in treating anything you can measure accurately.

In an informal study of de-identified data of more than 10,000 therapy sessions at a local treatment center about two years ago. I discovered that the RC the first time therapists met with their patients predicted the improvement over the entire course of therapy. In addition, different therapists had vastly different initial RC scores, which can range from -100% in a single session (meaning a complete elimination of symptoms)  to +100% in a single session (meaning severe worsening.)

Sadly, because all patient or therapist identifying information was removed to protect identities, I had no way of letting the therapists know their skill levels!

But today, we are joined by a therapist who had the guts to calculate his RC in ten patients to see how he was doing.

He was initial incredibly demoralize with his percent reductions (RC) of 45% for depression and 47% for anxiety in 50 minute sessions,  He reasoned that a 44% in a class would be a failing grade, but I pointed out that this isn’t the right comparison. After all, if you had a contract to build the Brooklyn Bridge, and could complete nearly half of it in 50 minutes, you’d be doing something incredibly amazing.

Kevin's Depression and Anxiety Recovery Coefficient Calculations
    Depression Anxiety Empathy
Before 6 14 20
After 3 1  
% Change -50.00% -92.86%  
    Depression Anxiety Empathy
Before 5 6 20
After 1 3  
% Change -80.00% -50.00%  
    Depression Anxiety Empathy
Before 12 10 20
After 9 9  
% Change -25.00% -10.00%  
    Depression Anxiety Empathy
Before 10 5 20
After 5 3  
% Change -50.00% -40.00%  
    Depression Anxiety Empathy
Before 5 9 18
After 3 5  
% Change -40.00% -44.44%  
    Depression Anxiety Empathy
Before 18 15 20
After 10 9  
% Change -44.44% -40.00%  
    Depression Anxiety Empathy
Before 14 12 20
After 10 6  
% Change -28.57% -50.00%  
    Depression Anxiety Empathy
Before 2 9 18
After 4 5  
% Change 50.00% -44.44%  
    Depression Anxiety Empathy
Before 2 1 20
After 0 1  
% Change -100.00% 0.00%  
    Depression Anxiety Empathy
Before 6 5 20
After 1 0  
% Change -83.33% -100.00%  
    Depression Anxiety Empathy
Recovery Coefficient
  -45.13% -47.17% 19.6

And indeed, Kevin’s scores actually showed he was outperforming all the published outcome studies on depression by a factor of several hundred. Which was, I think, a well-deserved pleasant shock to his system! I’ve always had tremendous admiration and respect for Keven because of his obvious great skill and intelligence combined with world-class compassion and humility.

In addition, patients complete the Evaluation of Therapy Session (ETS) immediately after the session, and rate the therapist on Empathy, Helpfulness, and other crucially important dimensions. Kevin’s Empathy score was 19.6 (96.5%), indicating near perfect empathy ratings from his patients. This is extremely impressive, since most therapists get failing Empathy scores from nearly all of their patients when they start using the ETS scales.

However, what was really cool is that Kevin brought the Daily Mood Log he prepared prior to the podcast. As you can see if you check the link, recording his intense negative feelings and self-critical thoughts when he initially completed his calculations. This helps to explain the fear that so many therapists—nearly all—feel when it comes to being accountable for the first time in the history of psychotherapy.

Here's what he was telling himself:

  1. I’m not doing well enough.

  2. I’m fooling myself.

  3. I’m letting my patients down.

  4. I’m a fraud.

  5. I should be better.

  6. I should charge less.

  7. I suck!

During the podcast, we used some TEAM-CBT to deal with these concerns live, in real time, using Positive Reframing, Identify the Distortions, Examine the Evidence, and Externalization of Voices to smash these thoughts.

If you’d like to see the Positive Reframing Table he brought to the session, you can check here.

In Kevin’s case, the RC calculations, which are simple and only take a minute, gave him a huge gift—the confirmation of his immense technical therapeutic skills as well as his empathy.

But what if you’re not like Kevin, and you discover that your RCs are not so great, and that your Empathy ratings are in the failing range. Isn’t that kind of terrible?

Well, it depends on how big your ego is, and how motivated you are to improve. I’ve gotten plenty of horrible ratings on the ETS, and have had lots of sessions with poor outcomes, including sessions when I wrongly believed I was doing a great job. It DOES hurt.

But over the years, my patients have dramatically shaped my therapy approach, and have become my greatest teachers by far. I now enjoy pretty tremendous outcomes with the vast majority of the people I treat, but could never have improved without the constant feedback.

Psychotherapy skills are a lot like athletic workouts, and they say, “no pain, no gain.” This is definitely just as true for shrinks.

Are you a shrink? Do you have the courage to check out your skills?

Here are a couple more random comments. Over the years I’ve seen the scores of many therapists in training, and many established shrinks in the community. And sometimes I’ve been surprised that some of the big name, flashy people were actually very unskilled in real therapy situations.

And I’ve also seen that some of the giants of our field, were humble, kindly individuals, like Kevin, who were quietly working miracles, but not even realizing it.

And I also had this brainstorm. If you’re a patient, and your shrink refuses to use the BMS and ETS, for whatever reason, you could take the test prior to and after each session, and calculate your therapist’s Empathy Scores and Recovery Coefficient scores.

Mmm. I am thinking there might be a business model in here somewhere! Like a website where you could take the tests and get all the calculations automatically. And maybe that type of information could be published...

After all, wouldn’t patients LOVE to have this information BEFORE going to a new shrink for treatment. And isn’t that EXACTLY where our field should be moving? Accountability and transparency?

I hope you enjoyed meeting the incredible Kevin Cornelius today. Thank you for listening and supporting our Feeling Good Podcasts!

Warmly, david