Friday, August 31, 2012

Get it right from the wolf's mouth

Photo by Tambako the Jaguar.
There are many good reasons (honest!) that I haven't posted here in so long, but the best of them is that I've been working on a spanking new blogsite, The Mouth of the Wolf. It's the home to two new blogs: Positively Kick Ass (for anyone who suspects that "nice" is overrated) and Animal Exuberance (for anyone whose fascination with life & love spills beyond the human realm - but not like that).

What does this mean for As Good As I Wanna Be? A relatively quick and I hope painless demise. I'll be raiding my archives for a few good posts (the open letter to Buck Brannaman already has a new home), and soon shutting this site down, doing my bit to clean the virtual streets.

Thanks to all whose curiosity led them here - I hope you'll take the leap with me into the mouth of the wolf and possibility unknown!

Friday, July 6, 2012

Did someone say spiritual?

Be here now.
The subtitle of this blog makes a promise that I haven't yet delivered on. Lots of intellectual adventure, very little direct reference so far to spiritual practice. (Scattered intimations at best.) I feel much less sure there, and so more vulnerable. But I think about the spiritual side of this enterprise a lot, and I must have intended it to become part of the blog eventually, or I would never have floated that particular balloon.

Just to get the obvious question out of the way, I'm not in any formal way religious, despite a strong, lifelong impulse toward wonder and reverence. I don't believe in any God/god/spaghetti monster/sentient guiding power. I revere life in all its mess and mystery as a holy accident. I'm grateful to be here, as long as that lasts, and I do sometimes wish I had a ready basket where I could gather the fruits of my gratitude. But none of the baskets on offer seems big enough, and humans usually figure much too prominently in the weaving for my taste. I don't think my individual life has any absolute or ultimate meaning, but I'm determined to make it meaningful by my own limited terms. After the late philosopher Richard Rorty, I believe that morality has only one more or less solid foundation: it rests on our intimate recognition that other beings suffer like we do and on our corresponding desire to lessen their suffering with our own. That is to say that my moral touchstone is compassion (which literally means "suffering with").

Rorty goes beyond the more literal forms of suffering to include humiliation, and I agree with him that compassion encompasses a tender concern for others' dignity and integrity. In the human case, Rorty strongly associates dignity with the ability to tell (and retell and revise) one's own story; I'm very interested in how other creatures might experience a sense of narrative, how they might perceive themselves as the heroes of their own lives. While the mirror test demonstrates a highly explicit (and rare) form of self-consciousness, there's abundant evidence that many animals (like dogs) who "fail" the mirror test nevertheless maintain and protect a sense of self (who I am, who I am not, the things I do, the things I don't).

As a teacher and trainer -- by definition someone who aims to alter other creatures' behavior -- I'm especially interested in and alert to self-consciousness as a force of resistance. The more precious we hold our ideas of ourselves, the more brittle they tend to be, and the more difficult learning becomes. (Dr. Carol Dweck gives a revelatory description of this phenomenon in her book Mindset.) So teaching becomes a balancing act between breaking down barriers to growth and honoring the self-protective impulse that established those barriers in the first place. And I try always to remember how incredibly fucking presumptuous the whole enterprise is, whether I'm working with people, dogs, or both. Who appointed me the Mistress of Change? My students did, I'd best not forget, and they can rescind that promotion anytime they choose.

So I've got to be present. I've got to attend to what's here, focus on what someone needs from me rather than on what I've got to prove. And that takes some serious discipline - more than will ever come naturally to me. Thus the need for practice. Lots and lots of practice.

Wednesday, June 27, 2012

The downside of luring a fearful dog

Here's another counter-intuitive idea, one I've taken a long time and many mistakes (some quite recent) to appreciate. I'm generally a big fan of "free shaping," a training method that marks and rewards successive approximations of a desired behavior (or, at its freest, a behavior that the dog invents). Free shaping requires patience, but it can really "light up" a dog, as it engages her initiative, intelligence, and pleasure in learning. That said, I haven't been a purist in this regard; I'll often resort (and encourage my clients and students to resort) to the use of food lures to jump start behaviors when time and/or patience are at a premium. (To begin to teach "down" from a sit, for instance, it's common to take a good, smelly treat and use it to draw a dog's nose down, then out along the floor in an L-motion.)

I'd like to take these shortcuts less often, but I haven't known them to be harmful or problematic in most run-of-the-mill training situations, as long as the lure is faded quickly and the dog kept mentally active. (Too much luring can lead to a kind of "passenger seat" phenomenon - have you ever been driven somewhere three or more times with nothing on your mind but the passing scenery and the fun you'll have when you arrive at your destination, then gotten lost when you had to drive there yourself? The same thing often happens with a dog whose focus is totally consumed by a moving treat.)

As harmless as luring generally is with a confident dog learning basic behaviors, it can backfire badly when used to encourage a fearful dog to "overcome" its fear, and I've become convinced that we should avoid it whenever possible.

The reasoning behind luring a fearful dog collapses the logic of classical conditioning (developing habits of association) with the logic of operant conditioning (developing habits of behavior). If I use the scent and sight of something delicious to draw a fearful dog toward me, my hope is that the dog will not only learn to approach what it fears (me), but also that I'll become less scary as I become more strongly associated with good stuff. In theory, this approach seems like it could be doubly powerful, but in practice it can create serious, even dangerous difficulties.

When luring a confident and physically sound dog in order to sketch out a new behavior, I'm not asking the dog to overcome anything but his ignorance of what he needs to do to get the treat he wants. Imagine instead that the dog were badly arthritic and I tried to lure him to do something physically painful. It wouldn't be surprising if the dog simply balked. Imagine that I offered a series of progressively more tempting treats, until I found the one that "worked" (a bit of steak, say), that is, the one that allowed me to override the dog's strong instinct toward self-preservation. I would not have used "force" as it's commonly understood, but it's doubtful that the dog would now be more likely to perform the desired behavior without the strong, direct temptation of the lure. And multiple repetitions of this "bargain" could well create an association between steak and pain, almost literally poisoning that source of reinforcement. This analogy also helps explain why a fearful dog, when lured, may snatch the treat, then bite the hand that fed him.

A dog riddled by pain and a dog riddled by fear share an especially strong need for autonomy; their great vulnerability naturally heightens their desire to be in control of themselves and their immediate surroundings. For a fearful dog, distance (between the dog and the object of her fear) is often the most critical variable determining her relative sense of comfort, and giving her control of that variable is often the most effective way to boost her confidence, especially if control itself is paired with other good stuff, and the feared object is the source (or the predictor) of that good stuff.

How to do this? One of the simplest and most effective methods I've found for ameliorating a dog's fear of humans is the "Treat and Retreat" exercise developed by Suzanne Clothier and Ian Dunbar. I should say "exercises," since trainers have invented many variations on the theme, but the principle remains the same: rather than luring the dog toward you (by offering the treat ahead of time and using it to draw the dog in), you reward any independent choice by the dog to approach (even the tiniest and most hesitant) with both a food treat and increased distance. My favorite way of doing this is to mark (with a quiet "yes") a dog's approach (or a lean forward, or even an inkling of interest) and toss the treat past her (gently and underhand). She has already established the distance at which she feels just safe enough; when she goes for the treat, the pressure of my frightening presence is relieved (though she may be reluctant to turn her back on me). Having moved further away, she is then set up to move back toward me to her original safe distance, a choice I'll mark and reward again in the same way.

As the dog comes to understand that she's in full control of the distance between us, and as she comes to think of me as a treat (and security!) dispensing machine, she'll draw closer at her own pace. And I will never have put her in the bind of choosing between nourishment and safety.

Grisha Stewart's BAT (Behavior Adjustment Training) extends this general approach to a variety of situations, with a strong emphasis on the "functional" reward of distance/security over the "bonus" reward of food. Its advantage over many other forms of counterconditioning (for the dog's well-being and building confidence) rests in its support of the dog's autonomy and self-control. Though for safety reasons BAT is practiced primarily on-leash, it still effectively allows the dog to choose the working distance: one of the handler's primary responsibilities is to discover and honor the dog's dynamic "zone of minimal discomfort" (as I would put it), that distance at which the dog alerts to a threat but remains capable of self-calming and peaceable choices. I highly recommend her book and videos to anyone who's not yet familiar with her approach.

Tuesday, June 5, 2012

Just extremely cool

Last night I attended a talk by Dr. Diana Reiss, a professor of biopsychology at Hunter College who has been studying animal cognition for roughly thirty years (dolphin and elephant cognition in particular). The event - sponsored by the Oregon Museum of Science and Industry as part of their "Science Pub" series - reminded me of one reason I love living in Portland: it's full to bursting with fellow (and fella) geeks! Arriving at the cavernous Bagdad Theater all of fifteen minutes ahead of time, I foolishly imagined that I'd join a warm huddle of fifty or maybe a hundred other psychology/ neuroscience buffs and dolphin lovers, to hear Dr. Reiss discuss the fine points of the mirror self-recognition test. Instead, I found myself clambering into one of the few remaining seats near the front of the theater, squeezing carefully between an assortment of knees and a line of skinny tables loaded with half-drunk pints of beer and and half-eaten slices of pizza, feeling like I'd crashed a party that was too big for anyone to mind much.

There was a lot to enjoy and a lot to learn from Dr. Reiss's mostly informal account of her research into cetacean thinking (she was there to promote her new book, Dolphin in the Mirror). She told a great anecdote (one I could swear I've heard from another trainer) about having inadvertently taught one of her subjects how to administer a time out: when she failed one day to cut the spines from the tail section of the mackerel she was using as a reinforcement, the dolphin retreated to the opposite side of the pool and waited there (watching her) for fifteen seconds, until he judged that she had registered the negative punishment. And she had - she was doubly careful thereafter to prepare the fish properly, though she did test the recalcitrant dolphin on a handful of occasions by intentionally leaving the spines on, and was given a time out on every occasion.

I also loved hearing about some of the wonderfully open-ended research Reiss conducted back in the early nineties with dolphins at Marine World Africa USA. Like many of her colleagues, she'd been continually frustrated in her attempts to "crack the code" of dolphin communication, but she knew that they were terrific vocal mimics. She decided to create a small, novel, mutually intelligible vocabulary by pairing some easily imitable but previously meaningless whistle patterns with meaningful objects: prized toys. One thing that was especially striking about her approach (and doubtless contributed to the success of the research) was her prioritization of choice and control for her subjects. She created an oversized keyboard with symbols that she'd already determined the dolphins could easily distinguish. When a dolphin pressed a key, it elicited a specific whistle and a specific toy: the dolphins chose their reinforcers, and each reinforcer became associated with the sound as well as with the symbol. As she had hoped, the dolphins started using the "words" for their preferred objects, often repeating them while at play. More remarkably, they invented compound terms ("ball-hoop") that they would use only when they had both objects in their possession. Reiss had built a pause into the keyboard, so that even when keys were pressed in quick succession, the two whistles never overlapped; thus the dolphins' neologisms went beyond mere imitation and association.

More wonderful than any of this, however, were Reiss's video clips of dolphins in a state of narcissistic bliss. I've talked in earlier posts about the mirror self-recognition test and the stubborn skepticism in some corners about whether it demonstrates true self-awareness. Can anyone watch this enchanting video and remain in any doubt?

Sunday, May 13, 2012

Follow the follower

All this horse talk (my open letter to Buck Brannaman continues to draw more readers than any other post here) sent me back to Jane Smiley's novel Horse Heaven, an intimate, multivocal conjuration of the brutal and beautiful world of thoroughbred racing. I'm curious to know whether people who know horses and horsepeople find it as persuasive as I do... Reading this passage last night gave me a thrill of recognition, as Smiley describes the ebb and flow of "leadership" that's possible between two skilled and supple animals:

"The noise was incredible -- hooves pounding, horses breathing like the roar of a high wind, jocks talking and calling -- and the whole time Justa Bob held Roberto's hands with his mouth, steadily and calmly. Now they were on the second turn. Roberto found himself wondering whether Justa Bob would chose to go wide or slip through the hole between the number-three horse and the number-two horse, and then, when he realized that it was supposed to be him making the decisions, maybe, Justa Bob chose the hole, and threaded that like a needle... Now Justa Bob began to close on the leader, a chestnut with a long silky tail that gleamed in the early-afternoon sunshine. Roberto could feel his horse gauge the distance and put on more speed, but Roberto didn't quite know whether to trust the horse's judgment. The chestnut's jockey was really riding -- going for the whip, yelling -- and the red horse was responding. But this was Roberto's first race; he literally didn't know what to do, so he went with his instincts -- just do the thing that feels the most delicious -- which in this case was to let Justa Bob take care of it. Now the animal's brown nose was at the other jockey's knee, then at the other horse's shoulder, neck, and head. The wire was upon them, and just then Justa Bob stretched out his nose and stuck it in front of the chestnut's nose. Three strides after the wire, Justa Bob was already pulling himself up. He cantered out calmly, turned without being asked, and returned to his groom, who said, "Hey, fella. No extra effort, huh?" Behind them, the tote board was flashing 'Photo Finish!' and so there was plenty of time to be taken. But Roberto had no doubts, and neither did the groom. He said to Roberto, with a laugh, 'This guy likes to give the bettors heart attacks, that's for sure. He is such a character.'

Roberto said, 'That was so much fun. Does he always make the decisions?'

'Always does. He does it his way or he doesn't do it at all.'

'I can't believe he doesn't win every race. He seems to know how.'

The groom shrugged, and now gave Roberto the best lesson of his life as a jockey. He said, 'Some jocks can listen and some can't.'"

Beautiful. The one question I asked Buck directly at the clinic I attended was about his description of the ideal rider as an "enlightened monarch." Given how few of us were perfectly enlightened, I asked, was there room in his philosophy or methods for honoring the horse's often superior knowledge, for rewarding a choice the horse made when it wasn't the rider's choice but was the choice that kept both horse and rider safe? The question got a laugh out of Buck, and he admitted to having occasionally led his horse to do something dumb, but, no, he said, the most important thing is for the rider to remain in charge. This was a disappointing answer, and optimistically I hope maybe a less than honest answer, the one he thought we all needed to hear. "I'm in charge" is a common human refuge when we're confronted with intelligence and/or wisdom that exceeds our own.

Monday, April 30, 2012

Partners at the dance

Less Cajun, more surrender.
More years ago than I want to count, when I was single and still living in California, Cajun & Zydeco dancing briefly became a mainstay of my nightlife. I wasn't looking for love on the dance floor -- in fact, I made it a rule not to date, kiss, or otherwise entangle myself with anyone I met there, and I broke that rule only once (to my ensuing regret). I didn't have any firm ideas about what I was looking for when I first attended a lesson at Berkeley's Ashkenaz Community Center (still going strong, I'm happy to see), but I found a lot more than I could have guessed I would.

For any gal raised proudly tomboy and feminist, partner dancing presents a bit of a quandary (at least when practiced conventionally with a male partner). The whole notion of following a man's lead had been anathema to me for most of my conscious life, so I really wasn't prepared to enjoy it so much. Once I'd achieved some rudimentary competence in the two-step and waltz, I was enchanted to discover how much a good partner could buoy my sense of my own skill and grace, as if I were borne up by the depth of his experience for the duration of the dance.

"Surrender" had always been a dirty word in my book, its uncounted pleasures all guilty and corrosive to self-respect. So I thought. But I felt undeniably that I became stronger, more wakeful, and more alive when I left a precious scrap of my will draped with my sweater over a metal folding chair at the edge of the dance floor. I also became a better dancer, as I floated from waltz to waltz until a clumsy partner grounded me again.

It's an old story, I know, often told in more explicitly erotic terms. Or religious ones. But I'm interested in it here as a story of education, a story of how learning often happens independently of (or even in conflict with) reasoning, of how it often happens in the relationship between bodies, of how touch can carry a current and a lesson at once. I'm interested in what separates leadership from brute coercion and domination -- I want to identify or at least to explore the circumstances that encourage and honor the free choice of one creature to follow another, particularly in the absence of language.

What separated the good partners from the bad wasn't a simple matter of skill, though that obviously played a critical part. A leader can't lead unless she's got some idea of where she's going and how to get there. But some of the most technically skilled dancers I encountered were also some of the most painfully obtuse: they had ideal dances mapped out in their heads, and if I failed to trace the Cartesian coordinates they'd laid out, they communicated their resentment clearly in the unforgiving stiffness of their carriage and the hard masks they made of their faces.

The best leaders were the most supple, in their bodies and their minds. Their strength had great give to it: they responded intuitively to my limitations and made inspired use of my heretofore untapped ability. Fundamentally, what made their guidance so generous was their native or learned respect for the creative power of resistance. Their respect for my resistance in the moment was precisely what allowed me to place myself willingly in their capable hands. My favorite partners were attuned to the quality and timing of my hesitations, and these shaped the dance as surely as the quality and timing of their pressure. They knew and led me to understand that some forms of surrender -- negotiated and conditional -- can be quite literally uplifting.

If you've ever seen a couple dance without resistance, you'll know it's an ugly mess at best. The follower either falls into the leader or keeps a careful, mechanical distance from him, the better to avoid getting manhandled. (I don't mean to push the gendered element in this too hard -- I'm guessing it's no fun getting "womanhandled" either... but maybe I better stop there.) As much potential influence as a follower has on the dance, the terms of its unfolding are set by the leader: like 'em or lump 'em. It doesn't take too many dances before you can sense at the first touch whether you've signed on for three minutes' duty carrying your partner's spun-glass ego -- or for sailing into waters unknown with a game and ready companion. One who knows what it means to "give good weight."

So what does all this have to do with training? Or with the serious limitations of behaviorist vocabulary in helping us to rethink and refine our practices? Forget the science for a moment, and tell me from your own experience: can we use literal and/or figurative pressure in respectful, creative, mutually life-affirming ways? My own governing assumption is that learning simply doesn't happen in the absence of all pressure (as Jean Donaldson puts it, no motivation, no training), but that may not be your governing assumption. Pray tell, et vive la résistance!

Friday, March 16, 2012

Prelude to the dance

here goes nothing...
As a relatively recent convert to the usefulness of a behaviorist perspective in descriptions of learning, I don't feel strongly wedded to the concepts or vocabulary that Skinner proposed so long ago, as resilient as they've proven to be. My appreciation for them is almost exclusively pragmatic: as long as the behaviorist lens serves my aim of unfolding my own latent strengths, making the best of my weaknesses, and helping other creatures to do the same, I'll hold it happily to my eye. But the moment it threatens to obscure the view, I'll toss it.

I'm fickle that way. When I was a theatre scholar (a role I never wore all that convincingly), I loved the idea of "interdisciplinary" study, and I delighted in conversations that spontaneously transgressed the many boundaries - essential, methodological, temperamental - dividing scientific from literary culture (to borrow C.P. Snow's categories). But formal efforts to close the gap seemed almost invariably to encourage the contempt for "fantasy" that's endemic among scientists and academic fantasists (i.e. literary types). Humanities departments are rife with relevance envy, and many of their faculty are eager to prostrate themselves before every promise of effectuality: you mean I might finally say something, do something that touches the world? Wow, hey. Some expunge the embarrassment of being mere doodlers and dreamers by becoming utterly prosaic (and untrained) scientists. Others eventually take up dog training. Ha.

I mean to say that I'm not immune. I caught the neuroscience bug early, and I got excited a few years ago when the contagion spread among my theatrical cohorts. But nothing quashed my enthusiasm like hearing the moderator of a conference seminar sternly remind us that the terms in play were technical, highly specific, and not to be fooled with in any loosey-goosey metaphorical way. Or hearing a director marvel about how wonderful it would be when she could attach electrodes to her actors' heads and discover what a sense memory really was.

Who's going to speak up for the reality of subjective experience if not for the dreamers and fantasists? What can scientists learn from us - why should they suppose we have anything to teach - if we surrender the stage before the play begins? Loose, sloppy, idle, playful, inexact - these are just some of the many strengths of literary culture. We cavort under the banner of "Not Quite." We spill ambiguity and uncertainty in our messy wake. That's our job, and it matters. Big time.

All this because I want to insist that science (generally) and Skinner (specifically) should not have the last word in every conversation about direct physical pressure in training. Next time!

Sunday, March 4, 2012

If you can't say something nice...

joys in dissonance?
...don't say anything at all? This question has recently felt very pressing, as I've been fortunate to get into conversation with some terrific, thoughtful people with whom I happen to disagree on a few points that are near and dear to them and to me (namely, the "proper" use of positive and negative reinforcement and positive punishment in training). Simultaneously, I've found myself resistant to one dominant (ahem!) interpretation of positive reinforcement in the community of "R+ trainers" with which I imperfectly identify. Within that community, when it comes to the negotiation of disagreement among human peers, the operating assumption for many seems to be that direct criticism amounts to a betrayal of the positive reinforcement ethos. Here, as in training situations, we are advised to reward what we like and ignore what we don't.

Insofar as this encourages us to focus more of our attention on the things we hold in common, to affirm the essential worth of the people with whom we're at odds, as well as the particular strengths in their experiences, perspectives, and arguments, this makes great sense to me both in practice and theory. In other words, I like the "reward"/reinforcement part of the equation. But I think the "ignore what you don't like" dictum runs roughshod over the ways that dialogue among contending equals differs (ideally) from even the most open and collaborative training process, which assumes superior knowledge and power of influence in one of the parties. I can attest that when I've been on the receiving end of these significant silences, I have found them positively punishing, as they resound (to my ears) with condescension. My feeling is that, yes, we should hold our tongues if we have nothing nice to say, but it's actually not so nice to end our discussions there.

This is a personal, idiosyncratic response - I realize that my appetite for modestly fractious engagement is unusually strong (maybe a symptom or cause of my theatrical vocation). And "modestly" is a key term there. Especially if the point of disagreement is a tender one, it's hard to trust that the other person won't lose his/her temper, won't fall back on ad hominem nastiness when reason runs aground - almost as hard as it is to trust myself! But I'm pretty sure that I'm not alone in craving the challenges that difficult conversations supply, or in finding them tremendously rewarding not just despite of but because of their difficulty.

So it felt like a delicious bit of serendipity to come across Richard Sennett's new book, Together, at the moment that this conundrum is weighing on my mind. I put a hold on it at the library a couple of weeks ago, because I'd loved his last book, The Craftsman, and I just picked it up today. The introduction alone is a revelation. Sennett is interested in what he calls "difficult cooperation," whether it takes the form of a musical collaboration (he was once a professional cellist), a public policy, or an online conversation. He argues that contemporary life conspires in all sorts of insidious ways to dull our appetite and skills for these demanding encounters, and that we become ever more socially fragmented as a result. I should probably read the rest of the book before trying to summarize his views(!), but here are a couple of choice bits from the first twenty pages:

"In addition to material and institutional reasons, cultural forces today work against the practice of demanding cooperation. Modern society is producing a new character type. This is the sort of person bent on reducing the anxieties which differences can inspire, whether these be political, racial, religious, ethnic or erotic in character. The person's goal is to avoid arousal, to feel as little stimulated by deep differences as possible. The withdrawal of which [Robert] Putnam speaks is one way to reduce these provocations. But so is the homogenization of taste... 'Everybody is basically the same' expresses a neutrality-seeking view of the world. The desire to neutralize difference, to domesticate it, arises (or so I will try to show) from an anxiety about difference which intersects with the economics of global consumer culture. One result is to weaken the impulse to cooperate with those who remain intractably Other."

"Reflexive, self-critical thinking doesn't imply withdrawal from other kids; children can be reflexive together. One piece of evidence [Erik] Erikson provides for this process is game-playing. At the age of five to six, children begin to negotiate the rules for games, rather than, as at the age of two or three, take the rules as givens; the more negotiation occurs, the more strongly do children become bonded to one another in game playing... the very misunderstandings, separations, transitional objects and self-criticism which appear in the course of development are tests of how to relate to other people rather than how to hibernate."

"In the performing arts, the sheer need of others can often prove a shock. Young musical hotshots are often brought up short when they begin playing chamber music; nothing has prepared them to attend to others... Though they may know their own part perfectly, in rehearsal they have to learn the ego-busting art of listening, turning outward. It's sometimes thought that the result moves to the opposite extreme, the musician blending in, submerging his or her ego in a larger whole. But sheer homogeneity is no recipe for making music together - or rather, a very dull recipe. Musical character appears instead through little dramas of deference and assertion; in chamber music, particularly, we need to hear individuals speaking in different voices which sometimes conflict, as in bowings or string colour. Weaving together these differences is like conducting a rich conversation."

Sennett's argument about the general need for more listening and less "asserting" struck a nerve with me, because it's something I recognize as a personal weakness. (Hello, fellow bloggers!) I love this passage and want to learn to live by it: "Usually, when we speak about communication skills, we focus on how to make a clear presentation, to present what we think or feel. Skills are indeed required to do so, but these are declarative in character. Listening well requires a different set of skills, those of closely attending to and interpreting what others say before responding, making sense of their gestures and silences as well as declarations. Though we may have to hold ourselves back to observe well, the resulting conversation will become a richer exchange for it, more cooperative in character, more dialogic."

Sunday, February 26, 2012

Rethinking negative reinforcement

Animals in a state of relief.
As I wrote in my last post regarding the increasingly fuzzy distinction between classical and operant conditioning, old terminology can hobble new thinking, and given how awkward the language of behaviorism was at its inception, we shouldn't be surprised to discover how creaky it has become in its dotage. (The surprise lies in its holding up at all!) The positive/negative confusion has never really cleared up for many lay training students (positive punishment? WTF?), and no term has given people more trouble than "negative reinforcement," which bundles all the paradoxes and blurred connotations of behaviorist theory into seven dry-sounding but intellectually and emotionally fraught syllables. Technically, it's negative because it describes the removal of some "thing" (which may not be a thing at all). Colloquially, it's negative because the thing that gets removed needs to be nasty or at least unpleasant in order for its removal to be reinforcing, and so the deliberate use of negative reinforcement implies (and carries the ghost of) the deliberate introduction of nasty or unpleasant things, i.e., positive punishment. That's the theoretical tangle as clearly as I can state it (not very!), and it has significant consequences in practice, as teachers and trainers line up on either side of the R+/R- divide (and take occasional potshots at each other over the crevasse that yawns between them).

Does the theory still encompass what we know of reality? Do the terms describe with satisfactory accuracy our growing knowledge of how animals learn? On the contrary, they appear to be busting at the seams. We're patching as fast as we can right now, but I think our best hope of finding our way to a new kind of coherence (to a description of teaching and learning that covers our collective butts once again) may be to pick at the threads where they're coming unraveled. To combine my canyon and sewing metaphors, these may become the ropes that swing us over the training divide. (Ack.)

Some of the most exciting work in contemporary learning theory is being done by scientists and practitioners (e.g. teachers and trainers) who dare to test the boundaries between behaviorism and humanism; between the body and the mind; between emotion and thought; between psychology, ethology, and neuroscience; between biological and historical accounts of the past; between objective and subjective accounts of the present. On the scholarly and/or scientific side, Frans de Waal, Sarah Blaffer Hrdy, Oliver Sacks, Irene Pepperberg, Marc Bekoff, Mihaly Csikszentmihaly, Alison Gopnik, Timothy Wilson, Gerd Gigerenzer, Antonio Damasio, Daniel Kahneman, and V. S. Ramachandran are some of the great "unravelers" I've encountered (if only on the page), and Jaak Panksepp seems like someone who might actually help us knit a new pattern.

But I think all of us who practice learning theory with focused intent and honest reflection can contribute significantly to the radical revision now underway, and a re-examination of the R+/R- split could be an excellent place to begin. I'm not prepared to say that, as a philosophical distinction, it's totally illusory (I'd like to tackle that question in another post), but as a scientific distinction, it may be. This is one of many places where Jaak Panksepp's work is so fascinating and potentially useful, as he's been investigating the physiological and neurochemical bases of approach and avoidance, of appetite and satisfaction, of aversion and reward. I look forward to the publication of his promised book for the lay reader, because I hope it will make his insights more widely accessible. (Temple Grandin's Animals in Translation remains the best introduction to his ideas for the general reader, as far as I know.) In the meantime, I've been making my way very slowly through Affective Neuroscience and highly recommend it despite its density. I hope I don't distort its content too badly here!

In his book, Panksepp describes a discrete number of affective (emotional) processes whose physiological coherence is marked enough that he is comfortable labeling them "systems." These are activated and expressed in more or less predictable ways by animals of diverse species, and we can guess from our common evolutionary history that there are also strong similarities in how they are subjectively experienced. Panksepp is keen to avoid Skinner's mistake of choosing his terms in opposition to common parlance, so he simply capitalizes the colloquial names for these primal emotions/processes to denote their technical use: FEAR, PANIC, RAGE, and SEEKING. While this group may appear heavily weighted to the unpleasant, the SEEKING system encompasses many varieties of pleasurable anticipation.

If I understand him correctly, Panksepp suggests that most of our strongest appetites or drives (and the emotions that accompany their satisfaction or frustration) arise from various kinds of disequilibrium. A truly safe and contented animal is an animal at rest. FEAR is activated by perceived threats to the self, PANIC by social isolation, and RAGE by constraint (especially of one's access to valued resources). The SEEKING system may be engaged when any of these other emotions is in less than full flower. When we're a little anxious, a little lonely, or a little hungry, our minds/brains are primed to seek out whatever will restore our internal equilibrium: an escape route, a friendly touch, a Hostess cupcake.

In such situations, our minds are also primed to learn, to draw connections between environmental circumstances, our own behavior, and the consequences that result from their meeting. Indeed, our capacity to learn has so many advantages for our continued survival that we are primed to find it intrinsically pleasurable. Thus the SEEKING system affords us pleasures that are largely independent from the satisfaction of consuming a good meal or the relief of escaping a fearsome predator. They're compelling enough to be literally addictive - the SEEKING system appears to be modulated primarily by the action of dopamine, and gets easily hijacked by cocaine and methamphetamine among other stimulants.

In addition, while the research remains sketchy, it appears that the (intrinsically rewarding) SEEKING system is activated whether an animal is seeking out the object of some appetitive desire (food, a mate, etc.) or seeking escape from a perceived threat.

Okay, if you've followed this far, I should finally be able to bring the conversation back around to positive and negative reinforcement and the question of whether they're entirely distinct. Once we start thinking about drive or desire in terms of disequilibrium, it becomes harder to draw an absolute line between the internal pressure of hunger and the external pressure of a bit or a leg; it becomes harder to separate the gift of peace from the gift of an apple. It becomes clear that all effective teaching necessarily "exploits" one appetite or another. And it becomes much more interesting and rich to talk about how to do so in a way that best enlists an animal's SEEKING system and taps into our shared love of learning.

I don't want to tax your patience much further in this post, but in closing I'd like to quote a couple of eloquent descriptions of expert horse trainers who supposedly sit on opposite sides of the R+/R- divide, but who clearly overlap in their ability to help other animals to flourish. I already knew I needed to learn more about Alex Kurland's work, but Cindy Martin persuaded me that I'd better do it soon. She wrote in an email, "When the dog world found clicker training, many people abandoned their leashes, vowed to free-shape everything and never touch their dogs. Well, with horses, we're bound to have physical contact. Riding is about tactile cues. Our weight shifts, we squeeze with our legs, we ask with the reins. Alex developed the idea of pressure as information, below the level of a
true aversive. So is it still R-? Probably. But if we very quickly lighten pressure, by highlighting the first approximations of a desired behavior, with the click/treat, then all these kinds of pressure can be information, simply cues for the horse. And they can still learn to work for 'the release.' In fact, the release of subtle pressure can be a low value reinforcer, once the horse gets more sophisticated, and the click/treat can highlight the especially good responses. Alex calls this process, 'Shaping on a point of contact.'"

Emma Kline attended the same Buck Brannaman clinic in Spanaway that inspired me to write my bumptious letter back in November. You can find some lovely reflections on the SEEKING system on her blog, and you can also find her poetic response to seeing Buck at work:  

"At one point Buck was talking about how extraordinary it was to be with a horse that was hunting the feel. He talked about giving the horse what it wants most in the world: PEACE. No wonder this guy doesn't need to use treats.

I could feel the lines in my forehead getting deeper as I strained to see how he was utilizing the laws of science and behavior modification with an accuracy I have rarely seen. And sure enough, he was using a marker and a reward. His marker was the release and his reward was the Peace of Feeling Together.

I think that it is very important to note that this is not a "peacefulness" that comes from robbing the horse of his sense of security or taking away the little peace he, as a flight animal, is born with. Its about adding a peace the horse didn't have before. That's when horse and human become more than what we were separately. So in fact, the release is a marker and not a reward."

Saturday, February 11, 2012

Have we outgrown our vocabulary?

A couple of weeks ago now, Professor Jesús Rosales-Ruiz (of the Department of Behavior Analysis at the University of North Texas) gave an esoteric but fascinating talk on the disappearing distinction between respondent (a.k.a. classical) and operant conditioning. By tracing the history of the terms and describing the difficulties that contemporary researchers often encounter when trying to apply them with any consistency, he exposed their contingency and fragility: while they have been extremely useful as springboards to the investigation of how we learn, they may prove not to have any real substance. They might even have brought us far enough that we can safely discard them (and move forward more easily without their dead weight). Wittgenstein once noted how many stubborn philosophical problems are in fact problems of vocabulary; we are sometimes slow to recognize when we've exhausted our terms.

But dying words (and the concepts or categories they name) have something left to teach. By looking closely at their definitional foundations, and then taking note of their specific failures vis-à-vis reality, we can identify some of the perceptual biases that made them so appealing in the first place. The lay distinction between "respondent" and "operant" has always hinged on the question of whether or not a response to a given stimulus (or set of stimuli) is voluntary, whether or not it can be brought under conscious control. But as Jesús described in his talk, even during Skinner's time, the erosion of that distinction was already underway, as physiological responses that had been considered perfectly autonomic (such as blood pressure) were brought through biofeedback under conscious control. More recently (and provocatively), challenges have come from the opposite direction, as individual cells have been observed in response patterns that mimic operant conditioning. As Jesús noted, anytime that relationships between contingencies (in the environment and behavior) grow measurably more consistent, learning is taking place. Our loyalty to the terms "respondent" (or "classical") and "operant" may obscure the complex but unified realities of that process.

Among the phenomena resistant to any simple respondent/operant dichotomy has been the tendency of certain behaviors to wander from unconscious to conscious and back to unconscious "control." We're all familiar with this dynamic as it applies to our assimilation of complex skills. The famous four stages of competence trace the general pattern, from unconscious incompetence (we don't know we can't do something), to conscious incompetence (we know we can't do it), to conscious competence (we can do it with great mental effort and focus), to unconscious competence (we can do it without effort and without conscious focus). If I'm a skilled driver, or soccer player, or surgeon, as long as the given challenge falls within the range of what is well-known to me and therefore predictable, the relationship between the contingencies of the environment and the contingencies of my behavior may be so consistent as to appear reflexive, and I will hardly have the sense that I am making a voluntary decision at any juncture. Only novelty is likely to wake me from the dream of competence and force me back into a state of conscious engagement.

"Respondent" and "operant," like "unconscious" and "conscious," may only describe different modes of energetic expenditure. The brain is a highly economical organ, a regular Bartleby when it comes to the heavy lifting required for conscious thought. ("I would prefer not to.") That said, it is much more active at an unconscious level than we generally give it credit for being.


Image by Jolyon.

Sunday, February 5, 2012

A no-brainer?

What can brown do for you?
As I've been getting ready to formally launch my people/dog training business (and to boldly go where no human or canine has gone before, split infinitives be damned), I've been seeking out advice from many corners, trying to sort and synthesize the ideas that seem most salient to my own particular enterprise. The ideal of "synergy" has become clichéd to the point of comedy, but it's worth pursuing nonetheless, particularly in this context. Given that dog training is primarily about bringing diverse desires into harmonious alignment, it makes perfect sense to extrapolate that goal out to one's business relations. So trainers ally themselves with sitters and vets and shelters and other trainers, and so we all sustain the flow of good things and the trust that follows in their wake.

Well, the muse of synergy tapped me on the shoulder the other day and whispered naughtily in my ear. Why not partner my dog training business with an escort service? Preferably one that employs men as well as women, and preferably one with an emphasis on role-playing and a warehouse full of costumes. How wonderful it would be if -- in my work with a reactive dog -- I could make one call and summon a physically imposing man in a UPS uniform, or a woman in scrubs to play vet tech? One day I might say, "Bring a dozen hats and a long, yellow raincoat." On another day, "Hey, do you still have that Dick Cheney mask? Excellent. A briefcase would be good, too."

I'm pretty sure no one has done this yet, and I think I'd better wait until my business is well enough established that such a partnership would be advantageous to the escorts, too. But anyone who wants to run with the idea has my blessing!

Tuesday, January 31, 2012

An open letter to Buck Brannaman

In the interests of greater harmony...
Like many who dwell outside the rarefied world of horses and horsepeople, I only recently became acquainted with Buck Brannaman's life and work through the beautiful documentary film Buck that was released last year and is now available on DVD. Buck gave a Q&A at the showing I attended in Portland early in the summer, and made good in person on the charisma so evident on film. It struck me immediately how much his training approach had in common with that of the clicker/marker trainers I most admired, and despite my great ignorance about horses I knew it would be worth my while to attend one of his clinics as a spectator. In late October, I traveled up to Spanaway, Washington with a firm cushion and a warm blanket and planted myself in the bleachers of the arena where Buck taught three separate horsemanship classes every day for four days. (He followed with two more for three days; his dedication and stamina are remarkable.)

I spent most of three days happily lapping up just about everything he had to say and to show about training horses, though I couldn't help remarking that he was somewhat less effective as a trainer of people. But at the end of his second session on that third day, one of his students asked what he thought of clicker training, and he could not have been more contemptuous or less measured in his response. He said he found it worthless at best, exploitative at worst. Good for nothing more than tricks. He recounted a recent encounter with a dangerously spooked steer and joked that a clicker trainer "couldn't click fast enough" to handle such a situation.

Well, that got me riled. And when I'm riled I write. A few days after returning home from Buck's clinic, I sent him an eight-page letter detailing all the reasons I was convinced that a) he was already a "clicker trainer" and b) he could be a better one. I would probably not post it here if I had heard back from him, and I am hesitant to do it now, but I don't know whether he's still trashing the people with whom he should be making common cause, and I'd love to jump start the dialogue that might bring us closer to mutual understanding. As I think I make clear in the letter, I admire Buck a great deal, but I think in this instance he's using his influence to real potential harm. I also realized that this letter represented my own most focused attempt to articulate the power and promise of clicker/marker training. (I regret that my summary of its history contained a couple of significant inaccuracies. I have let them stand here in the interests of fair representation of my own fallibility, but apologies are due to the memory of Keller Breland.) Anyway, here it is:

November 4, 2011

Dear Buck,

First and foremost, I want to thank you. I attended one of your recent clinics in Spanaway as a first-time spectator. Even from that remove, I learned more than I could have hoped, and I left powerfully inspired to put that learning into practice. I should say that I am not a horsewoman in either the casual or the proper sense of that term. I came to your clinic because I have a passion for clear communication between individual creatures who may not be of the same species, a passion I have so far exercised primarily as a writer and as a teacher of humans and dogs. I’ve spent about fifteen years teaching the first (high school, college, and adult students), only about two teaching the second (that is to say, only two with focused intent and the least little bit of efficacy). I guessed that I could learn a great deal from you in spite of the gap in our immediate interests, and I did.

One of the things that impressed me most during the clinic (and contributed immeasurably to your credibility) was your frequent reference to the limits of your own knowledge, your insistence that you still have and will always have more to learn. On a few occasions you expressed your well-founded disgust for people who get ahead of themselves, people who speak in tones of false authority on subjects about which they know next to nothing. (In my experience, next to nothing is often more dangerous than nothing at all when it comes to degrees of ignorance.) I would not have taken you for such a person, when you have generally been so careful to build your authority on a solid foundation from the ground up. So I was sorely disappointed and more than a little angered by your casual and insulting dismissal of clicker training in response to a student question on the third afternoon of the clinic. You made it clear from your comments that you know next to nothing about it, and yet you felt entitled to use the authority you have earned in other ways to trash the devoted work of people who might otherwise be your natural allies. You know only a caricature of clicker training, only the crudest sketch, and that’s the picture that may now persist indelibly in the minds of some of your students because you momentarily and uncharacteristically abdicated your responsibility as a teacher to know whereof you speak.

Imagine that someone who’d seen the film The Horse Whisperer considered himself competent to judge your methods and principles, to get on his mike and tell an arena full of people, “Oh that Buck Brannaman, what a load of mumbo jumbo. If you want to whisper to your horse, you go right ahead, but if you actually want to get something done...” Hell, you probably don’t have to imagine it. I’d bet you’ve heard it many a time, and I’d bet it pissed you off every time. I’d further bet that you’d hate to expose yourself for the same kind of fool, so it pains me to be the one to tell you that your pants were on the ground the other afternoon. But I’m hoping that this is what we both might call a teachable moment. I hope I can teach you enough in a few pages about clicker training that the next time someone asks you a similar question you don’t get yourself caught in a cranial-anal inversion but maybe pause long enough to say, “You know, I need to learn more about that before I can really judge whether there might be something to it.”

The telegraphic leash

Keep a float in your line...
One of the Clicker Expo presentations that I found most interesting and valuable was given by Michele Pouliot on "The Right Touch." Michele is determined (hooray!) to reclaim the leash as a tool for training and communication rather than simply for management, and she's demonstrating more generally that there are ways to employ contact artfully, informatively, and positively. As I told her after her talk, I'd been quite literally feeling some of this stuff out for myself over the last six months or so, inspired in the main by Buck Brannaman's work with horses, by his emphasis on finding a "soft feel" and leaving a "float" in the rein, and by his further emphasis on the importance of developing sensitivity in the horse and the rider so as to make the rein a conduit of information in both directions. I thought there was no reason that a leash couldn't function similarly, and I'd found through trial and error that it very much could. (Of course, the idea that collar pressure -- like bit pressure -- can be communicative is hardly a new one, but the messages people have sent by leash have typically been blunt and unpleasant. The idea that light pressure might be converted from an aversive to a conditioned reinforcer is, I think, novel.)

Michele has been much less clumsy in her efforts, and she gave all of us at her talk a simple, clear, and efficient method for flipping our dogs' conception of pressure (and our own), from oppositional force to welcome invitation.** As she mentioned, there had been some trepidation on the part of the Expo organizers around her presentation of her process, given that it relies on negative reinforcement to get rolling, but I can say with absolute conviction that her method could have saved my dogs a great deal of annoyance if I'd been acquainted with it earlier. And even having muddled my way to a rough approximation of what she's doing with the leash, I am better able now to refine my techniques intelligently (and to expand them into similar work with hand to body contact). I can more easily move forward thanks not only to the clarity of her approach but also to the intellectual and moral affirmation I took from noting its overlap with my own nascent ideas. Out of respect for her care in presenting the specifics of her method, I'll wait to describe them here until I've had a chance to review her notes, but I think they should be disseminated widely, as I'm convinced that they have the potential to reduce the use of negative reinforcement significantly. As long as we use leashes primarily to contain rather than to communicate, and as long as we labor under the misconception that the signals we send each other across the line must necessarily be aversive, we miss a great opportunity to get in better touch with our dogs.

** It's probably no coincidence that Michele is a champion "freestyler," i.e., she dances (beautifully) with her dogs. Anyone who's done much partnered dancing can readily understand how this mode of training is analogous to "giving good weight," and can also guess how seamlessly it might integrate with other vital forms of kinesthetic awareness and communication.

Photo by George Grall.

Monday, January 30, 2012

I love you, dammit!!

Arktomorphism?
I just spent the weekend in the company of a few hundred trainers and a smattering of scientists at the annual west coast Clicker Expo, organized by Karen Pryor and her skilled cohorts. My exhaustion last night spoke to the quality of the program and the liveliness of the other attendees -- it's good to be reminded in a training context of how much energy the brain consumes when it's fully engaged!

There were many ideas and provocations I encountered in the ballrooms and hallways of the Doubletree Hotel that I want to return to, things I'll need to gnaw on for a long time before I can digest them. What looks most temptingly chewy this morning, however, is a question that was posed to me by a fellow trainer yesterday morning. I had volunteered with a dozen or so other KPA graduates to offer a little coaching to interested parties (two sessions of twenty minutes apiece), with donated proceeds going a local charity. We worked in pairs, and it was unfortunately toward the end of our first session that our "client," whose dog was not with her, described how he would often growl when he lay on his bed and she approached and pet him. What should she do?

I really regret that our next client was waiting and we weren't able to give the question the attention it deserves, because it's loaded. Personally, emotionally, and theoretically. I didn't get any further than remarking that the dog was telling her something that she'd be wise to respect, which might have been a fine response if I'd had time to elaborate it, but was surely too brusque given the circumstances. My partner did better, noting that the dog was a terrier, asking whether the dog followed her hand when she withdrew (yes), and suggesting that the dog might be experiencing a conflict of intent: to roughhouse or to cuddle? But we had to leave it at that.

On the theoretical side, this presents as a relatively straightforward matter of strategic reinforcement, and I hope the woman with the terrier found her way later that morning to Ken Ramirez's excellent lecture, wherein he explored the promise and perils of working with secondary reinforcers, those things (not always tangible, sometimes experiential) that accrue value only by their association to other things that satisfy an animal's strong intrinsic needs (i.e. primary reinforcers). Is gentle touch a primary reinforcer? Considered broadly, for slow-developing, social mammals, it does appear to satisfy an intrinsic need, especially early in life. (Harry Harlow's poor rhesus macaques demonstrated this most tragically and persuasively.) But touch is critical at that early stage in part because it is instructive: a mother's or other's tactile tenderness teaches us what kind of touch is safe, and when. Squirming, jostling littermates and human carers contribute significantly to that education in the case of most dogs. Physical intimacy is double-edged for all of us: it has the simultaneous potential to be terribly harmful or deeply rewarding. So each of us necessarily becomes a connoisseur of touch, highly idiosyncratic in our taste for different varieties of contact.

As Ken noted, in the practical life of a trainer or pet owner, the need to draw any distinction between primary and secondary reinforcers is not nearly so pressing as the question of whether something is reinforcing at all. The question for the woman with the terrier is not whether her dog has a primal desire for touch, but whether he wants to be touched by her, in that way, in that place, at that moment. His growling suggests that he does not. Which does not mean that her desire to touch her dog in such a way under such circumstances must remain forever frustrated, only that she needs to teach her dog to enjoy it. Or risk getting bit.

There are many people who see these (sometimes irresistible) urges to kiss, hug, and cuddle our pets as yet another dangerous form of anthropomorphism. This is true to the extent that our species-typical touch repertoires do not everywhere overlap, and we need to be attentive to the places where they typically diverge. But when we're talking about an individual human and an individual dog (or cat or monkey or whale or other human), knowledge of what is typical may not only be immaterial, it may also be distorting. There are quite a few of us humans who find hugs from most people in most contexts highly aversive. Some find them aversive from all people in all contexts. Can we be shaped to enjoy them? Most of us, probably. But the more often we get hugged when we do not want to be hugged, by people who just want to show us how much they love us, the less a hug will communicate that professed love, and the more likely we'll be to interpret it as invasive and aggressive. As someone who should really know better, I am sorry to say that I think I inflicted an unwanted hug on someone this weekend, and the sincerity of my affection had no bearing on the question of whether it was rewarding for the victim. I "anthropomorphized" her, insofar as I made the narcissistic assumption that my desire to hug her was mirrored by her desire to be hugged.

Animals do this to us, too, as we'd be wise to remember the next time we get leapt on, slobbered over, or humped. My husband has a pair of black running tights that we've taken to calling his "sexy pants," because they drive our boy Pazzo into an amorous frenzy. (Perhaps not coincidentally, Pete vaguely resembles Pazzo from the waist down when he wears them.) Pazzo is clearly sincere in his passion for Pete, but the very force of that passion makes him insensitive to the question of how best to express it.

Friday, January 27, 2012

Calm before assertive

I recently picked up Cesar's Rules, Cesar Millan's newest book (co-written by Melissa Jo Peltier), and dug in with interest and a little trepidation. Like many who shelter under the "positive trainer" label, I have strong misgivings about Millan's methods and influence, misgivings inspired partly by the handful of his shows that I've seen and the smattering of his articles that I've read, but in the main by the multitude of people I've encountered who claim him as an authority in their efforts to become "leaders of the pack." In Cesar's Rules, Millan laments that many of his critics lambaste him without taking the trouble to understand his teachings, but I think he should worry at least as much about those who lionize him without taking the trouble to understand his teachings, or more importantly, without mastering the knowledge and skills that would enable them to employ his methods with relative safety. And I remain deeply skeptical that certain of his methods can be used by anyone with absolute safety.

Watching The Dog Whisperer makes it clear even to this critical observer that a) Millan is a highly skilled communicator and listener, b) he has amassed a great deal of informal knowledge about dogs, and c) he genuinely desires the best for all the animals (human and otherwise) with whom he works. Artful editing may give a fairy tale glow to each abbreviated narrative, but I don't think it can mask Millan's essential character, and I have never sensed that his use of strong aversives was an expression either of sadism or of an ego run amok. I bought Cesar's Rules for much the same reason that he says was inspired to write it: I think it is vital that people who share similar core values and aims find a way to air their differences and to learn from them. Many of the book's chapters center on other trainers, including a couple of heroes from the positive training world, Bob Bailey and Ian Dunbar. Elsewhere, too, Millan goes out of his way to express respect, and at moments even deference, toward views that conflict with his own.

Beyond that, I have been impressed while reading Cesar's Rules by what may or may not be a new emphasis on patience. Not having read Millan's other books, I don't know whether they supply a similar corrective to the implicit promise his show makes that "calm and assertive" leadership will produce near-immediate results. But it is striking here in his anecdotes and instruction how often he stresses the importance of baby steps. He has generously (and to his own benefit, of course) highlighted and disseminated the wisdom of other trainers, but I've also found myself nodding along with many of his personal insights. His stated desire to honor each individual animal is at the heart of my own philosophy of training (again, whether we're talking about canine or human animals).

Which brings us back to the questions surrounding "assertive" leadership and the use of strong aversives (or "positive" punishment). To Millan's credit, he acknowledges and makes a good faith effort to hear and faithfully represent the criticisms leveled against this aspect of his teaching. As I noted above, I think Millan's message is dangerous primarily for the encouragement it gives to those who lack his skills and understanding. When such people "assert" themselves with their dogs, they often become abusive and/or teach their dogs to be similarly "assertive," and the results can be disastrous. Millan quotes Ian Dunbar on this risk: "I teach mostly noncontact techniques, and there's a good reason for that. Most human hands can't be trusted... It's one thing if you're an experienced animal handler like you or me, 'cause you know which animals you dare touch and how you can touch them. The training methods that I would prescribe have nothing to do with the way I would train a dog or you would train a dog. It has to do with the fact that this is a family and there's two children in it. They're not necessarily going to have the observational skills that we have, or the speed or the timing, and certainly not the dog savvy. But they still have to learn to live happily with their dog."

I think Dunbar lets Millan off the hook a little too easily here, as I don't imagine there exists any great gap between how either man teaches others to train and how he trains dogs himself. And that's really the point. In his defense of e-collars, Millan enlists Temple Grandin to support his point that a strong aversive may be the most effective way to interrupt the prey drive at its highest intensity, and indeed it may be the only efficient way to do it. I'm grudgingly open to the arguments he makes for their careful use in special circumstances where a dog's safety is at stake and other solutions elusive. But I think (I hope) that, once Cesar opens the door to exclusively positive modes of training, he'll have an increasingly difficult time resorting to (and justifying) the regular use of leash "pops" and other physical corrections. Once you recognize that they're unnecessary to pretty much any training (and rehabilitation!) task you might face, and once you see the enormous uptick in mutual trust that results from a strong commitment to a "no harm, no force" ethic, you may need time to shake your old habits, but the logic of love says you must.

Wednesday, January 18, 2012

If dogs wore shoes...

Really??
...we'd more easily walk a mile in them. But most don't, and those who do don't look happy about it. Our relationships with our pets are wonderfully peculiar, as the ties that bind us braid together intimacy and alienation. This is true to a degree of all relationships (between dogs, between people, and certainly between cats), but when we extend our interest and care beyond the bounds of our own species, we seem sometimes to find more direct access to each other's emotions than we ever enjoy with our nearer kin. At those very moments, however, we may also be struck by the other's unfathomable otherness.

I think we need to sustain and not to collapse the tension between these simultaneous truths -- "we understand each other perfectly" and "we don't understand each other at all" -- if we want to flourish together. More, I think we should celebrate it. In the history of our relations with other animals, and particularly in the history of our domestication of other animals (and their domestication of us!), views have tended to swing from one pole to the other, from the conviction that other animals exist only as extensions of human need (or of human fear, as in the case of the benighted wolf) to the conviction that they exist utterly apart from us. Wittgenstein's oft-quoted aphorism captures the latter belief nicely: "If a lion could speak, we couldn't understand him." Likewise, Thomas Nagel's famous (and to his mind impossible) question -- what is it like to be a bat? -- encourages an all-or-nothing judgment on the possibility of shared experience. But otherness is always radical, and subjective feelings of connection are always an objective illusion. (Or rather, the connection itself is illusory, though the feeling would probably show up on a brain scan.) We have no direct means of access to any other being's perception of the world, no matter the species, so unless we wish to retreat into lonely solipsism, we have to make do with indirect means and earnest approximations.

With that limitation in mind, we have good reason (founded on objective evidence) to suppose that, in many ways, our pets' and other animals' emotional and cognitive experience strongly resembles our own. The speaker whose talk I'm most excited to hear at the upcoming Clicker Expo is Jaak Panksepp, the neuroscientist who holds the Baily Endowed Chair of Animal Well-Being Science at Washington State University (wonderful that there should be a chair so endowed). He is one of a small (but happily increasing) number of scientists who dare to emphasize the obvious homologies (common structures with common origins) among diverse animal minds, especially among the minds of humans and other social mammals. (I use "minds" advisedly, as Panksepp is interested in subjective as well as scientific modes of inquiry and description.) He is also leading research into homologies that are not so obvious, teasing out the physiology and chemistry that underlie those brain processes that we hold in common (and variations that we do not). His book Affective Neuroscience is a marvel. Densely technical in places, it nonetheless serves both as an excellent overview of contemporary research into the dynamics of primary emotions (including their influence on cognition and learning) and as an eloquent, richly speculative description of the big questions that remain.

Friday, January 13, 2012

Marker training basics III

what next?
Strengthening the marker's power.

Once you've established an association for your dog (or other animal) between the sound of your chosen marker and some valued reward, you can begin to use the marker to identify and encourage any and all behavior you like. If you have a totally untrained young pup, you might mark and reward a moment's quiet in an outburst of barking, then the next moment, and the next, until you find that the moments accumulate into longer spells of sweet silence.* Moments of eye contact are another great place to start with puppies and many full-grown dogs: everything you do in training will be built on a foundation of focused attention, so make it as wide and deep as you can. Don't worry at first about attaching cues to these behaviors. Saying "quiet" before your dog has arrived at a solid physical understanding of what quiet is will only create needless frustration for you both. And saying "QUIET!" will probably convince him that whatever he's barking at is even more threatening or exciting than he thought, since you're suddenly barking too.

If your dog already performs one or more behaviors pretty reliably when you ask for them, you could begin simply by marking correct responses to your cue. What's correct? For now, whatever it has been in the past. If your dog habitually responds to "sit" by backing up a couple of steps and settling lazily onto one haunch while sticking his other back leg out to the side, you know that's his definition of the word. Yours might be different, but for the moment you can set aside the task of bringing the two definitions together. Mark and reward every sit that follows your "sit," no matter how slow, no matter how sloppy. (You may find the sits get quicker and straighter in spite of your absence of effort.)

A few things to remember:
  1. Give the cue only once. If your dog fails to respond, wait at least twenty seconds (and until you have his full attention) before giving it again, or "Sit. Sit. Sit!" may become your cue. Treat all words like empty vessels, and fill them deliberately with meaning.**
  2. The mark is always followed by a reward. You don't have to mark every repetition of the behavior (I'll talk later about effective "schedules" for marking), but when you do mark, you're making a promise on which you need to deliver.
  3. Work on one new behavior at a time. There's a significant exception to this rule that I'll talk about later, but this helps avoid confusion for the animal and accelerates learning.
  4. Work in short sessions. Very short! Ten to fifteen repetitions between breaks. At the first sign of fatigue or fading interest, stop.
  5. End on a high note. If possible, end with the new behavior you've been training, but if necessary end with a behavior the dog already knows well. Success breeds success.
What's most important in the early going (and ever after) is that you and your animal enjoy yourselves. I won't go into an elaborate defense of positive training methods here, but they follow from the (scientifically sound) premise that the training of voluntary behaviors proceeds most effectively and predictably from a state of eager but contained anticipation (especially in the case of a predatory animal). But even when training's fun, it's taxing. Again, the moment you notice your dog's interest flagging, or your own impatience rising, stop -- always, if you can help it, with a fresh success, however small. That way you'll continually create positive associations (for you and your animal) with training itself.

*On the other hand, I do not recommend that you begin by marking and rewarding a bark, especially if you're using a more powerful marker like a clicker. One thing to keep in mind is that the first few behaviors you effectively marker train will become the animal's default behaviors in future training. Quietly attentive behaviors (like eye contact or sit) are your best choices at the start.

**The trick with words (and other cues and markers) as vessels of meaning is that they might already be topped up. Old meanings can be difficult to dislodge, especially if they're loaded with pain or fear. Thus it's a very good idea (though sometimes difficult in practice) to avoid saying your pet's name in anger. If you want a truly empty word, try something rare, silly, or foreign. I lived in Bologna more than twenty years ago, and pretty much the only time I get to knock the rust off my Italian these days is when I'm cueing Pazzo with "fusilli!" (left spin) or "bombolone!" (right spin).

Friday, January 6, 2012

Marker training basics II

Sounds like...
...steak!!
Making the marker meaningful.

The principles and methods I'm describing here work across species; they've been used effectively in the training of countless animals, from rabbits to rhinoceroses, from grizzlies to gerenuks. (I highly recommend that all skeptics check out this brief article by Karen Pryor and the embedded video of a marker-trained rhino.) Before her death last year, our lovely calico Hops had learned through marker training to target my hand with her nose and to give me a head butt on the cue "Zidane" (which will only make sense if you follow European football). Most of my experience, however, has been with dogs, and for ease of reference I'll focus my discussion on them.

As I noted in the previous post, it's important that the stimulus you choose as a marker should initially possess little or no meaning for the animal you want to train. This will give you full freedom to endow it with the meaning you want: "Well done! Good things coming!" Here's yet another reason that words can be problematic as markers -- unless you're training a young puppy and you can commit in a disciplined way to reserving your marker word(s) exclusively for training, there's a high likelihood that their meanings will become muddied with unintended associations.

I'm strongly sympathetic to the visceral distaste that many people feel for clickers and other mechanical soundmaking doo-hickeys. They're cold and fussy and seem to require a third hand that we haven't got. Still more annoying, they interpose a barrier of artifice between trainer and trainee. However, for consistency, precision, and repeatability, they're really hard to beat. And paradoxical as it may seem, the little gap they introduce in our "natural" communication with other animals actually improves our mutual understanding immeasurably. No, I take that back -- the improvement can be measured, has been measured, and it's big.

So I recommend a clicker despite the possibility that it may not be totally neutral for you or your dog. Contrary to popular belief, you won't need to use it forever: once you've trained a specific behavior and put it reliably on cue, word markers will usually suffice to maintain the training. But you'll get to that maintenance stage much more quickly with a clicker, and once you're there I can pretty much guarantee that you'll notice a significant uptick in your dog's enthusiasm and attention anytime you pick that silly gadget back up. Likewise your cat's -- Hops would immediately start purring whenever I started a new training session.

Of course, that wasn't her first response to the clicker. She was mostly indifferent to it, maybe a little affronted. The sound it makes is short, sharp, and attention grabbing, qualities that make it effective for training but also make it rude in other contexts. So you'll want to introduce it carefully, from a distance, or muffled in a pocket. (It's best to avoid pointing the clicker like a t.v. remote at your dog's face.) Gauge your dog's response. Curiosity and/or indifference are a fine place to start, but if you see him/her shrink back, you'll need to take things more slowly.

If you decide to use another marker, just do what you can to keep it precise and consistent. A single syllable like "yes" generally works better to this end than a longer word.

Your first and most important task is to persuade your dog that, from this moment on, the following equation holds absolutely true:

"click" (or "yes") = wonderfulness

In order to establish that equation, you need to know what your dog already considers wonderful. Ideally you can identify among the many things your dog loves some thing(s) that are easily doled out in small bits. Food is the obvious candidate for a predatory species, and the one I rely on most heavily (probably too heavily, made complacent by my dogs' eager appetites). For early training, when the strength of a good impression takes precedence over perfect nutrition, I like (because my dogs like) hot dogs and smoked mozzarella, which are relatively inexpensive, have great intensity of flavor, and are easily divvied into tiny (1/4" by 1/4") cubes. Red Barn and Natural Balance also make meaty but dry food rolls that are as mouthwatering (to most dogs) as they are nourishing; they're my treat of choice when I work with dogs at the Oregon Humane Society. But it's good and sometimes necessary to think beyond food rewards; depending on the animal and the situation, they may be impractical and/or unrewarding. I've been working with Pazzo recently on his ability to keep the leash loose when we walk through our local squirrel-infested park (where he may be totally indifferent to food that isn't on the move). When he pulls the leash taut, I simply stop. The moment he gives me slack, I click and move with him in the direction of the squirrel. To Pazzo's delight, the squirrels will often double-down on my reward by staying put, and we've thus become a great slow-motion stalking team. Likewise, agility trainers will often reward their dogs with quick games of tug, and trainers of impassioned herders carefully control their access to sheep.

But for clarity's sake I'll assume that you've got a clicker, a hungry dog, and a stash of small, tasty food treats. Here's what you need to do:
  1. Click.
  2. Treat.
  3. Repeat.
That's it. There are only a couple of competing provisos: try not to move your "treat hand" until after you've clicked, but deliver the treat as quickly as possible (within a second of the click). Finding a rhythm that keeps those two events close but distinct will make the click most meaningful to your dog and help unlock his/her exclusive focus on the treats.

Wednesday, January 4, 2012

Marker training basics I

Worth a thousand words?
On the definition and choice of a marker.

Even (or especially) among experienced animal trainers and savvy pet owners, I often encounter a strong prejudice against "clicker training." The phrase itself is a turnoff to many, which is one reason I've come to prefer the more or less interchangeable terms "marker training" or "bridge training." These latter phrases describe the approach more accurately and inclusively -- people naturally get confused when you tell them that "clicker training" doesn't necessarily involve a clicker. Another reason I favor the second two terms is that they have so far escaped strong commercial association and appropriation.**

"Marker training" is the most literal and straightforward of the three, so it's the one I'll use from now on. My aim here and in future "basics" posts is to lay out the foundational principles, reasoning, and tools of this approach so that you'll be free to adapt them to your own needs and ends. I'll also try to anticipate some of the challenges you might encounter when starting out, and to offer possible solutions. But one of the foremost advantages of marker training is its flexibility: once you have a good command of the core ideas, you and the animal you're training have infinite creative license in putting them to use!

Marker training falls under the larger umbrella of positive training methods; indeed, it's something we all practice whenever we say "good dog!" But a solid understanding of how and why it works can help us practice it much more deliberately and effectively.

As with the "good dog!" example, a marker is simply a stimulus chosen by the trainer to signal two things and establish a vital connection between them:
  1. I like that behavior.
  2. You will be rewarded.
An effective marker satisfies a few important criteria:
  1. It is specific.
  2. It is easily reproduced by the trainer.
  3. It is easily perceived by the trainee.
  4. It is initially neutral, meaning that it has little or no intrinsic meaning to the trainee.
I don't know of any successful use of taste markers, given that few tastes are truly neutral to any animal; smells can be tricky for the same reason but are sometimes used as markers, most obviously and often in tracking work. Sight markers are tops in neutrality, but not always easily reproduced or perceived. Like touch markers, they may be most useful with animals who have lost use of one or more of their senses, or in situations where sound markers are impractical or forbidden. For most trainers and trainees, in most situations, sound markers tend to be most adaptable and workable. That said, they require more care in their choice and use than you might expect.

Why is that? Part of the problem ironically arises from our great facility in producing varied and complex sounds, our gift of the gab. The general human reliance on words to convey meaning makes many of us sloppy with tone (unless we speak a tonal language), volume, enunciation, inflection, and emphasis. In other words, we take the least care with precisely those variables that other animals are most likely to find intelligible. We toss flurries of meaningless syllables their way like so many snowballs -- and instead of congratulating them for catching a few on the fly, we berate them for being stubborn and slow. Our carelessness in expression is mirrored by our bluntness in perception. Few of us can reliably hear the difference between one "good dog!" and another (less enthusiastic, slower in tempo, higher in pitch, etc.) but a dog can. "Sit, Stormy. Sit! Get down, Stormy! No, Stormy! Sit!" may be roughly translated as: "My poor owner is working herself unnecessarily into a lather." The more loquacious we are, the more faith we place in language, the less likely it is that our pets will understand us.

So choosing and using sound markers effectively requires that we get humble; we need to begin from a recognition of our limitations. Most of us just don't possess the emotional and vocal control we need to produce sounds that are highly specific, consistent, and intrinsically neutral. Which is not to say that words cannot work as markers, only that their ease of use masks (and even contributes to) their inefficacy relative to other, more precise sound markers. Like clickers, yes, but also like whistles, chimes, and bells. Training by whoopee cushion, anyone?

**I am an ardent fan of Karen Pryor (trainer and educator extraordinaire, founder and CEO of Karen Pryor Clickertraining), forever grateful to her for her insight, her dedication to reality over "common knowledge" (e.g. dominance theory), and her tireless advocacy of positive training methods. The six months I spent under the instruction of Helix Fairweather with the Karen Pryor Academy for Animal Training and Behavior were tremendously illuminating and rewarding. I am proud to be certified by KPA as a trainer, and I plan to attend ClickerExpo here in Portland at the end of the month. I do, however, think there's a downside to Karen's mostly laudable efforts to establish common professional standards and gather like-minded trainers into one big tent, particularly when there are fees collected at many of the tent's entrances. I had a mostly friendly tussle with KPCT's president, Aaron Clayton, when I graduated from KPA and learned that my promised year of free access to the alumni message boards was contingent upon my entering a marketing agreement that would require me to display the KPA logo on my website and anywhere else I advertised my services as a trainer. In this instance and a few others, I found that independence of thought and self-presentation ran somewhat at odds with the commercial imperatives of KPCT (as they would with those of most for-profit ventures).