2 Comments
User's avatar
Paul Coyne's avatar

Thank you for commenting on my two questions. I will read the articles you mentioned. While I was at WMU Jack Michael talked about “the state of the organism”, and used state diagrams to explain S-R-C relations. The organism is in a certain state of being, it responds, the state of the organism changes. If response frequency increases it’s a reinforcing condition, decreases it’s a punishing condition. It’s the change in the organism's state that matters not the notion of presentation or removal. Presentation, removal are concepts that are not needed to describe response consequence relations. Then he'd talk about the sunglasses example. Then talk about how we could use the terms: avoidance, escape, response cost, and so on without using the terms positive and negative reinforcer/punisher. Later, when I was at ASU I took coursework from Peter Killeen who talked about the same issue and agreed with Michael. (Although he didn’t mention state diagrams). So, here I had two pillars of behavior analysis explain away +/- reinforcement. I thought the field would eventually discard the terms, but it did not.

When I taught a parenting class, I used the law of least effort to explain the reduction of tantrums in toddlers once they began to talk instead of tantrum to make their desires known. Later I listened to Killeen at ABAI who mentioned that the law of least effort was confounded by time. He said a JEAB researcher teased out time and effort to declare that organisms would save time over effort for the same reinforcer. Law of least time. I wondered if there was any corresponding applied research. So, I went to the Cooper ABA book and could not find anything in there about the law of least effort, (or least time). That surprised me. I’ve looked in other books and research articles from time to time, that’s why I asked that question.

Anyway, thanks again for reading my post and commenting. I appreciate it.

Paul

Expand full comment
Fred's avatar

Hi Paul, as to your first point (why does the distinction between positive/negative reinforcement persist): Catania's chapter in the Handbook of Applied Behavior Analysis has great thoughts about this. For example, a rat in a chamber can press a lever to turn on a heat lamp. If it does, does it gain heat or escape cold? The answer, according to Catania, is not a matter of physics. One potential answer that Catania gives: does the preceding behavior interfere with the operant response? In the case of the rat, the cold air leads to huddling close to the wall of the chamber, shivering, etc. These are behaviors that make a lever press less likely, and therefore turning on the heat lamp negatively reinforces a lever press by allowing the rat to escape cold. The utility of the language is questionable, but it's obviously widespread and easy to understand. I sometimes compare it to something like teaching the concept of gravity: is gravity actually a force that pulls us down? Probably not if you're a physicist.

As to your second point (delay discounting vs. response effort), here is a full text article that summarizes some of the issues: https://www.sciencedirect.com/science/article/pii/S0376635721001947

Confounds include: delays with smaller/larger rewards are discounted differently; loss aversion has different effects depending on various factors; and "effort" could probably be defined in multiple ways (after all, what if by "effort" you mean a task that takes longer -- that would be tied inextricably to delay; this could be solved in a yoked condition, perhaps).

Further confusion: based on this recently published article in JEAB https://onlinelibrary.wiley.com/doi/abs/10.1002/jeab.882, real rewards are discounted *less* than hypothetical rewards. Most delay discounting research has relied on hypothetical rewards, and so it could be possible that the literature base overestimates delay discounting.

Expand full comment