20 Jun 2017

NIH Toolbox Offers Easier Data Collection

NIH Toolbox Offers Easier Data Collection

The set of measures is useful for both researchers and clinicians alike—and can save money and time over traditional tools

For years, neurobehavioral researchers often couldn't compare data across studies or even within the same longitudinal study because they lacked a "common currency" for collecting data on various aspects of research participants' functioning.

"People used all sorts of different measures and assessments," says Molly V. Wagster, PhD, a psychologist who heads the behavioral and systems neuroscience branch in the National Institute on Aging's neuroscience division. And because there were different tests for different age groups, she says, "people had to resort to all sorts of different measures to follow someone over a period of time." Plus, she adds, researchers looking for quick-and-easy assessments sometimes resorted to tools designed for diagnosing disorders, not assessing function.

Now all that has changed, thanks to the National Institutes of Health's creation of the NIH Toolbox® for Assessment of Neurological and Behavioral Function. Developed by more than 250 scientists, many of them psychologists, the toolbox offers brief measures—some already existing and some created especially for the project—for assessing cognitive, emotional, sensory and motor functioning in research participants ages 3 to 85.

Introduced in 2012 and adapted for the iPad in 2015, the NIH Toolbox offers researchers a comprehensive set of tools for collecting data that can be compared across existing and future studies, says Wagster, the lead federal project officer for the toolbox.

The NIH Toolbox saves researchers time, says psychologist Richard C. Gershon, PhD, the NIH Toolbox's principal investigator and a professor at Northwestern University's Feinberg School of Medicine. "You can administer the equivalent of a one- or two-day neuropsych battery in two hours," says Gershon. The complete cognition battery can be administered in about 30 minutes.

The toolbox can also save money, says Gershon. Take the test used to assess people's sense of balance, which could be used to gauge older people's risk of falling. "Our test arguably replaces between $10,000 and $100,000 worth of equipment with a $160 iPad," he says.

Clinical psychologists could find the NIH Toolbox useful, too, says Abigail B. Sivan, PhD, an associate professor of clinical psychiatry and behavioral sciences at Northwestern, who helped develop it. In the future, a clinical psychologist might use the toolbox's assessments to help distinguish between attention-deficit/hyperactivity disorder and anxiety, for example, or between Alzheimer's disease and normal age-related changes in memory, she says. Clinicians could also use the NIH Toolbox to track patients' progress over time, she says.

Available as an app at iTunes, the NIH Toolbox can be downloaded on up to 10 iPads for an annual subscription fee of $500. Users can try it out for free for 60 days.

For more information, visit www.nihtoolbox.org.

By Rebecca  A. Clay


This article was originally published in the December 2016 Monitor on Psychology

Did you find this article useful?

0 0
06 Jun 2017

Predatory Publishers Increasingly Targeting Psychologists, Social Scientists

Predatory Publishers Increasingly Targeting Psychologists, Social Scientists

Publishing in peer-reviewed journals can be rewarding — it allows us to share our research with peers and can advance academic careers. However, it can also be difficult and frustrating. Journals on average reject 75 percent of submissions, according to an APA report (American Psychologist, 2014). Peer review can take months and often requires authors to make significant changes to articles prior to publication.

So just imagine the joy psychologists might experience upon receiving an email from a journal (with a name very similar to a respectable APA journal) that invites them personally to submit a paper for a forthcoming issue. The journal promises peer review within one week and publication within two weeks. Imagine further that the journal claims to have a high impact factor, partly due to the fact that its content is freely available worldwide.

As the old adage goes: If it sounds too good to be true, it probably is. Unfortunately, there is a high likelihood that such an invitation has been sent by a "predatory publisher." While these publishers initially focused on biomedical sciences, a growing number now target psychologists and social scientists.

What are predatory publishers?

Predatory publishers are counterfeit scholarly publishers that aim to trick honest researchers into thinking they are legitimate. They use spam email to solicit research manuscripts, which they quickly accept and publish in their many online open-access journals. Though they claim to peer review articles, many conduct no peer review at all or carry out a minimalist or pro forma review, accepting and publishing flawed manuscripts that most legitimate journals would reject.

Predatory journals are supported by fees charged to authors upon acceptance of their manuscripts, and their goal is profit. The journals want to accept and publish as many manuscripts as possible to increase their revenue. This income strategy conflicts with peer review, which, when done properly, often results in manuscripts being denied publication.

Predatory publishers have fooled many honest scholars into believing that they are legitimate. Experts at mimicking respected publishing houses, they use sophisticated spam techniques, pandering to researchers through personalized spam that praises a researcher's earlier work while inviting a new submission. Other spam emails appeal to authors needing to publish in journals that have earned an impact factor. Companies now exist that supply fake impact factors to questionable journals, metrics they then display in their spam email advertising.

Problems caused by predatory publishing

Predatory publishing harms the scientific community in numerous ways. First, authors may be misled into investing their money and intellectual capital in a journal that they think is high impact and stable when it is neither. Some predatory online publications exist for very short periods of time and are rarely cited in journals that are indexed by reputable databases.

Second, predatory publishing has created a substantial body of published literature that is branded as science, but has not passed through adequate peer review, which is a primary form of quality control. For many readers, reporters and the public, the distinction between authentic and junk science is not readily discernable, yet these publications are readily accessible by anyone.

Compounding the problem, comprehensive academic indexes such as Google Scholar routinely index the junk science, mingling it with authentic research in search results. How are learners, such as high school and college students, supposed to tell them apart? Moreover, new research builds on already-published research, as anyone who has ever compiled a literature review knows. Writing such reviews now requires additional skill and more effort, for the author now must filter out unvetted research.

What can be done?

Researchers and academic disciplines benefit from open access to well-managed, high-quality journals. So what can be done to protect the integrity of open-access publishing?

First, researchers need to develop a "scholarly publishing literacy" skillset to recognize and avoid predatory publishers. Researchers can no longer assume that all scholarly journals are trustworthy and must be on guard against the perils of predatory publishers. Educating graduate students, fellows and junior faculty about predatory publishing should become a routine part of mentoring. (See sidebar for tips from APA staff on how to avoid predatory publishers.)

Second, scholars can refuse to serve on the editorial boards of predatory publishers, which seek to enhance their reputations by creating affiliations with scholars at reputable academic institutions.

Finally, the process of scholarly evaluation must adjust to reflect the new reality of scholarly publishing. Tenure and promotion committees must more carefully scrutinize candidates' publishing records. A quick scan of a CV is no longer sufficient, for journal titles that look authentic may not be. To be fair to those seeking promotion and tenure, this recommendation needs to be combined with the first — educating scholars about appropriate venues for scholarly publishing.

The world of publishing is quickly evolving. Electronic media are increasingly supplanting print media; journals are increasingly accessed through subscription packages rather than subscriptions to individual journals; and funding agencies and professional associations are increasingly pushing for free public access to scientific publications. The challenge before us is to protect the integrity of scholarly publishing even as we adapt to new technologies, circumstances and demands.

By Jeffrey Beall, DSc, a librarian at the University of Colorado Denver & James M. Dubois, PhD, the director of the Center for Clinical Research Ethics at Washington University in St. Louis.


Did you find this article useful?

2 0
05 Jun 2017

When Your Research Gets Criticized or Politicized

When Your Research Gets Criticized or Politicized

As researchers, we are used to having our peers challenge our research and ask questions. It’s part of the scientific process that we hold so dear. But sometimes, our research results can generate unexpected outcomes that run counter to public or political opinion, resulting in personal attacks that are not based on the facts.

If you ever find your research is being attacked because of political views people have attributed to it, you may be unsure how or even whether to respond. Before you do anything, it might be helpful to consider the reason for the attacks.

A 2011 study on politics and social science research reports that ideas play into politics, and those ideas tend to shape people’s reactions to facts more than the actual research does. While people have their own reasons for consulting available research findings, their acceptance of the research has less to do with the actual research results than the message they want to convey. They may attack findings so they can continue to communicate their own messages.

According to a 2015 Pew study, many more people hold positions on issues that are strictly liberal or conservative today than they did two decades ago, which suggests that your research might not just come up against political-minded people in the policy world. The general public may attack your findings, too, if those findings go against what they believe.

This is why Dr. Susan Courtney, Professor and Chair of the Department of Psychological & Brain Sciences at Johns Hopkins University, makes sure her students know that criticism from the public is part of the scientific process. “I try to prep my students from the very beginning of the research planning process to anticipate potential criticisms of the work so that they have already prepared answers when the expected criticism arrives,” she says.

So, should you find your research has become a part of a political debate, Courtney advises not to take it personally, but to respond professionally, only focusing on the scientific issues. Make sure you are very familiar with related literature, so that you can openly acknowledge alternative interpretations of the data, but also effectively defend your study and your results.

The OHSU School of Medicine offers curricula specifically designed to help researchers respond to feedback in a constructive manner, both orally and in written venues. It also has journal clubs that provide students with experience in responding to feedback on research, and seminar classes that often include mentoring on how to answer questions live.

If the feedback isn’t in a live format, but rather in an email or a social media post, you should probably talk to your dean or professor before responding. If your school doesn’t offer mentoring opportunities designed to help you with written responses like at OHSU, you can always go to your Principal Investigator, your Dissertation Advisory Committee, or any faculty member who advises on research for advice on an appropriate response.

The American Psychological Association Science Directorate provides three key pieces of advice. The first is to develop what’s called a one-pager about your research that explains the aims, the context, and the findings of your research, including information such as potential applications if relevant. APA suggests developing one-pagers to explain your research to congressional and other policymakers, but they are very useful in responses to media or other public inquiries as well (see examples). Second, make full use of your university public relations and media staff before responding to any sort of political attack. Third, let the APA Science Government Relations Office (pkobor@apa.org) know as well if your research is attacked by a government policymaker. APA makes it a priority to defend research that is subject to unwarranted political attacks, and co-leads the Coalition to Promote Research which was formed to help defend peer-reviewed research that is attacked in the congressional arena.

If you are the PI, the Union of Concerned Scientists’ (UCS) freely available guide, Science in an Age of Scrutiny: How Scientists Can Respond to Criticism, and Personal Attacks, offers several suggestions, including evaluating the tone of the feedback and investigating the legitimacy of its source before responding, and refraining from responding in a way in which your response can be edited or manipulated.

The UCS advises to stand by your research and to let your data speak for itself. If you come across people attempting to discredit the findings you are reporting because they don’t fit into their agenda, or simply because they do not agree, convey to them that you are reporting facts, not opinion. Educate them about the meaning of research by letting them know you are neither for nor against what you’ve researched, because that isn’t how research works. The point of research is to examine a topic of importance and to present findings unbiasedly.

The good news is, many in the public respect research and understand that the scientific process may produce unexpected or challenging findings. The American Association for the Advancement of Science summarized several articles that appeared in the March, 2015 issue of the ANNALS of the American Academy of Political and Social Science, and determined that “the public tends to hold scientists in high regard. People also generally welcome learning more about a controversial issue, such as geoengineering, in which their minds aren’t already made up. So, the situation is far from hopeless.”

Did you find this article useful?

0 0
26 Apr 2017

Gregory Ball and the Adaptiveness of Behavior

Gregory Ball and the Adaptiveness of Behavior
Gregory Ball
APA Fellow Gregory Ball has spent most of his academic career studying animals and birds, and using the findings to develop understanding about the human brain and behavior.

Growing up, Gregory Ball, PhD, learned a lot about birds from his father, who did his undergraduate and graduate studies in zoology. “He wanted to be an ornithologist,” he recalls, speaking to the American Psychological Association from his office at the University of Maryland, where he is a professor and dean of the College of Behavioral and Social Science and APA Fellow.

That experience helped shape Ball’s own future interest and research on the interrelation of hormones, the brain, and reproductive behavior. By studying nonhuman animals, in Ball’s case birds, “you can study relationships between the brain and physiology in a way that you can’t in primates and humans,” he said.

In his lab at the University of Maryland, his team is studying how the perception of song induces gene expression in the brain of birds and how early experience with different kinds of song might affect that gene expression. They also recently published a study looking at how hormones interact with the dopamine system to affect sexual motivation. “Hormones do their work by modulating neurotransmitters and we’re trying to understand the circuit that they interact with to do that,” he said. According to the study, the projection from the preoptic area of the brain to the ventral tegmental area, where the dopamine of one of four major dopamine systems originates, to the accumbens, which plays a significant role in the cognitive processing of aversion, motivation, reward, and reinforcement learning, is very important in that process.

One of the Ball’s favorite recent findings to come out of his lab is related to steroids. “People think that a steroid has a very general effect on behavior – that it just makes you more motivated, or stimulated to do something,” Ball said enthusiastically.

“And we’ve done experiments where we’ve put tiny amounts of hormones or hormone blockers on the brain and we’ve shown that hormones actually act in multiple parts of the brain in specific ways to modulate behavior. For instance, the desire to sing is controlled in one part of the brain, but the control of how well you produce song in a temporal fashion is modulated in another part of the brain.”

Ball first got swept up in the studies of brain function and behavior in animals while studying at Columbia University. He took his introduction to psychology course with Dr. Herbert S. Terrace, who, among other things, led the famous study of animal language acquisition in the chimpanzee Nim Chimpsky. Ball began working with Terrace, who had studied under B.F. Skinner, the year after he began working with Chimpsky. He was intrigued by the studies of brain function and behavior in animals at Columbia (along with the then-contentious, now-settled debate between behavioral and cognitive psychologists) and began his longtime specialization in experimenting on pigeons.

Under Terrace, they employed the Skinnerian approach, which doesn’t take into the account private events – like thinking, perceptions, and unobservable emotions – as causes of an organism’s behavior. Ball said he sensed something was missing in studying the pigeons this way.

“They didn’t know if they were males or females, they didn’t know anything about pigeons. They were just animals that you put in the box and you saw how the stimuli affected them. And this is that Skinnerian notion that the organism didn’t really matter – that the contingencies of reinforcement were so powerful that the same thing that happens in a pigeon could be programmed to happen in [other animals].”

Despite disagreeing with the Skinnerian approach, he learned in his early work in Terrace’s lab that he could parse and further understand many topics related to the brain and behavior by looking at nonhuman animals. He began to understand the potential for studying animals other than humans and use the findings to develop understanding about the human brain and behavior.

Around that time, he met Dr. Rae Silver, who had just come to Columbia University and was studying the parental behavior of doves in their natural habitat. He became her first research assistant at the university, which he said was a key event in his career as a psychologist.

“It was another milestone in my career because I realized ‘Oh, this is it!’ You study the animal on its own terms, you study the natural behavior of the animal, and try to glean what you can about the general principles of physiology and the brain related to behavior,” Ball said. “And that’s when I sort of saw that by studying these relationships in animals, you can understand the evolution, the adaptiveness of behavior and put it in the broader natural context.”

After his formative years at Columbia, he earned a PhD in psychobiology at Rutgers University, and completed his postdoctoral work in comparative neuroendocrinology and ethology at Rockefeller University. Prior to getting hired by the University of Maryland in 2014, he taught at Rutgers, Boston College, and Johns Hopkins University.
Today, as dean of the College of Behavioral and Social Science, much of his time is filled with administrative tasks, but he still finds time to pop over to the lab and check on his staff’s research while sharing encouraging stories to inspire the next generation of academics to follow their dreams.

One story he always enjoys retelling is about growing up right down the street from the University of Maryland and how on one summer break from his studies at Columbia, he took a job cutting the institution’s grass.

 “[I tell them] I used to mow the lawn of the building that I’m now dean of,” he says with a chuckle.

Did you find this article interesting?

0 2
21 Apr 2017

A Collection of Health Psychology & Medicine Articles Booklet

A Collection of Health Psychology & Medicine Articles Booklet

Health psychology and medicine examines how biological, social and psychological factors influence health and illness. Health psychologists use psychological science to promote health, prevent illness and improve health care systems.

This booklet, A Collection of Health Psychology & Medicine Articles, covers a range of topics—from sleep loss among teens to the heightened risk of hospitalization among older adults—and highlights some of the most innovative research in recent years.

If you enjoy these articles, don’t stop here. APA’s Journals Program maintains a database of hundreds of papers on health psychology and medicine, and as an APA member you enjoy highly discounted access that enables you to explore these and other research topics online at www.apa.org/pubs/journals.

 

Did you find this booklet interesting or useful?

4 3
21 Apr 2017

A Collection of Forensic Psychology Articles Booklet

A Collection of Forensic Psychology Articles Booklet

Forensic psychology is primarily intended to provide professional psychological expertise within the judicial and legal systems. The distinctiveness of forensic psychology is its advanced knowledge and skills reflecting the intersection of legal theory, procedures and law with clinical issues, practice and ethics.

This booklet, A Collection of Forensic Psychology Articles, highlights some of the leading psychological research today on topics ranging from sexual assault on college campuses to police community partnerships.

When curating this selection of articles, APA’s scientific staff drew from four of the leading journals on forensic psychology. We encourage you to visit these journals on our website at www.apa.org/pubs/journals where you can access them as well as hundreds of papers in the field of forensic psychology.

Did you find this booklet interesting or useful?

3 1
06 Apr 2017

A Collection of Neuroscience & Cognition Articles Booklet

A Collection of Neuroscience & Cognition Articles Booklet

Cognitive psychologists, sometimes called brain scientists, study how the human brain works—how we think, remember and learn. They apply psychological science to understand how we perceive events and make decisions.

This booklet, A Collection of Neuroscience & Cognition Articles, features some of the most influential scholars and cutting-edge scientific researchers on topics that range from increasing cognitive reserves to an analysis of learning and recall.

In curating this selection of articles, APA’s scientific staff drew from half a dozen scholarly APA journals and publications that focus on the latest neuroscience and cognition research. APA’s Journals Program houses hundreds of academic papers in this field, and you can access them by visiting the journals area on our website at www.apa.org/pubs/journals and browsing by subject: Neuroscience & Cognition.

Did you find this booklet interesting or useful?

80 12
06 Apr 2017

A Collection of Industrial and Organizational Psychology Articles from APA Journals Booklet

A Collection of Industrial and Organizational Psychology Articles from APA Journals Booklet

Industrial and organizational (IO) psychologists focus on the behavior of employees in the workplace. They apply psychological principles and research methods to improve the overall work environment, including performance, communication, professional satisfaction and safety.

This booklet, A Collection of Industrial and Organizational Psychology Articles, provides a window into some of the latest research in IO psychology, ranging from studies on leadership development to managing coworker conflicts.

In curating this selection of articles, APA’s scientific staff drew from 15 scholarly APA journals and publications that focus on the latest industrial and organizational psychology research. APA’s Journals Program houses hundreds of academic papers in this field, and you can access them by visiting the journals area on our website at www.apa.org/pubs/journals and browsing by subject: Industrial/Organizational Psychology & Management.

Did you find this booklet interesting or useful?

18 8
28 Mar 2017

Jeremy Wolfe Wants to Understand How We See Things

Jeremy Wolfe Wants to Understand How We See Things
Jeremy Wolfe
APA Fellow Jeremy Wolfe's research looks into how people use sight to process information that's out there in the world.

After four decades of investigating how the human eye works, Jeremy Wolfe, PhD, still finds plenty to keep him curious.

“I never get bored,” says Wolfe, head of the Visual Attention Lab at Harvard Medical School (HMS) and Brigham and Women’s Hospital, in Boston, Mass., and an APA Fellow. “There’s always something new to consider. My elevator speech is that for the last 25 years, most of my lab’s work has involved studying visual search. Or, how do you find what you’re looking for? We move back and forth between basic science issues and real-world problems.”

How do you locate the mustard in the refrigerator, pick out the weeds from the posies in your garden, or home in on the cereal you like best from the dozens arrayed on the shelf in your local supermarket? Because your eye conveys so much information in a glance, according to Wolfe, professor of ophthalmology and radiology at HMS, that information has to be processed to make perceptual sense. “If we want to know if a specific object is present, we will often need to search for it, even if it is easily visible,” Wolfe says.

The mechanics of those quotidian quests have fascinated Wolfe for his whole career. In 1989, he first published his influential analysis of the process, which he called Guided Search, building on “the two-stage architecture” — preattentive and attentive — of Anne Treisman’s pioneering feature integration theory, and other works. Guided Search tracks the complex process, conducted in fractions of seconds, by which we find “targets” among the “distractors” in our field of vision by applying certain fairly coarse criteria, such as color, shape, size, orientation and curvature, and then “binding,” or assembling, those traits into a “single representation of an object,” according to Wolfe. Some objects are fairly easy to find, while others, like the proverbial needle in a haystack, can take quite a bit of time and attention.

 “The core of GS was the claim that information from the first (preattentive) stage could be used to guide deployments of selective attention in the second (attentive stage),” Wolfe wrote. He is now tinkering with the fifth iteration of Guided Search, to incorporate new data.

Wolfe’s latest research studies some of the limitations on our ability to see what’s in front of us, specifically problems that arise when people are tasked with looking for “rare events,” or things they are not likely to find — the radiologist examining X-rays for breast cancer, or the airport inspector looking for weapons or bombs in luggage. Radiologists miss 20 to 30 percent of visible cancers; for security purposes, the government doesn’t like to share how airport scanners are doing, Wolfe notes. One of the things that happens to expert “searchers” over time is that their vigilance flags, because most of the time what they’re looking for isn’t there.

“There are really profound limits on the human search engine,” Wolfe says.

Computers do much better, typically finding 100 percent of tumors, for example. However, a very high false positive rate is the computers’ downfall (and also for programs designed to improve searchers’ find rate). That’s a serious problem, because identifying nonexistent cancers activates an expensive, irksome and, for the patients, a terrifying recall process, to no useful end. So, people are better prospects for these jobs than computers, at least for now, and Wolfe’s research is aimed at figuring out how to improve humans’ overall performance on screening for rare events.

What Wolfe calls his own “origin story,” or how he got his start in visual research, begins when he was in high school in New Jersey, at a summer job his solid-state physicist dad got him at his workplace, the Bell Labs facility in Murray Hill, N.J.

“He sold me to his tennis buddy, who was a color vision researcher,” Wolfe recalls. He spent stretches of that summer immobilized in a chair, “looking at barely visible spots of light. My job was to say what color they were. What was cool about that was that I didn’t think I could tell. I thought [I]was guessing,” he says, but the experiment showed that he was able to identify the colors more often than he would have if he were merely guessing. On his many necessary breaks from the tedious work, Wolfe roamed the labs’ halls. He spent hours that summer talking to scientists he later discovered were famous in their fields.

“Many of the issues that have been important to my career I was introduced to then,” he recalls. That exposure was so important to him that Wolfe himself now has “an absolute commitment” to bringing high school students into his own lab, providing internships for half a dozen of them every summer.

Wolfe went on to graduate summa cum laude from Princeton in 1977. His doctorate, in 1981, was from the Massachusetts Institute of Technology, where his doctoral thesis was entitled, “On Binocular Single Vision.” Wolfe taught at MIT for 10 years and won the Baker Memorial Prize for teaching there in 1989. He was denied tenure the following year.

 “I was not the first person to win that prize and the following year lose a tenure battle,” he recalls. “It was seen as a zero-sum game, that if you were devoting the kind of time to your teaching to be winning that prize, you couldn’t really be a serious researcher.”

That episode ended with Wolfe moving his lab to Harvard in 1991 (though he was also a popular lecturer at MIT for 25 years; the podcast version of his “Introduction to Psychology” has been a top offering on iTunes U), and he’s had “quite a nice career, but a rather different career” from the one he had in mind. He’s a medical school professor, not a psychology professor, and “I live entirely on grant money, which is an exciting way to live. I’ve done basic research and use-inspired basic research. I’ve gotten grants every which way.”

Wolfe doesn’t mind that his scientific research is expected to lead to useful applications. He says, “When we’re working on the public dime, we ought to be able to make a decent case for why this is a sensible use of taxpayers’ hard-earned money."

Did you find this article interesting?

33 0
20 Sep 2016

Research Roundup Articles from Practice Update

Research Roundup Articles from Practice Update

The APA Practice Organization, a separate companion organization to APA, supports practicing psychologists in all settings and at all stages of their career. The Practice Organization advocates for the profession of psychology regarding licensure, reimbursement for services and professional standing.

Practice Update is the e-newsletter of the Practice Organization. This collection research roundup articles address some of the latest literature covering a range of issues from the use of animals as a therapeutic agent and the growing field of concussion research and treatment to current research on body image among young girls and clinical considerations for psychologists who see patients with opioid misuse.

Please enjoy this collection of selected research roundup articles from Practice Update.

Did you find this booklet useful?

16 4