Discussion
Loading...

Post

  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Felix Schönbrodt
@nicebread@scicomm.xyz  ·  activity timestamp 3 days ago

The journal Psychological Science totally revamped their review and decision criteria towards good scientific practice (instead of novelty and significance).

E.g., the reviewer instructions say:

"Please do not assume that findings from studies that are not preregistered were the result of a detailed a priori plan - that would be unfair to authors who allow us to see their plans by preregistering them. [...] We do not want to create a situation where authors who preregister have their submissions evaluated more harshly than authors who do not preregister.“

Hear hear!

I consider them (now) to be a real top journal in the field (in the actual, quality-oriented sense; not in the crooked marketing speech JIF sense).

#psych #openscience

  • Copy link
  • Flag this post
  • Block
Ingo Rohlfing
@ingorohlfing@mastodon.social replied  ·  activity timestamp 3 days ago

@nicebread So, this means that non-preregistered studies should be evaluated more harshly because there is less transparency? I can imagine some social scientists (political science, sociology) would disagree if they cannot preregister their observational research. This maybe different for experiment-heavy psychology. In the end, there will always be a concern that some standard advantages one kind of research and disadvantages another.

  • Copy link
  • Flag this comment
  • Block
Oliver Brendel
@olibrendel@scicomm.xyz replied  ·  activity timestamp 3 days ago

@nicebread even though it seems good sense, I still have difficulties with this pre-registering experimental plans : at least in plant science, you are up to so many surprises, that you might have planned doing it one way, and ending up a different one.
#academicchatter

  • Copy link
  • Flag this comment
  • Block
Felix Schönbrodt
@nicebread@scicomm.xyz replied  ·  activity timestamp 3 days ago

@olibrendel The feasibility of preregistration differs by field and topic, for sure. At least in psychology, there is a broad consensus that deviations from preregistration are not necessarily a down-side of a paper. They are actually quite common and there often are good reasons to deviate. But the deviations need to be transparently reported. Readers then can make a judgment and evaluate the strength of evidence / risk of bias. (in contrast to non-prereg without disclosure of deviations, where everything looks „perfect“).

  • Copy link
  • Flag this comment
  • Block
Oliver D. Reithmaier
@odr_k4tana@infosec.exchange replied  ·  activity timestamp 3 days ago

@olibrendel @nicebread yeah, it's hard for some fields to do that. Psychologists (at least the ones I've talked to) have a hard time imagining how much "fucking around/finding out" there can be in natural sciences. But it's also different: psychologists deal with abstract constructs that have miniscule effect sizes, instruments with horrible measurement error etc. In natural sciences, measurements are better, effect sizes are often large, etc... Different ball game.

  • Copy link
  • Flag this comment
  • Block
Log in

Open Science

We are a network of scientists, developers and organizations building the next generation of digital spaces for open science.

Open Science: About · Code of conduct · Privacy · Users · Instances
Bonfire open science · 1.0.0-rc.3.14 no JS en
Manual federation enabled
  • Explore
  • About
  • Members
  • Code of Conduct
Home
Login