Want to take part in these discussions? Sign in if you have an account, or apply for one below
Vanilla 1.1.10 is a product of Lussumo. More Information: Documentation, Community Support.
Zoran at 48: good point.
I like the precision of the convincing idea you expressed in (50, paraphrased)
I don’t want to have to compete for the attention of (big name mathematicians/bloggers)… I just could do with the grudging approval (assigned reviewers/experts in my narrow field)
I mean I like you coming up with the “attention” and “grudging” words here which point how much subjective excitement may be (in some modes of work) over an argumentation, even when the latter is done with some hesitation and salt.
@pkra, I can’t find your email anywhere on your website (really?), so I’ll ask here: could you switch to using your real name? It’s sort of annoying to only finally realize that pkra == Peter Krautzberger when someone starts replying to you as Peter and I can’t decipher where the Peter is in the conversation.
@foobaron, could you write up a “blog post length” version of your proposal, so people don’t have to read your full paper? I tried reading it, but didn’t have time to get to the details.
(Also, perhaps you might use your real name or add your email address to your profile, so it’s possible to ask questions away from the noise here? :-)
Here’s a proposal I’ve been thinking about, although it seems to hit on some of the ideas discussed here -http://www.imachordata.com/?p=1132. A few of us are working to put together a group to try and create a thoughtful design and then implement it. I’d love any thoughts or comments.
@Scott: thanks for reminding me to change my name! Should be fixed now. (my email is mentioned both on top of http://boolesrings.org/krautzberger/resources/ and http://peter.krautzberger.info/about.html; also, googling “peter krautzberger email” offers it in google’s preview of the third hit – not sure how to help spammers more ;) )
@Yemon #50 // @Zskoda #52
I fully agree! The feedback I want does not come from random Prof Bigwig, but from a small crowd of researchers.
And yes, there are no crowds – yet; that’s what we have to build. I think any structure people come up with will suffer Nature’s failure – unless they can create a culture of embracing it. MO is an excellent example for building such a community, the nLab a similarly impressive one.
What I do believe is that, for the first time in the history of mathematics (and any other modern research area), the invisible colleges of mathematics can become real colleges.
With these tools, the small research areas with a handful of researchers can be almost as connected as if at the same department.
And now I’m completely off topic for John’s original title for this thread “Quick, easy & fun” – this is the hardest part, I think. Sorry.
I’m still getting caught up on what has been discussed, but see John in #12 said:
I’m not proposing a system that’s supposed to substitute for peer review.
Why not?
63: good point, popularity among whom. I often describe example from personal experience, of a closely related researcher who wrote two articles about certain topic. The first one he wrote alone, at the beginning stage of the research, when things were rudimentary, elementary and this paper also contains some sort of misconception in the main example. The first paper is 4 pages of pretty simple treatment of few easiest examples, and no general theory. The second paper is written a year later (and published after 3 years) even in higher impact journal, with a coauthor, it has over 35 pages, and has a correct and systematics theory developed with lots of useful calculations. The first paper had 72 citations, the second had 5 at the time when I done the analysis (both 10+ years after the publications). Thus the easy, nonfundamental, and partly even incorrect paper had 72. The second, a real breakthrough in the field, in better journal, with 35 pages of work had 5 citations. Why ? It is easy for John the Paperwriter to build on some trivialities from the first paper and publish another low quality work, why it is not easy to live up to a real research of the second paper. Notice that both papers are from the same author and the same topic.
@Alexander,
I think that might be misrepresenting the goals of some people here. I’m actually much more interested in the challenge of migrating journals away from commercial publishers (preserving reputation, production quality, moderate workload for editors) than anything about discussion or actually changing peer review.
While I agree that peer review as it exists is definitely suboptimal, I don’t think trying to replace it with something absolutely new is very productive. People (ie working mathematicians) just won’t take the plunge, and any incremental system has to remain CV compatible for at least a decade long period during any transition. Opening up space for more flexible journals (that is, by reducing the administrative and financial burdens of starting new journals, or migrating them) allows later tinkering with peer review, but I think it should be the first priority.
Scott,
I think we understand your position clearly, but it is not shared by everyone so in the spirit of dissensus, we should not actively discourage people from pursuing their own ideas. Can we try to be a bit more constructive and open minded?
If there exists a practical solution that does not involve a radical change to peer review, I have not seen it yet and cannot imagine it either.
Eric wrote:
John in #12 said:
I’m not proposing a system that’s supposed to substitute for peer review.
Why not?
I explained why not in my first comment on this thread. I do very much want a system that will substitute for current-day journals and peer review! But this may affect who gets jobs and who doesn’t, so academics find it very scary - whenever people discuss it, big arguments start and nothing actually happens. In fact you can see it happening here! People are saying “I don’t want to have to compete for the attention of big-name bloggers”, etc. etc. They’re imagining life in a radically new world… and they don’t like what they’re imagining.
So, for now, I want to do an end-run around this deadlock by trying something much easier:
People seem to get frozen in indecision when contemplating big serious changes to the current journal system. The consequences are too huge. So, I’m thinking we could hasten the evolution of good ideas by doing something quick, easy and fun. Something that’s not too painful to set up. And something that we use because we enjoy it, not because it’s good for us.
I’m hoping that in month or less we can set up at least one quick, easy and fun system that people will use. Christopher Lee and Marc Harper are working on one, but they could use more help.
Meanwhile, people here can discuss, and I hope actually set up, a more cautious and thoughtful solution to the journal problem.
Have any of you see http://www.peerevaluation.org/ - while it doesn’t like to arXiv, perhaps it might accomplish some of what you are looking for?