Doctor and activist

Notice: Undefined index: hide_archive_titles in /home/chesterf/public_html/wp-content/themes/modern-business/includes/theme-functions.php on line 233

Tag: Scientific Fraud

Fake Science now an Industry

6 January 2022

Many years ago (?1977), I applied for the job as editor of the Medical Journal of Australia.  I had done two years as a surgical trainee and took a year off from the somewhat disillusioning hierarchical system.  I had done 3 and a half years of university English, but in terms of my experience editing, it was perhaps a long shot.

The salary was roughly the same as a second year resident, though more than half that salary had been overtime.  The job seemed a bit of dangerous niche, but it was worth thinking about.  I didn’t get the job (Dr Alan Blum from the US did), but was invited to apply for Deputy Editor.  The salary here was $20,000 less, which was more than a third. But the key reason I declined is that I hate having someone else waste my time. 

There is such an incentive to publish in order to climb academic ladders that most writing is done for the writer, not the reader.  As many papers are written as possible, so the idea of spending a lifetime sorting through thousands of papers to find ones of merit seemed a hazardous occupation with a great danger of drudgery.

When I thought about the issue I devised the Chesterfield-Evans theory of knowledge acquisition. It is an exponential graph with time on the horizontal axis and knowledge in the vertical.  With a little time you can get quite a lot of knowledge, but to get a little more or to get the forefront takes an immense amount of time, for the last bit of knowledge. This extra bit of knowledge may be well rewarded financially in medicine if you get it ‘approved’ as a specialty, but in many scientific endeavours there is no reward at all.  Getting to the forefront is made harder by the lack of incentive to write concise papers for the benefit of the reader.

In practices as a medical professional the explosion of information of indifferent quality has made reliance on key journals the easiest way to go, but even here the increased specialisation makes even being a reasonable generalist more difficult. The monetisation of knowledge makes the specialties not want to share all their information, the college and universities act like businesses and the drug companies want to sponsor a certain view.

When I wrote both my Masters theses, getting a good supervisor was a problem. No one really wanted to go through the writings of yet another postgrad.  My supervisor, Dr Chris Winder said that he would simply prefer students write concise papers and send the lot to a publisher, giving degrees to the ones considered worthy of publishing. 

But there has been a profusion of journals, initially driven by the profitability of these.  Now the pressure from students has been joined by a rogue element, the dodgy rip-off factories.  Plagiarism and now straight out fraud are now industries.

Those who seek knowledge now have to be more discerning. There is delight amongst the non-scientific who can, like Pontius Pilate ask, ‘What is truth’ and then also like Pilate not want to know the answer.

Sadly, politicians and managers who have agenda other than optimal knowledge are flourishing  in this environment.

I am glad that I did not become a medical editor; it is hard enough getting a broad-based knowledge of reasonably indisputable facts.

I am quite unsure how the confluence of factors favouring ignorance can be countered.  Making everyone learn some science and maths at school might be a start.

How fake science is infiltrating scientific journals

Harriet Alexander

January 5, 2022

In 2015, molecular oncologist Jennifer Byrne was surprised to discover during a scan of the academic literature that five papers had been written about a gene she had originally identified, but did not find particularly interesting.

“Looking at these papers, I thought they were really similar, they had some mistakes in them and they had some stuff that didn’t make sense at all,” she said. As she dug deeper, it dawned on her that the papers might have been produced by a third-party working for profit.

“Part of me still feels awful thinking about it because it’s such an unpleasant thing when you’ve spent years in a laboratory and taking two to 10 years to publish stuff, and making stuff up is so easy,” Professor Byrne said. “That’s what scares the life out of me.”

The more she investigated, the more clear it became that a cottage industry in academic fraud was infecting the literature. In 2017, she uncovered 48 similarly suspicious papers and brought them to the attention of the journals, resulting in several retractions, but the response from the publishing industry was varied, she said.

“A lot of journals don’t really want to know,” she said. “They don’t really want to go and rifle through hundreds of papers in their archives that are generated by paper mills.”

More recently, she and a French collaborator developed a software tool that identified 712 papers from a total of more than 11,700 which contain wrongly identified sequences that suggest they were produced in a paper mill. Her research is due to be published in Life Science Alliance.

Even if the research was published in low-impact journals, it still had the potential to derail legitimate cancer research, and anybody who tried to build on it would be wasting time and grant money, she said. She has also suggested that journals could flag errors while articles were under investigation, so people did not continue to rely on their findings during that time.

Publishers and researchers have reported an extraordinary proliferation in junk science over the last decade, which has infiltrated even the most esteemed journals. Many bear the hallmarks of having been produced in a paper mill: submitted by authors at Chinese hospitals with similar templates or structures. Paper mills operate several models, including selling data (which may be fake), supplying entire manuscripts or selling authorship slots on manuscripts that have been accepted for publication.

The Sydney Morning Herald has learned of suicides among graduate students in China when they heard that their research might be questioned by authorities. Many universities have made publication a condition of students earning their masters or doctorates, and it is an open secret that the students fudge the data. The universities reap money from the research grants they earn. The teachers get their names on the papers as contributing authors, which helps them to seek promotions.

International biotechnology consultant Glenn Begley, who has been campaigning for more meaningful links between academia and industry, said research fraud was a story of perverse incentives. He wants researchers to be banned from producing more than two or three papers per year, to ensure the focus remained on quality rather than quantity.

“The real incentive is for researchers to get their papers published and it doesn’t have to be right so long as it’s published,” Dr Begley said. He recently told the vice-chancellor of a leading Australian university of his frustration with the narrative that Australia was “punching above its weight” in terms of research outcomes. “It’s outrageous,” Mr Begley told the vice-chancellor. “It’s not true.”

“Yes,” the vice-chancellor replied. “I use that phrase with politicians all the time. They love it.”

According to one publishing industry insider, editors are operating with an element of wishful thinking. This major publishing house employee, whose contract prevented him from speaking publicly, said when his journal started receiving a torrent of applications from Chinese researchers around 2014, the staff assumed that their efforts to tap into the Chinese market had borne fruit. They later realised that many of the papers were fraudulent and acted, but he was aware of other editors who turned a blind eye.

“Obviously there’s so much money in China and the journals have their shareholders to answer to, and they are very careful not to tread on Chinese toes because of the political sensitivity,” he said. “There’s a lot more they could do to sort the good from the bad because there is good science going on in China, but it’s all getting a bad name because of what some Chinese people have worked out — that there’s a market here for a business.”

Last month, SAGE journals retracted 212 articles that had clear evidence of peer review or submission manipulation, and subjected a further 318 papers to expressions of concern notices. The Royal Society of Chemistry announced last year that 68 papers had been retracted from its journal RSC Advances because of “systematic production of falsified research”.

To indicate the upswing in cases, German clinical researchers reported last week that in their analysis of osteosarcoma papers, just five were retracted before the millennium and 95 thereafter, with 83 of them from a single, unnamed country in Asia. University of Munster Professor Stefan Bielack, who published the study in Cancer Horizons, said some open access journals charged academics US$1500 to $2000 to publish their work, so they were more interested in publishing lots of papers than their scientific validity.

“There is a systematic problem and in some countries people might have the wrong incentives,” Professor Bielack said. “I think the journals have a major role. They all need to be more rigorous.”

The problem is not confined to China, but it has accompanied a dramatic growth in research output from that country, with the number of papers more than tripling over the last decade.

In 2017, responding to a fake peer review scandal that resulted in the retraction of 107 papers from a Springer Nature journal, the Chinese government cracked down and created penalties for research fraud. Universities stopped making research output a condition of graduation or the number of articles a condition of promotion.

But those familiar with the industry say the publication culture has prevailed because universities still compete for research funding and rankings. The number of research papers produced in China has more than tripled over the last decade, with dramatic growth over the past two years. The Chinese government’s investigation of the 107 papers found only 11 per cent were produced by paper mills, with the remainder produced in universities.

Until last year, University of NSW offered its academics a $500 bonus if they were the lead author in a prestige publication and $10,000 if they were the corresponding author of a paper published in Nature or Science. The system, which was designed to reward quality over quantity, was discontinued due to financial constraints.

But others have questioned whether the quality of a paper can be measured by the journal in which it is published, and an open access movement has sprung up in opposition to the scientific publishing industry, arguing that research paid for by taxpayers should be freely available to all.

Alecia Carter, an Australian biological anthropologist at University College London, said the emphasis on getting published in a high-impact journal rewarded sensational results over integrity, positive results over negative results and novel findings over building the evidence base. Researchers might inflate effect sizes or omit conflicting evidence because it muddied the overall story they were trying to tell.

“We as scientists know all these things that are wrong with the way the system is set up, but we still play the game,” Dr Carter said. “We’re all chasing the same thing.”

Dr Carter boycotts luxury journals, publishes as much as possible in open access journals and reports negative results, though this has come at a cost to her career. She was once asked at a job interview why she would bother reporting results that were not interesting.

“I said, ‘If it’s interesting enough to do the research then we should publish the results’.”

She did not get the job.

Here is an SMH article which stimulated my post:

Continue Reading

Scientific Fraud

29 December 2021

I have friends who campaign for various things, sometimes quite alone for many years.

One of my friends is Polish.  He was part of the dissident movement when Solidarity was trying to end the Communist system.  While the Government was forced to negotiate with Lech Walesa, the Secret Police were busy and the second tier of activists and sympathisers simply disappeared overnight, so he spent quite a lot of time moving around.  He learned English and studied industrial hygiene, the safe use of chemicals in industry, so that he would have a qualification that was useful and recognised when he escaped to the West, which he eventually did. 

But he retained an interest in Poland and noted that some of the researchers there simply translated English papers, changed them very marginally, passed off the plagiarism as their original work, and became professors based on their great advances.  When the various academies were informed, they did not really want to know, as it disturbed their internal structures and was also something of an insult to national pride.

So he has spent years campaigning against scientific fraud, both there and here. 

There are other problems that grossly distort research.  No one really wants to publish negative findings; new discoveries are much more exciting than finding that stuff was wrong.  Also private research is much more interested in funding work that will produce a marketable product, and research that shows a drug works or is better than another.  The government has got into this mode also, wanting ‘partnerships with the private sector’ that will allow them to defray the research costs. This has arguably meant that the private sector tends to have a lot of say in what is studied, gets the government to pay for areas that it might not have bothered with, and can also grab lucrative patents early.  In this competitive environment, researchers have to find funding, and there is not much money in repeating experiments to disprove them.

Some research needs thousands of subjects to see which investigations or drugs are the most useful so that treatment protocols can be developed. Naturally these require huge coordination between many hospitals, health authorities and clinicians.  They require huge budgets. They offer big rewards if a certain investigation or treatment is shown to be beneficial and is included in the final recommendation of a huge trial.  The lead authors will travel the world for years as the definitive experts in that field with all the prestige that that entails.  Yet, as clinicians tied up with clinical work and often departments to administer, they cannot personally manage the logistics or the data and usually rely on ghost writers to put the drafts together.  Who funds that you might ask?  And what are the consequences if the funding company’s products do not work so well?  Will the professor who said it did not work get funding next time?

There is even a whole scam industry of dodgy or even non-existent  journals where you pay to be published or to be a supposed reviewer of papers.

So the pure idea that scientists are only interested in the truth and have no personal or financial interest was never true and has been under even more stress of late. 

Just as self-regulation in banking, aged care, casinos, building, advertising and many other industries has been shown to be inadequate, now scientific publishing is coming under the public spotlight.

The world of academia is more poorly set up than most industries to act as policeman. Evidence is evaluated in good faith.  Universities are expected to fund their courses from fees and donations so they are less in a position to take action that may be expensive and may damage their reputations.

Now, at last, the Australian Academy of Sciences has asked for a research integrity watchdog. This will help with deliberate individual fraud.

How much it can affect the other biasing factors in research remains to be seen.  The political and economic factors are likely to remain in the ‘too hard basket’.  It is still hard to know what the truth is.  Gut feelings about plausibility are of course ‘unscientific’ and what you ‘believe’ at a point of time is supposed to relate to what the ‘facts’ are.  And all this without social media even considered.

On the bright side, my Polish friend will see a significant step for his campaign, and if regulatory oversight replaces one lot of self-regulation there is hope that it will spread to other industries.

Continue Reading