Blog

Who has the right to call someone 'White'?

Science cannot tell us


Keith S. Taber (him/his…and White?)


An opinion piece in Education in Chemistry by Kristy Turner recently highlighted the potential bias that may lead to scholars being more likely to access, read and cite research from some parts of the world than others. This was actually an issue I was very aware of when a journal editor, as an international journal should aim to reflect research globally, but needs to apply common quality criteria.

This means that those working in contexts where there are no traditions of educational research, and limited resources to develop capacity, are at a disadvantage. I could think of one country where the journal received regular contributions, but which were almost always rejected (perhaps, always rejected?), as they simply did not amount to substantive accounts of research. These included well-intentioned, if sometimes quite convoluted, suggestions for mnemonic schemes to teach abstract conceptual subject matter, which offered absolutely no evidence that the proposed approach had ever been evaluated (if, indeed, ever applied). I was aware that any simple calculation of success rates in the journal would show that submissions from this particular national context had no chance of publication, and that few indeed ever got as far as referees 1. This might look like prejudice, even if it reflected application of the same quality criteria to all submissions. 2

On the other hand, the situation is slowly shifting. An excellent example is Turkey, which transformed from being a virtual non-participant in science education research publication to one of the most productive national sources of research published in the top journals, in just a couple of decades. I am aware of several other countries that are, if more slowly, supporting similar development in science education. So, the situation is complex: but Turner is absolutely right that we need to also be aware of a possible mind-set that assumes useful, quality research in science education will only be going on in a limited number of national contexts.

Being classified by the colour of my skin

But what really made me reflect on the piece was was not this important point, but that I was name-checked at the start of the article, along with a number of other educational research scholars, before Turner asked:

"What do these names have in common?

To start with they are all men and all White. More significantly, they all worked in the West (although some had collaborations further afield). This means that much of the education research we consume is produced from a Western perspective."

Turner, 2023

I am not sure I have ever seen myself called out in this public way as being "White", and I was not sure I was comfortable with being labelled in this way. For me, this was a mild discomfort – the kind that usefully leads one to reflect. By contrast, many people in this world experience being referred to by colour labels every day of their lives.

I readily identify as English, British and European, as simply a matter of fact: so, I suppose, 'Western' – guilty as charged. I have no qualms about being publicly labelled as a man. (Though I had no problem with being called 'Miss' by new secondary school students just moving up from primary schools where their class teacher had been 'Miss'. The pupils tended to be more embarrassed than me on these occasions – as was the tutee who once inadvertently called me 'Dad'. Yes, Tamsin, I still remember that.)

When I went to school, the world (at least as it was usually talked about) seemed simple in that regard. Humans came in two types – males and females. In my class in school there were boys and girls, and there was absolutely no ambiguity about this, and the difference was clearly marked: the boys wore shorts, the girls skirts or dresses. When I got to secondary school I studied metalwork and woodwork and technical drawing, whilst the girls studied their own subjects such as cookery. (Yes, I am that old.) Science dichotomised people into these classes of males and females (this was strictly known to be a simplification, but I do not recall any mention of other possibilities when I was a child), and there was a widely assumed perfect correlation with gender.

Of course, we now know this is utterly simplistic, and if such a regimented approach is imposed on people it is a burden that does not reflect the range of ways that people themselves experience their lives. It is now very common for people to attach their preferred pronouns to their web-pages and emails footers, and we appreciate that people have a right to self-identify in gender terms, and should not be assigned such an identify from the outside.


Original image by Krzysztof Niewolny from Pixabay


Should what is good for the goose also be good for the gander?

So, if we respect people's right to claim their own gender identity, what gives us the right to assign them to 'colour' categories? These categories were historically linked to what many scientists considered distinct varieties of human being – the different 'races'. That is, just as scientists might have recognised different varieties of a species, say different breeds of sheep, so there was considered to be a substantive and biologically justifiable basis for classifying people as members of different 'races'.

Those classifications were also not just seen as categorical, but often as ordinal – there were not only considered to be different races, but some of them were widely thought of (*) as more advanced, more civilised, perhaps even more evolved, than others; and it sometimes followed to many people that members of some races were of more inherent worth than others. (* At least, this was a common stance among people who self-identified as White!)

As is well known, this attitude led to many terrible events, and such bizarre notions as long-inhabited lands being 'discovered' by newcomers who therefore felt entitled to take possession of them: perhaps because they did not consider the inhabitants worthy of land and resource ownership; or perhaps because often the indigenous population took an attitude to the land and biota that it was not open to their ownership, but rather was sacred and deserving of being seen as in a form of relationship, rather than just being a source for exploitation. (That is, in many senses, the supposed 'more primitive' people had a more sophisticated and ecologically viable Worldview than those making the comparisons and seeing themselves as 'more civilised'.) That was one historical form of the 'Western perspective' that Tuner rightly warns about. 3

Science progresses: but not everyone keeps up

Science has moved on. We now know that, from a scientific perspective, there is only one human race. We all descend from early human ancestors that lived in Africa – so, for example, all of us in Britain are, if not ourselves migrants, ultimately the descendants of African migrants.

There are no strong categorical differences that allow us to form clear-cut classes of people (such as we can nearly dichotomise sex, even if we now realise that does not correlate to gender in a simple, direct way). Certainly, there are differences in populations that have long lived in different parts of the world: some groups are more likely to be lactose intolerant; more likely to suffer from, or be resistant to, specific diseases, and so forth. But these are statistical differences, not absolute ones.


An analogy for categorising people into 'races' based on physical characteristics (original image by Mote Oo Education from Pixabay)


To divide people into racial groups on that kind of basis makes as much sense as dichotomising adult people into males and females purely on height (i.e., the tallest 50% are male, by definition) simply because there is a statistical correlation between biological sex and adult height. Throughout human history, there has been social and genetic interchange between populations, and that is now more so than ever. We all have a mix of genes from a diverse range of ancestors – indeed most of us have few percent of genes that are considered Neanderthal. 4 So being 'White' is not simply a matter of genetics: any notion of a pure European genome is simply fantasy, akin to the deluded Nazi fantasies of Aryan blood lines. 5

Race is not a biological classification. Race is a social system of categorising people, not a scientific system. There are different races in the world only in a similar sense to how there are different styles of art or architecture in the world, or different modes of fashion (or styles of music, or genres of literature): because people have constructed such a system and imbued certain perceived differences with significance. But, there are not races in the world 'naturally' in the sense that there are different elements or different minerals out there for scientists to find. 6

The idea of several distinct human races can be seen as a historical scientific concept that was once given serious credence (just like phlogiston, or the luminiferous æther), but today should be seen as an alternative conception – a bit of folk-science that is actually a misconception.

Read about historical scientific conceptions

So, if I am seen as White, this is because I have certain physical characteristics that others perceive as being 'White' (i.e., physiognomy). Presumably skin colour is a primary factor, although I certainly do not have white skin (I have never seen anyone who actually looks white or black, and suspect this choice of labels is in part a reflection of the historical associations of these colours 7). I am basically a pink colour, although at certain times of year I go somewhat orange. I am not being flippant here – I am obviously of pale skin tone as would be associated with someone of European descent. But, again, we know that skin tone does not simply divide into a few clear categories: there is a whole spectrum out there, and most of us do not have entirely even pigmentation over all parts of the body, and/or are subject to some variation depending on environmental factors (and in England the average potential exposure to the Sun's rays in June is VERY different to in December!)

Now, I am not suggesting there might not be times when pointing out the colour of someone's skin might be useful – it might be very relevant in giving a description of a missing child or a mugger. But, Turner was not calling me White to help you recognise me, but to label me as someone associated with a 'Western' perspective. This of course is not a perfect correlation either. (I suspect that Rishi Sunak and Barack Obama would be widely considered to have Western perspectives).

'I hate the White man'

The musician Roy Harper wrote a song called 'I hate the white man' which appeared on his 1970 album 'Flat Baroque and Berserk'. He sings it live with real venom. When I first heard this song, it seemed strange to me, as here was a white man [sic, my label] singing how he hated the White man. It was heartfelt, but it seemed ironic. It did not occur to me that I was just assuming Roy was White because he looked white to me. (He is 'obviously' white, just as I, apparently, obviously am – that is, his skin tone is pinkish.) I never entertained another possibility: the notion that he should have the right not to identify with the people who's crimes he was singing about; that is, not to identify as a White man.


Roy Harper. He hates the white man.

(Image from Wikipedia, license: CC BY-SA 3.0)


So, should I be able to opt out of being put in an unscientific, racial category? Can I decline being White, and simply be a global citizen, a member of the human race, and so deserving the same level of respect and the same human rights as any other?

A dilemma

Of course it is not that easy. It is all very well someone like me refusing to self-identify with a racial label: there is still much discrimination and even targeted violence in many part of the world against people on racial grounds, and that would not be stopped by any personal self-identification of the victims. It is the perceptions of the abusers that matter in such situations, not how those on the receiving end see themselves. The Nazi's decided for themselves who was Jewish and so who deserved to be, say, removed from academic posts, or even incarcerated and exterminated, without regard to, for example, the victim's professed religion or record of Christian Church attendance.

Moreover, even if there are no strong genetic grounds to classify humans into a small number of 'races', the science of epigenetics is starting to reveal the cross-generational effects of extreme life-experiences (Meloni, 2019) such as slavery. The descendants of oppressed and impoverished people will continue to suffer relative to others for several generations. There may be no moral basis for asking children to pay for the 'sins of the fathers', but children of heavily sinned-against parents will still be at a disadvantage in life. That is not all about 'race': it might be about class, or the effects of war, but often racial identity (something with real effects, even if no scientific justification) can certainly be a factor.

If we do not identify with ethnic groups, then this makes monitoring of bias and discrimination difficult. How does an organisation know it is being equitable in relation to ethnic diversity, if no one chooses to self-identify with the traditionally majority, and/or privileged, groupings?

I think there is a genuine conundrum here. I look forward to the day when no rational person would see physiognomy as a useful basis for unscientifically classifying human beings, and, even if I am unlikely to live that long, hope we continue to move in that direction. But I understand why minority and oppressed groups find solidarity in such identification, and I appreciate the need for monitoring progress towards a fairer and more equitable society. So, Kristy, I fully understand why you call me 'White', even if I feel a little uneasy being labelled in that way.


Work cited:
  • Meloni, M. (2019). Impressionable Biologies: From the archaeology of plasticity to the sociology of epigenetics. Routledge.
  • Szöllösi-Janze, M. (2001). National Socialism and the sciences: reflections, conclusions and historical perspectives. In M. Szöllösi-Janze (Ed.), Science in the Third Reich (pp. 1-34). Berg.
  • Turner, K. (2023). Taking a global view. Education in Chemistry, 60, p.40

Notes:

1 Submissions to a research journal normally undergo editorial screening, so that (unpaid, expert) referees are not asked to spend time evaluating material in peer review that is out of scope for the journal or clearly inadequate (e.g., an empirical study lacking a methodology section).

Read about submitting to a research journal


2 I did highlight this issue at the journals' editorial board. The journal itself could do little about solving the problem, but the wider community might find ways to support development of research capacity in contexts where science educators aspire to be publishing work in international research journals.


3 Without in any sense wishing to undermine the terrible consequences that followed from widely held perceptions of racial differences, this can be seen as part of the wider commonplace phenomenon of categorising humans into various groupings in ways that are then used to justify treating some people as less worthy of respect and rights as others – for example the torture and judicial murder of Catholics/Protestants by Protestants/Catholics in parts of Europe when, sometimes, different members of the same nuclear family were classified into different groups.


4 It is sometimes said that on average a person has about 2% of Neanderthal DNA. Given that all the biota on earth is considered to ultimately have a common descent it is of course not surprising that human beings share some genes with, say, chimpanzees, and for that matter, bananas. However, it is not considered humans have chimpanzee ancestors (or banana ancestors, of course) but rather the two species evolved from a common ancestor population.

The particular interest in Neanderthal genes (and genes from Denisovans) is that it is considered that extant human populations carry genes acquired from Neanderthals when the two different populations co-existed, not from some precursor species they both evolved from. Whilst this is still an area of active research, the findings are widely interpreted to suggests that humans sometimes interbred with Neanderthals.


5 The Nazis thought that the German Volk descended from a distinct, discrete race, the Aryans – and set up scientific research projects to explore and develop the idea. Some of the ideas involved seem incredible:

"…Himmler rejected the Darwinist theory of evolution for the Aryans, presenting instead phantasies, according to which their earthy existence was derived from living shoots conserved in the ice of outer space…"

Szöllösi-Janze, 2001


6 Failure to appreciate this leads to confused questions such as whether discrimination against Jews should be considered racism. From a scientific perspective there are no races, so ipso facto the Jews are not a race. However, this is besides the point: if Jewish people are discriminated against, abused, attacked etc., either because of their religion, or because they are perceived as being members of an identifiable social ('ethnic') group, then this is clearly wrong and to be condemned, regardless of the label used.

If a legal system puts a particular weight on criminal offences that are motivated by racism (so, for example, punishments for those convicted have a premium), then what counts as a race for those purposes needs to be defined within that (social, i.e., legal) system, as natural science can have no role in determining social groupings that have no scientific basis.


7 This was lampooned in 'Star Trek: Enterprise', where Andorian Thy'lek Shran adopts the nickname 'pink skin' for Enterprise's Captain Archer.

From the Paramount Network Television series Star Trek: Enterprise

The best science education journal

Where is the best place to publish science education research?


Keith S. Taber



OutletDescriptionNotes
International Journal of Science EducationTop-tier general international science education journalHistorically associated with the European Science Education Research Association
Science EducationTop-tier general international science education journal
Journal of Research in Science TeachingTop-tier general international science education journalAssociated with NARST
Research in Science EducationTop-tier general international science education journalAssociated with the Australasian Science Education Research Association
Studies in Science EducationLeading journal for publishing in-depth reviews of topics in science education
Research in Science and Technological Education Respected general international science education journal
International Journal of Science and Maths EducationRespected general international science education journalFounded by the National Science and Technology Council, Taiwan
Science Education InternationalPublishes papers that focus on the teaching and learning of science in school settings ranging from early childhood to university educationPublished by the International Council of Associations for Science Education
Science & EducationHas foci of historical, philosophical, and sociological perspectives on science educationAssociated with the International History, Philosophy, and Science Teaching Group
Journal of Science Teacher EducationConcerned with the preparation and development of science teachersAssociated with the Association for Science Teacher Education
International Journal of Science Education, Part B – Communication and Public EngagementConcerned with research into science communication and public engagement / understanding of science
Cultural Studies of Science EducationConcerned with science education as a cultural, cross-age, cross-class, and cross-disciplinary phenomenon
Journal of Science Education and TechnologyConcerns the intersection between science education and technology.
Disciplinary and Interdisciplinary Science Education ResearchConcerned with science education within specific disciplines and between disciplines.Affiliated with the Faculty of Education, Beijing Normal University
Journal of Biological Education For research specifically within biology educationPublished for the Royal Society of Biology.
Journal of Chemical EducationA long-standing journal of chemistry education, which includes a section for Chemistry Education Research papersPublished by the American Chemical Society.
Chemistry Education Research and Practice The leading research journal for chemistry educationPublished by the Royal Society of Chemistry
Some of the places to publish research in science education

I was recently asked which was the best journal in which to seek publication of science education research. This was a fair question, given that I had been been warning of the large number of low quality journals now diluting the academic literature.

I had been invited to give a seminar talk to the Physics Education and Scholarship Section in the Department of Physics at Durham University. I had been asked to talk on the theme of 'Publishing research in science education'.

The talk considered the usual processes involved in submitting a paper to a research journal and the particular responsibilities involved for authors, editors and reviewers. In the short time available I said a little about ethical issues, including difficulties that can arise when scholars are not fully aware of, or decide to ignore, the proper understanding of academic authorship 1 . I also discussed some of the specific issues that can arise when those with research training in the natural sciences undertake educational research without any further preparation (for example, see: Why do natural scientists tend to make poor social scientists?), such as underestimating the challenge of undertaking valid experiments in educational contexts.

I had not intended to offer advice on specific journals for the very good reasons that

  • there are a lot of journals
  • my experience of them is very uneven
  • I have biases!
  • knowledge of journals can quickly become out of date when publishers change policies, or editorial teams change

However, it was pointed out that there does not seem to be anywhere where such advice is readily available, so I made some comments based on my own experience. I later reflected that some such guidance could be useful, especially to those new to research in the area.

I do, in the 'Research methodology' section of the site, offer some advice to the new researcher on 'Publishing research', that includes some general advice on things to consider when thinking about where to send your work:

Read about 'Selecting a research journal: Selecting an outlet for your research articles'

Although I name check some journals there, I did not think I should offer strong guidance for the reasons I give above. However, taking on board the comment about the lack of guidance readily available, I thought I would make some suggestions here, with the full acknowledgement that this is a personal perspective, and that the comments facility below will allow other views and potential correctives to my biases! If I have missed an important journal, or seem to have made a misjudgement, then please tell me and (more importantly) other readers who may be looking for guidance.

Publishing in English?

My focus here is on English language journals. There are many important journals that publish in other languages such as Spanish. However, English is often seen as the international language for reporting academic research, and most of the journals with the greatest international reach work in the English language.

These journals publish work from all around the world, which therefore includes research into contexts where the language of instruction is NOT English, and where data is collected, and often analysed, in the local language. In these cases, reporting research in English requires translating material (curriculum materials, questions posed to participants, quotations from learners etc.) into English. That is perfectly acceptable, but translation is a skilled and nuanced activity, and needs to be acknowledged and reported, and some assurance of the quality of translation offered (Taber, 2018).

Read about guidelines for good practice regarding translation in reporting research

Science research journal or science education journal?

Sometime science research journals will publish work on science education. However, not all science journals will consider this, and even for those that do, this tends to be an occasional event.

With the advent of open-access, internet accessible publishing, some academic publishers are offering journals with very wide scope (presumably as it is considered that in the digital age it is easier to find research without it needing to be in a specialist journal), however, authors should be wary of journals that have titles implying a specialist scientific focus but which seem to accept material from a wide range of fields, as this is one common indicator of predatory journals – that is, journals which do not use robust peer review (despite what they may claim) and have low quality standards.

Read about predatory journals

There are some scientific journals with an interdisciplinary flavour which are not education journals per se, but are open to suitable submissions on educational topics. I am most familiar (disclosure of interest, being on the Editorial Board) is Foundations of Chemistry (published by Springer).



Science Education Journal or Education Journal?

Then, there is the question of whether to publish work in specialist science education journals or one of the many more general education journals. (There are too many to discuss them here.) General education journals will sometimes publish work from within science education, as long as they feel it is of high enough general interest to their readership. This may in part be a matter of presentation – if the paper is written so it is only understandable to subject specialists, and only makes recommendations for specialists in science education, it is unlikely to seem suitable for a more general journal.

On the other hand, just because research has been undertaken in science teaching and learning context, this may not make it of particular interest to science educators if the research aims, conceptualisation, conclusions and recommendations concern general educational issues, and anything that may be specific to science teaching and learning is ignored in the research – that is, if a science classroom was chosen just as a matter of convenience, but the work could have been just as well undertaken in a different curriculum context (Taber, 2013).

Research Journal or Professional Journal?

Another general question is whether it is best to send one's work to an academic research journal (offering more kudos for the author{s} if published) or a journal widely read by practitioners (but usually considered less prestigious when a scholar's academic record is examined for appointment and promotion). These different types of output usually have different expectations about the tone and balance of articles:

Read about Research journals and practitioner journals

Some work is highly theoretical, or is focussed on moving forward a research field – and is unlikely to be seen as suitable for a teacher's journal. Other useful work may have developed and evaluated new educational resources, but without critically exploring any educational questions in any depth. Information about this project would likely be of great interest to teachers, but is unlikely to meet the criteria to be accepted for publication in a research journal.

But what about a genuine piece of research that would be of interest to other researchers in the field, but also leads to strong recommendations for policy and practice? Here you do not have to choose one or other option. Although you cannot publish the same article in different journals, a research report sent to an academic journal and an article for teachers would be sufficiently different, with different emphases and weightings. For example, a professional journal does not usually want a critical literature review and discussion of details of data analysis, or long lists of references. But it may value vignettes that teachers can directly relate to, as well as exemplification of how recommendation might be followed through – information that would not fit in the research report.

Ideally, the research report would be completed and published first, and the article for the professional audience would refer to (and cite) this, so that anyone who does want to know more about the theoretical background and technical details can follow up.

Some examples of periodicals aimed at teachers (and welcoming work written by classroom teachers) include the School Science Review, (published by the Association for Science Education), Physics Education (published by the Institute of Physics) and the Royal Society of Chemistry's magazine Education in Chemistry. Globally, there are many publications of this kind, often with a national focus serving teachers working in a particular curriculum context by offering articles directly relevant to the specifics of the local education contexts.

The top science education research journals

Having established our work does fit in science education as a field, and would be considered academic research, we might consider sending it to one of these journals

  • International Journal of Science Education (IJSE)
  • Science Education (SE)
  • Journal of Research in Science Teaching (JRST)
  • Research in Science Education (RiSE)


To my mind these are the top general research journals in the field.

IJSE is the journal I have most worked with, having published quite a few papers in the journal, and have reviewed a great many. I have been on the Editorial Board for about 20 years, so I may be biased here.2 IJSE started as the European Journal of Science Education and has long had an association with the European Science Education Research Association (ESERA – not to be confused with ASERA).

Strictly this journal is now known as IJSE Part A, as there is also a Part B which has a particular focus on 'Communication and Public Engagement' (see below). IJSE is published by Taylor and Francis / Routledge.

SE is published by Wiley.

JRST is also published by Wiley, and is associated with NARST.

RISE is published by Springer, and is associated with the Australasian Science Education Research Association (ASERA – not to be confused with ESERA)

N.A.R.S.T. originally stood for the National Association for Research in Science Teaching, where the Nation referred to was the USA. However, having re-branded itself as "a global organization for improving science teaching and learning through research" it is now simply known as NARST. In a similar way ESERA describes itself as "an European organisation focusing on research in science education with worldwide membership" and ASERA clams it "draws together researchers in science education from Australia, New Zealand and more broadly".


The top science education reviews journal

Another 'global' journal I hold in high esteem in Studies in Science Education (published by Taylor & Francis / Routledge) 3 .

This journal, originally established at the University of Leeds and associated with the world famous Centre for Studies in Science Education 4, is the main reviews journal in science education. It publishes substantive, critical reviews of areas of science education, and some of the most influential articles in the field have been published here.

Studies in Science Education also has a tradition of publishing detailed scholarly book reviews.


In my view, getting your work published in any of these five journals is something to be proud of. I think people in many parts of the world tend to know IJSE best, but I believe that in the USA it is often considered to be less prestigious than JRST and SE. At one time RISE seemed to have a somewhat parochial focus, and (my impression is) attracted less work from outside Australasia and its region – but that has changed now. 'Studies' seems to be better known in some contexts than other, but it is the only high status general science education journal that publishes full-length reviews (both systematic, and thematic perspectives), with many of its contributions exceeding the normal word-length limits of other top science education journals. This is the place to send an article based on that literature review chapter that thesis examiners praised for its originality and insight!



There are other well-established general journals of merit, for example Research in Science and Technological Education (published by Taylor & Francis / Routledge, and originally based at the University of Hull) and the International Journal of Science and Maths Education (published by Springer, and founded by the National Science and Technology Council, Taiwan). The International Council of Associations for Science Education publishes Science Education International.

There are also journals with particular foci with the field of science education.

More specialist titles

There are also a number of well-regarded international research journals in science education which particular specialisms or flavours.


Science & Education (published by Springer) is associated with the International History, Philosophy, and Science Teaching Group 5, which as the name might suggest has a focus on science eduction with a focus on the nature of science, and "publishes research using historical, philosophical, and sociological approaches in order to improve teaching, learning, and curricula in science and mathematics".


The Journal of Science Teacher Education (published by Taylor & Francis / Routledge), as the name suggests is concerned with the preparation and development of science teachers. The journal is associated with the USA based Association for Science Teacher Education.


As suggested above, IJSE has a companion journal (also published by Taylor & Francis / Routledge), International Journal of Science Education, Part B – Communication and Public Engagement


Cultural Studies of Science Education (published by Springer) has a particular focus on  science education "as a cultural, cross-age, cross-class, and cross-disciplinary phenomenon".


The Journal of Science Education and Technology (published by Springer) has a focus on the intersection between science education and technology.


Disciplinary and Interdisciplinary Science Education Research has a particular focus on science taught within and across disciplines. 6 Whereas most of the journals described here are now hybrid (which means articles will usually be behind a subscription/pay-wall, unless the author pays a publication fee), DISER is an open-access journal, with publication costs paid on behalf of authors by the sponsoring organisation: the Faculty of Education, Beijing Normal University.

This relatively new journal reflects the increasing awareness of the importance of cross-disciplinary, interdisciplinary and transdisciplinary research in science itself. This is also reflected in notions of whether (or to what extent) science education should be considered part of a broader STEM education, and there are now journals styled as STEM education journals.


Science as part of STEM?

Read about STEM in the curriculum


Research within teaching and learning disciplines

Whilst both the Institute of Physics and the American Institute of Physics publish physics education journals (Physics Education and The Physics Teacher, respectively) neither publishes full length research reports of the kind included in research journals. The American Physical Society does publish Physical Review Physics Education Research as part of its set of Physical Review Journals. This is an on-line journal that is Open Access, so authors have to pay a publication fee.


The Journal of Biological Education (published by Taylor and Francis/Routledge) is the education journal of the Royal Society of Biology.


The Journal of Chemical Education is a long-established journal published by the American Chemical Society. It is not purely a research journal, but it does have a section for educational research and has published many important articles in the field. 7


Chemistry Education Research and Practice (published by the Royal Society of Chemistry, RSC) is purely a research journal, and can be considered the top international journal for research specifically in chemistry education. (Perhaps this is why there is a predatory journal knowingly called the Journal of Chemistry Education Research and Practice)

As CERP is sponsored by the RSC (which as a charity looks to use income to support educational and other valuable work), all articles in CERP are accessible for free on-line, but there are no publication charges for authors.


Not an exhaustive list!

These are the journals I am most familiar with, which focus on science education (or a science discipline education), publish serous peer-reviewed research papers, and can be considered international journals.

I know there are other discipline-based journals (e.g, biochemistry education, geology education) and indeed I expect there are many worthwhile places to publish that have slipped my mind or about which I am ignorant. Many regional or national journals have high standards and publish much good work. However, when it comes to research papers (rather than articles aimed primarily at teachers) academics usually get more credit when they publish in higher status international journals. It is these outlets that can best attract highly qualified editors and reviewers, and so peer review feedback tends to be most helpful 8, and the general standard of published work tends to be of a decent quality – both in terms of technical aspects, and its significance and originality.

There is no reason why work published in English is more important than work published in other languages, but the wide convention of publishing research for an international audience in English means that work published in English language journals probably gets wider attention globally. I have published a small number of pieces in other languages, but am primarily limited by my own restricted competence to only one language. This reflects my personal failings more than the global state of science education publishing!

A personal take – other viewpoints are welcome

So, this is my personal (belated) response to the question about where one should seek to publish research in science education. I have tried to give a fair account, but it is no doubt biased by my own experiences (and recollections), and so inadvertently subject to distortions and omissions.

I welcome any comments (below) to expand upon, or seek to correct, my suggested list, which might indeed make this a more useful listing for readers who are new to publishing their work. If you have had good (or bad) experiences with science education journals included in, or omitted from, my list, please share…


Sources cited:

Notes

1 Academic authorship is understood differently to how the term 'author' is usually used: in most contexts, the author is the person who prepared (wrote, types, dictated) a text. In academic research, the authors of the research paper are those who made a substantial direct intellectual contribution to the work being reported. That is, an author need not contribute to the writing-up phase (though all authors should approve the text) as long as they have made a proper contribution to the substance of the work. Most journals have clear expectations that all deserving authors, and only those people, should be named as authors.

Read about academic authorship


2 For many years the journal was edited by the late Prof. John Gilbert, who I first met sometime in the 1984-5 academic year when I applied to join the University of Surrey/Roehampton Institute part-time teachers' programme in the Practice of Science Education, and he – as one of course directors – interviewed me. I was later privileged to work with John on some projects – so this might be considered as a 'declaration of interest'.


3 Again, I must declare an interest. For some years I acted as the Book Reviews editor for the journal.


4 The centre was the base for the highly influential Children's Learning in Science Project which undertook much research and publication in the field under the Direction of the late Prof. Ros Driver.


5 Another declaration of interest: at the time of writing I am on the IHPST Advisory Board for the journal.


6 Declaration of interest: I am a member of the DISER's Editorial Board


7 I have recently shown some surprise at one research article published in JChemEd where major problems seem to have been missed in peer review. This is perhaps simply an aberration, or may reflect the challenge of including peer-reviewed academic research in a hybrid publication that also publishes a range of other kinds of articles.


8 Peer-review evaluates the quality of submissions, in part to inform publication decisions, but also to provide feedback to authors on areas where they can improve a manuscript prior to publication.

Read about peer review


Download this post


The first annual International Survey of Gullible Research Centres and Institutes

When is a 'survey' not really a survey? Perhaps, when it is a marketing tool.


Keith S. Taber


A research survey seeks information about a population by collecting data from a sample.
Acaudio's 'survey' seems to seek information about whether particular respondents might be persuaded to buy their services.

Today I received an invitation to contribute to something entitled "the first annual International Survey of Research Centres and Institutes". Despite this impressive title, I decided not to do so.

This was not because I had some doubts that whether it really was 'the first…' (has there never previously been an annual International Survey of Research Centres and Institutes?) Nor was it because I had been invited to represent 'The Science and Technology Education Research Group' which I used to lead – but not since retiring from my Faculty duties.

My main reason for not participating was because I suspected this was a scam. I imagined this might be marketing apparently masquerading as academic research. I include the provisos 'suspected' and 'apparently' as I was not quite sure whether this was actually a poor attempt to mislead participants or just a misjudged attempt at witty marketing. That is, I was not entirely sure if recipients of the invitation were supposed to think this was a serious academic survey.



There is a carpet company that claims that no one knows more about floors than … insert here any of a number of their individual employees. Their claims – taken together – are almost logically impossible, and certainly incredible. I am sure most people let this wash over them – but I actually find it disconcerting that I am not sure if the company is (i) having a logical joke I am supposed to enjoy ('obviously you are not meant to believe claims in adverts, so how about this…'), or (ii) simply lying to me, assuming that I will be too stupid to spot the logical incoherence.

Read 'Floored or flawed knowledge?: A domain with a low ceiling'

Why is this not serious academic research?

My first clue that this 'survey' was not a serious attempt at research was that the invitation was from an email address of '[email protected]', rather than from an academic institute or a learned society. Of course, commercial organisations can do serious academic research, if usually when they are hired to do so on behalf of a named academically-focussed organisation. The invitation made no mention of any reputable academic sponsor.

I clicked on the link to the survey to check for the indicators one finds in quality research. Academic research is subject to ethical norms, such as seeking voluntary informed consent, and any invitation to engage in bone fide academic research will provide information to participants up front (either on the front page of the survey or via a link that can be accessed before starting to respond to any questions). One would expect to be informed, at a minimum:

  • who is carrying out the research (and who for, if it is commissioned) and for what purpose;
  • how data will be used – for example, usually it is expected that any information provided with be treated as confidential, securely stored, and only used in ways that protect the anonymity of participants.

This was missing. Commercial organisations sometimes see information you provide differently, as being a resource that they can potentially sell on. (Thus the recent legislation regulating what can or cannot be done with personal information that is collected by organisations.)

Hopefully, potential participants will be informed about the population being sampled and something of the methodology being applied. In an ideal world an International Survey of Research Centres and Institutes would identify and seek data from all Research Centres and Institutes, internationally. That would be an immense undertaking – and is clearly not viable. Consider:

  • How many 'research centres' are initiated, and how many close down or fade away, internationally, each year?
  • Do they all even have websites? (If not, how are they to be identified?)
  • If so, spread over how many languages?

Even attempting a meaningful annual survey of all such organisations would require a substantive, well-resourced, research team working full-time on the task. Rather, a viable survey would collect data from a sample of all research centres and research institutes, internationally. So, some indication of how a sample has been formed, or how potential participants identified, might be expected.

Read about sampling a population of interest

One of the major limitations of many surveys of large populations is that even if a decent sample size is achieved, such surveys are unlikely to reach a representative sample, or even provide any useful indicators of whether the sample might be representative. For example, information provided by 'a sample of 80 science teachers' tells us next to nothing about 'science teachers' in general if we have no idea how representative that sample is.

It can be a different matter when surveys are undertaken of small, well-defined, populations. A researcher looking to survey the students in one school, for example (perhaps for a consultation about a mooted change in school dress policy), is likely to be in a position to make sure all in the population have the opportunity to respond, and perhaps encourage a decent response rate. They may even be able to see if, for example, respondents reflect the wider population in some important ways (for example, if one got responses from 400/1000 students, one would usually be reasonably pleased, but less so if hardly any of the responses were in, say, the two youngest year groups).

In such a situation there is likely to be a definitive list of members of the population, and a viable mechanism to reach them all. In more general surveys, this is seldom the case. One might see a particular type of exception as elections (which can be considered as akin to surveys). The electoral register potentially lists all enfranchised to vote, and includes a postal address where each voter can be informed of a forthcoming poll. In this situation, there is a considerable administrative cost of maintaining the register – considered worth paying to support the democratic process – and a legal requirement to register: yet, even here, no one imagines the roll is ever complete and entirely up-to-date.)

  • How many of the extant Research Centres and Research Institutes, internationally, had been invited to participated in this survey?
  • And did these invitations reflect the diversity of Research Centres and Institutes, internationally?
    • By geographical location?
    • By discipline?

No such information was provided.

The time-scale for an International Survey of Research Centres and Institutes

To be fair the invitation email did suggest the 'researchers' would share outcomes with the participants:

"We will release the results over the next month".

But that time-scale actually seemed to undermine the possibility that this initiative was meant as a serious survey. Anyone who has ever undertaken any serious research knows: it takes time.

When planning the stages of a research project, you should keep in mind that everything will likely take longer than you expect…

even when you allow for that.

Not entirely frivolous advice given to research students

Often with surveys, the initial response is weak (filling in other people's questionnaires is seldom anyone's top priority), and it becomes necessary to undertake additional rounds of eliciting participation. It is good practice to promise to provide feedback; but to offer to do this within a month seems, well, foolhardy.

Except, of course, Acaudio are not a research organisation, and the purpose of the 'survey' was, I suggest, not academic research. As becomes clear from the questions asked, this is marketing 'research': a questionnaire to support Acaudio's own marketing.

What does this company do?

Acaudio offer a platform for allowing researchers to upload short audio summaries of their research. Researchers can do this for free. The platform is open-access, allowing anyone to listen. The library is collated with play-lists and search functions. The company provides researchers data on access to their recordings.

This sounds useful, and indeed 'too good to be true' as there are no charges for the service. Clearly, of itself, that would be a lousy business model.

The website explains:

"We also collaborate with publishers and companies. While our services are licensed to these organizations, generating revenue, this approach is slightly different from our collaboration with you as researchers. However, it enables us to maintain the platform as fully open access for our valued users."

https://acaudio.com/faq

So, having established the website, and built up a library of recordings hosted for free (the 'loss leader' as they say 1), the company is now generating income by entering into commercial arrangements with organisations. Another page on their website claims the company has 'signed' 1000 journals and 2000 research centers [sic]. So, alongside the free service, the company is preparing content on behalf of clients to publicise, in effect advertise, their research for them. Nothing terrible there, although one would hope that the research that has the most impact gets that impact on merit, not because some journals and research centres can pay to bring more attention to their work. This business seems similar to those magazines that offer to feature your research in a special glossy article – for a price.

Read 'Research features…but only if you can afford it'

One would like to think that publicly funded researchers, at least, spend the public's money on the actual research, not on playing the impact indicators game by commissioning glossy articles in magazines which would not be any serious scholar's preferred source of information on research. Sadly, since the advent of the Research Assessment Exercise (and its evolution into the 'Research Excellence Framework') vast amounts of useful resource have been spent on both rating research and in playing the games needed to get the best ratings (and so the consequent research income). As is usually the case with anything of this kind (one could even include formal school examinations!), even if the original notion is well-intentioned,

  • the measurement process comes to distort what it is measuring;
  • those seen as competing spend increasing resources in trying to out do each other in terms of the specifics of the assessment indicators/criteria

So, as research impact is now considered measurable, and as it is (supposedly) measured, and contributes to university income, there is a temptation to spend money on things that might increase impact. It becomes less important whether a study has the potential to increase human health and happiness; and more important to get it the kind of public/'end user' attention that might ultimately lead to evidence of 'impact' – as this will increase income, and allow the research to continue (and, who knows, perhaps eventually even increase human health and happiness).

What do Acaudio want to know?

Given that background, the content of the survey questionnaire makes perfect sense. After collecting some information on your research centre, there are various questions such as

  • How satisfied are you with the level of awareness people have of your centre / institute?
  • How important is it that the general public are aware of the work your centre / institute does?

I suspect most heads of research centres think it is important people know of their work, and are not entirely satisfied that enough people do. (I suspect academic researchers generally tend to think that their own research is actually (i) more important than most other people realise and (ii) deserves more attention than it gets. That's human nature, surely? Any self-effacing and modest scholars are going to have to learn to sell themselves better, or, if not, they are perhaps unlikely to be made centre/institute heads.

There are questions about how much time is spent promoting the research centre, and whether this is enough (clearly, one would always want to do more, surely?), and the challenges of doing this, and who is responsible (I suspect most heads of centres feel some such responsibility, without considering it is how they most want to spend their limited time for research and scholarship).

Perhaps the core questions are:

  • Do you agree it is important to have a dedicated person to take care of promotional activities?
  • How much would you consider to be a reasonable amount to spend on promotional activities?

These questions will presumably help Acaudio decide whether you can easily be persuaded to sign up for their help, and what kind of budget you might have for this. (The responses for the latter include an option for spending more than $5000 each year on promotional activities!)

I am guessing that at even $5000+ p.a., they would not actually provide a person dedicated to 'take care of promotional activities' for you, rather than a person dedicated to adding your promotional activities to their existing portfolio of assigned clients!

So, this is a marketing questionnaire.

Is this dishonest?

It seems misleading to call a marketing questionnaire 'the first annual International Survey of Research Centres and Institutes' unless Acaudio are making a serious attempt to undertake a representative survey of Research Centres and Institutes, internationally, and they do intend to publish a full analysis of the findings. "We will release the results over the next month" sounds like a promise to publish, so I will look out with interest for an announcement that the results have indeed been made available.

Lies, delusional lies, and ill-judged attempts at humour

Of course, lying is not simply telling untruths. A person who claims to be Napoleon or Joan of Arc is not lying if that person actually believes that is who they are. Someone who claims they are the best person to run your country is not necessarily lying simply because the claim is false. If the Acaudio people genuinely think they are really doing an International Survey of Research Centres and Institutes then their invitation is not dishonest even if it might betray any claim to know much about academic research.


"I'm [an actor playing] Spartacus";"I'm [an actor playing another character who is not Spartacus, but is pretending to be] Spartacus"; "I'm [another actor playing another character who is also not Spartacus, but is also pretending to be] Spartacus"… [Still from Universal Pictures Home Entertainment movie 'Spartacus']


Nor is it lying, when there is no intent to deceive. Something said sarcastically or as a joke, or in the context of a theatrical performance, is not a lie as long as it is expected that the audience share the conceit and do not confuse it for an authentic knowledge claim. Kirk Douglas, Tony Curtis, and their fellow actors playing rebellious Roman slaves, all knew they were not Spartacus, and that anyone in a cinema watching their claims to be the said Spartacus would recognise these were actors playing parts in a film – and that indeed in the particular context of a whole group of people all claiming to be Spartacus, the aim even in the fiction was actually NOT to identify Spartacus, but to confuse the whole issue (even if being crucified as someone who was only possibly Spartacus might be seen as a Pyrrhic victory 2).

So, given that the claim to be undertaking the first annual International Survey of Research Centres and Institutes was surely, and fairly obviously, an attempt to identify research centres that (a) might be persuaded to purchase Acaudio's services and (b) had budget to pay for those services, I am not really sure this was an attempt to deceive. Perhaps it was a kind of joke, intended to pull in participants, rather than a serious attempt to fool them.

That said, any organisation hoping for credibility among the academic community surely needs to be careful about its reputation. Sending out scam emails that claim to be seeking participants for a research survey that is really a marketing questionnaire seems pretty dubious practice, even if there was no serious attempt to follow through by disguising the questionnaire as a serious piece of research. You might initially approach the questionnaire thinking it was genuine research, but as you worked through it SHOULD have dawned that this information was being collected because (i) it is of commercial value to Acaudio, and not (ii) to answer any theoretically motivated research questions.

  • So, is this dishonest? Well, it is not what it claims to be.
  • Does this intend to deceive? If it did, then it was not well designed to hide its true purpose.
  • Is it malpractice? Well, there are rules in the U.K. about marketing emails:

"You're only allowed to send marketing emails to individual customers if they've given you permission.

Emails or text messages must clearly indicate:

  • who you are
  • that you're selling something

Every marketing email you send must give the person the ability to opt out of (or 'unsubscribe from') further emails."

https://www.gov.uk/marketing-advertising-law/direct-marketing

The email from Hussain Ayed, Founder, Acaudio, told me who he, and his organisation, are, but

  • did not clearly suggest he was selling something: he was inviting me to contribute to a research survey (illegal?)
  • Nor was there any option to opt out of further messages (illegal?)
  • And I am not aware of having invited approaches from this company – which might be why it was masquerading as a request to contribute to research (illegal?)

I checked my email system to see if I'd had any previous communication with this company, and found in my junk folder a previous approach,"invit[ing Keith, again] to talk about some of the research being done at The Science and Technology Education Research Group on Acaudio…". It seems my email software can recognise cold calling – as long as it does not claim to be an invitation to respond to a research study.



The earlier email claimed it was advertising the free service…but then invited me to arrange a time to talk to them for 'roughly' 20 minutes. That seems odd, both because the website seems to provide all the information needed; and then why would they commit 20 minutes of their representative's time to talk about a free service? Presumably, they wanted to sell me their premium service. The email footer also gave a business address in E9, London – so the company should know about the UK laws about direct marketing that Acaudio seems to be flouting.

Perhaps not enough people responded to give them 20 minutes of their time, so the new approach skips all that and asks instead for people to "give us 2-3 minutes of your time to fill in the survey [sic 3]".


Original image by Mohamed Hassan from Pixabay


Would you buy a second hand account of research from this man?

In summary, if someone is looking to buy in this kind of support in publicising their work, and has the budget(!), and feels it is acceptable to spend research funds on such services, then perhaps they might fill in the questionnaire and await the response. But I am not sure I would want to get involved with companies which use marketing scams in this way. After all, if they cannot even start a conversation by staying within the law, and being honest about their intentions, then that does not bode well for being able to trust them going forward into a commercial arrangement.


Update (15th October, 2023): Were the outcomes of the first annual International Survey of Research Centres and Institutes published? See 'The sugger strikes back! An update on the 'first annual International Survey of Research Centres and Institutes'


Notes

1 When a shop offers a product at a much discounted price, below the price needed to 'break even', so as to entice people into the shop where they will hopefully buy other goods (at a decent mark-up for the seller), the goods sold at a loss are the 'loss leaders'.

Goods may also be sold at a loss when they are selling very slowly, to make space on the shop floor and in the storeroom for new produce that it is hoped will generate profit. Date-sensitive goods may be sold at a loss because they will soon not be saleable at all (such as perishables) or only at even greater discounts (such as models about to be replaced by updated versions by manufacturers – e.g., iPhones). But loss leader goods are priced low to get people to view other produce (so they might be displayed dominantly in the window, but only found deep in the shop).


2 In their wars against the armies of King Pyrrhus of Epirus, the Romans lost battles, but in doing so inflicted such heavy and unsustainable losses on the nominally victorious invading army that Pyrrhus was forced to abandon his campaign.

At the end of the slave revolt (a historical event on which the film 'Spartacus' is based) the Romans are supposed to have decided to execute the rebel leader, the escaped gladiator Spartacus, and return the other rebels to slavery. Supposedly, when the Roman official tried to identify Spartacus, each of the recaptured slaves in turn claimed he was Spartacus, thus thwarting identification. So, the ever pragmatic Romans crucified them all.


3 The set of questions is actually a questionnaire which is used to collect data for the survey. Survey (a type of methodology) does not necessarily imply using a questionnaire (a data collection technique) as a survey could be carried out using an observation schedule (i.e., a different data collection technique), for example.

Read about surveys

Read about questionnaires


Are physics teachers unaware of the applications of physics to other sciences?

Confounding conceptual integration


Keith S. Taber


Tuysuz and colleagues seem to have found chemistry and physics teachers have a different attitude to the importance of integrating concepts from across the subjects.


Conceptual integration?

Conceptual integration is very important in science. That is, science doesn't consist of a large set of unrelated facts, but rather the ability to subsume a great many phenomena under a limited number of ideas is valued. James Clerk Maxwell is widely remembered for showing that electricity, magnetism and radiation such as light (that is, what we now call electromagnetic radiation) were intimately related, and today theoretical physicists seek a 'Grand Unified Theory' that would account of all the forces in nature. Equally, the apparent incompatibility of the two major scientific ideas of the early twentieth century – general relativity and quantum mechanics – is widely recognised as suggesting a fundamental problem in our current best understanding of the world.

So, conceptual integration can be seen as a scientific value: something scientists expect to find in nature 1 and something they seek through their research.

Learners may not appreciate this. When I was teaching physics and chemistry I was quite surprised to see how little some students who studied both subjects would notice, or indeed expect, ideas taught in one course to link to those in another (e.g., Taber, 1998).

A demarcation criterion?

I have even, only partially tongue-in-cheek, suggested that a criterion for identifying an authentic science education would be that it emphasises the connections within science, both within and across disciplines (Taber, 2006). 2

Sadly, there has been limited attention to this theme within science education, and very little research. I was therefore pleased to find a references to a Turkish study on the topic. 3

A study with teachers-in-preparation

Tuysuz, Bektas, Geban, Ozturk and Yalvac (2016) undertook an interview study with students preparing for school science teaching. One of their findings was:

"Generally speaking, while the pre-service chemistry teachers think that physics concepts should be used in the chemistry lessons, the pre-service physics teachers believe that these two subjects' concepts generally are not related to each other."

Tuysuz, Bektas, Geban, Ozturk & Yalvac, 2016

Reading this in isolation might seem to suggest that those preparing for chemistry teaching (and therefore, likely, chemistry teachers) saw more value in emphasising conceptual integration in teaching than those preparing for physics teaching (and therefore, likely, physics teachers).

Why might physics teachers give less value to conceptual integration?

It is easy to try to think of possible reasons for this:

  • Conjecture 1: chemistry teachers are aware of how chemistry draws upon physical concepts, and so are more minded to emphasise links between the subjects than physics teachers. 4
  • Conjecture 2: physicists, and so physics teachers, are more arrogant about their discipline than other scientists (cf. "All science is either physics or stamp collecting" – as Ernest Rutherford supposedly claimed!)
  • Conjecture 3: chemists are more likely to have also studied other science disciplines at a high level (and so are well placed to appreciate conceptual integration across sciences), whereas physics specialists are more likely to have mainly focussed on mathematics as a subsidiary subject rather than other sciences.

I imagine other possibilities will have occurred to readers, but before spending too much time on explaining Tuysuz and colleagues' findings, it is worth considering how they came to this conclusion.

Not an experiment

Tuysuz and colleagues do not claim to have undertaken an experimental study, but rather claim their work is phenomenology. It did not use a large, randomly selected (and, so, likely to be representative) sample of populations of pre-service science teachers (as would be needed for an experiment), but rather used a convenience sample of six students who were accessible and willing to help: three pre-service physics teachers and three pre-service chemistry teachers.

Read about sampling populations in research

It is not unusual for educational studies to be based on very small samples, as this allows for in-depth work. If you want to know what a person really thinks about a topic, you need to establish rapport and trust with them, and encourage them to talk in some detail – not just offer a rating to some item on a questionnaire. Small samples are perfectly proper in such studies.

What is questionable, is whether it is really meaningful to tease out differences between two identified groups (e.g., pre-service chemistry teachers; pre-service physics teachers) based on such samples. We cannot generalise without representative samples, so, when Tuysuz, Bektas, Geban, Ozturk and Yalvac write "Generally speaking…", their study does not really support such generalisation. The authors are only reporting what they found in their particular sample, and so the reader needs to contextualise their claim in terms of further details of the study, i.e., the reader needs to read the claim as

"Generally speaking, while the three pre-service chemistry teachers who volunteered to talk to us from this one teacher preparation programme think that physics concepts should be used in the chemistry lessons, the three pre- service physics teachers who volunteered to talk to us from this one programme believe that these two subjects' concepts generally are not related to each other."

Put in those terms, this is a very localised and limited kind of 'generally'.

This does not undermine the potential value of the study. That any future school science teachers might think that "these two subjects' concepts generally are not related to each other" is a worrying finding.

A confounded design

Another reason why it is important not to read Tuysuz's study as suggesting a general difference between teacher candidates in physics and chemistry, is because of a major confound in the study design. If the research had been intended as an experiment, where the investigators have to control variables so that there is only one differences between the different conditions, this would have been a critical flaw in the design.

The pre-service physics teachers and the pre-service chemistry teachers were taking parallel, but distinct, courses during the study. The authors report that the teaching approaches were different in the two subject areas. In particular, the paper reports that in the case of the pre-service chemistry teachers conceptual integration was explicitly discussed. The chemists – but not the physicists – were taught that conceptual integration was important. When interviewed, the chemists (who had been taught about conceptual integration) suggested conceptual integration was more important than the physicists (who had not been taught about conceptual integration) did!

  • This might have been because of their different subject specialisms;
  • It might have been because of the differences in the practice teaching courses taken by the two groups, such as perhaps the specific engagement of the chemists (but not the physicists) with ideas about conceptual integration during their course;
  • It might have been due to an interaction between these two factors (that is, perhaps neither difference by itself would have led to this finding);
  • And it might have simply reflected the ideas and past experiences of the particular three students in the chemists group, and the particular three students in the physicists group.

Tuysuz and colleagues found that, 'generally speaking', three students (who were chemistry specialists and had been taught about conceptual integration) had a different attitude to the importance of conceptual integration in teaching science to three other students (who were physics specialists and had not been taught about conceptual integration)

Read about confounding variables in research

The researchers might have just as readily reported that:

"Generally speaking, while the pre-service science teachers who had discussed conceptual integration in their course think that physics concepts should be used in the chemistry lessons, the pre-service science teachers who had not been taught about this believe that these two subjects' concepts generally are not related to each other."

Of course, such a conclusion would be equally misleading as both factors (subject specialism and presence/absence of explicit teaching input) vary simultaneously between the two groups of students, so it is inappropriate to suggest a general difference due to either factor in isolation.


Work cited:

Notes

1 Although science is meant to be based on objective observations of the natural world, scientists approach their work with certain fundamental assumptions about nature. These might include beliefs that

  • an objective account of nature is in principle possible (that different observers can observe the same things), and
  • that there is at some level a consistent nature to the universe (there are fixed laws which continue to apply over time)

assumptions that are needed for science to be meaningful. As these things are assumed prior to undertaking any scientific observations they can be considered metaphysical commitments (Taber, 2013).

[Download 'Conceptual frameworks, metaphysical commitments and worldviews']

Another metaphysical commitment generally shared by scientists as a common worldview is that the complex and diverse phenomena we experience can be explained by a limited number of underlying principles and laws. From this perspective, progress in science leads to increased integration between topics.


2 The term 'demarcation criterion' is often used in relation to deciding what should be considered a science (e.g., usually, astronomy is considered a science, and so is biochemistry; but not astrology or psychoanalysis). A famous example of a demarcation criterion, due to Karl Popper, is that a scientific conjecture is one which is in principle capable of being refuted.

Astronomers can use their theories and data to predict the date of the next solar eclipse, for example. If the eclipse did not occur when predicted, that would be considered a falsification.

By contrast, if a psychotherapist suggested a person had personality issues due to repressed, unresolved, feelings about their parents, then this cannot be refuted. (The client may claim having positive and untroubled relationships with the parents, but the therapist does not consider this a refutation as the feelings have been repressed, so they are not consciously available to the client. The problem can only be detected indirectly by signs which the therapist knows how to interpret.).


3 I became aware of the study discussed here when reading the work in progress of Louise Vong, who has been doing some research in this important topic.


4 Physics concepts are widely applied in chemistry, but not vice versa. So, this is suggesting that chemistry teachers have more need to refer to physics in teaching their subject than the converse.

However, we could also have looked to explain the opposite finding (had it been reported that pre-service physics teachers paid more attention to conceptual integration than pre-service chemistry teachers) by suggesting physics teachers have more reason to refer to chemistry topics when discussing examples of applications of concepts being taught, than chemistry teachers have to refer to physics topics.


Is your heart in the research?

Someone else's research, that is


Keith S. Taber


Imagine you have a painful and debilitating illness. Your specialist tells you there is no conventional treatment known to help. However, there is a new – experimental – procedure: a surgery that may offer relief. But it has not yet been fully tested. If you are prepared to sign up for a study to evaluate this new procedure, then you can undergo surgery.

You are put under and wheeled into the operating theatre. Whilst you experience – rather, do not experience – the deep, sleepless rest of anaesthesia, the surgeon saws through your breastbone, prises open your ribcage with a retractor (hopefully avoiding breaking any ribs),
reaches in, and gently lifts up your heart.

The surgeon, pauses, perhaps counts to five, then carefully replaces your heart between the lungs. The ribcage is closed, and you are sown-up without any actual medical intervention. You had been randomly assigned to the control group.


How can we test whether surgical interventions are really effective without blind controls?

Is it right to carry out sham operations on sick people just for the sake of research?

Where is the balance of interests?

(Image from Pixabay)


Research ethics

A key aspect of planning, executing and reviewing research is ethical scrutiny. Planning, obviously, needs to take into account ethical considerations and guidelines. But even the best laid plans 'of mice and men' (or, of, say, people investigating mice) may not allow for all eventualities (after all, if we knew what was going to happen for sure in a study, it would not be research – and it would be unethical to spend precious public resources on the study), so the ethical imperative does not stop once we have got approval and permissions. And even then, we may find that we cannot fully mitigate for unexpected eventualities – which is something to be reported and discussed to help inform future research.

Read about research ethics

When preparing students setting out on research, instruction about research ethics is vital. It is possible to teach about rules, and policies, and guidelines and procedures – but real research contexts are often complex, and ethical thinking cannot be algorithmic or a matter of adopting slogans and following heuristics. In my teaching I would include discussion of past cases of research studies that raised ethical questions for students to discuss and consider.

One might think that as research ethics is so important, it would be difficult to find many published studies which were not exemplars of good practice – but attitudes to, and guidance on, ethics have developed over time, and there are many past studies which, if not clearly unethical in today's terms, at least present problematic cases. (That is without the 'doublethink' that allows some contemporary researchers to, in a single paper, both claim active learning methods should be studied because it is known that passive learning activities are not effective, yet then report how they required teachers to instruct classes through passive learning to act as control groups.)

Indeed, ethical decision-making may not always be straight-forward – as it often means balancing different considerations, and at a point where any hoped-for potential benefits of the research must remain uncertain.

Pretending to operate on ill patients

I recently came across an example of a medical study which I thought raised some serious questions, and which I might well have included in my teaching of research ethics as a case for discussion, had I known about before I retired.

The research apparently involved surgeons opening up a patient's ribcage (not a trivial procedure), and lifting out the person's heart in order to carry out a surgical intervention…or not,

"In the late 1950s and early 60s two different surgical teams, one in Kansas City and one in Seattle, did double-blind trials of a ligation procedure – the closing of a duct or tube using a clip – for very ill patients suffering from severe angina, a condition in which pain radiates from the chest to the outer extremities as a result of poor blood supply to the heart. The surgeons were not told until they arrived in the operating theatre which patients were to receive a real ligation and which were not. All the patients, whether or not they were getting the procedure, had their chest cracked open and their heart lifted out. But only half the patients actually had their arteries rerouted so that their blood could more efficiently bathe its pump …"

Slater, 2018

The quote is taken from a book by Lauren Slater which sets out a history of drug use in psychiatry. Slater is a psychotherapist who has written a number of books about aspects of mental health conditions and treatments.

Fair testing

In order to make a fair experiment, the double-blind procedure sought to treat the treatment and control group the same in all respects, apart from the actual procedure of ligation of selected blood vessels that comprised the mooted intervention. The patients did not know (at least, in one of the studies) they might not have the real operation. Their physicians were not told who was getting the treatment. Even the surgeons only found out who was in each group when the patient arrived in theatre.

It was necessary for those in the control group to think they were having an intervention, and to undergo the sham surgery, so that they formed a fair comparison with those who got the ligation.

Read about control of variables

It was necessary to have double-blind study (neither the patients themselves, nor the physicians looking after them, were told which patients were, and which were not, getting the treatment), because there is a great deal of research which shows that people's beliefs and expectations make substantial differences to outcomes. This is a real problem in educational research when researchers want to test classroom practices such as new teaching schemes or resources or innovative pedagogies (Taber, 2019). The teacher almost certainly knows whether she is teaching the experimental or control group, and usually the students have a pretty good idea. (If every previous lesson has been based on teacher presentations and note-taking, and suddenly they are doing group discussion work and making videos, they are likely to notice.)

Read about expectancy effects

It was important to undertake a study, because there was not clear objective evidence to show whether the new procedure actually improved patient outcomes (or possibly even made matters worst). Doctors reported seeing treated patients do better – but could only guess how they might have done without surgery. Without proper studies, many thousands or people might ultimately undergo an ineffective surgery, with all the associated risks and costs, without getting any benefit.

Simply comparing treated patients with matched untreated patients would not do the job, as there can be a strong placebo effect of believing one is getting a treatment. (It is likely that at least some alternative therapies largely work because a practitioner with good social skills spends time engaging with the patient and their concerns, and the client expects a positive outcome.)

If any positive effects of heart surgery were due to the placebo effect, then perhaps a highly coloured sugar pill prescribed with confidence by a physician could have the same effect without operating theatres, surgical teams, hospital stays… (For that matter, a faith healer who pretended to operate without actually breaking the skin, and revealed a piece of material {perhaps concealed in a pocket or sleeve} presented as an extracted mass of diseased tissue or a foreign body, would be just as effective if the patient believed in the procedure.)

So, I understood the logic here.

Do no harm

All the same – this seemed an extreme intervention. Even today, anaesthesia is not very well understood in detail: it involves giving a patient drugs that could kill them in carefully controlled sub-lethal doses – when how much would actually be lethal (and what would be insufficient to fully sedate) varies from person to person. There are always risks involved.


"All the patients, whether or not they were getting the procedure had their chest cracked open and their heart lifted out."

(Image by Starllyte from Pixabay)


Open heart surgery exposes someone to infection risks. Cracking open the chest is a big deal. It can take two months for the disrupted tissues to heal. Did the research really require opening up the chest and lifting the heart for the control group?

Could this really ever have been considered ethical?

I might have been much more cynical had I not known of other, hm, questionable medical studies. I recall hearing a BBC radio documentary in the 1990s about American physicians who deliberately gave patients radioactive materials without their knowledge, just to to explore the effects. Perhaps most infamously there was the Tuskegee Syphilis study where United States medical authorities followed the development of disease over decades without revealing the full nature of the study, or trying to treat any of those infected. Compared with these violations, the angina surgery research seemed tame.

But do not believe everything you read…

According to the notes at the back of Slater's book, her reference was another secondary source (Moerman, 2002) – that is someone writing about what the research reports said, not those actual 'primary' accounts in the research journals.

So, I looked on-line for the original accounts. I found a 1959 study, by a team from the University of Washington School of Medicine. They explained that:

"Considerable relief of symptoms has been reported for patient with angina pectoris subjected to bilateral ligation of the internal mammary arteries. The physiologic basis for the relief of angina afforded by this rather simple operation is not clear."

Cobb, Thomas, Dillard, Merendino & Bruce, 1959

It was not clear why clamping these blood vessels in the chest should make a substantial difference to blood flow to the heart muscles – despite various studies which had subjected a range of dogs (who were not complaining of the symptoms of angina, and did not need any surgery) to surgical interventions followed by invasive procedures in order to measure any modifications in blood flow (Blair, Roth & Zintel, 1960).

Would you like your aorta clamped, and the blood drained from the left side of your heart, for the sake of a research study?

That raises another ethical issue – the extent of pain and suffering and morbidity it is fair to inflect on non-human animals (which are never perfect models for human anatomy and physiology) to progress human medicine. Some studies explored the details of blood circulation in dogs. Would you like your aorta clamped, and the blood drained from the left side of your heart, for the sake of a research study? Moreover, in order to test the effectiveness of the ligation procedure, in some studies healthy dogs had to have the blood supply to the heart muscles disrupted to given them similar compromised heart function as the human angina sufferers. 1

But, hang on a moment. I think I passed over something rather important in that last quote: "this rather simple operation"?

"Considerable relief of symptoms has been reported for patient with angina pectoris subjected to bilateral ligation of the internal mammary arteries. The physiologic basis for the relief of angina afforded by this rather simple operation is not clear."

Cobb and colleagues' account of the procedure contradicted one of my assumptions,

 At the time of operation, which was performed under local anesthesia [anaesthesia], the surgeon was handed a randomly selected envelope, which contained a card instructing him whether or not to ligate the internal mammary arteries after they had been isolated.

Cobb et al, 1959

It seems my inference that the procedure was carried out under general anaesthetic was wrong. Never assume! Surgery under local anaesthetic is not a trivial enterprise, but carries much less risk than general anaesthetic.

Yet, surely, even back then, no surgeon was going to open up the chest and handle the heart under a local anaesthetic? Cobb and colleagues wrote:

"The surgical procedures commonly used in the therapy of coronary-artery disease have previously been "major" operations utilizing thoracotomy and accompanied by some morbidity and a definite mortality. … With the advent of internal-mammary-artery ligation and its alleged benefit, a unique opportunity for applying the principles of a double-blind evaluation to a surgical procedure has been afforded

Cobb, Thomas, Dillard, Merendino & Bruce, 1959

So, the researchers were arguing that, previously, surgical interventions for this condition were major operations that did involve opening up the chest (thorax) – thoracotomy – where sham surgery would not have been ethical; but the new procedure they were testing – "this rather simple operation" was different.

Effects of internal-mammary-artery ligation on 17 patients with angina pectoris were evaluated by a double-blind technic. Eight patients had their internal mammary arteries ligated; 9 had skin incisions only. 

Cobb et al, 1959

They describe "a 'placebo' procedure consisting of parasternal skin incisions"– that is some cuts were made into the skin next to the breast bone. Skin incisions are somewhat short of open heart surgery.

The description given by the Kansas team (from the Departments of Medicine and Surgery, University of Kansas Medical Center, Kansas City) also differs from Slater's third-hand account in this important way:

"The patients were operated on under local anesthesia. The surgeon, by random sampling, selected those in whom bilateral internal mammary artery and vein ligation (second interspace) was to be carried out and those in whom a sham procedure was to be performed. The sham procedure consisted of a similar skin incision with exposure of the internal mammary vessels, but without ligation."

Dimond, Kittle & Crocket, 1960

This description of the surgery seemed quite different from that offered by Slater.

These teams seemed to be reporting a procedure that could be carried out without exposing the lungs or the heart and opening their protective covers ("in this technique…the pericardium and pleura are not entered or disturbed", Glover, et al, 1957), and which could be superficially forged by making a few cuts into the skin.


"The performance of bilateral division of the internal mammary arteries as compared to other surgical procedures for cardiac disease is safe, simple and innocuous in capable hands."

Glover, Kitchell, Kyle, Davila & Trout, 1958

The surgery involved making cuts into the skin of the chest to access, and close off, arteries taking blood to (more superficial) chest areas in the hope it would allow more to flow to the heart muscles; the sham surgery, the placebo, involved making similar incisions, but without proceeding to change the pattern of arterial blood flow.

The sham surgery did not require general anaesthesia and involved relatively superficial wounds – and offered a research technique that did not need to cause suffering to, and the sacrifice of, perfectly healthy dogs. So, that's all ethical then?

The first hand research reports at least give a different impression of the balance of costs and potential benefits to stakeholders than I had originally drawn from Lauren Slater's account.

Getting consent for sham surgery

A key requirement for ethical research with human participants is being offered voluntary informed consent. Unlike dogs, humans can assent to research procedures, and it is generally considered that research should not be undertaken without such consent.

Read about voluntary informed consent

Of course, there is nuance and complication. The kind of research where investigators drop large denomination notes to test the honesty of passers by – where the 'participants' are in a public place and will not be identified or identifiable – is not usually seen as needing such consent (which would clearly undermine any possibility of getting authentic results). But is it acceptable to observe people using public toilets without their knowledge and consent (as was described in one published study I used as a teaching example)?

The extent to which a lay person can fully understand the logic and procedures explained to them when seeking consent can vary. The extent to which most participants would need, or even want to, know full details of the study can vary. When children of various ages are are involved, the extent to which consent can be given on their behalf by a parent or teachers raises interesting questions.


"I'm looking for volunteers to have a procedure designed to make it look like you've had surgery"

Image by mohamed_hassan from Pixabay


There is much nuance and many complications – and this is an area researchers needs to give very careful consideration.

  • How many ill patients would volunteer for sham surgery to help someone else's research?
  • Would that answer change, if the procedure being tested would later be offered to them?
  • What about volunteering for a study where you have a 50-50 chance of getting the real surgery or the placebo treatment?

In Cobb's study, the participants had all volunteered – but we might wonder if the extent of the information they were given amounted to what was required for informed consent,

The subjects were informed of the fact that this procedure had not been proved to be of value, and yet many were aware of the enthusiastic report published in the Reader's Digest. The patients were told only that they were participating in an evaluation of this operation; they were not informed of the double-blind nature of the study.

Cobb et al, 1959

So, it seems the patients thought they were having an operation that had been mooted to help angina sufferers – and indeed some of them were, but others just got taken into surgery to get a few wounds that suggested something more substantive had been done.

Was that ethical? (I doubt it would be allowed anywhere today?)

The outcome of these studies was that although the patients getting the ligation surgery did appear to get relief from their angina – so did those just getting the skin incisions. The placebo seemed just as good as the re-plumbing.

In hindsight, does this make the studies more worthwhile and seem more ethical? This research has probably prevented a great many people having an operation to have some of their vascular system blocked when that does not seem to make any difference to angina. Does that advance in medical knowledge justify the deceit involved in leading people to think they would get an experimental surgical treatment when they might just get an experimental control treatment?


Ethical principles and guidelines can helps us judge the merits of study

Coda – what did the middle man have to say?

I wondered how a relatively minor sham procedure under local anaesthetic became characterised as "the patients, whether or not they were getting the procedure had their chest cracked open and their heart lifted out" – a description which gave a vivid impression of a major intervention.


The heart is pretty well integrated into the body – how easy is it to life an intact, fully connected, working heart out of position?

Image by HANSUAN FABREGAS from Pixabay


I wondered to what extent it would even be possible to lift the heart out from the chest whilst it remained connected with the major vessels passing the blood it was pumping, and the nerves supplying it, and the vessels supplying blood to its own muscles (the ones that were considered compromised enough to make the treatment being tested worth considering). Some sources I found on-line referred to the heart being 'lifted' during open-heart procedures to give the surgeon access to specific sites: but that did not mean taking the heart out of the body. Having the heart 'lifted out' seemed more akin to Aztec sacrificial rites than medical treatment.

Although all surgery involves some risk, the actual procedure being investigated seemed of relatively routine nature. I actually attended a 'minor' operation which involved cutting into the chest when my late wife was prepared for kidney dialysis. Usually a site for venal access is prepared in the arm well in advance, but it was decided my wife needed to be put on dialysis urgently. A temporary hole was cut into her neck to allow the surgeon to connect a tube (a central venous catheter) to a vein, and another hole into her chest so that the catheter would exit in her chest, where the tap could be kept sterile, bandaged to the chest. This was clearly not considered a high risk operation (which is not to say I think I could have coped with having this done to me!) as I was asked by the doctors to stay in the room with my wife during the procedure, and I did not need to 'scrub' or 'gown up'.

Bilateral internal mammary artery ligation seemed a procedure on that kind of level, accessing blood vessels through incisions made in the skin. However, if Lauren Slater had read up some of the earlier procedures that did require opening the chest, or if she had read the papers describing how the dogs were investigated to trace blood flow through connected vessels, measure changes in flow, and prepare them for induced heart conditions, I could appreciate the potential for confusion. Yet she did not cite the primary research, but rather Daniel Moerman, an Emeritus Professor of Anthropology at University of Michigan-Dearborn, who has written a book about placebo treatments in medicine.

Moerman does write about the bilateral internal mammary artery ligation, and the two sham surgery studies I found in my search. Moerman describes the operation:

"It was quite simple, and since the arteries were not deep in the body, could be performed under local anaesthetic."

Moerman, 2002

He also refers to the subjective reports on one of the patients assigned to the placebo condition in one of the studies, who claimed to feel much better immediately after the procedure:

"This patient's arteries were not ligated…But he did have two scars on his chest…"

Moerman, 2002

But nobody cracked open his chest, and no one handled his heart.

There are still ethical issues here, but understanding the true (almost superficial) nature of the sham surgery clearly changes the balance of concerns. If there is a moral to this article, it is perhaps the importance of being fully informed before reaching judgement about the ethics of a research study.


Work cited:
  • Blair, C. R., Roth, R. F., & Zintel, H. A. (1960). Measurement of coronary artery blood-flow following experimental ligation of the internal mammary artery. Annals of Surgery, 152(2), 325.
  • Cobb, L. A., Thomas, G. I., Dillard, D. H., Merendino, K. A., & Bruce, R. A. (1959). An evaluation of internal-mammary-artery ligation by a double-blind technic. New England Journal of Medicine, 260(22), 1115-1118.
  • Dimond, E. G., Kittle, C. F., & Crockett, J. E. (1960). Comparison of internal mammary artery ligation and sham operation for angina pectoris. The American Journal of Cardiology, 5(4), 483-486.
  • Glover, R. P., Davila, J. C., Kyle, R. H., Beard, J. C., Trout, R. G., & Kitchell, J. R. (1957). Ligation of the internal mammary arteries as a means of increasing blood supply to the myocardium. Journal of Thoracic Surgery, 34(5), 661-678. https://doi.org/https://doi.org/10.1016/S0096-5588(20)30315-9
  • Glover, R. P., Kitchell, J. R., Kyle, R. H., Davila, J. C., & Trout, R. G. (1958). Experiences with Myocardial Revascularization By Division of the Internal Mammary Arteries. Diseases of the Chest, 33(6), 637-657. https://doi.org/https://doi.org/10.1378/chest.33.6.637
  • Moerman, D. E. (2002). Meaning, Medicine, and the "Placebo Effect". Cambridge University Press Cambridge.
  • Slater, Lauren (2018) The Drugs that Changed our Minds. The history of psychiatry in ten treatments. London. Simon & Schuster
  • Taber, K. S. (2019). Experimental research into teaching innovations: responding to methodological and ethical challengesStudies in Science Education, 55(1), 69-119. doi:10.1080/03057267.2019.1658058 [Download this paper.]


Note:

1 To find out if the ligation procedure protected a dog required stressing the blood supply to the heart itself,

"An attempt has been made to evaluate the degree of protection preliminary ligation of the internal mammary artery may afford the experimental animal when subjected to the production of sudden, acute myocardial infarction by ligation of the anterior descending coronary artery at its origin. …

It was hoped that survival in the control group would approximate 30 per cent so that infarct size could be compared with that of the "protected" group of animals. The "protected" group of dogs were treated in the same manner but in these the internal mammary arteries were ligated immediately before, at 24 hours, and at 48 hours before ligation of the anterior descending coronary.

In 14 control dogs, the anterior descending coronary artery with the aforementioned branch to the anterolateral aspect of the left ventricle was ligated. Nine of these animals went into ventricular fibrillation and died within 5 to 20 minutes. Attempts to resuscitate them by defibrillation and massage were to no avail. Four others died within 24 hours. One dog lived 2 weeks and died in pulmonary edema."

Glover, Davila, Kyle, Beard, Trout & Kitchell, 1957

Pulmonary oedema involves fluid build up in the lungs that restricts gaseous exchange and prevents effective breathing. The dog that survived longest (if it was kept conscious) will have experienced death as if by slow suffocation or drowning.

Why ask teachers to 'transmit' knowledge…

…if you believe that "knowledge is constructed in the minds of students"?


Keith S. Taber


While the students in the experimental treatment undertook open-ended enquiry, the learners in the control condition undertook practical work to demonstrate what they had already been told was the case – a rhetorical exercise that reflected the research study they were participating in


A team of researchers chose to compare a teaching approach they believed met the requirements for good science instruction, and which they knew had already been demonstrated effective pedagogy in other studies, with teaching they believed was not suitable for bringing about conceptual change.
(Ironically, they chose a research design more akin to the laboratory activities in the substandard control condition, than to the open-ended enquiry that was part of the pedagogy they considered effective!)

An imaginary conversation 1 with a team of science education researchers.

When we critically read a research paper, we interrogate the design of the study, and the argument for new knowledge claims that are being made. Authors of research papers need to anticipate the kinds of questions readers (editors, reviewers, and the wider readership on publication) will be asking as they try to decide if they find the study convincing.

Read about writing-up research

In effect, there is an asynchronous conversation.

Here I engage in 'an asynchronous conversation' with the authors of a research paper I was interrogating:

What was your study about?

"This study investigated the effect of the Science Writing Heuristic (SWH) approach on grade 9 students' understanding of chemical change and mixture concepts [in] a Turkish public high school."

Kingir, Geban & Gunel, 2013

I understand this research was set up as a quasi-experiment – what were the conditions being compared?

"Students in the treatment group were instructed by the SWH approach, while those in the comparison group were instructed with traditionally designed chemistry instruction."

Kingir, Geban & Gunel, 2013

Constructivism

Can you tell me about the theoretical perspective informing this study?

"Constructivism is increasingly influential in guiding student learning around the world. However, as knowledge is constructed in the minds of students, some of their commonsense ideas are personal, stable, and not congruent with the scientifically accepted conceptions… Students' misconceptions [a.k.a. alternative conceptions] and learning difficulties constitute a major barrier for their learning in various chemistry topics"

Kingir, Geban & Gunel, 2013

Read about constructivist pedagogy

Read about alternative conceptions

'Traditional' teaching versus 'constructivist' teaching

So, what does this suggest about so-called traditional teaching?

"Since prior learning is an active agent for student learning, science educators have been focused on changing these misconceptions with scientifically acceptable ideas. In traditional science teaching, it is difficult for the learners to change their misconceptions…According to the conceptual change approach, learning is the interaction between prior knowledge and new information. The process of learning depends on the degree of the integration of prior knowledge with the new information.2"

Kingir, Geban & Gunel, 2013

And does the Science Writing Heuristic Approach contrast to that?

"The Science Writing Heuristic (SWH) approach can be used to promote students' acquisition of scientific concepts. The SWH approach is grounded on the constructivist philosophy because it encourages students to use guided inquiry laboratory activities and collaborative group work to actively negotiate and construct knowledge. The SWH approach successfully integrates inquiry activities, collaborative group work, meaning making via argumentation, and writing-to-learn strategies…

The negotiation activities are the central part of the SWH because learning occurs through the negotiation of ideas. Students negotiate meaning from experimental data and observations through collaboration within and between groups. Moreover, the student template involves the structure of argumentation known as question, claim, and evidence. …Reflective writing scaffolds the integration of new ideas with prior learning. Students focus on how their ideas changed through negotiation and reflective writing, which helps them confront their misconceptions and construct scientifically accepted conceptions"

Kingir, Geban & Gunel, 2013

What is already known about SWH pedagogy?

It seems like the SWH approach should be effective at supporting student learning. So, has this not already been tested?

"There are many international studies investigating the effectiveness of the SWH approach over the traditional approach … [one team] found that student-written reports had evidence of their science learning, metacognitive thinking, and self-reflection. Students presented reasons and arguments in the meaning-making process, and students' self-reflections illustrated the presence of conceptual change about the science concepts.

[another team] asserted that using the SWH laboratory report format in lieu of a traditional laboratory report format was effective on acquisition of scientific conceptions, elimination of misconceptions, and learning difficulties in chemical equilibrium.

[Another team] found that SWH activities led to greater understanding of grade 6 science concepts when compared to traditional activities. The studies conducted at the postsecondary level showed similar results as studies conducted at the elementary level…

[In two studies] it was demonstrated that the SWH approach can be effective on students' acquisition of chemistry concepts. SWH facilitates conceptual change through a set of argument-based inquiry activities. Students negotiate meaning and construct knowledge, reflect on their own understandings through writing, and share and compare their personal meanings with others in a social context"

Kingir, Geban & Gunel, 2013

What was the point of another experimental test of SWH?

So, it seems that from a theoretical point of view, so-called traditional teaching is likely to be ineffective in bringing about conceptual learning in science, whilst a constructivist approach based on the Science Writing Heuristic is likely to support such learning. Moreover, you are aware of a range of existing studies which suggest that in practice the Science Writing Heuristic is indeed an effective basis for science teaching.

So, what was the point of your study?

"The present study aimed to investigate the effect of the SWH approach compared to traditional chemistry instruction on grade 9 students' understanding of chemical change and mixture concepts."

Kingir, Geban & Gunel, 2013

Okay, I would certainly accept that just because a teaching approach has been found effective with one age group, or in one topic, or in one cultural context, we cannot assume those findings can be generalised and will necessarily apply in other teaching contexts (Taber, 2019).

Read about generalisation from studies

What happened in the experimental condition?

So, what happened in the two classes taught in the experimental condition?

"The teacher asked students to form their own small groups (n=5) and introduced to them the SWH approach …they were asked to suggest a beginning question…, write a claim, and support that claim with evidence…

they shared their questions, claims, and evidence in order to construct a group question, claim, and evidence. …each group, in turn, explained their written arguments to the entire class. … the rest of the class asked them questions or refuted something they claimed or argued. …the teacher summarized [and then] engaged students in a discussion about questions, claims, and evidence in order to make students aware of the meaning of those words. The appropriateness of students' evidence for their claims, and the relations among questions, claims, and evidence were also discussed in the classroom…

The teacher then engaged students in a discussion about …chemical change. First, the teacher attempted to elicit students' prior understanding about chemical change through questioning…The teacher asked students to write down what they wanted to learn about chemical change, to share those items within their group, and to prepare an investigation question with a possible test and procedure for the next class. While students constructed their own questions and planned their testing procedure, the teacher circulated through the groups and facilitated students' thinking through questioning…

Each group presented their questions to the class. The teacher and the rest of the class evaluated the quality of the question in relation to the big idea …The groups' procedures were discussed and revised prior to the actual laboratory investigation…each group tested their own questions experimentally…The teacher asked each student to write a claim about what they thought happened, and support that claim with the evidence. The teacher circulated through the classroom, served as a resource person, and asked …questions

…students negotiated their individual claims and evidence within their groups, and constructed group claims and evidence… each group…presented … to the rest of the class."

Kingir, Geban & Gunel, 2013
What happened in the control condition?

Okay, I can see that the experimental groups experienced the kind of learning activities that both educational theory and previous research suggests are likely to engage them and develop their thinking.

So, what did you set up to compare with the Science Writing Heuristic Approach as a fair test of its effectiveness as a pedagogy?

"In the comparison group, the teacher mainly used lecture and discussion[3] methods while teaching chemical change and mixture concepts. The chemistry textbook was the primary source of knowledge in this group. Students were required to read the related topic from the textbook prior to each lesson….The teacher announced the goals of the lesson in advance, wrote the key concepts on the board, and explained each concept by giving examples. During the transmission of knowledge, the teacher and frequently used the board to write chemical formula[e] and equations and draw some figures. In order to ensure that all of the students understood the concepts in the same way, the teacher asked questions…[that] contributed to the creation of a discussion[3] between teacher and students. Then, the teacher summarized the concepts under consideration and prompted students to take notes. Toward the end of the class session, the teacher wrote some algorithmic problems [sic 4] on the board and asked students to solve those problems individually….the teacher asked a student to come to the board and solve a problem…

The …nature of their laboratory activities was traditional … to verify what students learned in the classroom. Prior to the laboratory session, students were asked to read the procedures of the laboratory experiment in their textbook. At the laboratory, the teacher explained the purpose and procedures of the experiment, and then requested the students to follow the step-by-step instructions for the experiment. Working in groups (n=5), all the students conducted the same experiment in their textbook under the direct control of the teacher. …

The students were asked to record their observations and data. They were not required to reason about the data in a deeper manner. In addition, the teacher asked each group to respond to the questions about the experiment included in their textbook. When students failed to answer those questions, the teacher answered them directly without giving any hint to the students. At the end of the laboratory activity, students were asked to write a laboratory report in traditional format, including purpose, procedure, observations and data, results, and discussion. The teacher asked questions and helped students during the activity to facilitate their connection of laboratory activity with what they learned in the classroom.

Kingir, Geban & Gunel, 2013

The teacher variable

Often in small scale research studies in education, a different teacher teaches each group and so the 'teacher variable' confounds the experiment (Taber, 2019). Here, however, you avoid that problem 5, as you had a sample of four classes, and two different teachers were involved, each teaching one class in each condition?

"In order to facilitate the proper instruction of the SWH approach in the treatment group, the teachers were given training sessions about its implementation prior to the study. The teachers were familiar with the traditional instruction. One of the teachers was teaching chemistry for 20 years, while the other was teaching chemistry for 22 years at a high school. The researcher also asked the teachers to teach the comparison group students in the same way they taught before and not to do things specified for the treatment group."

Kingir, Geban & Gunel, 2013

Was this research ethical?

As this is an imaginary conversation, not all of the questions I might like to ask are actually addressed in the paper. In particular, I would love to know how the authors would justify that their study was ethical, considering that the control condition they set up deliberately excluded features of pedagogy that they themselves claim are necessary to support effective science learning:

"In traditional science teaching, it is difficult for the learners to change their misconceptions"

The authors beleive that "learning occurs through the negotiation of ideas", and their experimental condition provides plenty of opportunity for that. The control condition is designed to avoid the explicit elicitation of learners' idea, dialogic talk, or peer interactions when reading, listening, writing notes or undertaking exercises. If the authors' beliefs are correct (and they are broadly consistent with a wide consensus across the global science education research community), then the teaching in the comparison condition is not suitable for facilitating conceptual learning.

Even if we think it is conceivable that highly experienced teachers, working in a national context where constructivist teaching has long been official education policy, had somehow previously managed to only teach in an ineffective way: was it ethical to ask these teachers to teach one of their classes poorly even after providing them with professional development enabling them to adopt a more engaging approach better aligned with our understanding of how science can be effectively taught?

Read about unethical control conditions

Given that the authors already believed that –

  • "Students' misconceptions and learning difficulties constitute a major barrier for their learning in various chemistry topics"
  • "knowledge is constructed in the minds of students"
  • "The process of learning depends on the degree of the integration of prior knowledge with the new information"
  • "learning occurs through the negotiation of ideas"
  • "The SWH approach successfully integrates inquiry activities, collaborative group work, meaning making" – A range of previous studies have shown that SWH effectively supports student learning

– why did they not test the SWH approach against existing good practice, rather than implement a control pedagogy they knew should not be effective, so setting up two classes of learners (who do not seem to have been asked to consent to being part of the research) to fail?

Read about the expectation for voluntary informed consent

Why not set up a genuinely informative test of the SWH pedagogy, rather than setting up conditions for manufacturing a forgone conclusion?


When it has already been widely established that a pedagogy is more effective than standard practice, there is little point further testing it against what is believed to be ineffective instruction.

Read about level of contol in experiments


How can it be ethical to ask teachers to teach in a way that is expected to be ineffective?

  • transmission of knowledge
  • follow the step-by-step instructions
  • not required to reason in a deeper manner
  • individual working

A rhetorical experiment?

Is this not just a 'rhetorical' experiment engineered to produce a desired outcome (a demonstration), rather than an open-ended enquiry (a genuine experiment)?

A rhetorical experiment is not designed to produce substantially new knowledge: but rather to create the conditions for a 'positive' result (Figure 8 from Taber, 2019).

Read about rhetorical experiments


A technical question

Any study of a teaching innovation requires the commitment of resources and some disruption of teaching. Therefore any research study which has inherent design faults that will prevent it producing informative outcomes can be seen as a misuse of resources, and an unproductive disruption of school activities, and so, if only in that sense, unethical.

As the research was undertaken with "four intact classes" is it possible to apply any statistical tests that can offer meaningful results, when there are only two units of analysis in each condition? [That is, I think not.]

The researchers claim to have 117 degrees of freedom when applying statistical tests to draw conclusions. They seem to assume that each of the 122 children can be considered to be a separate unit of analysis. But is it reasonable to assume that c.30 children taught together in the same intact class by the same teacher (and working in groups for at least part of the time) are independently experiencing the (experimental or control) treatment?

Surely, the students within a class influence each other's learning (especially during group-work), so the outcomes of statistical tests that rely on treating each learner as an independent unit of analysis are invalid (Taber, 2019). This is especially so in the experimental treatment where dialogue (and "the negotiation of ideas") through group-work, discussion, and argumentation were core parts of the instruction.

Read about units of analysis

Sources cited:


Notes:

1 I have used direct quotes from the published report in Research in Science Education (but I have omitted citations to other papers), with some emphasis added. Please refer to the full report of the study for further details. I have attempted to extract relevant points from the paper to develop an argument here. I have not deliberately distorted the published account by selection and/or omission, but clearly am only reproducing small extracts. I would recommend readers might access the original study in order to make up their own minds.


2 The next statement is "If individuals know little about the subject matter, new information is easily embedded in their cognitive structure (assimilation)." This is counter to the common thinking that learning about an unfamiliar topic is more difficult, and learning is made meaningful when it can be related to prior knowledge (Ausubel, 1968).

Read about making the unfamiliar familiar


3 The term 'discussion' might suggest an open-ended exchange of ideas and views. This would be a dialogic technique typical of constructivist approaches. From the wider context its seems likely something more teacher-directed and closed than this was meant here – but this is an interpretation which goes beyond the description available in the original text.

Read about dialogic learning


4 Researchers into problem-solving consider that a problem has to require a learner to do more that simply recall and apply previously learned knowledge and techniques – so an 'algorithmic problem' might be considered an oxymoron. However, it is common for teachers to refer to algorithmic exercises as 'problems' even though they do not require going beyond application of existing learning.


5 This design does avoid the criticism that one of the teacher may have just been more effective at teaching the topic to this age group, as both teachers teach in both conditions.

This does not entirely remove potential confounds as teachers interact differently with different classes, and with only four teacher-class combinations it could well be that there is better rapport in the two classes in one or other condition. It is very hard to see how this can be addressed (except by having a large enough sample of classes to allow inferential statistics to be used rigorously – which is not feasible in small scale studies).

A potentially more serious issue is 'expectancy' effects. There is much research in education and other social contexts to show that people's beliefs and expectations influence outcomes of studies – and this can make a substantial difference. If the two teachers were unconvinced by the newfangled and progressive approach being tested, then this could undermine their ability to effectively teach that way.

On the other hand, although it is implied that these teachers normally teach in the 'traditional' way, actually constructivist approaches are recommended in Turkey, and are officially sanctioned, and widely taught in teacher education and development courses. If the teachers accepted the arguments for believing the SWH was likely to be more effective at bringing about conceptual learning than the methods they were asked to adopt in the comparison classes, that would further undermine that treatment as a fair control condition.

Read about expectancy effects in research

Again, there is very little researchers can do about this issue as they cannot ensure that teachers participating in research studies are equally confident in the effectivenes of different treatments (and why should they be – the researchers are obviously expecting a substantive difference*), and this is a major problem in studies into teaching innovations (Taber, 2019).

* This is clear from their paper. Is it likely that they would have communicated this to the teachers? "The teachers were given training sessions about [SWH's] implementation prior to the study." Presumably, even if somehow these experienced teachers had previously managed to completely avoid or ignore years of government policy and guidance intending to persuade them of the value of constructivist approaches, the researchers could not have offered effective "training sessions" without explaining the rationales of the overall approach, and for the specific features of the SWH that they wanted teachers to adopt.


Burning is when you are burning something with fire …

Iconic chemical triangles


Keith S. Taber


Derek was a participant in the Understanding Science Project. When I interviewed Derek soon after the start of his secondary schooling, he told me he liked science, and was currently studying 'burning'.

So, I asked him what that was:

What is burning?

[pause, c.2s]

When [pause, c.2s] a fuel, oxygen and heat gets – in, erm, I'm not quite sure how to explain, but it's like – you get the triangle of fire, and then, burning is just when you've got fire and you're burning something with it.

Okay, so you'd recognise it if you saw it, would you?

Yeah.

Yeah, but maybe it's not that easy to explain?

Yeah.


The notion that 'burning is just when you've got fire and you're burning something with it' – might be considered tautological:

  • burning is when you are burning something

Scientists look to explain natural phenomena with theories, principles, models, and so forth. But for most people, phenomena that they have been familiar with since very young (such as a dropped object falling) do not seem to need explanation – as they are seen as just natural events (Watts & Taber, 1996).

Derek knew about the fire triangle, but his response reminded me of another triangle that is often referred to by science educators.

Johnstone's triangle

For many years Prof. Alex Johnstone (1930-2017) worked at the Centre for Science Education that he founded at the University of Glasgow; where he undertook, supervised, and collaborated on, a good many projects in science education – especially, but not only, relating to the teaching and learning of chemistry and physics in higher education.

However, one of Johnstone's most influential publications must be the short article he published in the School Science Review (Johnstone, 1982) – the secondary science journal of the Association for Science Education. In this short piece he argued that in each of biology, chemistry, and physics, learning difficulties in part derived from how the subject was taught at several 'levels' at once, asking young learners to think simultaneously on different planes as it were. In each of these science subjects, this could be represented by a triangle. In many lessons students would be asked to think about, and inter-relate, considerations from the viewpoints of several vertices.

Johnston's chemistry triangle distinguished between three levels:

  • the macroscopic (the scale at which people observe and handle materials);
  • the submicroscopic (molecular) scale at which many chemical explanations are developed;
  • the symbolic level – where abstract symbols are used to represent the chemistry

"Those of us who are academic chemists can view our subject on at least three levels.

There is the level at which which we can see and handle materials, and describe their properties in terms of density, flammability, colour and so on. We are also interested in the possibility of conversion of one material into another with consequent changes in properties.

A second level is the representational one in which we try to represent chemical substances by formulae and their changes by equations. This is part of the sophisticated language of the subject.

The third level is atomic and molecular, a level at which we attempt to explain why chemical substances behave the way they do. We invoke atoms, molecules, ions, structures, isomers, polymers etc to give us a mental picture by which to direct our thinking and rationalize the descriptive level mentioned above.

These levels could be called (a) descriptive and functional, (b) representational, (c) explanatory. Trained chemists jump freely from level to level in a series of mental gymnastics. It is eventually very hard to separate these levels."

Johnstone, 1982 (added emphasis)

Over the years there have been many attempts to apply, elaborate, and refine Johnston's triangle, and it has been an idea that has proved very productive in thinking about learning difficulties in the subject.


"Chemistry seeks to provide qualitative and quantitative explanations for the observed behaviour of elements and their compounds. Doing so involves making use of three types of representation: the macro (the empirical properties of substances); the sub-micro (the natures of the entities giving rise to those properties); and the symbolic (the number of entities involved in any changes that take place). Although understanding this triplet relationship is a key aspect of chemical education, there is considerable evidence that students find great difficulty in achieving mastery of the ideas involved…" (Publisher's description)


One well-respected, edited, scholarly book ('Multiple Representations in Chemical Education' – Gilbert & Treagust, 2009) consisted of contributions exploring implications of the idea. Indeed, now, there is even a book entitled 'The Johnstone Triangle' (Reid, 2021) with the telling subtitle: 'the key to understanding chemistry'!


Johnstone's triangle is now the subject of a book

Reconceptualisation

Derek was just being introduced to burning as a science topic, and for him it was still just a familiar phenomenon rather than a theoretical construct. We have all seen fires, and can recognise when something is burning – but how many people really know what fire is?1 Burning and fire are everyday concepts – fire is an impressive phenomenon to a young child: one that is salient enough to be noticed. The child's brain then recognises different instances of fire as being similar and it abstracts a spontaneous concept – that there is a category of events in the world that appear like this.

Of course, the brain of the young child does this without using language (it forms a category of events in the sense that it readily recognises new instances – it does not yet have access to have technical notions of 'category', 'concept', 'abstraction' of course.) And the child does not instinctively know this is called 'fire' or 'el incendio' or 'l' incendie' or whatever, until someone who is a more mature member of the child's natural language community shares this label.2

School science will involve learning that there is a formal scientific concept3 called 'combustion' that is basically the chemist's name for burning. However, 'combustion' is a technical term, so combustion will be defined in terms of other concepts. So, whereas in everyday life we recognise what counts as a fire or burning using the brain's inherent pattern-recognition mechanism (a spontaneous conception), in chemistry we have a technical definition (a scientific concept defined in relation to to other scientific concepts, and so 'theoretical').

That is, in everyday life, if you told someone you saw something on fire, it is unlikely anyone (leaving aside science teachers) would ask you which criteria you used to know this: you did not deliberate on the matter, you simply saw, and instantly recognised, a fire. When you refer to a fire, the other person recognises what you mean because they have learnt 'fire' to be the label for their own spontaneously formed conception that allows their perceptual-cognitive system to instantly recognise a fire.

But, for a chemist, combustion is one class of chemical reaction (so the learner can only understand combustion in chemical terms if they have an appreciation of what a chemical reaction is), which only makes sense to someone who has reasonable idea what a scientist means by a substance, as chemical reactions are changes resulting in different substances. Here we have shifted from everyday notions to the theoretical descriptions of science.


In school chemistry, everyday phenomena (e.g., burning) are reconsolidated in terms of technical concepts and language (e.g., combustion). (From Taber, 2013)

The invisible nanoscopic world

But chemists are seldom satisfied with macroscopic accounts – even when posed in technical language. Rather, students will be taught to explain the observable macroscopic phenomena in terms of invisible entities which have unfamiliar properties. Imagined entities such as molecules4, nanoscopic systems which are best understood as fuzzy balls of fields – that have no actual surface, and are mostly tenuous 'clouds' of charge. (Molecules are sometimes modelled as if billiard balls, or sets of balls connected by sticks, but this is just an attempt to represent entities quite unlike the familiar referents available to learners in ways they can make sense of.)

That is, combustion will be explained as a rearrangement of electrons and atomic cores that changes one set of molecules (of the reactants in the reaction) into another (the products). This process will involve energy changes, due to differences in stability of different sets of molecules, and will progress through the breaking and making of chemical bonds.

If the learner is able to form a mental image of (i.e., imagine) chemical reactions at the nanoscopic level, and see how this can be used to explain an actual observable phenomenon (such as a fire), they then also have to learn how chemists often represent these ideas in what is in effect a specialist language – involving chemical formulae, and reaction equations, and the like.

So, when Derek was using a Bunsen burner to set fire to pasta and (not quite set fire to) raisins as he reported to me, he was using a chemical reaction that might be summarised by the chemist or science teacher as:

CH4 + 2O2 ➞ CO2 + 2H2O

Johnstone suggested that the symbolic representation was the third level, alongside the macroscopic and submicroscopic. He was absolutely right that it added to the 'learning demand'. However, there is another complication in that many of these key representations (the formulae and equations) are ambiguous as they can represent either the macroscopic level of substances weighed out in grammes (2O2 would represent 64 g of the substance oxygen, although as it is a gas it would normally be measured by volume) or the individual imagined entities of the molecular world (where 2O2 would mean two molecules of oxygen).

Useful ambiguity

This is useful ambiguity for the chemist – but an added complication for the learner who has to follow the teacher's transitions where one moment a symbol reflects a test tube of stuff, and the next some molecule. Because of its role in bridging between the two very different scales at which we explain chemistry I prefer to see these symbols as being along one side of the triangle (whilst separating out the everyday phenomenological level from the technical, theoretical descriptions used by science). However, whatever version of Johnstone's triangle is applied, it has become something of an iconic image in chemistry education.


The chemist's triplet: a variation on Johnstone's triangle (from Taber, 2013)


Another iconic triangle

Derek had not yet been introduced to all this, and he was still operating with burning as a phenomenon:

And why is this important, do you think? Why do you think we study burning?

[pause, c.2s]

I'm not sure.

No one's told you that?

No.

Is it fun, is it a fun topic?

Yeah.

What Derek did seem to have learned well was the fire triangle.

But you have this 'triangle of fire'. So does that mean that fire is always a triangular shape?

No.

So, what's a triangle of fire?

You need three things to make a fire, which is oxygen, heat and fuel.

Okay, so what if I had erm some fuel and some heat, but I didn't have any oxygen, but maybe I've got lots of fuel?

No – wouldn't have fire.

I can't have extra fuel instead?

No.

No?

You need the three things.

What if I've got lots and lots of fuel, and lots and lots of oxygen, but it's very, very cold?

No.

No, that won't work either. So I always have to have the three things?

Yeah.

Derek stuck to his claim – you always needed all three. This is a useful heuristic (useful if ever one is faced with a fire as it tells you can act by just removing one of the three essentials) even if (like most heuristics) it will sometimes fail, e.g.

  • some materials will continue burning in the absence of an external supply of oxygen as they have an internal source;
  • chlorine will support combustion in place of oxygen (but that's seldom a practical issue in everyday situations) ;
  • substances have an auto-ignition temperature (where they can spontaneously ignite), and for a few substances this is around or below room temperature;

These exceptions do not undermine the general utility of the' 'triangle'.

Some useful learning had gone on here – and potentially not just about fire, because the idea that one factor may be limiting on a process is a generally useful principle (e.g., plants grown in a soil depleted in potassium will not thrive, no matter how much sunlight, water, nitrate and phosphate is present).

But the fire triangle, even if it is not supported by a deep understanding of chemical principles, is worth teaching because of its practical value. It seems to offer a heuristic that people accept and recall. And rather like Johnston's triangle, it seems to have become rather iconic. At least, I assume that is why when COVID-19 infection rates were high, the fire triangle was used as a familiar analogy to persuade people to avoid the 'oxygen' of social mixing…


"I like to think of COVID as a fire, if we are the fuel, social mixing is the oxygen that allows the fuel to burn…'"

Read 'COVID is like a fire because…'


Work cited

Notes

1 It has been mooted that fire should be understood as an example the 'fourth' phase of matter, plasma – that is an ionised gas.5 But actually fire is more complicated than this as it contains a mixture of reactant and product molecules and the molecular fragments that form intermediate and/or transition states. Some chemical reactions, when studied at the molecular level, largely follow a single reaction path. But combustion tends to be much more complex with multiple pathways involving many different ions and molecular fragments.

Read: The states of (don't) matter? Which state of matter is fire?

So, fire is a multiphase mixture, more akin to a solution, aerosol, or suspension, than to a gas or plasma.


2 The child does not know this is called fire, and when she is told this she may not realise that such names are social conventions – according to Jean Piaget's research young children may assume that things in the world have (that is, have always had) a name that people have had to learn.

This childish idea reflects superstitious notions about names that are part of some magical systems of knowledge – 'the law of names': the idea that if you know a person or thing's real name this gives you over over them/it.


3 A very influential theory due to Lev Vygotsky takes the distinction between spontaneous concepts formed automatically, and formal taught concepts that are shared through social interaction (such as teaching). These latter kinds of concepts are usually translated from Vygotsky's Russian as 'scientific' though this is meant in the broad sense of any formal field of study. A key point emphasised by Vygotsky was that, assuming the learners could relate a taught concept to existing spontaneous concepts (that is, 'meaningful learning' occurred), they would actually come to operate with a concept which was a hybrid developed from the interaction of the intuitive understanding and the learned technically defined notion – a melded conception.


4 By referring to molecules and ions and electrons as imagined entities, I am not suggesting they are only imaginary. Most (if not all) scientists today see them as real things (even if strictly our evidence is indirect, and they arguably remain theoretical constructs). But a teacher cannot directly show the class a molecule or an electron, even if some types of imaging equipment do now produce representations of individual atoms. For the learners (and I would suggest even the teacher) these are only ever imagined entities. Yet, we expect students to do a good deal of thinking about, and with, these imagined entities.


5 If we are expanding the three states of matter, then there is an argument for making plasma the 5th phase:

  • Bose-Einstein condensates
  • solids
  • liquids
  • gases
  • plasma
  • (quark 'soups'?)


Would you like some rare earths with that?

A chemically illiterate internet meme


Keith S. Taber


The challenge of popular science writing

I often enjoy reading popular accounts of science topics, but sometimes one comes across statements that are vague or dubious or confusing – or simply wrong. Some of this reflects a basic challenge that authors of popular science share with science teachers and other science communicators: scientific ideas are often complex, subtle and abstract. Doing them justice requires detailed text and technical terminology. Understanding them often depends upon already having a good grasp of underpinning concepts. That is fine in a formal report for other scientists, but is not of any value to a non-specialist audience.

So, the author has to simplify, and perhaps round off some of the irregular detail; and to find ways to engage readers by using language and examples that will make sense to them. That is, finding ways to 'make the unfamiliar familiar'.

Read about making the unfamiliar familiar in teaching

I am sure that often the passages in popular science books that I as a scientist 1 get grumpy about are well motivated, and, whilst strictly inaccurate, reflect a compromise between getting the science perfect and making it accessible and engaging for the wider readership. Sometimes, however, one does get the impression that the author has not fully grasped the science they are writing about.


"Lucy Jane Santos is the Executive Secretary of the British Society for the History of Science…"


Public engagement with radium

I very much enjoyed reading a book, 'Half lives', by the historian of science Lucy Jane Santos, about how in the decades after its discovery by Pierre and Marie Curie, radium was the subject of wide public interest and engagement. One of the intriguing observations about this newly discovered element was that it appeared to glow in the dark. We now know that actually the glow comes from nitrogen in the air, as radium is radioactive and emissions by radium 'excite' (into a higher energy state) nitrogen molecules, which then emit visible light as they return ('relax') to their 'ground' state. This production of light without heating (a phenomenon generally called luminescence), when it is due to exposure to radioactivity, is known as radioluminescence.

Today, many people are very wary of radioactivity – with good reason of course – but Santos describes how at one time radium was used (or at least claimed as an ingredient) in all kinds of patent medicines and spa treatments and cosmetics (and even golf balls). This was a fascinating (and sometimes shocking) story.

What substance(s) can you find in quinine?

I did find a few things to quibble over – although across a whole book it was, only, a few. However, one statement that immediately stood out as dodgy science was the claim that quinine contained phospor:

"Quinine contains phosphor, a substance that luminesces when exposed to certain wavelengths of light…"

Santos, 2020

This may seem an unremarkable statement to a lay person, but to a scientist this is nonsensical. Quinine is a chemical compound (of carbon, hydrogen, nitrogen and oxygen), that is – a single substance. A single substance cannot contain another substance – any more than say, a single year can contain other years. An impure sample of a substance will contain other substances (it is in effect a mixture of substances), but quinine itself is, by definition, just quinine.


Molecular structure of the chemical compound quinine (C20H24N2O2) – a pure sample of quinine would contain only (a great many copies of) this molecule.

Note – no phosphorus, and no rare earth metal atoms.

(Image source: Wikimedia)


Confusing terminology

The term 'phosphor' refers to a luminescent material – one that will glow after it has been exposed to radiation (often this will be ultraviolet) or otherwise excited. The term is usually applied to solid materials, such as those used to produce an image in television and monitor screens.

The term derives by reference to the element phosphorus which is a luminescent substance that was accordingly itself given a name meaning 'light-bearing'. The term phosphorescent was used to describe substances that continue to glow for a time after irradiation with electromagnet radiation ceases. But it is now known that phosphorus itself is not phosphorescent, but rather its glow is due to chemiluminescence – there is a chemical reaction between the element and oxygen in the air which leads to light being emitted.

The widely used term phosphor, then, reflects an outdated, historical, description of a property of phosphorus; and does not mean that phosphors contain, or are compounds of, phosphorus. There is clearly some scope for confusion of terms here. 2


termmeaning
luminescencethe emission of light by a cold object (in contrast to incandescence)
chemiluminescencea form of luminescence due to a chemical reaction
– – bioluminescencea form of chemiluminescence that occurs in living organisms
electroluminescencea form of luminescence produced by passing electrical current through some materials
photoluminescencea form of luminescence due to irradiation by electromagnetic radiation, such as ultraviolet
– – fluorescence a type of photoluminescence that only occurs whilst the object is being excited (e.g., by exposure to ultraviolet)
– – phosphorescencea type of photoluminescence that continues for some time after the object has been being excited (e.g., by exposure to ultraviolet)
radioluminescencea form of luminescence due to a material being exposed to ionising radiation (e.g., 𝛂 radiation)
sonoluminescencea form of luminescence due to a material being exposed to sound
phosphora material that exhibits luminescence
phosphorusa chemical element that exhibits chemiluminescence (when exposed to air)
There is a range of terms relating to luminescence. Here are some of those terms.


Some central ideas about luminescence (represented on a concept map)

A traditional medicine

Quinine, a substance extracted from the bark of several species of Cinchona, has long been used for medicinal purposes (e.g., by the Quechua people of the Americas 3), as it is a mild antipyretic and analgesic. It is an example of a class of compounds produced by plants known as an alkaloids. Plant alkaloids are bitter, and it is thought their presence deters animals from eating the plant. We might say that Quechua pain medication is a bitter pill to swallow.


Modern science has often adopted and developed technologies that had long been part of the 'traditional ecological knowledge' of indigenous groups – such as making extracts from Cinchona bark to use as medicines.

Sadly, the original discovers and owners of such technologies have not always been properly recognised when such technologies have been acquired, transferred elsewhere, and reported. 3

(Image by GOKALP ISCAN from Pixabay)


Quinine is an ingredient of tonic water (and bitter lemon drink) added because of its bitter taste.

(Why deliberately make a drink bitter? Quinine has anti-malarial properties which made it a useful substance to add to drinks in parts of the world where malaria is endemic. People liked the effect!)

Quinine glows when exposed to ultraviolet light. It is luminescent. To be more specific, quinine is photoluminescent. (This is responsible for the notion that someone offered a gin and tonic at a disco should test it under the 'blacklights' to make sure they have not been given pure gin to drink. Although, I am slightly sceptical about whether the kind of people that drink 'G&T's go to the kind of dances that have ultraviolet lighting.)


"I do apologise, I think I might have just splashed a tiny droplet of my tonic water on you"

(Image by Victoria_Watercolor from Pixabay)


It is reasonable to describe quinine as a phosphor in the wider sense of the term – but it does not contain another phosphor substance, any more than, say, iron contains a metallic substance or sulphur contains a yellow substance or sucrose contains a sweet substance or copper a conducting substance. So, a more accurate formulation would have been

"Quinine [is a] phosphor, a substance that luminesces when exposed to certain wavelengths of light…"

or, perhaps better still, simply

"Quinine [is] a substance that luminesces when exposed to certain wavelengths of light…"

Ask the oracle

I was intrigued at why Lucy Jane Santos might have been confused about this, until I did a quick internet search. Then I found a range of sites that claimed that quinine contains phosphors – indeed, often, rare earths are specified.

The rare earths (another unfortunate historic choice of name, as it transpired that they are neither especially rare nor 'earths', i.e., oxides) are a group of metallic elements. They are not as well known as, say, iron, copper, zinc, aluminium or gold, but they have with a wide range of useful applications.


Scandium, the first of the 'rare earth' metals. Probably not what you want in your tonic water.

(Creative Commons Attribution 3.0 Unported License, sourced from https://images-of-elements.com/scandium.php)


If something is repeated enough, does it become true?

Clearly there are not rare earths in quinine. So, the following quotes (from sites accessed on 7th March 2023) proffer misinformation.

"If you want to get a bit more scientific about it…. quinine contains rare earth compounds called phosphors.  These are the substances which glow when they are hit with particular wavelengths of the EM spectrum, including UV light.  Phosphors absorb UV light and then emit it in their own colour, in this case glowing blue light."

https://www.iceandaslice.co.uk/blogs/news/why-does-your-gin-and-tonic-glow-blue-in-ultraviolet-light

This claim is odd, as the previous paragraph explained more canonically: "why does quinine absorb UV light (the invisible component of sunlight that produces sun tans and sunburns!)? It is due to the structure of the quinine molecule, which enables it to take in energy in the form of invisible UV light and immediately radiate some of that same energy in the form of visible blue light." Other compounds cannot be inside a molecule – so this more canonical explanation is not consistent with quinine containing other "substances" which were "rare earth compounds."


"Quinine contains rare earth compounds called phosphors. These substances glow when they are hit with particular wavelengths of the EM spectrum, including UV light. Phosphors absorb UV light and then emit it in their own color [sic, colour]. Thus, the black light's UV radiation is absorbed by the phosphors in the quinine, and then emitted again in the form of glowing blue light."

https://sciencing.com/quinine-fluorescent-5344077.html

The following extract appeared under the subheading "Why is quinine fluorescence?" That reflects a category error as quinine is a substance and fluorescence is a process (and fluorescent the property) – so, presumably this should have read why is quinine fluorescent?

Why Quinine Glows

Quinine contains rare earth compounds called phosphors. … Phosphors absorb UV light and then emit it in their own color [sic, colour]. Thus, the black light's UV radiation is absorbed by the phosphors in the quinine, and then emitted again in the form of glowing blue light.

https://allfamousbirthday.com/faqs/does-tonic-water-make-things-glow-in-the-dark/

"Want to know one more fun fact about quinine? It glows.
Rare Earth compounds called phosphors in quinine glow under certain circumstances."

https://www.mixlycocktailco.com/blogs/news/does-tonic-water-go-bad

Why Does Tonic Water Glow Under UV Rays?

Tonic water glows and [sic] will fluoresce under UV rays because of quinine in it. Quinine is one of the most important alkaloids found in the cinchona bark, among many others. It has some rare earth compounds known as phosphors that glow when they hit certain wavelengths of the UV light. Phosphors in the quinine absorb the UV light and then reflect it or emit it again in the form of glowing blue light.

https://www.sawanonlinebookstore.com/why-does-tonic-water-glow-under-uv-rays/


Making magic mud – or not

Perhaps the most bizarre example was a site, 'emaze' which offered to show me "How to create magic mud…in 17 easy steps"

Step 1 was

"wash your potatoes!!!!"

However, perhaps due to exclamation fatigue(!), this went in a different, if now familiar, direction with step 2:

"Quinine contains rare earth compounds called phosphors. These substances glow when they are hit with particular wavelengths of the EM spectrum, including UV light. Phosphors absorb UV light and then emit it in their own color [sic, colour]. Thus, the black light's UV radiation is absorbed by the phosphors in the quinine, and then emitted again in the form of glowing blue light"

https://app.emaze.com/@AORQCIII#/16

This text was then repeated as each of steps 3-14. (Sadly steps 15-17 seemed to have been missed or lost. Or, perhaps not so sadly if they were just further repeats.) The first screen suggests this presentation was "done by Dr. Meena & Maha" but if Dr. Meena & Maha really exist (if you do, I am sorry, the internet makes me very sceptical) and 'done this', it is not clear if they got bored with their task very quickly, or whether the server managed to corrupt a much more coherent presentation when it was uploaded to the site.


This 'emaze' presentation seems to want to emphasise how quinine contains rare earth compounds…


According to Google, the site 'Course Hero' suggested

"Phosphors, which are found in quinine, are rare earth compounds. These chemicals glow when they are struck with particular wavelengths of the EM spectrum, …"

https://www.coursehero.com › Chemistry › 44733249–I…

but unfortunately (or perhaps fortunately given that snippet), the rest of the text seemed to be behind a pay-wall. This did not offer a strong incitement to pay for material on the site.

Toys coated with phosphorus?

Another website I came across was for a shop which claimed to be selling glow-in-the-dark objects that were made with phosoporus that needed to be illuminated to initiate a glow: a claim which seems not only scientifically incorrect (as mentioned above, phosphorus is not photoluminescent – it glows when in contact with air as it oxidises), and so unlikely; but, otherwise, dangerous and, surely, illegal.

Read about unscientific luminous creations

Defining scientific terms – badly

During my search, I came across a website (grammarist.com) offering to explain the difference between the words phosphorous and phosphorus. It did not discuss rare earths, but informed readers that

"Phosphate: Noun that means an electrically charged particle.
Phosphorus: Also a noun that means a mineral found in phosphate."
…We've already established that phosphorus is the simple mineral found in the particle phosphate, but phosphor is something else altogether."

https://grammarist.com/spelling/phosphorous-phosphorus/

So, that's 'no', 'no', 'no', and…I think at least one more 'no'.

Phosphorus is a reactive element, and is not found in nature as a mineral. To a scientist, a mineral is a material found in nature – as a component of rocks. Unfortunately, in discussing diet, the term minerals is often associated with elements, such as, for example, phosphorus, iodine, potassium and iron that are necessary for good health. However, one would not eat the element iron, but rather some compound of it. (Foods naturally contain iron compounds). And trying to eat phosphorus, iodine or potassium (rather than compounds of them) would be very hazardous.

So, whilst a nutritional supplement might well contain some minerals in the composition, strictly they are there as compounds that will provide a source of biologically important elements, and they will be metabolised into other compounds of those elements. (Iron from iron compounds will, for example, be used in synthesising the haem incorporated into red blood cells.) Unfortunately, learners commonly have alternative conceptions ('misconceptions') about the difference between mixtures and compounds and assume a compound maintains the properties of its 'constituent' elements (Taber, 1996).

"Compound is one or more elements mixed together"

alternative conception elicited from an Advance level chemisty student

The grammarist.com entry helpfully warned us that phosphate was "not to be confused with phosphoric acid, a chemical compound found in detergents and fertilizers". I suspect it is only found in detergents and fertilisers when something has gone wrong with the production process (notwithstanding diluted phosphoric acid has been used directly as a fertiliser) 4. It is a corrosive and irritant substance that can cause bronchitis – although tiny amounts are added to some colas. [n.b., cocaine also once featured in some cola, but that is no longer allowed.]

  • An ion is an electrically charged particle
  • The phosphate ion is one example of a type of ion.
  • Phosphates (such as calcium phosphate) are substances that contain phosphate ions.

So, phosphates contain electrically charged particles (phosphate ions), but that does not make phosphate an electrically charged particle, just as

  • blue does not mean a large marine mammal
  • bank does not mean a day of celebration where people do not need to go to work
  • vice does not mean a senior executive officer
  • motor does not mean a two wheeled vehicle
  • compact does not mean a flat circular object
  • final does not mean a simple musical instrument played with the breath
  • free does not mean a meal taken around noon or soon after, and
  • meal does not mean a token that provides entry or service

Grammarist invited feedback: I sent it some, so hopefully by the time you read this, the entry will have been changed.

It was on the internet: it must be true

The internet is an immense and powerful tool giving access to the vast resources of the World Wide Web. Unfortunately, the downside of a shared, democratic, free to access, reservoir of human knowledge is that there is no quality control. There is a lot of really good material on the web: but there is also a lot of nonsense on the web.

One example I have referred to before is the statement:

"energy is conserved in chemical reactions so can therefore be neither created nor destroyed"

This has the form of a logical structure

X so therefore Y

which is equivalent to

Y because X:

"energy can be neither created nor destroyed because it is conserved in chemical reactions"

This is just nonsense. There is no logical reason why the conservation of energy in chemical reactions implies a general principle of energy conservation.

We can deduce the specific from the general (days have 24 hours, so Sunday has 24 hours) but not the general from the specific (January has 31 days, so months have 31 days).

Perhaps this is easily missed by people who already know that energy is always conserved.

A parallel structure might be:

"association football teams always consist of eleven players so therefore sports teams always consist of eleven players"

"sports teams always consist of eleven players because association football teams always consist of eleven players"

This is 'obviously' wrong because we know that rugby teams and netball teams and volleyball teams and water polo teams (for example) do not consist of eleven players.

Yet, if you search for "energy can be neither created nor destroyed because it is conserved in chemical reactions", you will find that this claim is included on the public websites of many schools (Taber, 2020). That is because, despite being wrong, it has authority – it is included in the English National Curriculum for Science (which I find shocking – we all make mistakes, but did nobody check the document before publication?) The English government department responsible was made aware of the error but does not think that it is a priority to make corrections to the curriculum.

Artificial (ignorant) intelligence

But what about quinine containing rare earth compounds? A notion that is structurally similar to claiming that

  • France contains South American countries, or
  • 'Great Expectations' contains Jane Austin novels, or
  • February contains Autumn months, or
  • Cauliflower contains citrus fruits, or
  • Beethoven's 5th Symphony contains Haydn concerti

(in other words, something obviously silly to someone who has a basic understanding of the domain – chemistry or geography or literature or the calender or botany/horticulture or music – because it suggest one basic unit contains other units of similar status).

How does this error appear so often? Quite likely, a lot of website now are populated with material collected and collated by machines from other websites. If so, it only takes one human being (or government department) to publish something incorrect, and in time it is likely to start appearing in various places on the web.

There is currently a lot of talk of how artificial intelligence (AI) is getting better at writing essays, and answering questions, and even drafting lectures for busy academics. AI seemingly has great potential where it is provided with high quality feedback. Perhaps, but where the AI is based on finding patterns in publicly available texts, and has no real ability to check sense, then I wonder if the www is only going to become more and more polluted with misinformation and nonsense.

I do not know where Lucy Jane Santos got the idea that there are other substances in the single substance quinine (akin to having other countries in France), but if she did a web-search and relied on what she read, then I am in no position to be critical. I use the web to find things out and check things all the time. I am likely to spot gross errors in fields where I already have a strong background…but outside of that? I do seek to evaluate the likely authority of sources – but that does not mean I could not be taken in by a site which looked professional and authoritative.

The web started with imperfect people (because we all are) posting all kinds of material – with all kinds of motivations. I expect most of it was well-meaning, and usually represented something the poster actually believed; and indeed much of it was valid. However, a 'bot' can search, copy, and paste far quicker than a person, and if the internet is increasingly authored by programs that are indiscriminately copying bits and pieces from elsewhere to collage new copy to attract readers to advertising, then one cannot help wonder if the proportion of web-pages that cannot be trusted will be incrementally coming to dominate the whole network.

I (a fallible, but natural intelligence) hope not, but I am not very optimistic.


Work cited:


Notes:

1 Although my own research has been in science education and not one of the natural sciences, I am pleased that the learned societies (e.g. the Institute of Physics, the Royal Society of Chemistry, etc.) and the UK's Science Council, recognise the work of science educators as professional contributions to science.


2 One internet site suggests:

Luminescence is caused by various things like electric current, chemical reactions, nuclear radiation, electromagnetic radiation, etc. But phosphorescence takes place after a sample is irradiated with light.

• Phosphorescence remains for sometime even after the lighting source is removed. But luminescence is not so.

https://www.differencebetween.com/difference-between-luminescence-and-vs-phosphorescence/

The second paragraph is nonsensical since phosphorescence is a type of luminescence. (It should be, "…fluorescence" that does not.) The first paragraph seems reasonable except that the 'but' seems misplaced. However 'in the light of' the second sentence (which sees phosphorescence and luminescence as contrary) it seems that the (contrasting) 'but' was intended, and whoever wrote this did not realise that light is a form of electromagnetic radiation.

Another, more technical, site suggests,

Luminescence is the emission of light by a substance as a result of a chemical reaction (chemiluminescence) or an enzymatic reaction (bioluminescence).

https://www.moleculardevices.com/technology/luminescence

Here again a contrast is set up:

  • chemiluminescence (due to a chemical reaction) versus
  • bioluminescence (due to an enzymatic reaction).

However, the keen-eyed will have spotted that "an enzymatic reaction" is simply a chemical reaction catalysed by an enzyme. So, bioluminescence is a subtype of chemiluminescence, not something distinct.


3 Some sources claim that the medicinal properties of cinchona bark were discovered by Jesuit missionaries that travelled to South America as part of European imperial expansion there.

Nataly Allasi Canales of the Natural History Museum of Denmark, University of Copenhagen is reported as explaining that actually,

"Quinine was already known to the Quechua, the Cañari and the Chimú indigenous peoples that inhabited modern-day Peru, Bolivia and Ecuador before the arrival of the Spanish…They were the ones that introduced the bark to Spanish Jesuits."

https://www.bbc.com/travel/article/20200527-the-tree-that-changed-the-world-map

Learning about the history of indigenous technologies can be complicated because:

  • often they are transmitted by an oral and practice culture (rather than written accounts);
  • traditional practices may be disrupted (or even suppressed) by colonisation by external invaders; and
  • European colonisers, naturalists and other travellers, often did not think their indigenous informants 'counted', and rather considered (or at least treated) what they were shown as their own discoveries.

4 This again seems to reflect the common alternative conception that confuses mixtures and compounds (Taber, 1996): phosphoric acid is used in reactions to produce fertilizers and detergents, but having reacted is no longer present. It is a starting material, but not an ingredient of the final product.

Just as we do not eat iron and phosphorus, we do not use washing powders that contain phosphoric acid, even if they have been prepared with it. (Increasingly, phosphates are being replaced in detergents because of their polluting effects on surface water such as rivers and lakes.)


5 This gives the impression to me that the Department of Education sees schooling as little more than a game where students perform and are tested on learning whatever is presented to them, rather than being about learning what is worth knowing. There is surely no value in learning a logically flawed claim. Any student who understands the ideas will appreciate this statement is incorrect, but perhaps the English Government prefers testing for recall of rote learning rather than looking for critical engagement?


Unscientific luminous creations

Q: Which form of phosphorus both glows and is non toxic?


Keith S. Taber


I have just sent of an email to a company claiming to be selling glow-in-the-dark products containing non-toxic phosphorus…


The site offers answers to a range of questions, but unfortunately gets a lot wrong

Dear Pete's Luminous Creations

I am writing to raise concern about misleading information on your website, specifically some of the claims made on the page:

(accessed today, 18th March 2023).

This page contains a number of scientifically incorrect statements, but I am most concerned about your misleading characterisation of phosphorus as a 'safe' material.

Scientific errors

Your site claims that

  • "phosphorus…has the ability to absorb and store surrounding light"
  • "the ability to absorb and store surrounding light…works similar to the natural process of photosynthesis"
  • "Phosphorus glow absorbs and stores surrounding light. When it is dark, the stored light is slowly released in the form of a glow"
  • "Glow in the Dark products contain phosphorus…it needs to be exposed to light before it can work"
  • "Radium glow produces light on its own through a chemical process."

All of these claims are mistaken.

1. Luminescent materials do not store light. Light cannot be stored, it is a form of electromagnetic radiation. (In LASERS light is contained within a cavity by reflecting it back and forth by mirrors, but phosphorus is not able to do anything like this.) When the radiation is absorbed by a photoluminescent material the radiation ceases to exist. Because the molecules of the absorbing material are excited into a higher energy state, new electromagnetic radiation (light) may later be emitted – but it is not light that has been stored. (The energy transferred to the luminescent material by the radiation may be considered as stored: but not the light).

2. The process of photosynthesis does not involve "the ability to absorb and store surrounding light" – absorb, yes, but the light is not stored – it ceases to exist once absorbed.

3. Materials which absorb energy from radiation, and then release it slowly ('glow') are called phosphorescent. This does not (only) occur 'when it is dark', but from immediately after irradiation. (The process occurs regardless of whether it is dark enough to observe.)

4. Phosphorus is not itself a phosphorescent material. The glow seen around white phosphorus is due to a chemical reaction with oxygen in the air. Not only does this not store any light, but, also, it does not need light to initiate.

5. Radium does NOT produce light through a chemical process. Radium is radioactive. It undergoes radioactive decay (due to a change in the atomic nucleus). This is NOT considered a chemical process.

Now I turn to what I consider a more serous problem with your site.

Potentially dangerous misinformation

The more serious matter concerns your claim that to be selling products containing 'non toxic' phosphorus:

  • "Glow in the Dark products contain phosphorus (a non toxic substance) which has the ability to absorb and store surrounding light…"
  • "Phosphorus is non toxic and safe for general use."
  • "Phosphorus is a natural mineral found in the human body. Phosphorus Glow in the dark products is perfectly safe for everyday use"
  • "Many get confused and associate all green glow products to be radioactive. This is not true. Phosphorus glow is non toxic and non radioactive."

You may wonder why I think this matters enough to contact you.

It is very misleading to suggest to people reading the site (which could include children who might well be interested in glow-in-the-dark toys) that phosphorus is harmless, and this is completely wrong.

Phosphorus is not found as a natural mineral, as it is much too reactive to be found native (that is, as phosphorus) on earth – although many minerals are compounds of phosphorus (and thus do NOT share its chemical properties), and so sources of the element for use in agriculture etc. The human body does contain compounds of phosphorus, notably in the bones, but again there is no phosphorus (the substance phosphorus) in the human body – if you introduced some it would very quickly react. Sources of phosphorus are important in the diet, but it would be very unwise to try to eat phosphorus itself.

Phosphorus can be obtained in different forms (this is called allotropy where the same element can have different molecular structures – like graphite and diamond both being pure forms – allotropes -of carbon). Some allotropes of phosphorus are not especially dangerous. However, the form which glows is white (or yellow) phosphorus, and this is a very hazardous material.

So, handling phosphorus is dangerous and needs special precautions. (If you really did use phosphorus in your products, I imagine you would know that?) Here is some information from authoritative websites

"Ingestion of elemental white or yellow phosphorus typically causes severe vomiting and diarrhea [diarrhoea], which are both described as "smoking," "luminescent," and having a garlic-like odor. Other signs and symptoms of severe poisoning might include dysrhythmias, coma, hypotension, and death. Contact with skin might cause severe burns within minutes to hours…"

US Centres for Disease Control

"White phosphorus is extremely toxic to humans, while other forms of phosphorus are much less toxic. Acute (short-term) oral exposure to high levels of white phosphorus in humans is characterised by three stages: the first stage consists of gastrointestinal effects; the second stage is symptom-free and lasts about two days; the third stage consists of a rapid decline in condition with gastrointestinal effects, plus severe effects on the kidneys, liver, cardiovascular system, and central nervous system (CNS). Inhalation exposure has resulted in respiratory tract irritation and coughing in humans. Chronic (long-term) exposure to white phosphorus in humans results in necrosis of the jaw, termed "phossy jaw."

US Environmental Protection Agency

Please feel free to check on this information for yourself.

However, I recommend you change the information on your website. In particular, please stop suggesting that phosphorus is a safe, non-toxic material, when the form of phosphorus which glows is highly toxic. I trust that now this has been brought to your attention, you will appreciate that it would be highly irresponsible for you to continue to advertise your products using misleading information about a hazardous substance.

Best wishes

Keith

Shock result: more study time leads to higher test scores

(But 'all other things' are seldom equal)


Keith S. Taber


I came across an interesting journal article that reported a quasi-experimental study where different groups of students studied the same topic for different periods of time. One group was given 3 half-hour lessons, another group 5 half-hour lessons, and the third group 8 half-hour lessons. Then they were tested on the topic they had been studying. The researchers found that the average group performance was substantially different across the different conditions. This was tested statistically, but the results were clear enough to be quite impressive when presented visually (as I have below).


Results from a quasi-experiment: its seems more study time can lead to higher achievement

These results seem pretty clear cut. If this research could be replicated in diverse contexts then the findings could have great significance.

  • Is your manager trying to cut course hours to save budget?
  • Does your school want you to teach 'triple science' in a curriculum slot intended for 'double science'?
  • Does your child say they have done enough homework?

Research evidence suggests that, ceteris paribus, learners achieve more by spending more time studying.

Ceteris paribus?

That is ceteris paribus (no, it is not a newly discovered species of whale): all other things being equal. But of course, in the real world they seldom – if ever – are.

If you wondered about the motivation for a study designed to see whether more teaching led to more learning (hardly what Karl Popper would have classed as a suitable 'bold conjecture' on which to base productive research), then I should confess I am being disingenuous. The information I give above is based on the published research, but offers a rather different take on the study from that offered by the authors themselves.

An 'alternative interpretation' one might say.

How useful are DARTs as learning activities?

I came across this study when looking to see if there was any research on the effectiveness of DARTs in chemistry teaching. DARTs are directed activities related to text – that is text-based exercises designed to require learners to engage with content rather than just copy or read it. They have long been recommended, but I was not sure I had seen any published research on their use in science classrooms.

Read about using DARTs in teaching

Shamsulbahri and Zulkiply (2021) undertook a study that "examined the effect of Directed Activity Related to Texts (DARTs) and gender on student achievement in qualitative analysis in chemistry" (p.157). They considered their study to be a quasi-experiment.

An experiment…

Experiment is the favoured methodology in many areas of natural science, and, indeed, the double blind experiment is sometimes seen as the gold standard methodology in medicine – and when possible in the social sciences. This includes education, and certainly in science education the literature reports many, many educational experiments. However, doing experiments well in education is very tricky and many published studies have major methodological problems (Taber, 2019).

Read about experiments in education

…requires control of variables

As we teach in school science, fair testing requires careful control of variables.

So, if I suggest there are some issues that prevent a reader from being entirely confident in the conclusions that Shamsulbahri and Zulkiply reach in their paper, it should be borne in mind that I think it is almost impossible to do a rigorously 'fair' small-scale experiment in education. By small-scale, I mean the kind of study that involves a few classes of learners as opposed to studies that can enrol a large number of classes and randomly assign them to conditions. Even large scale randomised studies are usually compromised by factors that simply cannot be controlled in educational contexts (Taber, 2019) , and small scale studies are subject to additional, often (I would argue) insurmountable, 'challenges'.

The study is available on the web, open access, and the paper goes into a good deal of detail about the background to, and aspects of, the study. Here, I am focusing on a few points that relate to my wider concerns about the merits of experimental research into teaching, and there is much of potential interest in the paper that I am ignoring as not directly relevant to my specific argument here. In particular, the authors describe the different forms of DART they used in the study. As, inevitably (considering my stance on the intrinsic problems of small-scale experiments in education), the tone of this piece is critical, I would recommend readers to access the full paper and make up your own minds.

Not a predatory journal

I was not familiar with the journal in which this paper was published – the Malaysian Journal of Learning and Instruction. It describes itself as "a peer reviewed interdisciplinary journal with an international advisory board". It is an open access journal that charges authors for publication. However, the publication fees are modest (US$25 if authors are from countries that are members of The Association of Southeast Asian Nations, and US$50 otherwise). This is an order of magnitude less than is typical for some of the open-access journals that I have criticised here as being predatory – those which do not engage in meaningful peer review, and will publish some very low quality material as long as a fee is paid. 25 dollars seems a reasonable charge for the costs involved in publishing work, unlike the hefty fees charged by many of the less scrupulous journals.

Shamsulbahri and Zulkiply seem, then, to have published in a well-motivated journal and their paper has passed peer review. But this peer thinks that, like most small scale experiments into teaching, it is very hard to draw any solid conclusions from this work.

What do the authors conclude?

Shamsulbahri and Zulkiply argue that their study shows the value of DARTs activities in learning. I approach this work with a bias, as I also think DARTs can be very useful. I used different kinds of DARTs extensively in my teaching with 14-16 years olds when I worked in schools.

The authors claim their study,

"provides experimental evidence in support of the claim that the DARTs method has been beneficial as a pedagogical approach as it helps to enhance qualitative analysis learning in chemistry…

The present study however, has shown that the DARTs method facilitated better learning of the qualitative analysis component of chemistry when it was combined with the experimental method. Using the DARTs method only results in better learning of qualitative analysis component in chemistry, as compared with using the Experimental method only."

Shamsulbahri & Zulkiply, 2021

Yet, despite my bias, which leads me to suspect they are right, I do not think we can infer this much from their quasi-experiment.

I am going to separate out three claims in the quote above:

  1. the DARTs method has been beneficial as a pedagogical approach as it helps to enhance qualitative analysis learning in chemistry
  2. the DARTs method facilitated better learning of the qualitative analysis component of chemistry when it was combined with the [laboratory1] method
  3. the DARTs method [by itself] results in better learning of qualitative analysis component in chemistry, as compared with using the [laboratory] method only.

I am going to suggest that there are two weak claims here and one strong claim. The weak claims are reasonably well supported (but only as long as they are read strictly as presented and not assumed to extend beyond the study) but the strong claim is not.

Limitations of the experiment

I suggest there are several major limiations of this research design.

What population is represented in the study?

In a true experiment researchers would nominate the population of interest (say, for example, 14-16 year old school learners in Malaysia), and then randomly select participants from this population who would be randomly assigned to the different conditions being compared. Random selection and assignment cannot ensure that the groupings of participants are equivalent, nor that the samples genuinely represent the population; as by chance it could happen that, say, the most studious students are assigned to one condition and all the lazy students to an other – but that is very unlikely. Random selection and assignment means that there is strong statistical case to think the outcomes of the experiment probably represent (more or less) what would have happened on a larger scale had it been possible to include the whole population in the experiment.

Read about sampling in research

Obviously, researchers in small-scale experiments are very unlikely to be able to access full populations to sample. Shamsulbahri and Zulkiply did not – and it would be unreasonable to criticise them for this. But this does raise the question of whether what happens in their samples will reflect what would happen with other groups of students. Shamsulbahri and Zulkiply acknowledge their sample cannot be considered typical,

"One limitation of the present study would be the sample used; the participants were all from two local fully residential schools, which were schools for students with high academic performance."

Shamsulbahri & Zulkiply, 2021

So, we have to be careful about generalising from what happened in this specific experiment to what we might expect with different groups of learners. In that regard, two of the claims from the paper that I have highlighted (i.e., the weaker claims) do not directly imply these results can be generalised:

  1. the DARTs method has been beneficial as a pedagogical approach…
  2. the DARTs method facilitated better learning of the qualitative analysis component of chemistry when it was combined with the [laboratory] method

These are claims about what was found in the study – not inferences about what would happen in other circumstances.

Read about randomisation in studies

Equivalence at pretest?

When it is not possible to randomly assign participants to the different conditions then there is always the possibility that whatever process has been used to assign conditions to groups produces a bias. (An extreme case would be in a school that used setting, that is assigning students to teaching groups according to achievement, if one set was assigned to one condition, and another set to a different condition.)

In quasi-experiments on teaching it is usual to pre-test students and to present analysis to show that at the start of the experiment the groups 'are equivalent'. Of course, it is very unlikely two different classes would prove to be entriely equivalent on a pre-test, so often there is a judgement made of the test results being sufficiently similar across the conditions. In practice, in many published studies, authors settle for the very weak (and inadequate) test of not finding differences so great that would be very unlikely to occur by chance (Taber, 2019)!

Read about testing for equivalence

Shamsulbahri and Zulkiply did pretest all participants as a screening process to exclude any students who already had good subject knowledge in the topic (qualitative chemical analysis),

"Before the experimental manipulation began, all participants were given a pre-screening test (i.e., the Cation assessment test) with the intention of selecting only the most qualified participants, that is, those who had a low-level of knowledge on the topic….The participants who scored ten or below (out of a total mark of 30) were selected for the actual experimental manipulation. As it turned out, all 120 participants scored 10 and below (i.e., with an average of 3.66 out of 30 marks), which was the requirement that had been set, and thus they were selected for the actual experimental manipulation."

Shamsulbahri & Zulkiply, 2021

But the researchers do not report the mean results for the groups in the three conditions (laboratory1; DARTs; {laboratory+DARTs}) or give any indication of how similar (or not) these were. Nor do these scores seem to have been included as a variable in the analysis of results. The authors seem to be assuming that as no students scored more than one-third marks in the pre-test, then any differences beteen groups at pre-test can be ignored. (This seems to suggest that scoring 30% or 0% can be considered the same level of prior knowledge in terms of the potential influence on further learning and subsequent post-test scores.) That does not seem a sound assumption.

"It is important to note that there was no issue of pre-test treatment interaction in the context of the present study. This has improved the external validity of the study, since all of the participants were given a pre-screening test before they got involved in the actual experimental manipulation, i.e., in one of the three instructional methods. Therefore, any differences observed in the participants' performance in the post-test later were due to the effect of the instructional method used in the experimental manipulation."

Shamsulbahri & Zulkiply, 2021 (emphasis added)

There seems to be a flaw in the logic here, as the authors seem to be equating demonstrating an absence of high scorers at pre-test with there being no differences between groups which might have influenced learning. 2

Units of analysis

In any research study, researchers need to be clear regarding what their 'unit of analysis' should be. In this case the extreme options seem to be:

The key question is whether individual learners can be considered as being subject to the treatment conditions independently of others assiged to the same condition.

"During the study phase, student participants from the three groups were instructed by their respective chemistry teachers to learn in pairs…"

Shamsulbahri & Zulkiply, 2021

There is a strong argument that when a group of students attend class together, and are taught together, and interact with each other during class, they strictly should not be considered as learning independently of each other. Anyone who has taught parallel classes that are supposedly equivalent will know that classes take on their own personalities as groups, and the behaviour and learning of individual students is influenced by the particular class ethos.

Read about units of analysis

So, rigorous research into class teaching pedagogy should not treat the individual learners as units of analysis – yet it often does. The reason is obvious – it is only possible to do statistical testing when the sample size is large enough, and in small scale educational experiments the sample size is never going to be large enough unless one…hm…pretends/imagines/considers/judges/assumes/hopes?, that each learner is independently subject to the assigned treatment without being substantially influenced by others in that condition.

So, Shamsulbahri and Zulkiply treated their participants as independent units of analysis and based on this find a statistically significant effect of treatment:

⎟laboratory⎢ vs. ⎟DARTs⎢ vs. ⎟laboratory+DARTs⎢.

That is questionable – but what if, for argument's sake, we accept this assumption that within a class of 40 students the learners can be considered not to influence each other (even their learning partner?) or the classroom more generally sufficiently to make a difference to others in the class?

A confounding variable?

Perhaps a more serious problem with the research design is that there is insufficient control of potentially relevant variables. In order to make a comparison of ⎟laboratory⎢ vs. ⎟DARTs⎢ vs. ⎟laboratory+DARTs⎢ then the only relevant difference between the three treatment conditions should be whether the students learn by laboratory activity, DARTs, or both. There should not be any other differences between the groups in the different treatments that might reasonably be expected to influence the outcomes.

Read about confounding variables

But the description of how groups were set up suggests this was not the case:

"….the researchers conducted a briefing session on the aims and experimental details of the study for the school's [schools'?] chemistry teachers…the researchers demonstrated and then guided the school's chemistry teachers in terms of the appropriate procedures to implement the DARTs instructional method (i.e., using the DARTs handout sheets)…The researcher also explained to the school's chemistry teachers the way to implement the combined method …

Participants were then classified into three groups: control group (experimental method), first treatment group (DARTs method) and second treatment group (Combination of experiment and DARTs method). There was an equal number of participants for each group (i.e., 40 participants) as well as gender distribution (i.e., 20 females and 20 males in each group). The control group consisted of the participants from School A, while both treatment groups consisted of participants from School B"


Shamsulbahri & Zulkiply, 2021

Several different teachers seems to have been involved in teaching the classes, and even if it is not entirely clear how the teaching was divided up, it is clear that the group that only undertook the laboratory activities were from a different school than those in the other two conditions.

If we think one teacher can be replaced by another without changing learning outcomes, and that schools are interchangeable such that we would expect exactly the same outcomes if we swapped a class of students from one school for a class from another school, then these variables are unimportant. If, however, we think the teacher doing the teaching and the school from which learners are sampled could reasonably make a difference to the learning achieved, then these are confounding variables which have not been properly controlled.

In my own experience, I do not think different teachers become equivalent even when their are briefed to teach in the same way, and I do not think we can assume schools are equivalent when providing students to participate in learning. These differences, then, undermine our ability to assign any differences in outcomes as due to the differences in pedagogy (that "any differences observed…were due to the effect of the instructional method used").

Another confounding variable

And then I come back to my starting point. Learners did not just experience different forms of pedagogy but also different amounts of teaching. The difference between 3 lessons and 5 lessons might in itself be a factor (that is, even if the pedagogy employed in those lessons had been the same), as might the difference between 5 lessons and 8 lessons. So, time spent studying must be seen as a likely confounding variable. Indeed, it is not just the amount of time, but also the number of lessons, as the brain processes learning between classes and what is learnt in one lesson can be reinforced when reviewed in the next. (So we could not just assume, for example, that students automatically learn the same amount from, say, two 60 min. classes and four 30 min. classes covering the same material.)

What can we conclude?

As with many experiments in science teaching, we can accept the results of Shamsulbahri and Zulkiply's study, in terms of what they found in the specific study context, but still not be able to draw strong conclusions of wider significance.

Is the DARTs method beneficial as a pedagogical approach?

I expect the answer to this question is yes, but we need to be careful in drawing this conclusion from the experiment. Certainly the two groups which undertook the DARTs activities outperformed the group which did not. Yet that group was drawn from a different school and taught by a different teacher or teachers. That could have explained why there was less learning. (I am not claiming this is so – the point is we have no way of knowing as different variables are conflated.) In any case, the two groups that did undertake the DARTs activity were both given more lessons and spent substantially longer studying the topic they were tested on, than the class that did not. We simply cannot make a fair comparison here with any confidence.

Did the DARTs method facilitate better learning when it was combined with laboratory work?

There is a stronger comparison here. We still do not know if the two groups were taught by the same teacher/teachers (which could make a difference) or indeed whether the two groups started from a very similar level of prior knowledge. But, at least the two groups were from the same school, and both experienced the same DARTs based instruction. Greater learning was achieved when students undertook laboratory work as well as undertaking DARTs activities compared with students who only undertook the DARTs activity.

The 'combined' group still had more teaching than the DARTs group, but that does not matter here in drawing a logical conclusion because the question being explored is of the form 'does additional teaching input provide additional value?' (Taber, 2019). The question here is not whether one type of pedagogy is better than the other, but simply whether also undertaking practical works adds something over just doing the paper based learning activities.

Read about levels of control in experimental design

As the sample of learners was not representative of any specfiic wider population, we cannot assume this result would generalise beyond the participants in the study, although we might reasonably expect this result would be found elsewhere. But that is because we might already assume that learning about a practical activity (qualitative chemical analysis) will be enhanced by adding some laboratory based study!

Does DARTs pedagogy produce more learning about qualitative analysis than laboratory activities?

Shamsulbahri and Zulkiply's third claim was bolder because it was framed as a generalisation: instruction through DARTs produces more learning about qualitative analysis than laboratory-based instruction. That seems quite a stretch from what the study clearly shows us.

What the research does show us with confidence is that a group of 40 students in one school taught by a particular teacher/teaching team with 5 lessons of a specific set of DARTs activities, performed better on a specific assessment instrument than a different group of 40 students in another school taught by a different teacher/teaching team through three lessons of laboratory work following a specific scheme of practical activities.


a group of 40 students
performed better on a specific assessment instrumentthan a different group of 40 students
in one schoolin another school
taught by a particular teacher/teaching team
taught by a different teacher/teaching team
with 5 lessonsthrough 3 lessons
of a specific set of DARTs activities, of laboratory work following a specific scheme of practical activities
Confounded variables

Test instrument bias?

Even if we thought the post-test used by Shamsulbahri and Zulkiply was perfectly valid as an assessment of topic knowledge, we might be concerned by knowing that learning is situated in a context – we better recall in a similar context to that in which we learned.


How can we best assess students' learning about qualitative analysis?


So:

  • should we be concerned that the form of assessment, a paper-based instrument, is closer in nature to the DARTs learning experience than the laboratory learning experience?

and, if so,

  • might this suggest a bias in the measurement instrument towards one treatment (i.e., DARTs)

and, if so,

  • might a laboratory-based assessment have favoured the group that did the laboratory based learning over the DARTs group, and led to different outcomes?

and, if so,

  • which approach to assessment has more ecological validity in this case: which type of assessment activity is a more authentic way of testing learning about a laboratory-based activity like qualitative chemical analysis?

A representation of my understanding of the experimental design

Can we generalise?

As always with small scale experiments into teaching, we have to judge the extent to which the specifics of the study might prevent us from generalising the findings – to be able to assume they would generally apply elsewhere.3 Here, we are left to ask to what extent we can

  • ignore any undisclosed difference between the groups in levels of prior learning;
  • ignore any difference between the schools and their populations;
  • ignore any differences in teacher(s) (competence, confidence, teaching style, rapport with classes, etc.);
  • ignore any idiosyncrasies in the DARTs scheme of instruction;
  • ignore any idiosyncrasies in the scheme of laboratory instruction;
  • ignore any idiosyncrasies (and potential biases) in the assessment instrument and its marking scheme and their application;

And, if we decide we can put aside any concerns about any of those matters, we can safely assume that (in learning this topic at this level)

  • 5 sessions of learning by DARTs is more effective than 3 sessions of laboratory learning.

Then we only have to decide if that is because

  • (i) DARTs activities teach more about this topic at this level than laboratory activities, or
  • (ii) whether some or all of the difference in learning outcomes is simply because 150 minutes of study (broken into five blocks) has more effect than 90 minutes of study (broken into three blocks).

What do you think?


Loading poll ...
Work cited:

Notes:

1 The authors refer to the conditions as

I am referring to the first group as 'laboratory' both because it not clear the students were doing any experiments (that is, testing hypotheses) as the practical activity was learning to undertake standard analytical tests, and, secondly, to avoid confusion (between the educational experiment and the laboratory practicals).


2 I think the reference to "no issue of pre-test treatment interaction" is probably meant to suggest that as all students took the same pre-test it will have had the same effect on all participants. But this not only ignores the potential effect of any differences in prior knowledge reflected in the pre-test scores that might influence subsequent learning, but also the effect of taking the pre-test cannot be assumed to be neutral if for some learners it merely told them they knew nothing about the topic, whilst for others it activated and so reinforced some prior knowledge in the subject. In principle, the interaction between prior knowledge and taking the pretest could have influenced learning at both cognitive and affective levels: that is, both in terms of consolidation of prior learning and cuing for the new learning; and in terms of a learner's confidence in, and attitude towards, learning the topic.


3 Even when we do have a representative sample of a population to test, we can only infer that the outcomes of an experiment reflect what will be most likely for members (schools, learners, classes, teachers…) of the wider population. Individual differences are such that we can never say that what most probably is the case will always be the case.


When an experiment tests a sample drawn at random from a wider population, then the findings of the experiment can be assumed to apply (on average) to the population. (Source: after Taber, 2019).

The Indiscrete Quantum

Did Thomas Kuhn make a continuity error?


Keith S. Taber


Would you like to read a science joke?

At least, I think this was intended as a joke:

"A month after his return from Brussels, Poincaré [Henri Poincaré] presented to the French Academy of Sciences the first version of his own detailed proof of the necessity of discontinuity. The full version followed in January 1912, after which date French publication on the quantum, if initially sparse, is nevertheless continuous."

Kuhn, 1978/1887 (emphasis added)

This is from a book on the history of science, and, in particular, one detailing the slow process by which the notion that energy is quantised became established in physics. Quantised, here, means existing as discrete quanta – coming in distinct lumps so to speak – in the way that coinage does, but, say, tap water does not [seem to].

The author, Thomas Kuhn, is most famous for his theory of how science tends to occur within established traditions, so-called paradigms, interrupted by the occasional 'revolutionary' paradigm-shift. At the level of the individual scientist, a paradigm-shift requires the kind of gestalt-switch involved in switching one's perception of an ambiguous image.


An ambiguous figure (Image by ElisaRiva from Pixabay).

"The figure might be seen as two faces (shown in white against a black background). Or the same image (i.e., the same perceptual data) could be seen – that is interpreted – as some kind of goblet or candlestick holder (in black against a white background).

A person can learn to see either version, but not both at the same time. The brain actively organises perception to make sense of the image, and the viewer can force the 'Gestalt-shift' between the two interpretations…."

Taber, 2023, p.197

That is, there is a clear discontinuity in thinking. Understanding the earth in space as one planet among others orbiting a star requires a drastic reorganisation of thinking from seeing the earth as the centre of a universe which all revolves about it. That switch may be the outcome of a lot of deliberation and reflection – but the two paradigms are, Kuhn claimed, incommensurable. That did not mean it was not possible to compare competing paradigms, but rather that each mind-set reflected a particular perspective, and there is no neutral ground that allows a completely objective comparison.

Scientists may only slowly construct a new way of conceptualising a phenomenon or field (Thagard, 1992), but once they have, they can 'see' matters completely differently. Ironically, perhaps, Kuhn suggests that the more historical research reveals the details of how such shifts come about the more the discontinuity can be seen as the outcome of a continuous development in the scientist's thinking,

"…as almost always happens in historical reconstruction, the new narrative is more nearly continuous than its predecessor."
p.354

Kuhn, 1984/1987

So, the paradigm-shift is a kind of quantum jump in thinking. But this discontinuity is also the outcome of a gradual, continuous process. If that seems a contradiction, consider what happens if someone blows up a balloon – in both senses of 'blow up'! Inflating the balloon is a continuous process where the balloon slowly gets larger – until it 'pops'.


A balloon can be inflated to differing degrees – and can be stable at many degrees of inflation as the elastic skin stretches, creating an increasing tension that balances the effect of the increasing (excess) gas pressure inside.

However, the same process that continously inflates the balloon through a sequence of myriad possible stable states eventually leads to an internal pressure greater than the skin can tolerate, and there is a sudden catastrophic shift to a new, quite different, state (i.e., a burst balloon)

(Image by RAHIL GUPTA from Pixabay)


Kuhn was a physicist who become involved in teaching about the history of science at Harvard, and transitioned to become a historian of science. He wrote a book about the Copernican revolution (1957) – the shift from seeing the universe as earth-centred to appreciating that the earth was one subsidiary part of a sun-centred system – but his ideas about science in general progressing through such dramatic shifts were widely criticised. 1

One of the criticisms was that his model only reflected a limited number of examples of developments in physics, and could not be generalised as applying to science as a matter of course. Kuhn had not trained as a historian and his book on the Copernican revolution largely derived from his reading of secondary sources he had used in preparing lectures. (Many valuable books are primarily based on synthesising other secondary sources – but original works of academic history are based on detailed engagement with original sources such as the original scientific publications, as well as letters, diary entries, and the like.)

Kuhn's book on the 'quantum discontinuity' was intended to be serious historical scholarship. It is a detailed and evidenced account of how an idea introduced into physics as a kind of mental trick – if not perhaps a desperate stop-gap measure – slowly become accepted as actually reflecting a key aspect of the fundamental nature of the physical world.2

A second quantum revolution

Yet this was not the first quantum revolution in science. It was already widely accepted that matter was quantised – the apparently continuous nature of an iron bar or a drop of water was understood to reflect the emergence at a perceptible scale of properties that were due to the interactions of myriad tiny discrete parts. (We generally say matter is made up of tiny particles, but these are not like tiny ball bearings, but more like fuzzy concentrations of electrical fields – quanticles.)

Something that everyone today learns in school – about matter comprising of molecules and ions, that are themselves made up of protons, neutrons and electrons – was once a seemingly bizarre and wild conjecture. Even into the Twentieth Century some scientists saw the atomic hypothesis (sic) as only a useful explanatory device which did not offer a realistic description of how the world was actually structured.

Indeed, even today, it is widely considered that one of the most challenging aspects of introductory chemistry is appreciating how models of the structure and properties of matter at the nano-scale of quanticles – ions, molecules, electrons – are used to explain the very different structures and properties of matter at the familiar everyday scale (Taber, 2013).


Chemistry is a science which explains familiar phenomena through models of submicroscopic quanticles that behave in unfamiliar ways (Figure from Taber, 2013)

But scientists came to accept the 'atomic hypothesis' because it explained many phenomena, and proved successful in making predictions – leading to conjectures that could be successfully tested.

The continuous and the discrete

The distinction between what is continuous and what is discrete is generally marked in English in that mass nouns are applied to entities that are seen as continuous. So, at the perceptible scale, air and water are examples of things that are continuous. In English, then, the words 'air' and 'water' are mass nouns rather than count nouns used for countable entities (e.g., coins, chairs, plates, schools).

We can say:

  • I need some air
  • let's get a little more air
  • would you like some water?
  • I have drunk too much water

but not (usually)

  • I need another air
  • let's gets many more airs
  • Would you like any waters?
  • I have drunk too many waters

(Ironically, in the circumstances, we teach children that air is a mixture of substances comprising discrete molecules, and that water is a substance comprised of a great many molecules that are attracted to each other. So, we can refer to another molecule, or many more molecules, of water!)

  • One can do much research ('research' is a mass noun), but one cannot do many research. Although one can undertake many studies ('study 'is a count noun), which amounts to much research.
  • A person can be quite sad, or very sad (or not sad at all), but is not said to have fewer sads or more sads (or to have no sads).
  • On the other hand, a person may have many books, but not much book. Although we might say the person had much literature (not many literatures).'Book' is a count noun, where 'literature' is a mass noun. Publications (articles, books, chapters, conference papers, posters) are discrete – and both the references cited at the end of an academic work, and the individual scholar's record of publication, take the form of lists.

Of course, language is fluid (so to speak! – like water and air), and can change and become stretched or modified. We now see references to people who have done 'many researches', even if this is not (yet at least) standard use. Whilst, in English, data is plural (some data, many data), and the singular is datum (the datum, a datum) the widespread use of data as a mass noun (much data)3 has led to the respected newspaper The Financial Times giving in to the mob and deciding to use 'data' for 'datum' in future.

"…in the last few weeks something has happened that has shaken our very civilisation and made walls come tumbling down. The Financial Times…has announced that according to their style guide, henceforth 'data' will be a singular noun."

Tim Harford presenting the BBC radio programme/podcast 'More or Less' episode 'Nurses' pay, ambulance times and forgotten female economists' (Released On: 15 Feb 2023)

The quantum theory

When scientists and physics teachers refer to the quantum theory they tend to mean not the quantisation of matter, but of energy. The idea that energy might be quantised seemed counter-intuitive – even if matter came in lumps, energy was not 'stuff' and was surely continuous in nature. Energy was seen to be more like sadness than coinage.

Yet there were problems. The 'ultraviolet catastrophe' referred to how theory suggested that a 'black-body' radiator (an ideal radiator) should emit a spectrum of radiation that showed ever increasing energy output in moving to higher frequencies. That did not happen. This was not just because real radiators could only be expected to approximate to an ideal model – the discrepancy was extreme. A real hot body gave an emission spectrum with a maximum peak, and then decreasing power output at increasing frequencies (lower wavelengths); whereas theory predicted a continuously rising curve. (See the figure below.) Clearly, if hot bodies had been able to radiate with infinite power they would have cooled instantly then no one could have ever made a decent cup of tea. (Although that may not have ben the most serious concern.)


Classical theory predicted something bizarre: that thermal radiators would emit with infinite power, with the energy output increasing with increasing frequency (i.e., decreasing wavelength – read the graph from right to left) of radiation (as shown by the black curve for a body at 5000K according to classical theory). The spectra of actual radiators (other curves) have maxima, beyond which the output drops at higher frequencies (and so the area under a curve – and the energy radiated – is finite).
(Image source: By Darth Kule – Own work, Public Domain, wikimedia)

The theoretically derived spectrum was found to be quite well-matched to empirical results obtained at low enough frequencies, but once into the ultraviolet region the predictions and experimental results diverged considerably, and in a way that become even more extreme as frequency increased. Thus the term ultraviolet catastrophe.

For that matter, the simple model of the atom with orbiting electrons did not fit classical theory which predicted that an oscillating electrical charge should emit radiation (and in doing so shift to a lower energy state). These radiating atoms should (on this theory) collapse as electrons spiralled into their nuclei. Moreover, this should also happen on a very short time-scale. Clearly matter did not behave as theory predicted. There was something of a crisis in physics.

Quantum hypotheses

The idea that when matter interacts with radiation there might be restrictions on the magnitude of energy changes involved was first introduced as a kind of mathematical 'fix' to bring the theory into line with the empirical data (plural!) Only slowly did it become accepted that this was not just some mathematical trick, but part of an authentic description of how the universe actually appears to be: when a body absorbs or emits radiation this happens in discrete quanta.

That is, what was invented as a thinking tool, became seen as having significant physical significance,

"…the changed meaning of the quantity h𝜈 from

a mental subdivision of the energy continuum to

a physically separable atom of energy."

Kuhn, 1984/1987 {emphasis added}

When your desk lamp emits radiation the number of quanta involved is enormous, so it seems a continuous process – just as the shade appears to be a continuous lump of material rather than a vast conglomeration of molecules. Our experience of the effect of turning on a lamp is like observing a beach from such a great distance that the sand looks like a continuous entity – even though we know that if we went on the beach and looked very closely we would see the sand comprised of myriad tiny grains. (Tiny on our scale – still enormous on the scale of individual atoms.)


Seen from a distance, sand on a beach seems a continuous material, but under the right viewing conditions we can see it is particulate – comprised of discrete grains
(Image by Marcel from Pixabay)

But in the photoelectric effect, where the absorption of radiation can change the electrical properties of certain materials, it becomes clear that the radiation is not being absorbed as a continuous flow of energy from the radiation field, but as series of discrete events. There is a threshold frequency of light below which the effect does not occur and the radiation has no effect on the electrical properties of the material. No matter how much we turn up the intensity of light, even if we are only just below the threshold frequency, we do not see the photoelectric effect as it relies on the radiation arriving in energy-packets that are individually large enough to have an effect at the atomic level.

Consider two children standing by a garden fence behind which the neighbours are having a wild party. Imagine the brother is just too short to see over the fence, but the sister is slightly taller – above the threshold to see over the fence. The taller child observes the crazy events next door, and the longer she watches, the more she observes. However, the shorter child observes nothing. Even if he stands there for the entire evening, he will not get a glimpse, whereas the taller companion sees something – and so sees more than her brother – even if she gets bored and goes away after just a few minutes.


A visual analogy for the kind of threshold that occurs in the photoelectric effect. There is a minimum frequency of radiation (and so minimum energy quantum) needed to trigger the photoelectric effect – just as there is minimum height needed to see over the fence such that a constantly growing child will fairly rapidly transition from being too short (seeing nothing) to tall enough (seeing all there is to see).

Albert Einstein explained this as the radiation being comprised of particle-like packets of energy – the photons. Again this was, initially, widely seen as a heuristic, a way of moving research forward – and so putting aside, at least for the time being, a conceptual problem. But over time it came to be understood as something fundamental about the nature of radiation. Light, and other electromagnetic radiation, may have wave-like aspects, but a full description has to account for its particle-like nature as well.

A physics pun?

Kuhn's book on 'Black-Body Theory and the Quantum Discontinuity' is centrally about the way this idea of radiated energy being discontinuous gradually moved

  • from being a stop-gap heuristic (i.e., treat energy as quantised for the moment) of the kind scientists often use to allow them to make progress despite a conceptual problem they will need to return to at some point
  • to become seen as a fundamental truth about the nature of the universe: energy, in interacting with matter, is quantised.

In this sense, energy is more like coins than sadness– more like studies than research.

And, in physics, studies are generally published in the research literature as 'papers' – reports of research, each described in a discrete and self-contained article.4 The wider literature also includes books and book chapters and conference papers – but these are also all discrete entities, even when they collectively reflect an author's slowly shifting perspective on some topic.

As Kuhn was centrally writing about the transition from radiation understood as something continuous to radiation understood as energy quantised in discrete photons, something discontinuous, he was clearly well aware of this distinction. Indeed, the 'Quantum Discontinuity' of his title was itself a kind of pun, that could refer either

  • to how the quantisation physics describes reflects a discontinuous process – or
  • to the paradigm shift in understanding among the physics community in accepting quantisation as a physical description.

There was a discontinuity in both developing scientific thinking about the physics, and in the physical nature of the universe itself.

'French publication' was not continuous

"French publication" on the quantum, whether sparse or dense, would have occurred through a sequence of discrete publications (and, so, as distinct events separated in time by intervals). "French publication" on the quantum – however, we might be able to describe these events: infrequent, occasional, regular, sporadic – was not continuous.

Or, perhaps better, French publications on the quantum were not continuous?

Surely, Kuhn would not have slipped-up in this regard? More likely he was deliberately adopting a loose use of 'continuous' as a kind of pun in contrast to the discrete quanta the publications discussed.

Taking a historical overview from a distance of some decades (like viewing the sand on the beach from a passing boat) the flow of publications about quanta might blur into seeming a continuous stream – perhaps this can be seen as a kind of inverse effect to how Kuhn suggests detailed historical scholarship could reveal the gradual, incremental progression in thinking that led to a revolutionary conceptual rupture.

In the history of science, as in the investigation of matter and energy, whether something appears as a continuum or not very much depends upon the scale at which we view and the grain size at which we sample. And much the same has been found in science education research exploring learners' developing ideas (Taber, 2008).

Coda: data are like energy

Dr Beth Malory, a lecturer in English Linguistics at UCL, commenting on the change in house style at The Financial Times referred to above, suggested that a corpus analysis of the occurrence of the word 'data' in accessible published texts indicates that "for most people, data is a mass noun" – that is, in general use people are much more likely to write "data is" instead of the formally correct "a datum is"/"data are". She made the following intriguing comparison,

"Something like energy or air would be a good analogy for it [data]."

Dr Beth Malory interviewed by Tim Harford on the BBC radio programme/podcast 'More or Less' episode 'Reoffending rates, Welsh taxes and the menopause' (Released On: 22 Feb 2023)

I doubt she had in mind that energy and air, like sand, and indeed like data themselves, are – if you investigate them closely enough – quantised.


Work cited

Notes

1 For scholars in the humanities, being widely criticised is not to be understood as an entirely negative thing. Primarily, it means people have noticed your work, and they think it is significant enough to be challenged: so many scholars would think that being widely criticised is to be welcomed! For that matter, having other scholars publish work criticising your scholarship can be a justification for seeking to publish a response to their criticisms and, so, an opportunity for developing and further disseminating your own ideas.

This might be seen as the academic equivalent of Oscar Wilde's quip that

the only thing worse than being talked about, was not being talked about!


2 Another example of a 'fudge factor come good' might be the 'cosmological constant' that Albert Einstein introduced into his theories to give the equations a form that fitted the assumed nature of the universe. Einstein later considered this his greatest blunder – but other physicists have found ways to interpret the cosmological constant as relating to important, observable features of the universe.


3 I suspect, often, data is actually being used as a collective noun (akin to the committee, the council, the population {nouns which refer to a (singular) group of people}; the swarm, the herd, the flock, the shoal, etc.), where 'the data' refers to the particular 'data set' ('dataset') being discussed.


4 Contributions to the literature are expected to build upon, and cite, existing work in a field – but each research report should set out a coherent and complete, self-contained argument to support its conclusions.

Read about research writing


Batteries – what are they good for?

Okay, 'energy storage' – but what else are they good for?


Keith S. Taber


I was struck by an item on the BBC Radio 4 news headlines at 09.00 this morning (27th Feb. 2023):

"The collapsed battery maker Britishvolt which went into administration last month has been bought by an Australian company.
The new owners will focus initially on batteries for energy storage rather than electric vehicles."

BBC Radio 4 news item

Now on reflection, this was an ambiguous statement. I heard it as

"The new owners will focus initially on batteries for

  • energy storage, rather than
  • electric vehicles."

Which immediately provoked in my mind the question what batteries might be used for in electric vehicles – if not 'energy storage'?


It is possible to charge up an electric car because it includes a battery
(Image by Sabine Kroschel from Pixabay)

Conceptions of energy

Now, this whole area is, metaphorically, a bit of a linguistic minefield as when people say batteries they do not usually distinguish between an individual cell and a battery (of cells). Traditional electrochemical cells we are familiar with have a specific and usually modest e.m.f. – 1.5V or 1.2 V for example. The old 6V and 9V batteries that used to be commonly sold for many purposes (before the switch to most appliances having internal batteries) would be batteries of cells connected in series to work together to provide (1.5V + 1.5V + 1.5V + 1.5V = ) 6V (or whatever). Car batteries were traditionally batteries of lead-acid cells connected together. If each cell has an e.m.f. of 2V, then a dozen connected in series (i.e., the battery) offers 24V.

Moreover, energy is a highly abstract idea, such that even physics teachers do not always agree on how to describe it – the model of energy coming in a number of flavours, 'forms', and processes involving transformations in the form of the energy (e.g., a filament lamp converts electrical energy into heat energy) that many of us learnt (and some of us taught) has come to be seen as misleading and unhelpful by some (it not all) educators. Oh, and if you think I made a mistake there and forget that a lamp produces light energy – not at all. In the 'forms of energy' typology, heat is energy transferred due to a difference in temperature – so that covers all the radiation being emitted by the hot filament.

No wonder, that energy is a common topic for student alternative conceptions, as energy permeates (so to speak) all areas of science, but is a highly abstract notion.

Read about conceptions of energy

An alternative hearing?

Yet, I realised that the statement I had heard was ambiguous and could be parsed differently. It perhaps meant

"The new owners will focus initially on

  • batteries for energy storage

rather than

  • electric vehicles."

That is, I was putting my imaginary brackets in the wrong place and perhaps the company had previously intended to build complete electric cars and not just the batteries? If so, the news was not

  • The new owners will focus initially on batteries (for energy storage rather than electric vehicles).

but rather that

  • The new owners will focus initially on (batteries for energy storage) rather than (electric vehicles).

If this was the intention, it might have been better to have assumed listeners would know that batteries were used for 'energy storage', and to have simplified the statement to

"The new owners will focus initially on batteries rather than electric vehicles."

Batteries for under-performing sports cars?

That made more sense, as surely the BBC's news journalists do not think electric batteries in cars are used for something other than 'energy storage'. So, I checked on the BBC news website, where I found

"The company intends to start by focusing on batteries for energy storage and hopes to have those products available by the end of 2025.

It then intends to produce batteries for high-performance sports cars."

https://www.bbc.co.uk/news/business-64754879

So, I did not misinterpret the news item. According to the BBC (and to be fair, they are probably just reporting, albeit uncritically, what they have been told) under its new owners Britishvolt will

  • first work on batteries that can be used for energy storage, and
  • then shift attention to batteries for sports cars.

My best guess is that "batteries for energy storage" is shorthand for large scale devices for long term storage (that could, for example, be charged by wind generators when it is windy, and then later fed into the National Grid at times of high power demand). The characteristics of these devices would surely be different in detail from batteries used in electric vehicles.

However, I am pretty sure that "batteries for high-performance sports cars" also need to provide 'energy storage' or else those cars are not going to offer the kind of performance Britishvolt and the car manufacturers they will supply are looking for. After all, besides 'energy storage', what else are batteries actually good for?


Another late night writing copy in the newsroom?
(Image by mohamed_hassan from Pixabay)