Articles | Volume 21, issue 5
https://doi.org/10.5194/bg-21-1191-2024
© Author(s) 2024. This work is distributed under the Creative Commons Attribution 4.0 License.
Technical note: Assessment of float pH data quality control methods – a case study in the subpolar northwest Atlantic Ocean
Download
- Final revised paper (published on 13 Mar 2024)
- Preprint (discussion started on 22 May 2023)
Interactive discussion
Status: closed
Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor
| : Report abuse
-
RC1: 'Comment on bg-2023-76', Brendan Carter, 28 Jun 2023
- AC1: 'Reply on RC1', Cathy Wimart-Rousseau, 29 Aug 2023
-
RC2: 'Comment on bg-2023-76', Anonymous Referee #2, 28 Jul 2023
- AC2: 'Reply on RC2', Cathy Wimart-Rousseau, 29 Aug 2023
Peer review completion
AR – Author's response | RR – Referee report | ED – Editor decision | EF – Editorial file upload
ED: Reconsider after major revisions (11 Sep 2023) by Julia Uitz
AR by Cathy Wimart-Rousseau on behalf of the Authors (14 Sep 2023)
Author's response
Author's tracked changes
Manuscript
ED: Referee Nomination & Report Request started (15 Sep 2023) by Julia Uitz
RR by Brendan Carter (10 Oct 2023)
RR by Anonymous Referee #2 (29 Oct 2023)
ED: Reconsider after major revisions (30 Oct 2023) by Julia Uitz
AR by Cathy Wimart-Rousseau on behalf of the Authors (19 Dec 2023)
Author's response
Author's tracked changes
Manuscript
ED: Publish as is (10 Jan 2024) by Julia Uitz
AR by Cathy Wimart-Rousseau on behalf of the Authors (19 Jan 2024)
Author's response
Manuscript
Wimart-Rousseau et al. have put together an interesting new data set and float-cruise comparison. They also review float adjustment algorithms, adjustment reference depths, and choices regarding how and when adjustments are updated. Their findings show significant offsets between their floats and discrete samples collected from a nearby cruise. They arrive at a plausible set of conclusions and suggest several useful measures. The resulting paper could be a useful contribution to the literature, but I believe it should nevertheless be returned to the authors for revision for the following reasons:
Ultimately I was left uncertain of what to make of the results. This is perhaps a useful outcome for a paper that is arguing that we need to be less optimistic about the quality of the data generated by certain approaches, but I feel like the authors should take advantage of a revision to address the issues noted above and below, should double check for potential errors in the presentation and the analysis (particularly the pH- temperature and pressure conversions), should more rigorously compare how the algorithm estimate variability compares to the expected variability in a statistical sense, and should shorten the paper and distill the main ideas (particularly if it is to be kept as a technical note). That said, I tend to agree with all of the conclusions made by the authors, and their presentation did seem to support the conclusions. The subject matter is important and the statements in the conclusions are worth making to the community, so I hope the authors resubmit this paper.
Line-by-line comments
1: “this” refers to a subject that has not yet been defined
6: “decipher punctual events” is awkward phrasing. Suggest “Measure the impacts of short-term events”
8: This is a matter of personal preference so please feel free to ignore this comment, but I feel this sentence is written backwards. It is shorter and easier to read when written as, e.g., “Quality control is needed to correct sensor offsets or drifts.” A recommendation a past advisor gave me is to establish the subject and verb of a sentence early in the sentence so the readers know what the sentence is about. The subject and verb are among the last words in this sentence, and this is a common element of many of the most difficult sentences in this paper.
9: Again, this feels backwards
12: LIRPH should be LIPHR or LIR-pH
32: This sentence is correct, but it is probably better to say “ocean acidity will increase” because “alkalinity” will not decrease by this mechanism.
49: The majority of what we know about surface ocean pCO2 arguably comes from ships of opportunity, which deserve greater mention in this discussion.
58: Maurer et al. show large pH sensor adjustments, suggesting the pre-deployment calibration is not a major factor since it is seldom used… except perhaps for characterizing the dependence on, e.g., pressure.
71: Missing ESPER-NN and ESPER-LIR (which are updates to LIR).
98: the “claimed” pH accuracy…
104: worth pointing out that this is a single point calibration that doesn’t reflect the conditions often found at the reference adjustment depth for pH.
120: the GLODAP data are not directly used in the float pH correction procedure in most instances.
135: this is not a CRM for pH, and there is no certified value
137: on what basis is it assigned this very low pH uncertainty given that the best methods are typically assigned an uncertainty of 0.01-0.007? The uncertainties in the calculations from DIC and TA are also quite large, and the uncertainties from the conversion to in situ conditions are thought to be large and poorly known. This claim might be justifiable if it is expressed in terms of reproducibility, but uncertainty has a more expansive definition than reproducibility.
152: This caveat should go earlier.
200: note
230: and in
236: measure pH
250: Figure 4 does not obviously support this statement without further explanation
256: what does the "respectively" refer to? Are these different depths? Estimate methods?
Figure 4: You should indicate whether LIR-PH estimates are using the OA adjustment option. I believe SAGE usually omits this adjustment, which might explain why LIR-PH is high relative to CANYON-B in the North Atlantic and low in the North Pacific. That said, as you correctly point out, LIR-pH uses an globally uniform OA adjustment that varies only by density, whereas CANYON-B uses an empirical local fit (that, I argue elsewhere, may erroneously project interannual variability forward and backward in time). Carter et al. 2021 attempt to resolve these issues, and this technical note would be more useful if it also included a comparison with the ESPER routine estimates. These routines are slated to become incorporated into SAGE. (Note, you’ll probably still find large differences between ESPER pH estimates and LIR-pH estimates, particularly in the North Atlantic, which appear to be attributable to the omission of depth as a predictor variable from ESPER-pH… i.e. the values from ESPER-LIR are much more similar to LIR-PH (and ESPER-NN) when depth is included as a predictor... future updates to ESPER-LIR will likely have depth as an optional predictor to minimize the discontinuity that we'll see if and when the transition from LIPHR to ESPER-LIR is implemented).
Figure 4c: The y axis is not labeled. Also, there may be a missing 0 in the std value?: It is only possible for the STD to exceed the 5th and 95th percentiles if there are a small number of extreme outliers (that should have likely been omitted). This is among the most important numbers in this manuscript, to my thinking. If it is much smaller, then I'd ask whether the std is indeed much larger than we’d expect from a comparison of two algorithm reference adjusmtents?
261: from the way the
264: is the noise uniform with depth? If not, then it should be handled by averaging the adjustment across a depth range. If it is, then should it be removed by adjusting every profile independently?
266: “corrected for” should be “removed”
Figure 5: The use of 2 y axes is very confusing here and defeats the purpose of being able to compare the adjustments to one another, though the goal of increasing visibility makes sense. It would probably be better to use a single y axis, which would allow the plot to focus in on the 0.04 to 0.06 range. The greater vertical resolution should also improve visibility. If the different methods are difficult to distinguish on this unified scale, then that suggests that the methods aren’t different enough to worry about on this scale. What are the numbers in the upper right? (it’s not hard to guess, but it is better if it is spelled out)
278: profile-by-profile or cycle-by-cycle? Either is fine but be consistent. Also, doesn’t it remove too much sensor noise, or am I misunderstanding?
282: “has to” is an overstatement as this is not currently done by many data centers (this is another case where the verb is among the last words in the sentence). Also, you have not completely made the case against the cycle-by-cycle approach or the SAGE approach. The basis for the SAGE approach, I believe, was based upon the first principles assumption that the reference potential jumps with discrete events and that the wiggles around the jumps reflect variability in the algorithm estimates or short term sensor noise. This hypothesis would need to be discounted to really make the case effectively.
293: discontinuities are not a problem for QC. The statistics still work fine. They are perhaps a problem for studies examining biogeochemical variability over time for a specific profiling float, but these studies would also be challenged by excessively smoothed transitions if a reference potential jump occurred. I believe the authors have a strong case to make here, but this presentation leaves me more confused than convinced. I’d urge them to instead focus on the consequences for a common biogeochemical analysis that would be affected by discontinuities (leading to, e.g., discontinuities in DIC vs. time… though even then a clearly visible discontinuity in DIC might be preferable to a smooth-seeming but equally spurious excursion in DIC as the smoothed adjustment factor catches up to the true adjustment factor). These arguments lead me to the belief that the best approach would be a 1000-1500 m average adjustment applied cycle-by-cycle.
289: Figure A1 is critical for your argument. It needs to be brought into the main text if this section is retained in the final manuscript. It needs to be well-explained and your rationale for preferring the smoothed adjustments over alternatives needs to be more strongly and thoroughly defended. The rationale should go quantitatively beyond “In our view, the sensor rather shows undulations in response with smooth and less smooth phases.”
293: others would argue that these are correcting biases of that magnitude
Figure A1: would be more useful if pHTotalInsitu were plotted as the difference from the algorithm estimate. Also, it is unclear if the parking depth pH value has any adjustments applied and, if so, on what basis. Finally, the indication of whether pH is “total scale pH” is inconsistent in these figures. Based on other conversations with people who have strong opinions about these things, my recommendation is to universally use pHT to indicate total scale pH.
302: Yikes! Variants on this experiment have been performed by several members of the community, and none, to my recollection, saw consistent differences this large.
302: There is a growing sense in the community that bottle pH samples are not well preserved even when following SOPs for DIC and AT storage. Is this possibly a discrete sample issue? Do you have some at-sea measurements to compare with?
302: the two numbers in this figure only make sense after looking at figure 6, and it should be clear from the text alone
6D: the y axis is unlabeled and missing many negative signs (looks like the figure was just cut off on the left). Far more worrying, the delta pH is about the same magnitude as the change in pH expected from changes in temperature. It is unlikely that there is a 100% uncertainty in the calculated pH change with temperature, which leads a possible simpler explanation that the pH vs. temperature correction was performed incorrectly in this comparison. Were the discrete pH values recalculated at the in situ temperature and pressure? When you say “discrete water temperature” is this the temperature at the time of bottle triggering or the laboratory temperature at the moment of analysis?
324: SOOP-pH is not a mature effort to my understanding. Some comments on the SOOP-pH methods and QC practices are warranted. SOOP-pCO2 comparisons, to my understanding, are showing much more modest implied float offsets.
328: needs
Table 2: A standard deviation of 0.5 salinity units is quite large, is it not? Usually this represents an offset of hundreds of km or more in the surface of the North Atlantic except in areas of very strong salinity gradients near coasts. A mean of 0.4 is just as worrisome. Am I misreading this?
364: Climate and weather goals are specifically formulated based on needs for characterizing (paraphrased) “changes in carbonate ion concentrations.” This means they are related to precision and not accuracy. This analysis is concerned with accuracy to a much greater extent than precision, so this is not an apples to apples comparison. A better comparison would be how the offset varies over time for a given float or varies between two or more floats in the same location.
379: The TA uncertainty is also far more important if we become interested in DIC.
385: The situation becomes worse still when including uncertainties in the carbonate system constants (Orr et al., 2018)… however, again, these additional uncertainties should be relatively consistent over time, and “weather” and “climate” relate to precision. Many of the concerns raised herein (and the concern over carbonate constants) fall away when you begin to examine variability in the float observations over time.