Wondering whether anyone has any experience removing the persistent striping pattern on S5P data? I’ve read in the NO2 PUM that this pattern is identified daily and removed for the NO2 data. Would the provided mask from the NO2 data apply exactly to the CH4 data?
I have looked at other methods to identify the pattern with limited success.
Another question is once the pattern is identified, should the high spots be reduced or the low points amplified?
For CH4, the product als contains a ‘bias corrected’ version of the CH4 mixing ratios. This does a decent job of removing the stripes.
You can get this data with harp by providing the ch4=bias_corrected ingestion option (e.g. add a options="ch4=bias_corrected" argument to harp.import_product).
Thanks again! I see ESA has released a new processor this month and the bias corrected variable in the NetCDF file is present in older files. Will this method work on older data or do we need to wait for a reprocessed dataset?
For CH4 the background corrected value was there already since the beginning. For CO a similar corrected variable was introduced earlier this month.
You can see this back in the mapping description for these products in the HARP documentation. We indicate the processor version if a specific variable/mapping is dependent on the version of the processor.
There will at some point be a reprocessing of the data, since earlier this month they also introduced a new L1b processor version. And the L1b data will likely get reprocessed back to the start of the mission again (including all L2 derived from it). This difference in L1b can be seen in the collection number in the filename. This is 02 for recent products and 01 for older products.