The original text struck me as inappropriate so I’ve edited it. I put it down to being overtired. The original is archived if anyone wants to see it, just ask (there is a contact form), no questions asked on why.
This is a huge plot including hourly data from WMO3768 Farnborough, England, a synoptic Met Office station where I estimate the site meets WMO 2010 recommendation Class 1, although the presence of a triangular airfield runway layout surrounding the station will have some side effects.
A details view of the plot is only practical via PDF (201kB) Very likely the PDF will open looking as above so you need to set magnification and scroll around the plot, 100% is the intended view. Some details of interest are reproduced below at a normal scale.
This post is in honour of a great mind where I have more to say sometime.
The late Vít Klemeš who died 2010 gave a talk on July 12, 2007, in the HW2003 Workshop on Analysis of Variability in Hydrological Data Series, at the IAHS General Assembly in Perugia, Italy.
He concluded with a truism I believe in
The moral of my talk is this: The most fun and perhaps the greatest value of doing something is in doing it. The results may well go up in smoke, be wrong, become obsolete and forgotten, but some new ideas may have emerged in pursuing them, and some of them may somewhere, sometime, bear fruit. …”
They have, right now.
And that is Vít Klemeš. He had a sense of fun, sense of humour, yet enough is revealed in past writing showing he comes across as quietly subtle, a real technician, the lack of ego which comes with confidence.
This presentation is as a PDF at a moderate technical level which might seem somewhat wooden in places. It needs a degree of background knowledge, without this maybe there is enough.
[update: I used an incorrect mix of datasets, see Talkshop thread here. Corrected PDF and now expanded to include HadCRUT4.
The UK Met Office / Hadley Centre (Met Office) / Climatic Research Unit (UEA) construct and publish global time series for temperature based on published 5 degree gridded. How this is derived from land meteorological station readings and ship board for sea surface temperature is unclear. The gridded to eg. global is a simple (cosine) weighted average which takes into account the variable area of a linear grid representing a sphere.
I have put together maps showing the data counts for decades over a world shore outline. These are provided as vector plots (master work), PDF, or for casual looks, PNG. The results are disturbing and particularly in the light of the Met Office producing 100 different versions of HadSST3. “Each of the following files is a zip archive containing ten realisations of the HadSST3 data set. There are 100 realisations in total.”
Do I detect obfuscation, flapping for distraction?
What follows is first art. I have yet to work out a better pictorial method. For now a tortured spreadsheet will do well enough.
You can just make out continental land masses…
Data: Met Office HadSST3
I’ve known for a number of years of the dreadful state of climatic datasets, HadSST being one of those but did not have the pictorial evidence. Period from 2005 is an arbitary choice arising during software development.
When I first looked at the gridded SST data, some time before 2010 I noticed what seemed to be a mix of monthly and annual in cells, with many missing data. It also looked very dubious on coastline handling. This was noted but nothing further done.
August 2014 there was a meteorological gift of both exceptional conditions and good data. What can be learnt?
Three Met Office sites showed a signature of exponential cooling. This requires clear sky and a calm. Given somewhat limited parameter hourly data the following shows the commonality. The computed terminal conditions are shown later in this article.
Benson and Santon Downham data has been normalised to Katesbridge, which has the least noisy data or the three.
Achieving a close overlay requires taking earth rotation into account, dusk and dawn move relatively both by geographic location and the peculiar movement throughout the year as night length changes, these do not move together . Fractional delay (less that the sample period) was used to equalize diurnal time. (see the two blog articles here)
Dusk appears to be the important factor, a surprising finding, I assume cooling is time from dusk, dawn terminates cooling.
General information, under essentially calm conditions wind drops for a period during the night then reappears just after dawn. (not shown here)
Temperature normalisation defined is for the cold period, not as accurate for Benson where the better site exposure (more open) led to more wind at times.
I’ve been busy pottering on code as a mindless intermission during house repairs, can only do so much at a time. Argue with a piece of wood or with a computer screen? 🙂
This is a bitmap copy of a map of the UK with markers showing the location of Met Office weather sites with hourly data published via their Datapoint service. Data is under OGL (Open Government Licence) which allows usage. Unfinished work, references are not yet included.
The real file is part of a large PDF (vector format) containing plots for all those stations during a 24 hour period.
Example PDF https://daedalearth.files.wordpress.com/2014/08/uk-2014-08-24-0045.pdf (1.2MB, work in progress, more to be done)
Image NOAA, click for full size.
I came across the above graphic. On pondering I went huh?
The most eastern (right hand) is Lake Ontario. Is that a mistake, the only one largely ice free 2014, largely clear 1994.
Superconducting conductors arriving at Fermilab, credits at end.
None of you will know I have history in photography, award winning, newspaper front page, glossy magazine front page, etc., none earth shattering but it was a personal challenge in the film era. Put another way I have an interest from both the art and technical perspective.
I intended producing a minor blog post on Fermilab and the magnet, ideally posts need a good headline photograph, what with copyright and poor technical standards this is often tricky. My own blog, this one, tends to get poor art.
A new university satellite is scheduled launch 2015. A web site for the project is available in English
Mikhail Lomonosov (1711 – 1765) helped establish what is now known as Moscow University, decree signed 1755, 250 years ago.
According to Lomonosov’s plan, there were originally three faculties. First all the students acquired a comprehensive knowledge in the field of science and humanities at the Faculty of Philosophy; then they could specialize and continue at the Faculty of Philosophy or join either the Law Faculty or The Faculty of Medicine. Lectures were delivered either in Latin, the language of educated people at the time, or in Russian. 
Illustrations from a book published 1753. Text, perhaps embellished a little as these things are, “Mikhail Lomonosov – the Pioneer of Russian Science” nevertheless looks a good fellow.
The satellite is named Lononosov.
I need help in locating a few Met Office meteorological sites as part of a new project part of making reality open to all. In addition any correction of errors or additional information is welcome. For anyone not aware I have past history of extensive unearthing of similar information via a surfacestations project. This is not an easy to read post, sorry.
The UK Met Office has relatively recently started publishing moderate resolution meteorological data for a subset of all stations via a web based facility called Datapoint.
We get hourly data for 176 stations, a few wind data only, the rest a mixture of full or partial data
WARNING opening this full blog article will display a long list of data. Read more…