{"id":5642,"date":"2014-08-21T10:37:33","date_gmt":"2014-08-21T08:37:33","guid":{"rendered":"http:\/\/www.randform.org\/blog\/?p=5642"},"modified":"2021-12-29T12:00:49","modified_gmt":"2021-12-29T11:00:49","slug":"on-the-deterioration-of-data","status":"publish","type":"post","link":"https:\/\/www.randform.org\/blog\/?p=5642","title":{"rendered":"On the deterioration of data"},"content":{"rendered":"

Tim and me are currently working on a interactive browser visualization using temperature data from HADCRUT<\/a>, namely the CRUTEM 4 temperature station data<\/a> which we map with the help of the open source web GL earth API<\/a> (which seems to be to quite some extend the work of the Czech-Swiss company Klokan technologies<\/a>) onto a model of the earth (covered with open street maps<\/a>).
\nThe visualization is still work in progress, but what is already visible is that the temperature data is quite deteriorating (please see also the previous randform post<\/a> on the topic of deteriorization of data). Where it looks as if the deterioration had been bigger in the years from 2000-2009 than in the years 1980-2000. Below you can see screenshots of various regions of the world for the month of January for the years 1980, 2000 and 2009. The color of a rectangle indicates the (monthly) temperature value for the respective station (the station is represented by a rectangle around its coordinates) which is encoded with the usual hue encoding (blue is cold, red is hot). Black rectangles are invalid data. The CRUTEM 4 data file contains the data of 4634 stations. Mapping all the station data makes the visualization very slow, especially for scaling, therefore the slightly different scalings\/views for each region and the fact that screenshots are on display. The interactive application will probably be not for all stations at once.<\/p>\n

North America:
\n
\n\"\"<\/a>
\nJan 1980<\/p>\n

\"\"<\/a>
\nJan 2000<\/p>\n


\n\"\"<\/a>
\nJan 2009<\/p>\n

Africa:
\n<\/p>\n

\"\"<\/a>
\nJan 1980<\/p>\n

\"\"<\/a>
\nJan 2000<\/p>\n

\"\"<\/a>
\nJan 2009<\/p>\n

Asia:
\n
\n\"\"<\/a>
\nJan 1980<\/p>\n

\"\"<\/a>
\nJan 2000<\/p>\n

\"\"<\/a>
\nJan 2009<\/p>\n

Eurasia\/Northern Africa:
\n
\n\"\"<\/a>
\nJan 1980<\/p>\n

\"\"<\/a>
\nJan 2000<\/p>\n

\"\"<\/a>
\nJan 2009<\/p>\n

Northpole:
\n
\n\"\"<\/a>
\nJan 1980<\/p>\n

\"\"<\/a>
\nJan 2000<\/p>\n

\"\"<\/a>
\nJan 2009<\/p>\n

update June 15, 2019:
\nThere is now a similar interactive visualization at NASA for the GHCN data set at https:\/\/data.giss.nasa.gov\/gistemp\/stdata\/<\/a><\/p>\n

update December 29, 2021:
\nThe link to our interactive temperature visualization, which was announced above in the post is here<\/a>, the corresponding post about it is here.<\/a><\/p>\n

The GHCN page linked on June 15, 2019 doesn’t show any station data anymore:
\n
\n\"\"<\/a><\/p>\n

There is currently a new page with a “version 4 dataset” here.<\/a> This is how it currently looks like:
\n
\n\"\"<\/a>
\n
\nApriori this looks as if most of the stations are “back on track” but then I couldn’t find out within a decent time how much of this data is “reconstructed” in the sense of “educated guess” and how much is actual data from the respective stations. Another thing that caught my attention was that the content of the tooltipmenu of each station is partially non accessible, I don’t remember whether this is a new phenomenon.<\/p>\n","protected":false},"excerpt":{"rendered":"

Tim and me are currently working on a interactive browser visualization using temperature data from HADCRUT, namely the CRUTEM 4 temperature station data which we map with the help of the open source web GL earth API (which seems to be to quite some extend the work of the Czech-Swiss company Klokan technologies) onto a […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[3,4,25,15,26,8,6,14],"tags":[],"_links":{"self":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/5642"}],"collection":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5642"}],"version-history":[{"count":24,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/5642\/revisions"}],"predecessor-version":[{"id":7607,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/5642\/revisions\/7607"}],"wp:attachment":[{"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5642"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5642"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.randform.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5642"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}