Weather Forecasting: How Does It Work, and How Reliable Is It?

Do you ever wonder exactly how the weather forecast is made? And how good are they, really? In last month’s article, I discussed the accuracy and usefulness of seasonal weather outlooks. This month, I want to hone in on near-term weather forecasts, defined for our purposes as forecasts of specific day-by-day or even hourly conditions for periods less than two weeks into the future. These are the forecasts by which we plan our weather-sensitive operations and personal activities. This is my career passion because it is in these time frames that confidence is high enough to make significant decisions that directly affect agricultural operations and output. Yet, my observation is that weather forecasts are still under-utilized in agricultural decision-making processes, with an over-emphasis on using recent and past data for determining future actions, perhaps due to the historical perception that forecasts are no better than the flip of a coin. Hopefully, this article can help build confidence in modern weather forecasting capabilities.

The weather forecasting process starts with the collection, quality control, and fusion of large amounts of diverse raw observational data from space, airborne, and ground-based assets to produce a coherent, three-dimensional view of the atmosphere at any point in time, from which we project the future conditions, adjust, and repeat. Those are all large topics for another time. For now, let’s just focus on the actual methods used in projecting the weather forward in time from the current conditions.

It turns out there are multiple techniques that are used, each of which has specific time frames for which they are most relevant. These methods are shown in the figure below, which depicts their comparative usefulness as a function of forecast lead time (meaning, how far into the future are you trying to predict, e.g., a forecast for tomorrow would have a lead time of one day).

Automated-Forecast-Method-Comparison-Graph

The two simplest methods are persistence and climatology. A persistence forecast means that conditions are assumed to remain unchanged. We all do this inherently when we look out the window to see if an umbrella or sunglasses are needed for an immediate, short-lived outside activity because in most cases we can assume things remain constant for a few minutes or longer.  A climatology-based forecast assumes conditions for a particular day or time period will fall within statistical normals derived over many years for that same day or period. Interestingly, these two “easy” methods are applicable at opposite ends of the time spectrum, with persistence often working very well for forecasting very near term conditions, and climatology being the best predictor for long-range forecasts. For a forecast to be considered to have any skill, it must be able to at least beat both of these two methods.

Extrapolation is slightly more complicated, and assumes an existing weather feature, such as a cold front or a line of storms, will continue generally moving in the same speed and direction without significant change. But it cannot account for new development or dissipation. We will save teleconnections for another time, as it is primarily for long-range forecasting, using large scale indicators such as the El Niño Southern Oscillation to infer what might be expected for the longer-range patterns.

That leaves numerical weather prediction, which is by far the most important method used in modern meteorology for forecasting lead times beyond a couple of hours. The advent of affordable, high-performance computing has revolutionized our ability to create computer models that simulate the motion and physics of the three-dimensional atmosphere, accounting for its interaction with topography, land surface, and the oceans with amazing realism, without any need for historical data or statistical relationships.

You often hear the TV meteorologist refer to “the models” when talking about the forecast, often accompanied with realistic animations of future clouds and precipitation.  In the last few decades, the advancement of these models have dramatically improved forecast accuracy and changed the role of the human weather forecaster. Yet, they still are subject to errors due to our incomplete understanding of all process interactions, our inability to explicitly simulate down to chaotic, molecular levels, and insufficient sampling of the initial state of the atmosphere, particularly in the mid and upper levels of the atmosphere over the oceans and other unpopulated areas. Thus, in most cases, the best weather forecast is an optimum blend of some or all of these methods, most often performed by a combination of automation and human oversight.

So, how good are the near-term forecasts now? ForecastWatch.com is an independent weather forecast verification service. Each day they collect and archive daily forecasts from a large number of public and private weather forecast providers. They compare these forecasts to weather observations from high-quality, government-operated weather stations and generate statistics on a variety of weather parameters of interest to the general public, including daily high and low temperature, wind speed, and occurrence of precipitation. This provides an excellent “apples-to-apples” comparison across providers because the same methods and truth data are applied to all sources, and the consistency allows for the assessment of long-term changes in accuracy. They recently published their study of daily high-temperature forecast accuracy, based on a 12-year period spanning 2005 through 2016, aggregating almost 200 million individual data sample for over 750 U.S. locations. If you like numbers and graphs, it’s worth a read. But, some key takeaways are summarized here:

  • One-day forecasts have an error of less than 3° Fahrenheit.
  • The five-day forecast is now almost as accurate as a one day forecast was in 2005, and overall error of the daily high-temperature forecast decreased by 33% over that period.
  • We have now reached a point where the nine-day temperature forecast is slightly better than climatology.

The graph below shows statistics from ForecastWatch for this year, spanning January through September. It shows the forecast error in degrees by forecast lead time for a climatology-based forecast (black), persistence forecast (red), and the average error of all providers analyzed by their service (blue). As mentioned, a forecast is really only useful if it performs better than persistence and climatology, and you can see that is the case all the way through day nine. This is consistent with the conclusions drawn from the 12-year study. The error tends to increase roughly 0.5° per day, so you can also infer that by around 10 days out, the forecasts are no longer more accurate than climatology, corroborating my assertion in last month’s article that forecasts of specific conditions at a particular location beyond a couple of weeks are beyond the state of the science.

As models continue to improve, we can expect to see a continuation of improving forecast accuracy, at least to a point. There is much debate about what the realistic limits are for weather forecasting, and it may not ever reach a point where we can project exact weather for a location beyond a few weeks in our lifetimes. But, in terms of things we attempt to predict in this world, the forecasting of near term weather is a major success story. Hopefully, as confidence grows in our ability to forecast weather and soil conditions, much value will be extracted for more efficient operations, higher yields, and better environmental stewardship.

Leave a Reply

2 comments on “Weather Forecasting: How Does It Work, and How Reliable Is It?

  1. Very interesting and important. We, in Netafim, use short term weather forecast as part of our crop irrigation models and this is an essential part of it.
    Temperature, I guess, is a relatively an easy parameter for forecasting. We mainly straggle with precipitation which is mostly a local event and thus very hard to forecast

    1. Hello Lior,

      Nice to hear from you! Indeed, forecasting temperature, in terms of actual values, is “easier” than forecasting timing and amounts of precipitation, especially in warm season situations where showery convective activity is occurring and can produce very localized differences, with high variability even within farm scale. However, even those situations are now much better forecast than in the past even down to the mesoscale level. That is, we can pretty accurately say, even multiple days out, that a particular area will be susceptible to scattered showery activity vs. wide scale steady precipitation, and even do a reasonable job of bounding the amount of precipitation. The best way of using this information in irrigation decision support, in my opinion, is to use a source of forecast information that provided well-calibrated probability of precipitation along with the forecast amount. Then, you can select the probability value that best balances your decisions in cost vs. loss framework. Doing that will give better overall performance over the season than using no forecast information at all, which seems to be a more common practice in the irrigation world.

      Thanks for reading and contributing!

      – Brent

Data Management Stories
Data ManagementInfoAg News: Farmobile Launches DataEngine, Streamlines DataStore Buyer Process
July 17, 2018
Busy times these days out in Overland Park Leawood, KS, for ag data startup Farmobile, as they continue to – Read More
Farmer-Tablet
Data ManagementAgriculture’s Next Breakthrough: New Technologies Are Driving Efficiency, Data Insights
July 3, 2018
We live in an exciting time in agriculture. Not only is technology advancing rapidly, but the understanding and comprehension of Read More
Data ManagementThe Most Overlooked Asset in the Agtech Revolution
June 25, 2018
There is no doubt that advancements in genetics, precision agriculture, and innovative farming practices have all played an instrumental role Read More
Soil-Corn-plants-field
Data ManagementRemote Soil-Sensed Management Zones Help Increase Crop Input Efficiency
June 18, 2018
Accurate prescription maps are essential for effective variable rate technology (VRT) fertilizer application. Grid soil sampling is frequently used to Read More
Trending Articles
ISPA-Yoshua-Bengio
EventsHighlights from the 14th International Conference on Precision Agriculture
July 9, 2018
The 14th International Conference on Precision Agriculture (ICPA) presented by the International Society of Precision Agriculture (ISPA) was held in Montreal, Read More
Topcon X30 Console in cab
EventsAssociation Seeks Definitive Definition of “Precision Agriculture” — What’s Your Vote?
July 2, 2018
More than two-dozen definitions of precision agriculture have been identified through the years — but which is the best and Read More
AmericasRaven Name to Grace New South Dakota State University Facility
June 27, 2018
According to a press release issued by the company, Raven Industries was recognized today in the naming of South Dakota Read More
dropcopter
DronesNew York Apple Orchard Claims World First in Pollination by Drone
June 18, 2018
Beak & Skiff Apple Orchard in LaFayette, NY, is the first orchard in the world to use drones to pollinate Read More
JDandPessl
Sensors/IoTJohn Deere, Pessl Instruments Team Up to Create Opportunities
June 18, 2018
John Deere is best known for its line of tractors, combines, sprayers, and implements. However, in an effort to help Read More
Matt-Waits-featured
Decision Support SoftwareSST’s Matt Waits: Innovative Data Solutions Key to Transforming Global Agriculture
May 31, 2018
Proagrica, part of RELX Group, earlier this year acquired U.S.-based precision agriculture solutions company, SST Software, in a move set Read More
Latest News
Tools & Smart EquipmentCanadian Planter Manufacturer Purchases Harvest Interna…
July 19, 2018
Seeding and planting technology innovator Clean Seed has signed an agreement to strategically acquire U.S. planting equipment manufacturer Harvest International, Read More
Data ManagementInfoAg News: Farmobile Launches DataEngine, Streamlines…
July 17, 2018
Busy times these days out in Overland Park Leawood, KS, for ag data startup Farmobile, as they continue to – Read More
Agrible
Grower Services & SolutionsNutrien Drops $63 Million to Acquire Agrible
July 16, 2018
Nutrien announced today that it has entered into a definitive agreement to acquire Agrible for total consideration of $63 million, Read More
Industry NewsFarmobile Acquires Prime Meridian, Taps Cubbage as New …
July 13, 2018
Farmobile today announced an agreement to acquire the assets of Prime Meridian, a precision agriculture data management company based in Read More
group-photo
DronesPrecision Agriculture Takes Flight at North Carolina St…
July 13, 2018
Take a walk into the Suggs Laboratory for Precision Agriculture and Machine Systems and it’s hard not to be impressed, Read More
Skeketee-IC-Weeder
DronesAutomated Weeders Have Arrived in Vegetable Fields
July 12, 2018
The vegetable production areas of the Central Coast of California have lifted vegetable cultivation to a high art, writes Richard Read More
AgJunction, InfoAg 2014, Autosteer, GPS
Industry NewsAgJunction Settles with Raven in Patent Infringement Su…
July 12, 2018
AgJunction Inc., a leader in advanced guidance and autosteering, has settled a patent infringement lawsuit it filed against Raven Industries, Read More
Retailer-Grower-tablet
Business ManagementTaking Measure of the Precision Agriculture Program: 6 …
July 12, 2018
In the overall agriculture market, the rhetoric surrounding emerging technology over the past half-decade has been nothing short of breathless. Read More
raven-slingshot-job-generator-job-sync-1
Industry NewsNew Raven Slingshot Advancements Will Help Save Time, R…
July 11, 2018
Raven Industries, Inc. has announced several new services available on the Slingshot and Viper 4 platforms: Job Generator and Job Read More
Onsite-logo
Industry NewsAgIntegrated Acquires Exclusive Licence to Satshot’s Im…
July 11, 2018
AgIntegrated, Inc. (AGI), a leader in precision ag data integration and software development, and Satshot, a leader and pioneer in Read More
Australian Harvest
Australia/New ZealandAustralian Agritech Plants Blockchain for Efficiency
July 11, 2018
“Agritech” at one time would have meant new equipment such as tractors and combine harvesters, but today it refers to Read More
Tomato-crop-India
AsiaIndia: Using Artificial Intelligence for the Good of Fa…
July 11, 2018
After graduating from IIT-Madras, the first thing that Vivek Rajkumar did was to buy four acres near Thiruvananthapuram and start Read More
BrightFarms
Industry NewsForbes List of Innovative Ag-Tech Companies Includes Gr…
July 9, 2018
Forbes magazine recently posted a list of the 25 most innovative ag-tech startups in 2018, which includes a few companies Read More
AmericasNutrien Ag Solutions Brand, New Digital Platform Launch…
July 9, 2018
Nutrien (formerly Crop Production Services) has officially rebranded its retail business to Nutrien Ag Solutions, aligning the company’s retail operations Read More
ISPA-Yoshua-Bengio
EventsHighlights from the 14th International Conference on Pr…
July 9, 2018
The 14th International Conference on Precision Agriculture (ICPA) presented by the International Society of Precision Agriculture (ISPA) was held in Montreal, Read More
TerrAvion
Industry NewsTerrAvion Integrates Aerial Imagery with John Deere Ope…
July 6, 2018
TerrAvion, Inc., a large volume provider of aerial imagery to agriculture, has announced an integration to allow TerrAvion’s aerial imagery Read More
Farmer-Tablet
Data ManagementAgriculture’s Next Breakthrough: New Technologies…
July 3, 2018
We live in an exciting time in agriculture. Not only is technology advancing rapidly, but the understanding and comprehension of Read More
Nebraska-Storm
Precision IrrigationNotes from the Field: A Look at Irrigation Management P…
July 2, 2018
One of the things I love most about my work is making periodic treks into the field – more often Read More