Betting on Rain? The Accuracy and Reliability of Precipitation Forecasts

For you sports junkies out there, if I could prove to you that I can correctly predict winners and losers with 80% accuracy, would you use my advice in Las Vegas? I don’t gamble, but according to this article on sports forecasting that summarized the results of professional research, the best methods provided only 54% accuracy. Yet, even with what one might think is an accuracy not much better than a coin flip, hypothetical bets using this model would have provided 16% returns.

Now, what if I told you that professional weather forecasts can correctly predict whether rain will fall on your specific field within the next three days 80% of the time and with almost 70% accuracy out to nine days? Considering how many risks we take on things that are less predictable than the weather, whether it be the stock market, horses, or sports, I posit that there is untapped potential in the proper use of weather forecasts to increase efficiency or productivity, and ultimately improve margins. In the case of useful rainfall predictions, there is potential to reduce risk of over-watering or mistiming a rain-sensitive product application or a host of other operations that can affect yield or operational efficiency.

Like my last article where I used independent forecast accuracy assessment from ForecastWatch to demonstrate that location-specific temperature forecasts are skillful out to around 10 days into the future, this month we use their service to demonstrate the accuracy of rainfall predictions. The data discussed here is based on an average of many different weather service providers’ daily nine-day forecasts collected each day for about 750 U.S. locations during January through November of 2017. These are not “area” forecasts where a successful forecast only means rain fell in a larger area. Rather, these are point-to-point comparisons.

For the forecasts to be considered skillful, they have to be better than forecasts created using the “persistence” technique. A persistence forecast is one that assumes the conditions occurring at the time of the forecast will continue through the forecast period. So, if it is raining at the time of the forecast, a nine-day forecast would assume that each of the subsequent nine days would have rain. Such a forecast requires no special knowledge or skill to create.

The graph below shows the average percentage of correct precipitation forecasts for all of the weather services as a function of lead time in days compared to the persistence forecasts. Indeed, the forecast services are around 80% accurate for the first three days and tail off to just under 70% by day nine, and for all days, the forecasts are better than persistence. You might be surprised, though, that the persistence forecasts are 60-70% accurate as well. This is because precipitation events are relatively infrequent when you consider the entire U.S. over nearly a full year, occurring only about 30% of the total time. These overall accuracy numbers include all of the cases where no rain was forecast nor occurred. If you simply forecast dry conditions every day for all the locations, you would still be correct almost 70% of the time.

US-Daily-Percent-Correct-Precipitation-Forecasts

Thus, the value of precipitation forecasts are in those situations where rain is possible. We can use different metrics that focus more on the more difficult, non-dry events that cannot rely on random guessing and still do well. In the following graph, the solid lines show such a metric called the Equitable Threat Score (ETS) for the average of the providers (solid blue) versus persistence (solid red). Perfect forecasts have a value of 1.0, and 0.0 means no skill. Professional service providers on average provide much more skillful forecasts than persistence. In other words, you would do much better betting on one of these forecasts rather than basing future actions only on how much rain has fallen.

US-Daily-Precipitation-Forecast-Skill

For example, rather than irrigating only because you are approaching an inferred deficit of available water content computed from current and past evapotranspiration estimates, rain, and irrigation activities, you can choose to hold off based on a forecast of rain in the next few days, and more often than not this will be the correct decision. This would be important for crops that are sensitive to over-watering, such as soybeans in their vegetative stage where too much moisture can lead to disease as well as yield reductions.

Now, there is one more dashed line on the skill graph that depicts a metric called the Brier Skill Score (BSS). Like ETS, a perfect BSS is 1.0. However, BSS is a measure of how reliable the probability forecasts are. For perfectly reliable (BSS = 1.0) probability forecasts, the number of rainfall occurrences for a large set of forecasts having the same probability are equal. In other words, rain actually fell for 20% of all the forecasts having a 20% chance of rain. Likewise, rain occurs 80% of time for all forecasts of an 80% chance of rain.

Having reliable probabilities means decision support tools can use objective cost-loss modeling to achieve an appropriate level of risk applicable to the potential savings or gains. We are now reaching a point where some providers are able to provide objective, reliable, and calibrated probability forecasts that will enable cost-loss optimization in automated decision support tools. Because of the discrete nature of rainfall, especially in showery situations, there will be times the forecast misses, just like a sports bookie. But a disciplined approach based on objective probabilistic rainfall forecasts will yield more wins than losses, and the agtech community needs to increase reliance on near-term weather forecasts that are professionally generated and designed for agronomic decision making.

Topics:

Leave a Reply

Data Management Stories
Data Science tablet
Data ManagementMicrosoft, Agile Networks Detail Central Ohio Broadband Expansion Project
August 9, 2018
Agile Networks, a leading provider of telecommunications solutions, and Microsoft Corp. has announced a new agreement to bring broadband internet Read More
BigDataSmall2
Data ManagementPrecision Agriculture: A Smaller Approach to Big Data
August 7, 2018
Big data is one of the most buzzed-about concepts in our industry. Rarely do we read a newsletter, attend a Read More
InfoAg Trade show floor
AmericasInfoAg 2018 Deep Dive: Pixels Over Plastic (OPINION)
July 25, 2018
  InfoAg, precision farming’s annual mid-summer blowout, is about a week in the rearview as I type this, a hazy Read More
Plants-Corn-Clouds
Data ManagementHow Machine Learning Plus Weather Information Can Help Us Feed the World
July 23, 2018
The world of technology-based solutions has been increasingly flooded with buzzwords like “analytics”, “big data”, and “Internet of Things”. In Read More
Trending Articles
1 On 1 With Paul Schrimpf: Simplot’s Allan Fetters
PrecisionAg InstituteOne on One With Simplot’s Allan Fetters
August 8, 2018
Allan Fetters of PrecisionAg Institute partner Simplot Grower Solutions talks about techology trends and key learnings from the recent InfoAg Conference in this exclusive interview with PrecisionAg's Paul Schrimpf. Read More
PrecisionAg InstitutePrecisionAg Institute Whitepaper Library
August 1, 2018
Welcome to the PrecisionAg Institute Whitepaper library! Here you will find free whitepapers and case studies from the PrecisionAg Institute Partners Read More
AmericasIntegrity Ag Group: People Over Precision
July 30, 2018
It’s not every day that this reporter walks into the office of a precision ag dealer, sits across from the Read More
farmer-tractor-tablet
Systems ManagementWhat is Digital Farming — Really?
July 24, 2018
The agricultural community has spent several years synthesizing an operational description for digital farming. In several cases, there have also Read More
Data ManagementInfoAg News: Farmobile Launches DataEngine, Streamlines DataStore Buyer Process
July 17, 2018
Busy times these days out in Leawood, KS, for ag data startup Farmobile, as they continue to – pardon the Read More
ISPA-Yoshua-Bengio
EventsHighlights from the 14th International Conference on Precision Agriculture
July 9, 2018
The 14th International Conference on Precision Agriculture (ICPA) presented by the International Society of Precision Agriculture (ISPA) was held in Montreal, Read More
Latest News
Events5 Reasons You Should Attend Growing Innovations
August 13, 2018
The specialty crop market is wracked by unprecedented change: labor scarcity, water shortages, pressing demands for increased quality and transparency Read More
Data Science tablet
Data ManagementMicrosoft, Agile Networks Detail Central Ohio Broadband…
August 9, 2018
Agile Networks, a leading provider of telecommunications solutions, and Microsoft Corp. has announced a new agreement to bring broadband internet Read More
AmericasIvy Tech Opens Center of Excellence to Train Tomorrow&#…
August 9, 2018
Students interested in careers in precision agriculture equipment technology or diesel technology now have the opportunity to pursue certificates, technical Read More
1 On 1 With Paul Schrimpf: Simplot’s Allan Fetters
PrecisionAg InstituteOne on One With Simplot’s Allan Fetters
August 8, 2018
Allan Fetters of PrecisionAg Institute partner Simplot Grower Solutions talks about techology trends and key learnings from the recent InfoAg Conference in this exclusive interview with PrecisionAg's Paul Schrimpf. Read More
Corn field sunset
Industry NewsTrimble RTX Correction Technology Now Delivers Two Cent…
August 7, 2018
Trimble has announced that its Trimble RTX GNSS corrections technology can now achieve horizontal accuracies of better than two centimeters. Read More
Sentera-Gimbaled-Quad-Sensor
Sensors/IoTSentera Gimbaled Quad Sensor Optimizes Crop Health Data…
August 7, 2018
Sentera’s Quad sensor is now available in an integrated gimbal-stabilized package for DJI Inspire and Matrice drones. Featuring four fully-customizable Read More
BigDataSmall2
Data ManagementPrecision Agriculture: A Smaller Approach to Big Data
August 7, 2018
Big data is one of the most buzzed-about concepts in our industry. Rarely do we read a newsletter, attend a Read More
Grower-Retailer
Industry NewsAgworld, K-coe Isom Form Strategic Partnership
August 6, 2018
Agworld and K-coe Isom have announced a strategic partnership that will see them integrating business advisory and technology to deliver Read More
Industry NewsAgEagle Acquires Agribotix
August 6, 2018
AgEagle Aerial Systems has signed an agreement to acquire substantially all of the assets of Agribotix, a Boulder, CO-based drone-enabled Read More
Digital-Farming
Systems ManagementImplementing Digital Farming’s Five Major Needs
August 2, 2018
Building a house starts with a plan and then a foundation; it does not start with doors and windows. From Read More
PrecisionAg InstitutePrecisionAg Institute Whitepaper Library
August 1, 2018
Welcome to the PrecisionAg Institute Whitepaper library! Here you will find free whitepapers and case studies from the PrecisionAg Institute Partners Read More
Bruce-Erickson-video
Excellence AwardsPassion for Teaching: Purdue’s Bruce Erickson
August 1, 2018
PrecisionAg Award of Excellence recipient Bruce Erickson is driven to share his knowledge of precision technologies and techniques with students, as well as the larger agriculture community. Read More
Newell-Kitchen
Excellence AwardsChasing the Mystery Behind Soil Variability: Newell Kit…
August 1, 2018
Newell Kitchen of the University of Missouri, recipient of the Legacy award in the 2018 PrecisionAg Award of Excellence program, has worked for decades to employ technology in unlocking the secrets hidden in farm fields. Read More
Nish-Majarian-video
Excellence AwardsNishan Majarian: Keeping Software Simple
August 1, 2018
Addressing the grower's true needs and making software easy to use has driven Agrian's product development from the beginning says co-founder and CEO Nishan Majarian, recipient of the 2018 Crop Adviser/Entrepreneur Award in the PrecisionAg Awards of Excellence program Read More
Rodney-Wright-video
Excellence AwardsRodney Wright: Better Farming With Precision
August 1, 2018
Harnessing the power of precision technology leads to year-over-year improvement in productivity and stewardship, says Arkansas grower Rodney Wright, recipient of the 2018 Farmer award in the PrecisionAg Awards of Excellence program. Read More
Rod Weimer and Paul Schrimpf
Australia/New ZealandPast Recipients Of The PrecisionAg Awards Of Excellence
July 31, 2018
Since 2007, the PrecisionAg Insititute has sponsored the annual Awards of Excellence program. Here's a list of the past winners. Read More
vineyard-canopy-sensing
Specialty CropsHow to Make Vineyard Management More Precise
July 31, 2018
There are ways mechanization can help winegrape growers complete vineyard tasks more efficiently and make more informed vineyard decisions. One Read More
Agriculture_Horizon
Industry NewsLand O’Lakes SUSTAIN Acquires Software Company Ag…
July 31, 2018
Land O’Lakes SUSTAIN has announced Land O’Lakes, Inc. has acquired substantially all assets of Agren, Inc., an Iowa-based software company Read More