Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

3 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Data Science tablet
Data ManagementHow to Address the Challenges of Data Science in Agriculture
April 26, 2017
Recently, Joe Byrum wrote an excellent article on the state of machine learning in agriculture. In it, Joe highlighted one Read More
Data ManagementNew Partnership: Farmers Edge, Allied Cooperative Link Up
April 24, 2017
Farmers Edge announced it has partnered with Allied Cooperative, a provider of agronomy, feed, grain, and equipment services to growers Read More
Data ManagementFarm Market iD Launches Sales & Marketing Platform
April 20, 2017
Following Farm Market iD’s February 2017 introduction of FieldVision, its mobile data-delivery platform, the company announced today its newest online Read More
Data ManagementInnovation Series Highlights: The Weather Company’s Rob Berglund on Cognitive Computing
April 19, 2017
Rob Berglund, global director of sales, energy and agriculture at The Weather Company, discusses IBM’s Watson and applications for advanced analytics that will fundamentally change Read More
Trending Articles
GPS, Guidance
Business ManagementPromoting Precision Agricultural Innovation in a Risk Averse Marketplace
April 24, 2017
As precision agriculture consultants we constantly are being asked our opinions on where to invest, and how to strategically invest Read More
Data ManagementInnovation Series Highlights: The Weather Company’s Rob Berglund on Cognitive Computing
April 19, 2017
Rob Berglund, global director of sales, energy and agriculture at The Weather Company, discusses IBM’s Watson and applications for advanced analytics that will fundamentally change Read More
Corn close up
Data ManagementFarmers Business Network Releases State of the Industry Style Report
April 17, 2017
Farmer’s Business Network (FBN) released today its “The Voice of the Farmer”, a special research report on the state of Read More
Soybean Closeup
Ag Tech GlobalPrecision Agriculture Helps Brazilian Farmers Top 90-Bushel Soybean Yield
April 5, 2017
In the 2016/2017 harvest, the Mato Grossense Institute of Economics (IMEA) estimated that the largest soybean state in Brazil will Read More
Grower Retaile iPad
ProfessionalsField Scouting Apps Boost Efficiency, Speed
March 31, 2017
Scouting is one of the most critical services that ag retailers and consultants can offer their grower-customers. The need for Read More
Bruce Rasa corn AgVoice app
Data ManagementVoice-To-Data Tool Shows Promise For Scouting
March 24, 2017
See it, speak it, record it. No pens, no paper, no lost information. In a nutshell that’s what Bruce Rasa Read More
Latest News
Simplot Truck on Wilcox Farm
Ag Tech GlobalSimplot Taps Spensa to Power Advisor Platform
April 28, 2017
J.R. Simplot Co. announced it has entered into a partnership with Spensa Technologies Inc., an agriculture services company based in Read More
BASF Maglis Grower Tablet
Ag Tech GlobalBASF Fortifies Digital Farming Offer with ZedX Acquisit…
April 27, 2017
BASF has signed an agreement to acquire US-based company ZedX, a leader in the development of digital agricultural intelligence. The Read More
Sentera
DronesSentera Announces May Release of Multispectral Double 4…
April 27, 2017
Sentera announced the release of its Multispectral Double 4K Sensor, offering five precise spectral bands: blue, green, red, red edge, Read More
Data Science tablet
Data ManagementHow to Address the Challenges of Data Science in Agricu…
April 26, 2017
Recently, Joe Byrum wrote an excellent article on the state of machine learning in agriculture. In it, Joe highlighted one Read More
Industry NewsFrom PrecisionAg with Love: Thanks, President Trump! (O…
April 26, 2017
Without getting too far into the weeds, I think it’s safe to say that today America feels more divided than Read More
Purdue Online Course
ProfessionalsPurdue University’s Online Precision Ag Course Re…
April 25, 2017
An online course offered by Purdue University’s Agronomy e-Learning Academy, Precision Agriculture, has received the 2017 Digital Education Excellence in Read More
Nuffield Scholarship
Ag Tech GlobalNuffield: Promoting the Diffusion of Knowledge of Preci…
April 24, 2017
Recently, I had the opportunity to meet John Stevenson, a 2016 Nuffield Australia Scholarship winner.  As part of the scholarship, John Read More
GPS, Guidance
Business ManagementPromoting Precision Agricultural Innovation in a Risk A…
April 24, 2017
As precision agriculture consultants we constantly are being asked our opinions on where to invest, and how to strategically invest Read More
Case IH Autonomous concept vehicle
ProfessionalsOpinion: What the Heck is A.I. Going to do for Agricult…
April 24, 2017
Let’s pause from the daily toils of ag for a minute and start thinking about the future. In a very Read More
Imagery ipad
Imagery/SensingNew Opportunities with In-season Imagery?
April 24, 2017
When I think about precision agriculture my usual thoughts are around the continuous learning about the variability in a field. Read More
Data ManagementNew Partnership: Farmers Edge, Allied Cooperative Link …
April 24, 2017
Farmers Edge announced it has partnered with Allied Cooperative, a provider of agronomy, feed, grain, and equipment services to growers Read More
Retailer Grower Tractor
ProfessionalsAg Attorney: Sorry Right to Repair Advocates, But You&#…
April 21, 2017
(via AgLaw.us) This recent article on Motherboard is getting a lot of press: “Why American Farmers are Hacking Their Tractors Read More
ProfessionalsAgFunder: Clean Seed’s Wireless Smart Seeder is Set to …
April 21, 2017
(Via AgFunderNews.com) Heard of Clean Seed Capital Group? No? You will very soon because this Canadian company has been quietly Read More
Business ManagementBionic Leaves: Future Source of Endless Fertilizer?
April 21, 2017
*Article Notes: This monthly column takes some crazy sounding ideas and applies them to the field of Ag Tech. The Read More
Sentera software
Decision Support SoftwareSentera Launching Field-Edge Plant Population Analysis …
April 20, 2017
Sentera is excited to announce the launch of its closed beta for field-edge Plant Population Analysis, available through its AgVault Read More
Data ManagementFarm Market iD Launches Sales & Marketing Platform
April 20, 2017
Following Farm Market iD’s February 2017 introduction of FieldVision, its mobile data-delivery platform, the company announced today its newest online Read More
Data ManagementInnovation Series Highlights: The Weather Company’…
April 19, 2017
Rob Berglund, global director of sales, energy and agriculture at The Weather Company, discusses IBM’s Watson and applications for advanced analytics that will fundamentally change Read More
Data ManagementInnovation Series Highlights: EFC Systems & 5 Facto…
April 19, 2017
Ernie Chappell of EFC Systems discusses five factors impacting the ag retail industry, the competitive advantages of enhanced customer engagement Read More