Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

4 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Texas-and-Oklahoma-Panhandles-Google-Earth
Data ManagementAgriculture Impacts Weather: The Case for Connected Ecosystems
February 15, 2018
It’s fascinating to see how modern technology has helped us increase our agricultural productivity in areas not otherwise suited for Read More
Norris planter
Data ManagementBig Data is a Chicken-or-Egg Scenario on the Farm
February 1, 2018
According to McKinsey, the agricultural sector is the least digitized industry in the U.S., writes Tony Baer on ZDNet.com. Yet, Read More
Business Management2018 Retail Precision Ag Programs: At-A-Glance
February 1, 2018
Deep in the midst off December downtime, we reached out to three retailers well-versed in running a grower-facing precision ag Read More
Data ManagementClimate Corp. Announces CNH Data Sharing Partnership
February 1, 2018
CNH Industrial and The Climate Corporation announced today a new partnership that will extend and develop a portfolio of data Read More
Trending Articles
India-Farm-Irrigation
AsiaCloud-based Irrigation Could Double India’s Crop Yield and Halve Water Use
February 12, 2018
A cloud-based, micro-irrigation system tested on a farm in India has cut water use by up to 80%  and doubled Read More
Tools & Smart EquipmentAutonomous Tractors Could Work in Wetter Conditions than Traditional Tractors
February 8, 2018
March 20th is the first day of spring, making spring much closer than even I expected. On the farm I Read More
AmericasPrecision Farming Companies to Watch in 2018 (OPINION)
January 17, 2018
My friends, as many of you told me repeatedly throughout the last 12 months, 2017 was an interesting year in Read More
John-Deere-Cab-GPS
Data ManagementPrecision Ag Hardware and Software: A Little Off-Season Maintenance Goes A Long Way
January 11, 2018
All service technicians have heard this line. Most often when spring makes its anticipated return to our lives. It is Read More
Anez-Consulting-Paul-Anez-and-Michael-Dunn
Service ProvidersAnez Consulting: Focus On Fertility
January 9, 2018
Central Minnesota features variability aplenty when it comes to soil characteristics and topography, from flat, black expanses rich in organic Read More
Agrishow2017
Americas5 Best Ag Tech Shows in Brazil
January 8, 2018
Brazil continues to demonstrate its potential in agriculture. Several international companies are investing in our country because we have a Read More
Latest News
Harvested-Corn-Field-Clouds
Industry NewsUnderstory Patents Solid State Weather Sensor
February 16, 2018
Understory today announced that it received a patent for its mechanical strain-based weather sensor, a key component in its weather Read More
Retailer Grower
Business ManagementAgriculture and Technology: Industry Progress Lies in C…
February 16, 2018
Water is essential for agriculture. While this may seem obvious, nowhere is it more apparent than the Sonoran Desert of Read More
Agtegra_SDSU
Industry NewsAgtegra Cooperative Pledges $500,000 to SDSU Precision …
February 15, 2018
Agtegra Cooperative, Aberdeen, SD, today in Pierre announced a $500,000 donation to South Dakota State University for the Precision Agriculture Read More
Ag Retailer and Grower WinField United
Business ManagementThe Importance of Teamwork for Successful Precision Ag …
February 15, 2018
Interdependency is defined as the quality or condition of being mutually reliant on each other. I’m not a huge sports Read More
Texas-and-Oklahoma-Panhandles-Google-Earth
Data ManagementAgriculture Impacts Weather: The Case for Connected Eco…
February 15, 2018
It’s fascinating to see how modern technology has helped us increase our agricultural productivity in areas not otherwise suited for Read More
Adapt-N VRT
Decision Support SoftwareDTN Partners with Adapt-N to Provide Weather and Nitrog…
February 14, 2018
DTN has announced a partnership today at the National Farm Machinery Show with Agronomic Technology Corp (ATC), a Yara International Read More
Corn close up
Imagery/SensingSyngenta Acquires Satellite Imagery Provider FarmShots
February 14, 2018
Syngenta has acquired FarmShots, Inc., a North Carolina-based innovator of high-resolution satellite imagery that detects plant health by analyzing absorbed Read More
Pexels-Agriculture_Fields_Tractor_Precision_AG
Tools & Smart EquipmentMachine Learning: The Secret Sauce of Precision Agricul…
February 13, 2018
With the development of agricultural technologies, crop and plant diseases have been advancing as well, causing degradation of both quality Read More
Farmers Edge Truck
Africa/Middle EastFarmers Edge Aligns with PartnerRE to Streamline Crop I…
February 13, 2018
Today Winnipeg-based FMIS giant Farmers Edge announced a partnership around crop insurance with Zurich-based PartnerRE. Although a bit short on Read More
Robotics Specialty Crops
AmericasHortau, Agrian Announce Strategic Partnership
February 12, 2018
Hortau today announced a strategic partnership with Agrian Inc. to deliver an expansive precision irrigation service for commercial agriculture. “With Read More
India-Farm-Irrigation
AsiaCloud-based Irrigation Could Double India’s Crop Yield …
February 12, 2018
A cloud-based, micro-irrigation system tested on a farm in India has cut water use by up to 80%  and doubled Read More
Forbes Mixing Bowl NYC
EventsInnovative Forum Geared to Let Food, Farming, and Tech …
February 9, 2018
Industry innovators in agriculture, food, and information technology are set to mix it up again at this year’s Forbes Mixing Read More
Tools & Smart EquipmentAutonomous Tractors Could Work in Wetter Conditions tha…
February 8, 2018
March 20th is the first day of spring, making spring much closer than even I expected. On the farm I Read More
corn weather
Industry NewsSciFi in Ag: Stanford Cooling Project Could Drive Energ…
February 7, 2018
(Article Notes: This monthly column takes some crazy sounding ideas and applies them to the field of Ag Tech. The Read More
Industry NewsAgGateway Debuts ADAPT ISO Plugin Version 2.0
February 6, 2018
AgGateway’s ADAPT Framework, which is designed to make it easy for various hardware and software systems that growers use in Read More
Roger-DuMond-and-Brandon-Butz-Kova-Fertilizer
Systems ManagementThere’s No Easy Button For Value in Variable-Rate Nutri…
February 6, 2018
Roger Dumond has weathered the ups and downs of precision agriculture programs as much as anybody who’s been riding that Read More
Farmer-Soybean-field
Business ManagementFeel Something is Missing in Precision Agriculture? Ans…
February 5, 2018
I’ve seen a lot of ideas and met a lot of people in the agtech world. There have been great Read More
HomeSST Software to be Acquired by Proagrica
February 5, 2018
UPDATED 2.5.18, 2:10 PM Proagrica has signed an agreement to acquire 100% of SST Software, including Raven’s ownership stake. Based Read More