Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

3 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Joe Russo Stories

Joe RussoData Privacy, Ownership In Precision Agriculture
September 3, 2013
The line between what data and information a grower is willing to share, and a company is allowed to use, will keep vacillating in the future. Read More
Joe RussoBig Data & Precision Agriculture
April 25, 2013
As the ability to collect data expands exponentially, precision ag users will need to start relying on computers to help crunch all of the numbers. Read More
Joe RussoThe Future Fusion Of Machines, Models And Sensors In Precision Agriculture
February 1, 2013
As technology improves, the lines between certain ag tools are certain to blur and combine. Read More

Trending Articles

ImageryDrones Grounded: NTSB Overturns Pirker Decision, Affirms FAA Authority
November 19, 2014
The National Transportation Safety Board (NTSB) issued a much-awaited decision ruling that FAA rules that apply to manned aircraft apply to unmanned aircraft or drones, reports Forbes.com contributor John Goglia; Pirker can still appeal. Read More
Variable RateA Doubleshot Of Precision Ag Services
November 3, 2014
Ag retailer South Dakota Wheat Growers is using an innovative piece of equipment to enhance the precision ag application work for its growers-customers. Read More
DataPrecision Interest Grows In Brazil
October 29, 2014
The country has made solid progress on soil sampling and variable-rate fertility, but limited cell coverage hampers connectivity and data collection. Read More
DataAmerican Farm Bureau Survey Shows Big Data Use Increasing
October 24, 2014
A survey by the American Farm Bureau Federation shows more farmers are reaping the benefits of the latest agricultural technologies, but most remain wary of risks involved with big data collection. Read More
PrecisionAg Institute1 On 1 With Paul Schrimpf: Simplot’s Allan Fetters
October 8, 2014
Allan Fetters of Simplot talks with PrecisionAg Executive Editor Paul Schrimpf about the precision ag challenges and opportunities for specialty crop growers, how variable rate planting is gaining momentum among Simplot’s customers, how the company’s SmartFarm solutions are helping farmers make better decisions, and much more. Read More
MappingDuPont Pioneer Teams With Government Organizations For Soil Initiative
October 6, 2014
University of Missouri, USDA-ARS and DuPont Pioneer announce an innovative collaboration to pool soil mapping resources, predictive technologies and expertise. Read More

Latest News

ImageryAUVSI Announces New Leader For 2015
November 21, 2014
Brian Wynne has been named president and CEO of the Association for Unmanned Vehicle Systems International (AUVSI). Read More
GPSTopcon Acquires German Console Manufacturer
November 20, 2014
Wachendorff Elektronik GmbH and its US subsidiary, Wachendorff Electronics Inc., are leading manufacturers of in-cabin mounted consoles for the industrial vehicle market in the agricultural and construction industries. Read More
DataRanch Systems, OnFarm Announce Partnership
November 19, 2014
Ranch Systems, a new OnFarm Ready Partner, is now “plug and play” compatible with the Grower Dashboard; growers can now seamlessly view field data collected by Ranch Systems. Read More
DataFarmers Edge Looking To Expand U.S. Customer Base
November 19, 2014
A Canadian precision ag outfit is feeling frisky after a recent capital infusion, looking at bringing its agnostic data management system to more U.S. growers and retailers. Read More
ImageryDrones Grounded: NTSB Overturns Pirker Decision, Affirm…
November 19, 2014
The National Transportation Safety Board (NTSB) issued a much-awaited decision ruling that FAA rules that apply to manned aircraft apply to unmanned aircraft or drones, reports Forbes.com contributor John Goglia; Pirker can still appeal. Read More
DataAgrian, Others Detail Open Modus Standard For Ag Data
November 19, 2014
The Open Modus Standard provides the industry with a single, unified format for data management and exchange that can be used across Farm Management Information Systems (FMIS) in support of precision agriculture. Read More
ComputingNew AyrMesh Bridge Provides Long-Range Network Access
November 18, 2014
Ayrstone Productivity introduced the AyrMesh Bridge, a 5-mile-long, point-to-point Internet bridge that acts like a wireless Ethernet cable, allowing farmers and ranchers to easily connect distant devices to their networks. Read More
DataValley Launches Irrigation Exchange Data Transfer Solut…
November 18, 2014
Irrigation Exchange provides for the seamless transfer of precision data to other ag companies from BaseStation3, the new Valley remote irrigation management product. Read More
DataMajor Farm Organizations Ratify Data Privacy Policy
November 13, 2014
A coalition of major farm organizations and agriculture technology providers have announced an agreement on data privacy and security principles. Read More
DataAgGateway Releases Data Privacy White Papers
November 11, 2014
AgGateway's Data Privacy and Security Committee has published a white paper to help the agriculture industry consider ways to incorporate data privacy best practices and standards into their operations. Read More
GuidanceRaven Industries Names CFO
November 11, 2014
Steven E. Brazones will join the company as its Chief Financial Officer, effective December 1, 2014. He succeeds Thomas Iacarella, who will remain with the company and work with Brazones to ensure a smooth transition. Read More
ImageryFAA Confirms Small Drone Rule By End Of Year
November 11, 2014
The proposed ruling, which the agency has been working on over the past year, is currently being reviewed by the Office of Management and Budget, Jim Williams, manager of the FAA’s UAS integration office, said on Nov. 5. Read More
DataFarmers Edge Receives Funding Infusion
November 10, 2014
Farmers Edge has received an investment from Kleiner Perkins Caufield & Byers’ Green Growth Fund for expansion of Farmers Edge’s technology platform. Read More
GuidanceIndustry Loses Tremendous Young Leader
November 9, 2014
Pat Schaddel, a young leader and innovator in precision ag for Brandt Consolidated, passed away on November 6. Read More
SteeringStara Selects AgJunction eDrive XC Precision Steering F…
November 6, 2014
Stara and AgJunction have signed an agreement to integrate AgJunction's newest and highest performing steering solution, eDrive XC with Stara's industry-leading precision terminal, the Topper 5500. Read More
PrecisionAg Institute1 On 1 With Paul Schrimpf: Raven’s Tim Hines
November 5, 2014
Tim Hines of Raven Industries talks with PrecisionAg Executive Editor Paul Schrimpf about the latest with the Slingshot precision ag system, including new products and services available under the brand such as SmartYield Pro and Viper 4. Read More
MappingNew MapShots Site Goes Live
November 3, 2014
The site includes an enhanced homepage, more robust content and new navigation, all leading to a more user-friendly experience. Read More
DataDuPont, Raven Join Forces On Encirca Yield Data Transfe…
November 3, 2014
As part of this data exchange, growers can choose to have their Encirca services prescriptions wirelessly transferred directly to compatible Raven controllers. Read More