Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Subscribe to the Newsletter!
Get your free weekly Precision Ag Newsletter!

Leave a Reply

3 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Joe Russo Stories
Joe RussoData Privacy, Ownership In Precision Agriculture
September 3, 2013
The line between what data and information a grower is willing to share, and a company is allowed to use, will keep vacillating in the future. Read More
Joe RussoBig Data & Precision Agriculture
April 25, 2013
As the ability to collect data expands exponentially, precision ag users will need to start relying on computers to help crunch all of the numbers. Read More
Joe RussoThe Future Fusion Of Machines, Models And Sensors In Precision Agriculture
February 1, 2013
As technology improves, the lines between certain ag tools are certain to blur and combine. Read More
Trending Articles
EquipmentRaven, CNH Industrial Strengthen Ties
November 19, 2015
Raven Industries and CNH Industrial have established a new long term agreement, strengthening the partnership between the two companies. This Read More
ComputingDeere, Precision Planting Deal: 7 Things We Learned
November 3, 2015
Rather predictably, the recently announced John Deere acquisition of Monsanto’s Precision Planting raised plenty of eyebrows around the office Tuesday Read More
Grower using MyJohnDeere with tablet
DataDeere, Cloud Provider DN2K Form SageInsights Joint Venture
October 8, 2015
Deere & Co. and DN2K have agreed to form SageInsights – a joint venture to initially serve the agriculture industry Read More
Trimble - Xfill
GPSGPS Gaining Power, Expanding Applications
September 21, 2015
While the ability to harness the field navigation power of GPS has been around for decades, these days equipment makers Read More
EquipmentMore Deere Planters Get ExactEmerge Retrofit Kit
August 25, 2015
John Deere recently announced that additional ExactEmerge-enabling Retrofit Kits are now available for additional late model John Deere planters. Now, model year 2011 Read More
DataClimate Corp: We’ve Mapped Nearly 45% Of U.S. Corn And Soybeans
June 25, 2015
Today, The Climate Corporation, a division of Monsanto Company, announced that farmers have mapped more than 75 million row crop Read More
Latest News
Gary Knutson, executive director of the North Dakota Agricultural Association
EquipmentNorthern Ag Expo To Showcase Precision Agriculture
November 25, 2015
The 45th Northern Ag Expo, December 1 and 2 at the Fargodome in Fargo, ND, will be a showcase for Read More
Katie MacMillan - Precision Agronomist with Farmers Edge
DataFarmers Edge Announces New Retail Partnerships
November 24, 2015
Farmers Edge announced it is expanding its local partnerships throughout the agriculture supply chain. The new cooperatives signal the commitment Read More
Monosem Planter
EquipmentBig Plays In Precision Ag Technology Segment
November 24, 2015
The move to a high tech agricultural environment continues apace with recent agreements and acquisitions cementing intent of key players Read More
In Cab Wilcox Farm
DataPrecision Agriculture Workshop Kicks Off Food, Ag And H…
November 20, 2015
A 32-hour app hackathon fueled by pizza and caffeine, an “idea hack” tackling global challenges, a precision-agriculture workshop for drought Read More
MyTraps Spensa Technologies
DataPrecision Ag Company Finalizes $2.5 Million Investment,…
November 20, 2015
Spensa Technologies Inc., a startup in Purdue Research Park, closed on $2.5 million in Series A funding to expand its Read More
ImageryKansas Students To Operate AgEagle UAS For Precision Ag…
November 20, 2015
A group of students in Kansas are pairing with some of the state’s farmers on a precision agriculture project that Read More
ComputingAgGateway Introduces Specialty Chemical Council
November 19, 2015
AgGateway members have created a new council to address electronic connectivity issues related to the specialty chemical business. Segments covered Read More
EquipmentRaven, CNH Industrial Strengthen Ties
November 19, 2015
Raven Industries and CNH Industrial have established a new long term agreement, strengthening the partnership between the two companies. This Read More
DataFBN Brings Moneyball Conference To Bettendorf
November 19, 2015
Farmers Business Network (FBN), the independent and trusted farmer-to-farmer information network, today announced the company is hosting a major farmer Read More
ComputingSST Launching Analytics Platform for Agronomists, Ag Re…
November 19, 2015
SST Software has released a new web-based application, SST Analytics, that allows agronomists and ag retailers to perform regional analysis Read More
ComputingAgworld, CDMS Announce Partnership
November 18, 2015
Agworld, a provider of mobile farm management software, announced a new partnership today with CDMS to provide crop protection and Read More
AgBot16 Challenge
EquipmentCool Idea: Details On Robotic Planter Challenge Reveale…
November 18, 2015
Teams representing the educational and business sectors are entered to compete in the 2016 agBot Challenge, which will be held Read More
DataWilbur Ellis Taps aWhere For Weather Data, Modeling
November 18, 2015
Retailer Wilbur-Ellis has chosen Colorado-based aWhere to provide agricultural weather data and agronomic modeling services to the retailer’s AgVerdict decision-making toolkit. aWhere is Read More
MyJohnDeere tablet
EquipmentPrecision Agriculture The Focus Of Recent John Deere Ac…
November 17, 2015
John Deere continues to focus on precision agriculture, as the company announced on November 3 that it reached an agreement Read More
Super Nova Drone
DataUniversity’s Drone Program Poised To Change Agric…
November 17, 2015
The Aviation Program at the University of Louisiana Monroe is producing cutting-edge drone research and hands on field operations that Read More
An Agribotix pilot flies over emerging corn.
DataKansas Senator Praises UAV Technology For Agriculture
November 17, 2015
A sense of history hovered over Kansas Sen. Pat Roberts on Friday as he gingerly took the controls of an Read More
PrecisionAg Innovation Series Audience
Data2016 PrecisionAg Innovation Series Meeting Slated For S…
November 16, 2015
“Agriculture And Data: Finding What Works” is the latest installment in the PrecisionAg Innovation Series, to be held January 26, Read More
ComputingDigging Deep Into Precision Agriculture
November 13, 2015
Silent Shade Planting Company has only scratched the surface when it comes to using precision agriculture in its 12,000-acre operation. Read More