Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

3 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Data ManagementEFC Announces FieldAlytics, Adapt-N Expanded Integration
July 17, 2017
EFC Systems is pleased to announce an expanded integration between its FieldAlytics product and Agronomic Technology Corp’s Adapt-N nitrogen recommendations Read More
Data ManagementOpinion: Benchmarking in Precision Agriculture is Big Statistics
July 17, 2017
Benchmarking has become a buzzword in precision agriculture recently and before we get too excited with all of the profound Read More
Yield Data Image
Data ManagementYield Data: More Than a Pretty Picture
July 13, 2017
It is mid-July, which, for the Australian cotton industry, means that picking is still going on for some growers. A Read More
Helena Spreader
Data ManagementDriving Value Through Machine Data
July 5, 2017
Telematics data is readily becoming common place thanks to smart edge devices in ag equipment. Many groups have begun storing Read More
Trending Articles
Yield Data Image
Data ManagementYield Data: More Than a Pretty Picture
July 13, 2017
It is mid-July, which, for the Australian cotton industry, means that picking is still going on for some growers. A Read More
BASF Maglis Grower Tablet
ProfessionalsPatience Needed: Lessons for Getting New Tech onto the Farm
July 6, 2017
A popular joke within the tech industry was trotted out at GAI AgTech Week in Boston, MA, speaking volumes about Read More
PrecisionAg Vision Conference
EventsPrecisionAg® Vision Conference: Focused on the Future
June 13, 2017
PrecisionAg® is pleased to announce the return of its PrecisionAg Vision Conference, October 10-12, 2017. Based on overwhelmingly positive response Read More
Gavin Newsom Forbes AgTech-Summit
ProfessionalsAgTech Summit Aiming High for Modern Farming Solutions
June 12, 2017
THRIVE AgTech, in partnership with SVG Partners and Forbes, is hosting the third annual Forbes AgTech Summit June 28-29 in Read More
Quantix Drone Farmer
DronesTop 10 Most Intriguing Technologies in Agriculture
June 3, 2017
This may be a bit of stating the obvious here, but we’ll throw it out there anyways: as much as Read More
Farming iPad
Data ManagementOpinion: ROI or Die in Precision Agriculture
May 12, 2017
The thought of $3.50 corn for the foreseeable future seems pretty disheartening. However, if you look at the precision ag Read More
Latest News
Industry NewsLindsay Corp. Names Dow’s Timothy Hassinger New C…
July 19, 2017
Lindsay Corp. has  announced the appointment of Timothy Hassinger as president and CEO and a member of its board of Read More
InfoAg 2015
Events2017 Awards of Excellence Winners Announced
July 18, 2017
PrecisionAg Institute is pleased to announce its Awards of Excellence winners for 2017. Honorees of this year’s prestigious award are Read More
Interseeding Cover Crops
ProfessionalsA 3-Step Approach to Interseeding Cover Crops
July 18, 2017
As growers continue to search for opportunities to create healthier soils and increase yields, more trusted advisors and farmers are Read More
Rod Weimer and Paul Schrimpf
Excellence AwardsPast Recipients Of The PrecisionAg Awards Of Excellence
July 18, 2017
Since 2007, the PrecisionAg Insititute has sponsored the annual Awards of Excellence program. Here's a list of the past winners. Read More
Data ManagementEFC Announces FieldAlytics, Adapt-N Expanded Integratio…
July 17, 2017
EFC Systems is pleased to announce an expanded integration between its FieldAlytics product and Agronomic Technology Corp’s Adapt-N nitrogen recommendations Read More
Data ManagementOpinion: Benchmarking in Precision Agriculture is Big S…
July 17, 2017
Benchmarking has become a buzzword in precision agriculture recently and before we get too excited with all of the profound Read More
Yield Data Image
Data ManagementYield Data: More Than a Pretty Picture
July 13, 2017
It is mid-July, which, for the Australian cotton industry, means that picking is still going on for some growers. A Read More
Industry NewsQuick Rewind: Ohio Dealer Talks Deere-Precision Plantin…
July 12, 2017
A few weeks ago I took a quick trip south down I-71 to Central Ohio (for you non-Buckeyes, I-71 runs Read More
DronesSentera Launches Versatile Quad Sensor for Drones
July 12, 2017
Fully Customizable Filters on Sentera Quad Sensor Allow for Unique Crop Health Detection Capabilities Sentera introduces the latest update to Read More
Hortau Irrigation Management Software
Sensors/IoTHortau Named Finalist for CogX Artificial Intelligence …
July 10, 2017
Hortau was recently named a CogX Award finalist in the Best Artificial Intelligence Product in Agriculture category. The awards were Read More
Grower Services & SolutionsVantage South Atlantic Announces Mid-South Expansion
July 10, 2017
Vantage South Atlantic announced that it has joined Trimble Agriculture’s global network of independent Vantage partners to provide farmers, advisors, Read More
Ag Retailer and Grower WinField United
Decision Support SoftwareAgronomic Technology Corp Surpasses Daily Nitrogen Reco…
July 6, 2017
Agronomic Technology Corp, a leader in agricultural field modeling for soil, water, crops, and fertilizer, for the first time surpassed Read More
Precision IrrigationDealership Celebrates 25 Years in the Irrigation Game
July 6, 2017
25 years ago, Bobby Kempenich had an idea. An idea to launch a business that combined his knowledge of irrigation Read More
BASF Maglis Grower Tablet
ProfessionalsPatience Needed: Lessons for Getting New Tech onto the …
July 6, 2017
A popular joke within the tech industry was trotted out at GAI AgTech Week in Boston, MA, speaking volumes about Read More
Deere R4023 cab
Business ManagementOpinion: Reality vs. Hype in Precision Agriculture
July 6, 2017
I think there is a certain word that can accurately describe much of the precision ag and/or ag tech industry right Read More
Events2017 agBOT Challenge Winners Announced
July 6, 2017
Driverless robotic machines entered the fields of Gerrish Farms in Rockville, IN in June 2017. Universities and entrepreneurial teams showcased Read More
gomez-featured
ProfessionalsCommitment to Ag Innovation: Q&A with DuPont Pionee…
July 5, 2017
Editor’s note: PrecisionAg.com contributor Amy Wu often writes about women in ag technology. Recently, she interviewed DuPont Pioneer’s Nadilia Gomez, research scientist, Read More
LAP
InternationalLAP and ABPSAP: Advancing Precision Agriculture in Braz…
July 5, 2017
In this article, I would like to highlight two important entities of precision agriculture in Brazil. The first of these Read More