Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

3 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Young Corn Field
Data ManagementPurdue Online Tool to Help Farmers Make Precision Decisions, Keep Data Private
September 14, 2017
An innovative online tool developed by a Purdue University engineering professor will allow farmers to process data collected from their Read More
BASF Maglis grower retailer tablet
Data ManagementWhat Will Happen to My Data? Understanding Your Rights in Precision Agriculture
September 12, 2017
The use of precision agriculture-based decision making to determine fertilizer rates and hybrid types and planting rates is becoming more Read More
Data ManagementPrecision Farming: What’s Your Data Worth to You?
September 8, 2017
Today’s farm equipment today comes with more bells, whistles and blinking lights than Captain Nemo’s submarine, and most of those Read More
corn field
Data ManagementCan Artificial Intelligence Help Feed the World?
September 6, 2017
Editor’s note: Ryan Rakestraw from Monsanto Growth Ventures has teamed up with Amrit Acharya from Mckinsey to write the following Read More
Trending Articles
Farmer with iPad
Australia/New ZealandAgrian Expands into Australia
September 20, 2017
In line with a familiar growth trajectory, Agrian Inc. is moving into Australia with a physical support and sales presence Read More
John-Deere-labs
Tools & Smart EquipmentHow John Deere’s New AI Lab Is Designing Farm Equipment for a More Sustainable Future
September 15, 2017
On a block in San Francisco’s SoMa district, near LinkedIn’s headquarters and dozens of startups, a 180-year-old company best-known for Read More
BASF Maglis grower retailer tablet
Data ManagementWhat Will Happen to My Data? Understanding Your Rights in Precision Agriculture
September 12, 2017
The use of precision agriculture-based decision making to determine fertilizer rates and hybrid types and planting rates is becoming more Read More
Robotics/Labor SaversBlue River, Deere Deal Will Accelerate Farm Robot Innovation
September 11, 2017
No, Blue River Co-founder and CEO Jorge Heraud has not been deposed — Gaddafi-style — by big, bad corporate overlord Read More
Farming at Sunset
Business ManagementAgtech Issues: The Shiny Object Syndrome
September 6, 2017
Do you remember those cartoons where someone lures someone else by placing a piece of candy, small amount of money, Read More
AgQuip overview
Australia/New ZealandAgQuip 2017 Displays New Ag Technology in Australia
August 28, 2017
The annual AgQuip field days took place in Gunnedah, NSW on August 22-24. Being the largest agricultural field days in Read More
Latest News
deepfield-robotics-bonirob
Robotics/Labor SaversDeepfield Robotics to Showcase Precision Agriculture Te…
September 22, 2017
Deepfield Robotics is preparing to showcase its robotics and automation technologies for the agriculture market at the Agrilevante event, in Read More
Kray Drone Application
DronesCrop Spraying Drone Manufacturer Kray Technologies Gets…
September 22, 2017
Chernovetskyi Investment Group (CIG) has reached an agreement on investment into Kray Technologies company, which manufactures Kray Protection industrial robotic Read More
Imagery/SensingPlanet Announces New Hi-Res Imagery Products
September 21, 2017
Since our acquisition of Terra Bella, and the SkySat constellation of seven satellites, we’ve been focused on making this high-resolution Read More
Systems ManagementBayer Dismisses Antitrust Concerns about Digital Farmin…
September 20, 2017
Bayer said it was unable to propose the sale of any digital farming assets to allay EU concerns about its Read More
Farmer with iPad
Australia/New ZealandAgrian Expands into Australia
September 20, 2017
In line with a familiar growth trajectory, Agrian Inc. is moving into Australia with a physical support and sales presence Read More
Robotics Specialty Crops
EventsPrecision in Specialty Crops Gains Momentum
September 20, 2017
When John Deere acquired Blue River Technologies (BRT) recently, BRT’s See & Spray technology received plenty of play. Yet many Read More
Decision Support SoftwareSyngenta Helps Lead Efforts for Farm Management Softwar…
September 19, 2017
Ag data from tractors, combines, planters, and other farm machinery present a huge opportunity for growers to manage their operations Read More
Petra-Andren-Cicada-Innovations
Australia/New ZealandGrowLab’s Rocket Fuel for AgTech in Australia
September 19, 2017
Despite its superpower status as a producer and exporter of agricultural goods and services, up until now Australia has had Read More
CropIn-Team-Photo-credit-BW-Disrupt
AsiaCropIn Aims to be a Global Leader in AgTech Sector
September 19, 2017
Krishna Kumar created AgTech startup, CropIn Technology in 2010, along with co-founders Kunal Prasad and Chittranjan Jena. The trio went Read More
China-Beidou-Navigation-Satellite-System
AsiaChina’s Navigation System Gets Powerful Chip to I…
September 18, 2017
A new powerful chip technology has been introduced in China’s national satellite navigation system to provide high-precision positioning, according to Read More
Tablet Grower
Industry NewsFieldReveal Names Hesse New CEO
September 18, 2017
Matt Hesse has been selected as the Chief Executive Officer of FieldReveal, a newly launched joint venture formed to deliver Read More
John-Deere-labs
Tools & Smart EquipmentHow John Deere’s New AI Lab Is Designing Farm Equipment…
September 15, 2017
On a block in San Francisco’s SoMa district, near LinkedIn’s headquarters and dozens of startups, a 180-year-old company best-known for Read More
Wheat sunrise
Australia/New ZealandSparkLabs Group Launches an Agricultural Tech Accelerat…
September 15, 2017
SparkLabs Group, which claims to be the largest startup accelerator group in Asia, is stepping into agricultural tech with a Read More
Sensors/IoTCollaboration Leverages Internet of Things, Sensors in …
September 15, 2017
The vision of having license-free community sensor networks for agricultural users has made a giant leap closer to reality. A Read More
Young Corn Field
Data ManagementPurdue Online Tool to Help Farmers Make Precision Decis…
September 14, 2017
An innovative online tool developed by a Purdue University engineering professor will allow farmers to process data collected from their Read More
forbes-agtech-summit
Precision IrrigationImproving Water Management: Can Silicon Valley Help?
September 13, 2017
I recently attended the Forbes AgTech Summit in Salinas, CA, where roughly 50 start-up companies originating from Silicon Valley and Read More
Nate-Dorsey-Field-Trial-Curve-Compensation
Systems ManagementField Trial: Precision Application and Curve Compensati…
September 13, 2017
Several months ago I wrote an article about curve compensation in planters and how these systems can help create more Read More
Diamondback moth
Tools & Smart EquipmentTechAccel Invests in Unique Sprayable RNAi Pesticide Te…
September 12, 2017
TechAccel, the Kansas City-based technology and venture development company, has announced it has awarded the first grant under its “Path Read More