Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

4 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Google-Earth-Map-featured-image
Data ManagementRainfall Revisited: Accurate Observations and Beyond
September 18, 2018
As a provider of weather analysis and forecast services to the agricultural industry, one of the most common questions I Read More
Soil-Hand
Data ManagementAre You Using Your Soil to Its Full Potential?
September 14, 2018
Harvest is progressing across most parts of the U.S. and those growers who aren’t already harvesting are gearing up to Read More
Tablet Grower
Data ManagementThe Power of Predictive Analytics in Agriculture
September 5, 2018
Years ago if we would have been told computers, data, and technology would be scattered around every farm there may Read More
AmericasOn The Scene: 2018 Farm Progress Show Wrap Up
September 5, 2018
Former Monsanto President (now Bayer CropScience Chief Operating Office) Brett Begemann’s opening salvo during his first appearance at a Farm Read More
Trending Articles
Soil-Hand
Data ManagementAre You Using Your Soil to Its Full Potential?
September 14, 2018
Harvest is progressing across most parts of the U.S. and those growers who aren’t already harvesting are gearing up to Read More
Grower-Retailer
Imagery/SensingAgtech: 10 Things I Hate About You!
September 4, 2018
Before you get bent out of shape from the title, remember if you’ve read my articles before you know I Read More
Kansas State University
Industry NewsKansas State University, Topcon Form Precision Ag Research Partnership
August 30, 2018
Kansas State University and Topcon Agriculture are collaborating to develop tools and systems to advance precision agriculture and support farmers. Read More
Blockchain building block graphic
Specialty CropsIs Blockchain the Future of Food Safety?
August 24, 2018
When the Internet Protocol Suite (TCP/IP) was standardized in 1982, permitting the worldwide proliferation of interconnected networks and eventually the Read More
WinField’s Joel Wipperfurth On Empowering Data-Driven Decisions
InfoAg ConferenceOne on One with Joel Wipperfurth, Winfield United
August 15, 2018
Winfield United's Joel Wipperfurth discusses ag technology trends and topics during last month’s InfoAg Conference. Read More
Geosys
Industry NewsUrtheCast to Acquire Geosys from Land O’Lakes in $20 Million Deal
August 15, 2018
UrtheCast Corp. and Land O’Lakes, Inc. today announced they have entered a binding term sheet for the purchase of Geosys Read More
Latest News
Business ManagementIvy Tech, Farmers Partner to Help Precision Ag Educatio…
September 20, 2018
Harvest time has taken on a new meaning for some Wabash Valley farmers, and Bobbi Hunt-Kincaid hopes her family’s first Read More
Sensors
Sensors/IoTThe Answer to Agriculture’s Daunting Challenges – Soil …
September 20, 2018
According to the United Nations, 9.6 billion people will live on planet Earth by 2050. Feeding these mouths will require Read More
Google-Earth-Map-featured-image
Data ManagementRainfall Revisited: Accurate Observations and Beyond
September 18, 2018
As a provider of weather analysis and forecast services to the agricultural industry, one of the most common questions I Read More
PenelopeNagel
Business ManagementWhy Is Funding a Challenge for Women-Led Agtech Compani…
September 17, 2018
When it comes to women-led agtech companies the funding discussion never seems to cease. In June after the The New Read More
Mobile Phone in field
Decision Support SoftwareWhy Are 570 Million Farmers Not Yet Using Agricultural …
September 17, 2018
Until recently, using agricultural apps and software was a rare practice among growers. This is now changing. The mass adoption Read More
Soil-Hand
Data ManagementAre You Using Your Soil to Its Full Potential?
September 14, 2018
Harvest is progressing across most parts of the U.S. and those growers who aren’t already harvesting are gearing up to Read More
Grower Services & SolutionsDeere-Granular Collaboration Produces New Profit Maps T…
September 14, 2018
The newest development from the ongoing John Deere-Granular product development and marketing collaboration is Profit Maps, now available to farmers Read More
Wingtra
DronesOpinion: Combining Two Pluses with the WingtraOne UAV
September 13, 2018
For the every-day consumer interested in UAVs, there is an ocean of products from which to choose. This includes the Read More
Farmer-tablet
AsiaShould Agri-Input Manufacturers Outsource E-Commerce to…
September 12, 2018
Editor’s note: Venky Ramachandran is a contributing writer for PrecisionAg.com’s sister site, AgriBusinessGlobal.com. This article was originally published on LinkedIn. Now, Read More
ICON-Link-Licensing_featured-image
Industry NewsValley Irrigation Adds Remote Irrigation Management Opt…
September 11, 2018
Valley Irrigation, an industry leader in smart irrigation solutions, has announced enhancements to its remote management technologies. Multi-Year Licensing In Read More
Reflex-Connect-Agri-Inject-featured-image
Variable Rate ApplicationVariable Rate Fertigation System Expands with Mobile Co…
September 10, 2018
Building on the success of its Reflex Variable Rate Fertigation system, Agri-Inject has taken fluid injection to the next level Read More
Industry NewsTeralytic Earns Ag Data Transparent Certification
September 10, 2018
Soil analytics company Teralytic has completed the Ag Data Transparent certification, affirming that their data use is private, secure, and Read More
Business ManagementTop 20 Two-Year Colleges for Precision Agriculture
September 10, 2018
Earlier this year, I compiled a list of the 25 best colleges for precision agriculture. It was quite the process. Read More
Industry NewsRaven, Topcon Announce Slingshot API Agreement
September 6, 2018
Raven Industries and Topcon Agriculture announced today a licensing agreement for Topcon Agriculture’s use of the Slingshot Application Programming Interface Read More
Tablet Grower
Data ManagementThe Power of Predictive Analytics in Agriculture
September 5, 2018
Years ago if we would have been told computers, data, and technology would be scattered around every farm there may Read More
DronessenseFly Launches eBee X Drone, Breaks Through 1,000 ac…
September 5, 2018
senseFly today reportedly sets a new standard in mapping tools with the launch of the eBee X. Launched with the Read More
AmericasOn The Scene: 2018 Farm Progress Show Wrap Up
September 5, 2018
Former Monsanto President (now Bayer CropScience Chief Operating Office) Brett Begemann’s opening salvo during his first appearance at a Farm Read More
EventsAg Experts Discuss Big Data Challenges in Agriculture
September 5, 2018
Agricultural experts at a Houston conference praised the advancements in unmanned aerial vehicles, sensors, and data-collecting technology used in precision Read More