Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

3 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Joe Russo Stories

Joe RussoData Privacy, Ownership In Precision Agriculture
September 3, 2013
The line between what data and information a grower is willing to share, and a company is allowed to use, will keep vacillating in the future. Read More
Joe RussoBig Data & Precision Agriculture
April 25, 2013
As the ability to collect data expands exponentially, precision ag users will need to start relying on computers to help crunch all of the numbers. Read More
Joe RussoThe Future Fusion Of Machines, Models And Sensors In Precision Agriculture
February 1, 2013
As technology improves, the lines between certain ag tools are certain to blur and combine. Read More

Trending Articles

Data5 Key Precision Farming Trends Showcased At The InfoAg Conference
July 30, 2014
No other event in agriculture quite captures the latest trends in precision farming like The InfoAg Conference. Find out what was hot at this year's event in our photo gallery. Read More
EquipmentNew Soil Sampling System Debuts At InfoAg
July 28, 2014
North Carolina grower Allan Baucom has what he feels is a better idea for automating soil sampling, and it’s on Read More
EquipmentKinze Electric Multi-Hybrid Planter Moves Closer To Full Launch
July 15, 2014
Based on early successes with the multi-hybrid planter, Kinze announced that it is putting the model into limited production for the spring 2015 planting season. Read More
SoftwareTrimble Adds Multi-Spectral Processing Capabilities To Connected Farm
June 19, 2014
Trimble has added another new agronomic service to its Connected Farm solution. Read More
ImageryInfoAg 2014 Is Next Week, Record Crowd Anticipated
June 11, 2014
A new and improved InfoAg 2014 program hits the hot topics of today: unmanned aerial vehicles, big data and wearable computers. Read More
ImageryAUVSI Unmanned Systems 2014: 14 Cool Things We Saw For Precision Ag
May 20, 2014
We were in attendance May 13-15 in Orlando, FL, for the AUVSI 2014 Unmanned Systems conference. Here are 14 cool ag-related things we saw. Read More

Latest News

DataBig Data Workshop Set For Monday, Aug. 25 In Ames
August 20, 2014
"Big Data: Managing Your Most Elusive Farm Asset" is set to bring growers, educators and industry experts together Aug. 25 on the Iowa State University campus in Ames, IA. Read More
WinField logo
DataWinField Launches Data Silo, Mobile App Store
August 20, 2014
Answer Tech by WinField is a web portal and mobile app store, while the WinField Data Silo is a secure, cloud-based data-management system. Read More
UncategorizedUSDA Launches Website To Provide Guidance For New Farme…
August 20, 2014
Farmers work hard while dealing with unpredictable weather, long hours and countless risks. New farmers face even more start-up obstacles Read More
DataVilsack, USDA Pledge $2 Million To Lake Erie Water Qual…
August 19, 2014
The new funding is the latest contribution of resources to the Lake Erie watershed from USDA, which has invested $46 million in the watershed since 2009. Read More
DataLeadership Change Ahead For AgGateway
August 19, 2014
Current Executive Vice President and COO Wendy Smith will move into the role of AgGateway President and CEO beginning in 2015. Read More
PrecisionAg Institute1 On 1 With Paul Schrimpf: Topcon Precision Agriculture…
August 13, 2014
Harlan Little of Topcon Precision Agriculture talks with PrecisionAg Executive Editor Paul Schrimpf about key issues in precision agriculture, how positioning and steering systems are still a key focus for the company, data privacy and much more. Read More
AwardsPrecisionAg Awards Of Excellence Winners Talk About Car…
August 13, 2014
Winners of the 2014 PrecisionAg Awards of Excellence share insights into their successful careers and what’s driving advancement in farming technology. Read More
Raven - Precision Simplified® - Company Logo
EquipmentRaven Introduces New Nozzle Control System
August 12, 2014
Hawkeye is an innovative pressure-based nozzle control system that provides the precise and accurate application across the entire sprayer boom, and the entire field. Read More
GuidanceSouthern States Coop Expanding RTK Offerings
August 11, 2014
Southern States Cooperative has announced plans to offer Real-Time Kinematic (RTK) technology to its precision ag customers in the southeast. Read More
DataGROWMARK Adds Three To Agronomy Team
August 8, 2014
GROWMARK is pleased to welcome three employees into new roles within the Agronomy Services Department. Read More
EquipmentPrecisionHawk Obtains FAA Authorization For UAV Researc…
August 7, 2014
PrecisionHawk announced today its UAV platform, the Lancaster Mark III, has been granted the first FAA Certificate of Authorization for operation at the N.Y. test site. Read More
Variable Rate Technology
DataFarmers Edge Forms Joint Venture With FarmCommand
August 6, 2014
Farmers Edge, a global leader in variable rate technology, has formed a joint venture with ISOBUS, M2M and telematics provider, FarmCommand. Read More
SteeringAg Leader Introduces OnTrac3 Steering System
August 4, 2014
OnTrac3 represents the next generation of the company’s assisted steering system and features a number of improvements to the Electronic Control Unit and the Mechanical Drive Unit. Read More
EquipmentOcean Optics Launches Spectral Sensing Kit For UAVs
August 4, 2014
The STS Developers Kit brings together its powerful STS spectrometer, a Raspberry Pi microcomputer, customizable software and wireless capabilities in a single package. Read More
DataCTIC Indian Creek Watershed Tour Two Weeks Away
August 4, 2014
The tour takes place Aug. 19 at several locations near Fairbury, IL, and is hosted by the Conservation Technology Information Center (CTIC) and the Livingston County Soil and Water Conservation District (SWCD). Read More
AwardsPrecisionAg Awards Of Excellence Winners Honored At Inf…
July 30, 2014
Winners of the PrecisionAg Institute's Awards of Excellence were honored at The 2014 InfoAg Conference in St. Louis. Read More
SoftwareDoug Mills Joins MapShots As Business Manager
July 30, 2014
Mills will have responsibility for enhancing the strong software development and outstanding customer service functions of the company through a focused sales and marketing strategy. Read More
GPSFirst Galileo Commercial Service Demonstration With Enc…
July 30, 2014
The Early Proof of Concept team has successfully tracked the encrypted Galileo E6-B and E6-C signals broadcast by Galileo satellites. Read More