Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

3 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Data ManagementNew Partnerhship Between AgIntegrated, CDMS, SeediQ Will Create Single Source Reference Data API
January 18, 2017
AgIntegrated, Inc. (AGI), CDMS, Inc. and SeediQ announce a partnership to develop, promote, and sell a single-source crop input reference Read More
Data ManagementProspera Selected for Top 100 Artificial Intelligence Rankings
January 11, 2017
CB Insights today selected Prospera to the prestigious Artificial Intelligence 100 list (“AI 100”), a select group of emerging private Read More
Corn Field
Data ManagementWaypoint Analytical, Highland Precision Ag Announce Strategic Alliance
January 9, 2017
Waypoint Analytical (WP), based in Memphis, TN, and Highland Precision Ag (HPA), based in Mulberry, FL, are pleased to announce Read More
Wade Barnes Farmers Edge using FarmCommand
Data ManagementFarmers Edge Makes Precision Ag Simple
January 3, 2017
Jon Labine of Argyle, MN, is a regional sales representative for Farmers Edge Inc., one of the latest entries in Read More
Trending Articles
Terry Griffin
Business ManagementUsing High Tech To Make Farm Decisions
January 17, 2017
Raj Khosla, professor of precision agriculture at Colorado State University, challenged farmers to think about how far the technology of Read More
PrecisionAg.com featured image
ProfessionalsWelcome to the Newly Enhanced PrecisionAg.com
December 29, 2016
Talk a quick look around our website and we hope you’ll notice it’s significantly different as we head into 2017 Read More
Ryan Raguse and Matthew Grassi
ProfessionalsIndustry Executives Talk New PrecisionAg Professional Brand
December 19, 2016
EFC Systems President and CEO Ernie Chappell Myriad Mobile Cofounder and Chairman Ryan Raguse Read More
PrecisionAg Professional logo
Industry NewsMeister Media Debuts PrecisionAg Professional
December 13, 2016
Agricultural technology is accelerating, and precision agriculture is gaining renewed interest across cropping systems. At the same time, growers are Read More
NDSU IoT
Sensors/IoTNew Farming Focused IoT Partnership Announced
December 13, 2016
Infiswift, an enterprise Internet of Things (IoT) platform developer, announces a partnership to develop IoT solutions with Acuitus Ag, an Read More
GVM E-Series cab
Ag Tech GlobalGlobalization And Precision Agriculture
December 7, 2016
Globalization has taken on a negative connotation in some circles in the U.S. in recent months. The lightning rod for Read More
Latest News
Farming big data style
Hort TechSpecialty Crops: Precision Agriculture And Big Data Gai…
January 23, 2017
This year, the iPhone will celebrate its 10th birthday. In only a decade, smartphones have found their way into just Read More
Sonny Perdue
Business ManagementAg Tech CEOs Weigh In On Trump’s Pick For Ag Secr…
January 20, 2017
With President-Elect Donald Trump’s selection of Sonny Perdue as the new proposed Secretary of Agriculture, it brings a new set Read More
BASF Maglis Grower Tablet
EventsRetailers, Consultants Untangle Software Decision Proce…
January 19, 2017
Today, business and agronomy management software is the engine that facilitates a smooth running ag business. The next software decision Read More
Ag Weather Service
Decision Support SoftwareSciFi in Ag: Will Amazon’s Alexa Control the Fami…
January 19, 2017
*Article Notes: This monthly column takes some crazy sounding ideas and applies them to the field of Ag Tech. The Read More
Data ManagementNew Partnerhship Between AgIntegrated, CDMS, SeediQ Wil…
January 18, 2017
AgIntegrated, Inc. (AGI), CDMS, Inc. and SeediQ announce a partnership to develop, promote, and sell a single-source crop input reference Read More
Corn Field Sunset
Ag Tech GlobalAg Technology Among Focus Areas For Kohli Impact Invest…
January 18, 2017
Tej Kohli, a serial entrepreneur, global businessman and philanthropist, has announced he has earmarked an initial $25 million USD, through his Read More
Terry Griffin
Business ManagementUsing High Tech To Make Farm Decisions
January 17, 2017
Raj Khosla, professor of precision agriculture at Colorado State University, challenged farmers to think about how far the technology of Read More
Decisive Farming My Farm Manager mobile app
Ag Tech GlobalLeading Canadian Farming Co-op Brings In New Tech To Bo…
January 17, 2017
Co-op, one of the largest agricultural retailers in Western Canada, is partnering with farm management company Decisive Farming to provide Read More
Business ManagementCNH Names Danford Industry Relations Manager
January 17, 2017
Dan Danford has been named Industry Relations Manager, Precision Solutions and Telematics (PS&T), for CNH Industrial, parent company of agricultural Read More
Australian Harvest
Ag Tech GlobalAustralian Precision Agriculture Market, Forecast To 20…
January 13, 2017
Research and Markets has announced the addition of the “Australian Precision Agriculture Market, Forecast to 2020” report to their offering. Read More
Norris planter
Innovation SeriesCompelling Consultant Panel Kicks Off Next Month’s Prec…
January 12, 2017
Jeremy Wilson, Technology Specialist at CropIMS and renowned precision expert, leads a panel of top precision consultants to kick off Read More
Data ManagementProspera Selected for Top 100 Artificial Intelligence R…
January 11, 2017
CB Insights today selected Prospera to the prestigious Artificial Intelligence 100 list (“AI 100”), a select group of emerging private Read More
Business ManagementBREAKING: FAA Considering Less Restrictive Commercial D…
January 11, 2017
FAA is working toward allowing more freedom for drone operators, and at the same time is working with NASA on Read More
DronessenseFly, Agribotix Combine eBee SQ and FarmLens Offeri…
January 11, 2017
Agribotix has partnered with senseFly to offer a new combined solution for professional users. This technology solution combines the top Read More
Sentera software
DronesSentera Announces NDVI Livestream Capabilities for Doub…
January 10, 2017
Sentera today announced the upcoming release of LiveNDVI Video: livestreamed NDVI video via Sentera’s Double 4K sensor. This breakthrough technology Read More
Young Corn Field
Ag Tech GlobalEurocontrol To Commercialize Precision Agricultural Ini…
January 9, 2017
Eurocontrol Technics Group Inc., a Canadian public company specializing in the acquisition, development and commercialization of innovative test and measurement Read More
Corn Field
Data ManagementWaypoint Analytical, Highland Precision Ag Announce Str…
January 9, 2017
Waypoint Analytical (WP), based in Memphis, TN, and Highland Precision Ag (HPA), based in Mulberry, FL, are pleased to announce Read More
Western Canada Wheat field
EventsSixth Annual Precision Ag Summit Set for January 16-17 …
January 4, 2017
The 6th annual Precision Ag Summit will be held Jan. 16-17, at the North Dakota Farmers Union Conference Center in Read More