Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

4 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Finalists-teams-Syngenta-Crop-Challenge-in-Analytics
Data ManagementData-Driven Strategies and Machine Learning Shaping the Future of Agriculture
April 26, 2018
Last week I attended the 2018 INFORMS Conference on Business Analytics & Operations Research in Baltimore, MD. Among the activities Read More
Farm-Storm-Clouds-Photo-Eden-Hills
Data ManagementThe Precipitation Problem in Agriculture
April 17, 2018
Precipitation is arguably the most important agricultural weather parameter, yet it is the most difficult variable to precisely measure. For Read More
Facebook-phone
Data ManagementWhat Lessons Can the Ag Industry Learn from the Facebook Data Breach? How to Tell if Your Ag Data is Secure
April 12, 2018
Today, a seemingly endless amount of ag data flows from growers’ fields into a host of technology platforms. It is Read More
Data ManagementREPORT: Bayer’s Digital Farming Business Slated for BASF Takeover
April 11, 2018
Germany’s Bayer plans to sell its digital farming business to BASF as part of changes to concessions it has offered Read More
Trending Articles
Farm-Storm-Clouds-Photo-Eden-Hills
Data ManagementThe Precipitation Problem in Agriculture
April 17, 2018
Precipitation is arguably the most important agricultural weather parameter, yet it is the most difficult variable to precisely measure. For Read More
SDSU-drone
Business ManagementInside the Key Strategies For Selling Precision Ag Services
April 13, 2018
In its earliest manifestation, the motive for developing precision agriculture service was entirely pure. Agronomists knew that crops were responding Read More
CROO Robotics’ automated strawberry harvester
Robotics/Labor SaversSpecialty Crops: Get in Gear Now for Agriculture’s Robotic Revolution
April 11, 2018
While the immigration debate rages on in Washington, DC, with little chance for reform in sight, the uncertain labor picture Read More
InSiteDCM
Business ManagementDelivering on Ag Data Value
April 3, 2018
Bruce Baier is another deeply experienced precision agriculture manager who survived the early years of ag technology while riding the Read More
University-of-Georgia-photo-credit-USDA
Business Management25 Best Colleges for Precision Agriculture
March 21, 2018
Choosing the right college is a process. It’s one that I’m just now embarking on with my teenage daughter. Long Read More
Farmer-tablet
Decision Support SoftwareOpinion: The Missing Link in Precision Agriculture
March 15, 2018
The agtech boom over the last two years is indeed astonishing. Farmers are becoming more open to new, emerging technologies Read More
Latest News
Finalists-teams-Syngenta-Crop-Challenge-in-Analytics
Data ManagementData-Driven Strategies and Machine Learning Shaping the…
April 26, 2018
Last week I attended the 2018 INFORMS Conference on Business Analytics & Operations Research in Baltimore, MD. Among the activities Read More
Sentera-FieldAgent
Industry NewsSentera, The Climate Corp. Partner to Enhance Agronomic…
April 24, 2018
Climate FieldView customers can now enjoy seamless integration of Sentera FieldAgent on-field sensor and analytics products with FieldView, as well Read More
Field Sprayer
Sensors/IoTHere’s What’s Working with the Internet of Things ̷…
April 24, 2018
With the advent of the Internet of Things (IoT), we are now seeing farmers use more wireless technologies to increase Read More
Case-Header-2
Industry NewsAustralian Company Offers On Combine Analysis Technolog…
April 24, 2018
Next Instruments is an Australian manufacturer of instrumentation for the grains and food industries. Over the last 5 years Next Read More
corn field
Industry NewsNutrient Ag Solutions Launching New Digital Farming Pla…
April 24, 2018
Nutrien’s retail division – soon to be rebranded as Nutrien Ag Solutions – has announced the launch of a new Read More
Industry NewsClimate Corp Announces 5 New FieldView Integrations
April 23, 2018
The Climate Corporation announced the addition of five industry-leading partners to The Climate Corporation’s Climate FieldView digital agriculture platform. The Read More
Laura_Crook_WinterWheat_Blackgrass_PrecisionAg
Industry NewsKansas Software Outfit Ag Developer Announces agX Integ…
April 23, 2018
Ag Developer, a Kansas based software development company, is simplifying grower/advisor communications by connecting to the agX Platform, according to Read More
field_in_back_1000_wd-featured-image
Industry NewsAyrstone Introduces High-Speed WiFi System for Farms
April 20, 2018
WiFi has become a necessity, and a proliferation of new WiFi devices have come to market for urban homes and Read More
Indian-Agriculture
AsiaIndian IoT Platform for Pre and Post Harvest Raises See…
April 19, 2018
Indian startup AgNext has raised an undisclosed seed round led by India-focused Agtech VC Omnivore Partners along with Singaporean angel Read More
Bayer-Forward-Farming
Industry NewsMaryland Farm Opens as Hub of Learning about Sustainabl…
April 19, 2018
Fourth-generation Maryland farmer Trey Hill measures the success of his operation not just by how many bushels of corn, soybeans, Read More
THRIVE
Industry NewsAgritech Startup Backers Announce New Corporate Partner…
April 18, 2018
Entering its fourth year, the THRIVE Venture & Innovation platform announced today the nine finalists and investment in its spring Read More
computer-in-field
EventsFinding Our Way in the Business of Precision Agricultur…
April 17, 2018
Service providers are the essential link between precision agriculture products and practices and the farmers who are increasingly relying on Read More
Farm-Storm-Clouds-Photo-Eden-Hills
Data ManagementThe Precipitation Problem in Agriculture
April 17, 2018
Precipitation is arguably the most important agricultural weather parameter, yet it is the most difficult variable to precisely measure. For Read More
Digital-Farming
Business Management7 Factors That Could Make or Break Digital Farming
April 13, 2018
Digital farming is the new technology genie – a genie that is now out of the bottle and cannot be Read More
SDSU-drone
Business ManagementInside the Key Strategies For Selling Precision Ag Serv…
April 13, 2018
In its earliest manifestation, the motive for developing precision agriculture service was entirely pure. Agronomists knew that crops were responding Read More
Facebook-phone
Data ManagementWhat Lessons Can the Ag Industry Learn from the Faceboo…
April 12, 2018
Today, a seemingly endless amount of ag data flows from growers’ fields into a host of technology platforms. It is Read More
DronesWhen High Value Crops Meet Inaccessible Areas: How Dron…
April 12, 2018
Avocados are one of the few crops in Chile that can economically be commercially cultivated on hills. On one hand Read More
Almond-trees-blooming
Sensors/IoTWhy Virtual Sensors Could Save California’s At-Ri…
April 12, 2018
To say that the Golden State can lay claim to the title of king of almonds might be an understatement. Read More