Big Data & Precision Agriculture

GreenSeeker Sensor System

There is new term creating a lot of excitement in technological and scientific circles. It is “big data.” Big data refers to the generation of enormous amounts of data due to new technologies for measurement, collection and storage. Data are accumulated in such vast quantities that they defy conventional analysis techniques. As we will see, big data offers great opportunities but also major challenges. Before discussing how big data will impact precision agriculture, it may be instructive to learn how it has impacted another field which literally redefines itself through continuous observations.

The field of astronomy during the past two decades has undergone a rapid improvement in the ability of telescopes to collect data. If we assume that all data can be defined in terms binary digits or “bits,” then we can calculate how much data are in an image, book or table. This is because we can construct bytes from bits which numerically define colors, letters and numbers. The bigger a telescope is for making observations, the more data are collected in the same interval of time. The greater the density of picture elements or pixels in the same viewing area of a telescope, the more data are collected in the same interval of time. The faster the recording of images in a telescope of the same size and pixel density, the more data are collected in the same interval of time. With each new telescope launched into space or constructed on the ground, there has been acceleration in data realization.

The improvement in telescopes along with their “big data” capabilities is best illustrated through examples. The popular, exoplanet-hunting Kepler telescope, launched by the U.S. National Aeronautics and Space Administration (NASA), has a density of 95 million pixels with the capability to sum imaged data over 30-minute intervals. The Kepler telescope can precisely measure the light emitted from over 100,000 stars. This periodic tracking of stars has increased the number of known exoplanets from in the tens to in the thousands. The Atacama Large Millimeter Array (ALMA) is an international collaboration of ground-based, radio telescopes to observe galaxies, stars and planet formation. It began generating 40 terabytes of data per day when it became fully operational this year. The Large Synoptic Survey Telescope (LSST), a public-private partnership, has a 3-billion pixel density. It will be able to image an area of the sky that is 49 times the size of the Moon when it becomes operational in 2015. It has been estimated that there is now a doubling every year in the amount of data being collected in the field of astronomy.

The exponential growth of data requires new thinking on how to look at data. Today, it is humanly impossible to look at all but a tiny portion of astronomical data using conventional analysis. Consequently, in place of humans, computer programs conduct comparative analysis on large stores of data. Through a step-by-step procedure of calculations and/or comparisons, programs in the form of algorithms reveal patterns in large data sets. For example, in the case of the Kepler telescope, the tell-tale variation in light from a star reveals the presence of an orbiting exoplanet. A computer program can identify this variation with an algorithm and conduct an analysis of a star’s extended time series in the blink of an eye. While new telescopes are generating “astronomical” amounts of data, new algorithms are being written to analyze these data.

New Ways Of Thinking Needed

While agriculture is a latecomer to the big data phenomenon, it will soon follow a similar path as astronomy. Precision agriculture, with its time-dependent, geospatial data at the field scale, will be front and center in the realization of big data in agriculture. As sensors are placed on machinery, arrayed in soils and canopies and flown remotely overhead, the amount of data collected in the field will increase geometrically. As was the case in astronomy, it will be become humanly impossible to analyze data collected in an agricultural setting. And like in the field of astronomy, computer programs will be relied upon to conduct nearly all the analyses of large data sets.

Big data by its sheer volume of information offers a number of opportunities for precision agriculture. At the most rudimentary level, ingested data can be analyzed in real-time to flag critical values important for production decision-making. At a more sophisticated level, high resolution spatial maps of soil moisture can direct the efficient use of irrigation. Similarly, detailed maps of pest damage can allow for the precise targeting of controls in a field. At the most advanced level, remote-sensed data coupled with measurements made with sensors on machines or arrayed on the ground can be processed to create a dynamic, three-dimensional picture of soil, plant and environmental properties in a field. This picture would be composed of many layers of data, which singly or together can support specific management decisions.

The big data opportunities can be overshadowed by their challenges, especially in the early going. First, there are very few “data” scientists or persons who know how to create and execute the algorithms necessary for analyzing large of amounts of data. Second, there is commonly a mismatch in the scale, precision and accuracy of data coming from different sources. This mismatch can create an erroneous picture of what is actually happening in a field.

Third, big data, like all data, needs to be quality controlled before it is used in algorithms. The necessary quality control procedures can become pretty elaborate and time-consuming. The fourth and most important challenge is the interpretation of products created by algorithms processing large data sets. Interpretation of data patterns is very subjective. Every individual has their own way of looking at the world according to their beliefs, prejudices and preconceived notions of acceptable outcomes. Consequently, no two individuals will reach exactly the same decisions after interpreting big data patterns.

We can conclude that big data will increasingly become part of precision agriculture and will heavily influence our production decision-making in the not-too-distant future. We can also conclude that there will be a learning curve on the part of agricultural stakeholders making decisions based on big data.

The incorporation of big data in decisions, while challenging, may be one of the things precision agriculture needs to do to get back on a growth curve.

Leave a Reply

4 comments on “Big Data & Precision Agriculture

  1. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

  2. Without any doubt and in a complete agreement with the article: "programs in the form of algorithms reveal patterns in large data sets". Certainly a big challenge is use in presicion farming area those tools coming from the multivariate statistics field.

Data Management Stories
Data ManagementInfoAg News: Farmobile Launches DataEngine, Streamlines DataStore Buyer Process
July 17, 2018
Busy times these days out in Overland Park Leawood, KS, for ag data startup Farmobile, as they continue to – Read More
Farmer-Tablet
Data ManagementAgriculture’s Next Breakthrough: New Technologies Are Driving Efficiency, Data Insights
July 3, 2018
We live in an exciting time in agriculture. Not only is technology advancing rapidly, but the understanding and comprehension of Read More
Data ManagementThe Most Overlooked Asset in the Agtech Revolution
June 25, 2018
There is no doubt that advancements in genetics, precision agriculture, and innovative farming practices have all played an instrumental role Read More
Soil-Corn-plants-field
Data ManagementRemote Soil-Sensed Management Zones Help Increase Crop Input Efficiency
June 18, 2018
Accurate prescription maps are essential for effective variable rate technology (VRT) fertilizer application. Grid soil sampling is frequently used to Read More
Trending Articles
ISPA-Yoshua-Bengio
EventsHighlights from the 14th International Conference on Precision Agriculture
July 9, 2018
The 14th International Conference on Precision Agriculture (ICPA) presented by the International Society of Precision Agriculture (ISPA) was held in Montreal, Read More
Topcon X30 Console in cab
EventsAssociation Seeks Definitive Definition of “Precision Agriculture” — What’s Your Vote?
July 2, 2018
More than two-dozen definitions of precision agriculture have been identified through the years — but which is the best and Read More
AmericasRaven Name to Grace New South Dakota State University Facility
June 27, 2018
According to a press release issued by the company, Raven Industries was recognized today in the naming of South Dakota Read More
dropcopter
DronesNew York Apple Orchard Claims World First in Pollination by Drone
June 18, 2018
Beak & Skiff Apple Orchard in LaFayette, NY, is the first orchard in the world to use drones to pollinate Read More
JDandPessl
Sensors/IoTJohn Deere, Pessl Instruments Team Up to Create Opportunities
June 18, 2018
John Deere is best known for its line of tractors, combines, sprayers, and implements. However, in an effort to help Read More
Matt-Waits-featured
Decision Support SoftwareSST’s Matt Waits: Innovative Data Solutions Key to Transforming Global Agriculture
May 31, 2018
Proagrica, part of RELX Group, earlier this year acquired U.S.-based precision agriculture solutions company, SST Software, in a move set Read More
Latest News
Uncategorized2018 CTIC Conservation In Action Tour: Bringing Back th…
July 20, 2018
We here at PrecisionAg.com and PrecisionAg Professional recently had the opportunity to attend the 2018 Conservation Technology Information Center’s(West Lafeyette, Read More
Tools & Smart EquipmentCanadian Planter Manufacturer Purchases Harvest Interna…
July 19, 2018
Seeding and planting technology innovator Clean Seed has signed an agreement to strategically acquire U.S. planting equipment manufacturer Harvest International, Read More
Data ManagementInfoAg News: Farmobile Launches DataEngine, Streamlines…
July 17, 2018
Busy times these days out in Overland Park Leawood, KS, for ag data startup Farmobile, as they continue to – Read More
Agrible
Grower Services & SolutionsNutrien Drops $63 Million to Acquire Agrible
July 16, 2018
Nutrien announced today that it has entered into a definitive agreement to acquire Agrible for total consideration of $63 million, Read More
Industry NewsFarmobile Acquires Prime Meridian, Taps Cubbage as New …
July 13, 2018
Farmobile today announced an agreement to acquire the assets of Prime Meridian, a precision agriculture data management company based in Read More
group-photo
DronesPrecision Agriculture Takes Flight at North Carolina St…
July 13, 2018
Take a walk into the Suggs Laboratory for Precision Agriculture and Machine Systems and it’s hard not to be impressed, Read More
Skeketee-IC-Weeder
DronesAutomated Weeders Have Arrived in Vegetable Fields
July 12, 2018
The vegetable production areas of the Central Coast of California have lifted vegetable cultivation to a high art, writes Richard Read More
AgJunction, InfoAg 2014, Autosteer, GPS
Industry NewsAgJunction Settles with Raven in Patent Infringement Su…
July 12, 2018
AgJunction Inc., a leader in advanced guidance and autosteering, has settled a patent infringement lawsuit it filed against Raven Industries, Read More
Retailer-Grower-tablet
Business ManagementTaking Measure of the Precision Agriculture Program: 6 …
July 12, 2018
In the overall agriculture market, the rhetoric surrounding emerging technology over the past half-decade has been nothing short of breathless. Read More
raven-slingshot-job-generator-job-sync-1
Industry NewsNew Raven Slingshot Advancements Will Help Save Time, R…
July 11, 2018
Raven Industries, Inc. has announced several new services available on the Slingshot and Viper 4 platforms: Job Generator and Job Read More
Onsite-logo
Industry NewsAgIntegrated Acquires Exclusive Licence to Satshot’s Im…
July 11, 2018
AgIntegrated, Inc. (AGI), a leader in precision ag data integration and software development, and Satshot, a leader and pioneer in Read More
Australian Harvest
Australia/New ZealandAustralian Agritech Plants Blockchain for Efficiency
July 11, 2018
“Agritech” at one time would have meant new equipment such as tractors and combine harvesters, but today it refers to Read More
Tomato-crop-India
AsiaIndia: Using Artificial Intelligence for the Good of Fa…
July 11, 2018
After graduating from IIT-Madras, the first thing that Vivek Rajkumar did was to buy four acres near Thiruvananthapuram and start Read More
BrightFarms
Industry NewsForbes List of Innovative Ag-Tech Companies Includes Gr…
July 9, 2018
Forbes magazine recently posted a list of the 25 most innovative ag-tech startups in 2018, which includes a few companies Read More
AmericasNutrien Ag Solutions Brand, New Digital Platform Launch…
July 9, 2018
Nutrien (formerly Crop Production Services) has officially rebranded its retail business to Nutrien Ag Solutions, aligning the company’s retail operations Read More
ISPA-Yoshua-Bengio
EventsHighlights from the 14th International Conference on Pr…
July 9, 2018
The 14th International Conference on Precision Agriculture (ICPA) presented by the International Society of Precision Agriculture (ISPA) was held in Montreal, Read More
TerrAvion
Industry NewsTerrAvion Integrates Aerial Imagery with John Deere Ope…
July 6, 2018
TerrAvion, Inc., a large volume provider of aerial imagery to agriculture, has announced an integration to allow TerrAvion’s aerial imagery Read More
Farmer-Tablet
Data ManagementAgriculture’s Next Breakthrough: New Technologies…
July 3, 2018
We live in an exciting time in agriculture. Not only is technology advancing rapidly, but the understanding and comprehension of Read More