Where Is Imagery in Digital Farming?

Where Is Imagery in Digital Farming?

I was recently asked, “Where is imagery in digital farming?” Imagery, especially from satellites and increasingly from drones, is often proposed or inferred as the core functionality of digital farming. Why else would almost every digital farming discussion center on it and every platform lead with it as its centerpiece functionality?

Advertisement

Digital farming is about two key objectives. The first objective is getting inside the decision loops of the cultivation and making decisions before they become a risk. The second objective is enabling digital farming, the digital twin, to use its data to anticipate, assess, and explore alternative courses of action.

The user must first understand the agricultural decision cycle, and then the user must separate the variable data from the invariable data. The agricultural process will contain continuous decision loops throughout the cultivation, and the invariable data will provide the foundation for decision analysis. On the other hand, the variable data will enable the development of decision information.

The agricultural decision process looks like a decision loop developed in the 1960s for the military. It was called the OODA loop. From Wikipedia: “The OODA loop is the decision cycle of observe, orient, decide, and act, developed by military strategist and USAF Colonel John Boyd.“

For agriculture, digital farming might employ a modified OODA Loop for its decision loop. The modified OODA Loop is: Indication, Detection, Identification, Localization, Mitigation, and Validation. The Observe step is Indication. The Orient steps are Detection, Identification and Localization. The Decide step is deciding upon mitigation based upon analysis from the digital twin. The Act Step is Mitigation and Validation.

Imaging is used at the Detection, Identification, Localization, and Validation steps. Imaging exists inside of the decision loops for each of these steps and only exists to develop the decision information required for each loop. Each imaging technology has its optimum OODA use case.

Imaging provides both variable and invariable data. The best known of the imaging technologies measures the amount of the incident energy that is reflected by vegetation, soil, and other artifacts in the cultivation. These imaging sensors have varying spatial, spectral, radiometric, and temporal resolutions, and each has an optimum utility in the decision process. Other sensors that that might be used include Light Detection and Ranging (LIDAR), Synthetic Aperture Radar (SAR), and earth penetrating radars. These sensors transmit a pulse of incident energy and then measure the reflected energy, including the time and intensity of the return. This data tends to be invariable.

File sizes for imaging environments are massive and are often measured in multiple gigabytes. Generating, collecting, managing, and analyzing this data is expensive. The size of the files demands that they are optimally used and managed before sensing starts. It also demands application automation and integration. Automation and integration can only be accomplished when Imaging is aligned with its specific decision loop.

To date much of the imaging has generated information about the cultivation that does not support a decision, is not automated, and has already happened. Imaging today often has limited contribution to the overall decision process. This might be because it was the wrong sensor, the wrong resolution, or analyzed too late to do any good. Imaging’s contribution to the decision process is where it establishes its value.

When does imaging technology get used, how often, and what is its objective? The following is a sample of where imaging is in a digital farming sequence. There are potentially many different decision cycles that could be synthesized; each decision cycle will be crop and objective dependent.

As a functional starting point there are some key takeaways that were stated in the previous article about a digital farming system. Many of these factors represent invariant data. First, soil is the productive asset. There needs to be a digital soil model in this ecosystem, i.e., a digital twin that models the soil and its productive capability. Soil is the common denominator; one cultivation to the next. Next, seed production generates a wealth of information about that crop and the metrics for that production are available to the next cultivation. This includes crop and variety information like time to first emergence, timing of vegetative states, root growth profiles, nutrient and moisture utilization, and fruit size and maturation. Finally, the stresses that impact the cultivation are persistent. The geo-location and persistence of these stresses applies to weeds, fungi, insects, and biologicals. Early indications of these stresses are locked in the memory of the soil, and the digital twin will remember exactly where.

These data and their metrics can be statistically described, and these results can be used to digitally predict, specify, and schedule when imaging events in the next cultivation should be happening. This “memory” can be used to develop the indication, and like seed production their occurrence can be predicted and used to develop the various OODA loops.

Some examples of imagery used in digital farming include:

  1. Using LIDAR to establish and determine the topography of the field. Topography is the height of each soil asset relative to the soil assets around it. LIDAR systems on airborne systems can develop topographic or elevation maps of a field in a very short time, and LIDAR can provide resolutions in centimeters/ inches. This map with Electrical Conductivity maps will assist in determining where to take soil samples. Its value will be reinforced over and over as it gives insight to the soil horizons and soil contents at depth.
  2. The next area might be crop emergence. We know what the planting plan was and when it was implemented, and we can geo locate every seed. The computer can anticipate emergence, and with imagery it can count each seed with unitary precision. With emergence the digital twin can predict time to vegetative states, crop moisture and nutrient usage and requirements, potential fruit sizes, and production yields. It can execute this process for every seed if required. Each of these predicted steps gives rise to a new OODA loop.
  3. The digital twin will provide indications from memory or from environmental inputs that indicate the presence of these stresses, and properly used imaging will note the possible first detection of these stresses. The digital twin will predict when to start the next OODA Loop. Each stress will have its own signature, its sensible profile, and its temporal offset. This data in a digital twin defines the imaging technology and when and where to look beyond indication to achieve detection, identification, and localization.

Indeed, imagery is a part of digital farming, and, potentially, it is useful at many steps in the decision process. The image requires a level of precision that enables the required decision. It should be appropriate to the action required and no more, but its value is as a complement to the decision process to provide the valuable inputs that support detection, identification, localization and validation. It should seek to inform the process before an event so that it is inside the decision loop and there is time to take the appropriate action.

Leave a Reply

Appreciation, is the right world to thank you for such excellent article Michael. I could not stop underlining all the key points of your narrative. Translating your ideas into validations that will make business sense — specially for new Agtech companies emerging everywhere — is no easy task, needless to say from an investment perspective. Business model for many Agtechs addresses decision cycles poorly. Decision cycles evokes critical processes and these are often overlooked, that’s why I think your article is so helpful in seen through these from a real and practical viewpoint. I love when you said that “… image requires a level of precision that enables the required decision ….to provide the valuable inputs to support detection, identification, localization, and validation” which, for me translates into the last delivered mile of real value. From a business/investment point of view, this is absolutely critical. The impact of imagery in supporting real management decisions which, in turn, will deliver and have direct impact on production outputs is, perhaps, the single most important asset for sustaining growth for the emerging Agtech companies (startups especially). Again, thanks for this clear and educational article.

Michael Collins says:

Paulo, Thank you for the comment. I have spent a lot of time in the subject of imagery. Satellite, airborne, and drone. The key is the sensor and what it is you need to “see”. It is about spectral, spatial, radiometric, and temporal resolution. It is about the analytics needed to process and the decision that must be made. What I have seen is that there is a focus on NDVI and multi-spectral… when all you have is a hammer everything is a nail. I see need for high spatial resolution monochrome, hyperspectral in 1-2 nanometer wide measures, and even occasional LIDAR. The crop, the cultivation cycle and the decision loop will help specify the need. I would suggest that for every situation there is a standard Statement of Work and a templated task specification that would capture this need for each decision. This could be easily evaluated for its contribution to the business. At the end of the day it is about profit. I would apply this same measure to IoT and the infrastructure that it requires. I am building a couple of more articles that hopefully will bring all of this together. I have had a couple of excellent conversations about the economics of imagery and the state of technology. Again, thank you for the comments. Michael Collins

Topography and elevation are not the same thing. Elevation is an instant map. Topography is a massive job.

Michael Collins says:

Cory, Thank you for your reply. I did mean topography and I do know how difficult that it is. I built a couple using QGIS and participated in others with ARCGIS. I do mean topography and this can be used throughout the imaging process to determine a number of cultivation factors like crop height, etc. It is useful for soil and other factors. I did not mention elevation. On a macro scale of geological constructs I can see the need for elevation but in the immediacy of the Digital Farming initiative I am interested in topography including buried artifacts, boundaries, and geological artifacts that impact hydration, nutrients, and soil horizons. I have written a couple of follow on articles and in those I also specify topology. I also say that the user should not be burdened with manipulating this data to get it. Again, thank you. Would you like to discuss this further? Michael Collins