Friday, May 20, 2016

Calculating Volumetrics

Introduction:

Aggregate processing operations in Wisconsin are under strict legislation, regarding where water flows, and dust travels, in order minimize their ecologic impact. These operations are also required by the DNR to record the volume of material on their site each month. These volumetric calculations are often performed using rudimentary methods. For example, there has been speculation that some mine operators perform their estimations based on the relative size of the pile to the surveyor's thumb from a specific distance. Other methods require the operator to walk around the base of the pile, estimating the volume of the pile based on the number of steps taken around it. Some mine operators use laser range finders to record the height, width, and depth of their piles, for specific calculations they've developed. These methods are not only extremely time-consuming, but it is also difficult to detect the error incurred by using these methods.

By using UAS, the calculation of aggregate volumes can be performed faster and more accurately than through the manual survey methods. If permanent GCPs are installed at the mine site, the entire survey could be performed in less than 30 minutes, and the volume measurements could be obtained within a day of the flight.


Methods:

Data from three separate UAS flights were used for the volumetric calculations: on October 10th, 2015,  March 14th, 2016, and May 2nd 2016. Three piles were chosen for the volumetric calculations based on changes detected in their appearance between flights. The edges of the piles were digitized, however, the digitized lines follow the edges loosely, to reduce the overall error in the calculations.

The volumes were calculated using the following workflow. First, the pile edge polygons were buffered by 5m. Second, the DSM of each image was clipped to the boundary of each buffered pile. Next, the clipped rasters' cells were converted to points using the 'raster to point' tool in the ArcGIS conversion toolbox. The cells within the piles were eliminated using the 'erase' tool and the digitized polygons as the erasing features. The ground surface below the pile was then estimated using 'IDW' interpolation using the remaining points as the input feature class, and the clipped raster to set the 'Cellsize', 'Extent', and 'Snap Raster' tool environments. Once the surface was interpolated, the 'Cut Fill' tool was used to calculate the volume of each pile.

The volumes of each pile were recorded for each time period for which they could be calculated. The third pile's volume could only be calculated for the first two flights, as it was not fully covered by the third flight.

Results:

Pile 1 only changed by 2.3% of its total volume between the first and second flights, and this change could be entirely due to subtle differences in how the data were processed, accuracy of the gcps, etc. It saw a 138% increase between flights two and three (Figures 1-3).
Figure 1: The volumes for each pile from each flight.
Figure 2: The volumes per pile, graphed 

Figure 3: Pile 1 had very minimal changes (2.3% increase) between the first and second flights, but
saw an extremely large increase (138%) between the second and third flights.

Pile two was greatly reduced in size (42% decrease) between the first and second flights, and again (26.9% decrease) between the second and third flights (Figures 2 & 4).

Figure 4: Pile 2 was severely reduced between the first and second flights.
Pile three was reduced in size by 46.54% between flights one and two. The reduction of 1,947 m^2 was the largest single volumetric decrease based on these calculations (Figures 2&5).

Figure 5: Pile 3 saw a 46.54% reduction in volume between flights one and two. The removal of the material also
likely affected the drainage patterns of the site, potentially causing more water to collect in new basins.

The accuracy of these calculations cannot truly be determined at this point because only one volumetric method was undertaken. However, if additional methods were compared in the future, the accuracy of the individual methods could certainly be investigated.

Conclusions:

A white paper comparing the accuracy of LiDAR to UAS imagery processed using Pix4D was published several years ago, and their findings claimed the difference in accuracy between the two methods was less than 1%. The volumetric calculations performed for this lab could very easily be automated, potentially allowing the volumetric processing to be completed less than five hours from the imagery being captured (three hours allotted for Pix4D processing and one hour for volumetric change calculations). By calculating volumetrics using UAS, aggregate operations will save man-hours and have a more accurate idea of exactly how much material is distributed within their operations.

In the future, it may be prudent for aggregate operations to have flow models re-calculated when new volumetric flights are processed, as drainage networks are constantly changing. As the penalties for material escaping the mine are high, temporally and spatially accurate flow models may be extremely helpful for preventing such situations from occurring.

Monday, May 16, 2016

Point Cloud Classification & Hydrologic Modeling

Introduction:

Aggregate processing operations in Wisconsin are under strict permits, requiring all storm water to be internally drained. These measures are to ensure no fine sediment-laden water enters Wisconsin's waterways from the mine sites. If the sediment were to enter streams, it would damage habitat for numerous aquatic species, as eggs and food sources would become buried. If an aggregate operation fails to meet their permit requirements, they face steep fines. This project seeks to derive accurate flow models from UAS sourced data, in order to assess the drainage paths of water from an active aggregate operation.

When modeling surface water flow with a Digital Surface Model (DSM), vegetation can spuriously alter the direction, greatly reducing the accuracy of the results. In order to increase the accuracy of the flow models, vegetation will be removed using object-based Random-Forest classification and Esri point cloud tools.

Methods:

The imagery was captured using the Sentek GEMS sensor on May 2nd, 2016, and was recorded as an RGB and a single-band NIR jpeg images. The images were processed in the Sentek GEMS software, and were then aligned using Esri's 'image stack' tool. Next, the stacked images were imported into Pix4D with RTK-recorded GCP points. I ran the images with the GCPs, and generated a densified point cloud, orthomosaic, and DSM.

I used Trimble eCognition to perform object based segmentation on the orthomosaic. The classified results were next brought into ArcMap, and converted to polygons. The vegetation polygons were then used to classify the point cloud using the 'Classify Las by Feature Tool'. A Digital Terrain Model (DTM) was then generated from the classified point cloud.

Next, the culvert locations were digitized and burned into the DTM, and the reservoirs were filled to their holding capacities. The flow was calculated with these simulated capacities, in order to see how the water would flow in this situation.

The flow was modeled in an iterative manner. First, the algorithm calculated the total fill amount for each sink to flow into another. Next, the average fill value was used to perform fill, flow direction, and flow accumulation tools. The flow accumulation tool was visualized using 1/4 standard deviation breaks, and the value of the smallest break was used to run the con tool - limiting the flow accumulation raster to only values greater than 350. The output of the con tool was used to create stream links and calculate stream order. The stream order was then converted into vector for display and interpretation.

Results:

The DSM generated by Pix4D was very smooth, but didn't represent the landscape realistically overall (Figure 1).
Figure 1: This is the DSM generated by Pix4d.
The object-based "Random Forest" classification did well at identifying the leafy vegetation in most circumstances, however, auto-exposure problems with the sensor caused some issues with identifying features in over and under-exposed areas of the flight (Figure 2).

Figure 2: Vegetation Classification.
Following the classification of the point cloud, a DTM was generated, and the results were less than perfect (Figure 3). The poor results were due to the vegetation classifier's inability to accurately classify woody vegetation, leaving much of it unclassified (Figure 4).

Figure 3: This DTM was generated from the classified point cloud.
Figure 4: The pink polygons are the areas classified as 'vegetation' on the orthomosaic. The polygons were used to classify
points into the 'vegetation' class. Unfortunately, the vegetation identified during the classification process only partially classified the actual vegetation.


Figure : In order to more accurately model the flow, the vegetation was completely removed, the culverts were burned
into the DTM, and the reservoirs were filled to their outflow elevation.