When a Cessna fixed-wing aircraft took off over an Austrian alpine region on an early morning day in August 2016, it ascended carrying two crew, a large-format digital camera, a bit of uncertainty, and a whole lot of risk.

The plane’s mission was part of an overall project to provide a precise, as-built survey of a 40-kilometer (24-mile), narrow stretch of railway in the Lower Inn Valley east of Innsbruck. Although this wasn’t an unusual task for a surveying company, the required accuracy of the project was: 2-cm (0.8-in) horizontal and vertical accuracy for the entire area of interest (AOI).

“Airborne mapping surveys under 5-cm (2-in) accuracy are rare in alpine environments because the mountainous terrain is treacherous and unpredictable,” says Klaus Legat, head of the photogrammetry and aerial survey department at Vermessung AVT, a surveying company based in Imst, Austria. “To achieve 2-cm resolution we would have to fly about 500 meters above ground within a very narrow air space, making maneuvering tricky. And for this specific railway section, we’d need to supplement the aerial imagery with ground imagery, precise control points, and software that could integrate all the data into an accurate, true-to-life map of the AOI. Neither we nor the client had ever taken on such a task before so this would be a proof-of-concept test to see whether modern surveying techniques could deliver such high accuracy over a large area. It was a risky proposition.”

But, it proved to be a successful gamble.

Integrating GNSS technology, aerial imagery and LiDAR data, mobile mapping technology, and advanced image processing software, AVT proved not only that its multi-sensor, data fusion approach was a solid bet, it’s given the company the confidence and experience to pursue similar high-precision alpine mapping projects, pioneer new business developments and reap the rewards of an expanded service area, project portfolio, and revenue stream.

Placing Their Bets

Based in Imst, about 50 km (30 miles) west of Innsbruck, the Alps are in AVT’s backyard, making mapping and surveying mountainous environments a natural focus since the company’s inception in 1970. With such a perfect testbed for researching methodologies and technologies, AVT has become quite comfortable and experienced in the notoriously difficult alpine regions, pushing their photogrammetric capabilities to the point where they routinely provide ground-resolution accuracies of 5 cm or better.

The Lower Inn Valley (LIV) railway project would push them further.

A double-track, high-speed main line of the Austrian Federal Railways (ÖBB), the LIV railway is a core part of the Trans-European Transport Networks (TEN-T), a high-performance railroad that will eventually connect southern Italy with northern Europe.

AVT’s target was the 40-km section between the Austrian towns of Kundl and Baumkirchen (KB), the first segment of the LIV that opened in November 2012. Designed for speeds up to 220 km/h (124 mph), the KB dual railway crosses the Alps and is the northern connection to the Brenner Base Tunnel, a 64-km-long (40-mile-long) tunnel between Austria and Italy scheduled for operation in 2026.

In 2016, ÖBB Infrastruktur AG issued a tender for a final as-built measurement of the above-ground areas of the new line, the converted sections of the existing line and any objects within 100 m (328 ft) of the tracks themselves. In addition to the 2-cm vertical and horizontal accuracy requirement, ÖBB specified that access to the tracks was prohibited, so a purely terrestrial measurement technique wouldn’t be possible. There was also another complication: the tracks were lined by up to 6-meter-high (19-ft-high) noise-prevention walls.

“Because we couldn’t access the track, we had to choose aero photogrammetry,” says Legat. “But the prevention walls and other obstacles would hide many along-track features from the plane’s nadir-looking camera. So our approach was to pair an aerial survey with mobile mapping. The aerial data would give us both the railway detail and the area outside the walls, and the mobile mapper would give us the ancillary features not visible from the plane.”

Critical to the multi-sensor approach, however, was the ability to integrate the diverse data formats into one image processing software to create precise orthophotos and a seamless orthomosaic. AVT selected Trimble’s Inpho Suite to process its data. Inpho is a set of photogrammetry modules for transforming aerial imagery into orthophoto mosaics, point clouds, and other 3D datasets.

“Inpho can work with both analog and all brands of digital cameras,” says Legat. “That flexibility and interoperability is quite important for us and saves us significant data processing time. It also is quite good at triangulating and multi-ray image matching which is the foundation for producing accurate results.”

Rolling the Dice

To achieve consistently high accuracy over such a long distance, AVT needed to first establish both a precise control network and a network of ground control points (GCPs). In an effort to minimize atmospheric disturbances, they chose to create the control network through a static observation, night survey. Using two permanent base stations situated near the center of the AOI, crews set out 30 GNSS receivers on pre-determined locations and the units simultaneously collected measurements for 12 hours. The permanent survey established a base network precise to 0.5 cm (0.2 in).

For the GCPs, teams painted markers on concrete or other hard surfaces at 2-km (1-mile) intervals around the 40-km area and measured the center points of each with shorter, static observations of about two hours. They set five points at a time and laid out a total of 50 GCPs with a horizontal accuracy of 1 cm (0.4 in).

With the control networks set, AVT could dispatch their flight crew to collect aerial imagery with a ground sample distance of 2 cm. Flying at an altitude of 450 m (1,476 ft) and an average speed of 200 km/h, they covered the entire AOI in two hours. They flew 21 flight paths in an east-west direction and collected 1,300 images with their Vexcel large-format digital camera. The images had a 60 percent overlap and the average lateral overlap between the flying segments was about 50 percent.

Per ÖBB’s request, they also carried out a secondary aerial LiDAR mission to produce detailed point clouds to generate digital terrain and surface models. Reducing the altitude to 200 m, a crew collected LiDAR data with a point density of 25 points per square meter and a side-overlap of 70 percent.

Completing the data collection campaign was a terrestrial survey using a Trimble MX7 mobile imaging system. A vehicle-mounted photogrammetric system, the MX7 is equipped with six, 5 megapixel cameras, and Trimble Applanix GNSS and inertial georeferencing modules. The system was mounted on the roof of a small van that was placed on a truck-transport wagon which in turn was pulled by a special locomotive of the ÖBB. Maintaining an average driving speed of 50 km/h, the MX7 captured a 30MP panoramic image every 4 meters (13 ft) along each of the KB tracks and acquired important features such as switching boxes, passenger benches and electrical housings that were not visible in the aerial photogrammetry. Along the railway there is a 600-meter-long (1,698-ft) tunnel which required the AVT team to install six LED headlights to compensate for the low-light conditions and enable them to capture features inside the tunnel walls. In total, the MX7 system collected 20,000 images.

“This was our first experience with the MX7 so we weren’t sure how well it would perform,” says Legat. “It not only complimented our aerial campaign and captured the essential ground elements but it performed surprisingly well in the tunnel. We knew acquiring features with LED spotlights would be challenging, but the cameras’ rapid exposure times enabled us to capture darkened features.”

Into the Ortho

After downloading and processing the aerial images and aircraft trajectory data, AVT personnel imported that data as well as the GCPs into the Match-AT georeferencing module of Inpho to automatically triangulate the images. Using an image pyramid process, the software analyzed the 1,300 images and automatically pinpointed 15,500 common features or tie points (TPs) across the images, with an average of 200 TPs per image. The precisely surveyed GCPs were measured in the images and the Match-AT module used a bundle-block adjustment process to automatically and precisely orient the imagery. The accuracy of the GCPs in the AT was around 1 cm in planimetry and altimetry.

“The triangulation needed to be done as precisely as possible to ensure we could achieve the vertical accuracy,” says Legat. “So investing in our ground control was crucial, but we also needed image processing software that could deliver on the precision requirements. As a long-term user of Inpho, we haven’t found any software that can rival Match-AT’s triangulation abilities or its intuitiveness.”

With the OrthoMaster module, the software automatically orthorectified the individual images with a ground resolution of 2 cm. Switching to Inpho OrthoVista each orthophoto was then stitched together to create a 2D orthomosaic for the whole AOI. Experienced AVT operators used the OrthoVista Seam Edit tool to manually check the seam lines to ensure they didn’t cross objects like bridges which would be distorted in the mosaic. Any imperfections were fixed to create a seamless, color-balanced and geometrically correct orthomosaic of the 40-km-corridor.

“This was such a satisfying achievement ... it has raised the profile of our multi-sensor fusion technique and given us the confidence to pursue similarly challenging projects.”

– Klaus Legat

AVT personnel used the Inpho interface to export the aerial images into DAT/EM Summit Evolution (DSE) software to create a 3D vector map of all railway-related features. The map was customized and finalized in AutoCAD.

In parallel with the aerial mapping, a team processed and precisely georeferenced the MX7 imagery to map objects that couldn’t be seen in the aerial images. They first determined the path of the MX7 using the accurate GNSS/INS data recorded during the ride. They manually selected several hundred 3D points that had been determined as multi-ray TPs (aerial GCPs) within Match-AT, and used them to orient the MX7 images to ensure the maximum consistency between the aerial and mobile-mapping data. They then extracted and mapped the mobile-mapping objects and exported the results to Auto-CAD to produce the finalized 3D vector map showing the specific layers and symbols defined by the ÖBB.

To process the aerial LiDAR data, personnel extracted approximately 300 horizontal patches, or surface sections, from the data and determined the mean height and standard deviation per patch. They imported this data into Match-AT as vertical-only GCPs with a 2.5 cm standard deviation. The ground points were used to process a digital terrain model and to derive height isolines, the latter of which were integrated into the 3D vector map.

Both the 2D orthomosaic and 3D vector map were delivered to the ÖBB in August 2017 and the authority conducted several independent evaluations to assess the quality and accuracy of the datasets. AVT’s results were given full approval.

“This was such a satisfying achievement,” says Legat. “The project proved that with the right tools and approach, incredibly precise photogrammetry-based maps can be produced for the difficult alpine environment. More importantly, it has raised the profile of our multi-sensor fusion technique and given us the confidence to pursue similarly challenging projects.”

To check out more of our technology innovations stories, click here!

The successful proof-of-concept has indeed led to further work with the ÖBB and piqued the interest of other organizations who service alpine communities. AVT is using the same flight data to support ÖBB’s needs on the LIV railway and is scheduled to wrap up current LIV-related projects in mid-2019. And, an Austrian electricity provider wants the company to map its electrical network at a horizontal and vertical accuracy similar to the KB railway. It’s a safe bet that for the next high-precision mapping project, AVT’s plane and its crews won’t be carrying the same amount of uncertainty or risk.