A WEB-BASED APROACH FOR ONLINE DIGITAL TERRAIN MODEL AND ORTHOIMAGE GENERATION

advertisement
A WEB-BASED APROACH FOR ONLINE DIGITAL TERRAIN MODEL AND
ORTHOIMAGE GENERATION
Z. Paszotta, M. Szumilo *
Dept. of Photogrammetry and Remote Sensing, University of Warmia and Mazury in Olsztyn,
ul. Oczapowskiego 1,10-719 Olsztyn, paszotta@uwm.edu.pl, malgorzata.szumilo@uwm.edu.pl
Commission IV, WG IV/5
KEY WORDS: Internet/Web, Matching, DEM/DTM, Orthoimage, Programming, Orthorectification
ABSTRACT:
Currently, the Digital Terrain Model (DTM) and orthoimages have become standard geospatial products. However,
photogrammetric systems used for generating them still remain desktop or workstation based systems. This paper outlines an
innovative concept of DTM generation and geospatial image orthorectification over the Internet. The article contains description of
algorithms for automatic DTM and orthoimage construction. DTM is an element that is necessary in the process of creating
orthoimages and has a crucial influence on their cartometric attributes. Thus, it is extremely important to determine sources of errors
that can influence the accuracy of the Digital Terrain Model constructing photogrammetric methods. Last part of the article contains
presentation of Internet application dedicated to DTM and orthoimage construction and their quality assessment. Several Java clientserver web applications were developed. In practice the application of the proposed algorithms is based on the system of a central
unit (a server of applications and Web pages) and customer computers equipped with standard Internet browsers. It is possible to
access this application from the Internet site of Department of Photogrammetry and Remote Sensing UWM in Olsztyn
(http://www.kfit.uwm.edu.pl/zp.html) by selecting the “Orthophoto generation” projects. Opportunities of networked DTM
generation and image ortorectification have had a great impact on the development of geo-information processing.
1. INTRODUCTION
New technologies have always been a key driving force in
geographic information science. The Internet has opened up
fantastic new opportunities for applications. There is an
abundance of powerful, inexpensive personal computers and
mobile devices that can access the Internet and run these new
applications. The Internet also provides a new possibility for
visualization of aerial and satellite images and other mapping
datasets (Dai, et al., 2007). The needs of geospatial information
obtain in the near real-time is also important for example to
change detection or environmental monitoring. One of such
data source is ortophoto image and DTM (Digital Terrain
Model) that have became standard geospatial products.
However, photogrammetric systems have used for generating
them still remain desktop or workstation based systems. People
in particular geodetic, architects or town planners, who wants to
use topical orthophoto image to his study, has neither suitable
photogrametric photos nor appropriate software to process
them. The opportunity of networked orthorectification come
with modern information technologies has had a great impact
on the development of geo-information processing.
This paper outlines an innovative concept of DTM generation
and geospatial image orthorectification over Internet. The
article contains description of algorithms for automatic DTM
and orthoimage construction and presentation of Web
application based on algorithms mentioned previously.
2. ARCHITECTURE OF WEB PHOTOGRAMMETRIC
APPLICATION
The nature of web-based applications lend themselves to an ntiered approach (Petersen, 2009). A typical application usually
includes three essential elements: presentation, logic and data.
Presentation represents user interface, logic refers to processing,
and data refers to database or database management system.
The relationship between these elements is that one element
makes a request to the other element and the other element then
fulfills the requests. The element that makes request is called a
client and the element that fulfills the request is called server.
A web application is one of the example the client/server model
implementation (Peng, Z.,Tsou, M., 2003). A 3-tier architecture
is the most common approach used for such applications today.
In the typical example of this model, the web browser acts as
the client, an application server handles the logic, and a separate
tier (database server) handles database functions (Petersen,
2009).
In the physical client/server model, a client refers to the
computer that interacts with the end user and the server refers to
the computer that manages and stores data and/or other
processing functions.
In constructing a Web photogrammetric application, it can be
assumed that the best quality of photogrammetric data
(especially aerial photos and very high resolution satellite
imageries) was stored on expensive, well-equipped data servers.
Software that is necessary to read data from these servers was
installed on another computer called an application server.
Moreover, users have been communicating with the application
server by means of their own software. Because we have a webbased application in mind, the client used a web browser for
* Corresponding author. This is useful to know for communication with the appropriate person in cases with more than one author.
this task. When the client communicated with the application
server the HTML code of the web side and short programs called applets have been sent as a response. Actions on the
server side have been conducted by programs called servlets.
Applets and servlets are written in the JAVA programming
language and compiled to bytecode, which at runtime is either
interpreted or compiled to native machine code for
execution.(Graba 2003)
The scheme of distributed application described above was
shown in the figure 1
Figure 1. Architecture of web photogrammetric application.
In order to the web application presented in this paper acted
correctly it is necessary to have a WWW page server, e.g.
Apache HTTP Server, and an application server, e.g. Apache
Tomcat to execute servlets. Additionally, users had to install
Java Virtual Machine (JVM) to execute applets on the client
side. In presented solution the Microsoft SQL Server fulfilled
the database server role.
3. DESCRIPTION OF TEST DATASET
AND ITS PROCESSING
To generate orthophoto image the following data are needed:
digital aerial photos, elements of interior and external photos
orientation and DTM. The test material included the block of
two strips photos. There were six photos in the strip. The aerial
photos were taken by an analog Zeiss’s LMK 2030 camera in
the region of campus of University of Warmia and Mazury in
Olsztyn. The scale of photos was 1:8000, with the camera focus
equaling approximately 305 mm. Coordinates of principal point
and fiduacial marks were included in the attached calibration
report of the camera. Photos were scanned with the pixel size
approximately 21 µm.
To determine the transformation from pixel coordinate system
to an image coordinate system, affine transformation was used.
The coefficients of inverse transformation were calculated too.
Additionally, for determination of the external orientation
aerotiangulation was performed.
The all data concern photos were stored in the database.
According to the structure presented in the figure database
contained two tables. Table PHOTO included basis information
like numbers of columns, rows and levels of pyramid, and also
shown which photos made up stereo-pair. There are elements of
photos
orientation
in
the
second
table,
where
Figure 2. The structure of photos database.
4. ALGORITHM OF DTM AND ORTHOIMAGE
GENERATION
DTM and orthophoto images a commonly produced by the use
of digital photogrammetric workstations that are usually
equipped with advanced technology. The process of creating
web photogrametric applications has not been based on copying
or translating the source codes of such systems. It was
necessary to build new programs to conduct definite tasks. They
ought to fill gaps in of the user’s existing software and take into
consideration the properties of the network structure (Harold
2004).
The algorithm of the web-based approach for online DTM and
orthoimage generation is presented with the aid of UML
activity diagram in the figure 3. In presented solution there are
three successive steps: parameters determination, DTM built
and orthoimage generation. In the next part of paper we focus
on the problem of DTM constraction. The mathematical basis
of construction of orthoimage as a function was also described.
a _ af , b _ af , c _ af , d _ af , e _ af , f _ af , ck , xs, ys
related to coefficients of affine transformation, whereas
X 0, Y 0, Z 0, OM , FI , KA was the external orientation
elements.
Figure 3. Activity diagram shows steps in the process of online
DTM and orthoimage generation
4.1 Digital Terrain Model
c' , c"
DTM is an element that is necessary in the process of creating
orthoimages. Aerial photogrammetry provides major source of
data that are used to create it. The main task in the
photogrammetrical approach is to measure homologous points
on two or more images (photos), i.e. selecting an object on one
photo and finding its equivalent on the other one. In analogous
and analytical photogrammetry, this is achieved by manual
measurements
performed
by
an
operator.
Digital
photogrammetry aims to solve this problem automatically. This
process is called image matching.
Algorithms for automatic DTM construction from raster data
(aerial photographs, satellite imagery) are mainly based on
correlation methods. The main measurement of similarity (goal
function), while using the image matching method, is a
coefficient of correlation. For a defined neighbourhood of one
pixel on the left photo (neighbourhood of grid point on the left
photo) and the same neighbourhood on the right photo, a
coefficient of correlation is repeatedly calculated. The area is
considered to be matched for the maximum value of the
coefficient and when its value is larger than the threshold value
(Paszotta, 2006).
The theoretical basis and detailed explanation of mentioned
image matching algorithm was presented in other article
(Paszotta 2000a)
The above described procedure is repeated on subsequent,
previously established grid nodes. Matching results in obtaining
a dataset, which includes pixel coordinates of the centres of the
areas matched on the left picture, recording the differences
between coordinates on the right and on the left picture and the
minimum of the goal function (Paszotta, 2000b)
After image coordinates of homologous points have been
obtained, data to generate DTM can be acquired in two ways:
a spatial model is built, by determining elements of
reciprocal orientation, which is then transformed to
the ground coordinate system.
after determining the elements of exterior orientation
of photos, image coordinates of points measured on
the stereogram are directly converted into X,Y,Z
coordinates in a ground system, by using collinearity
equation.
The last step of DTM generation is modellling of terrain
surface. There are many methods of DTM interpolation widely
described in the literature of the subject.
- fragments of the left and right photo of stereopair.
4.2 Orthorectification process
The orthophoto image is obtained in the orthorectification
process. We defined orhtoimage and digital photo as functions
c' (i ' , j ' ) , c(i, j ) where arguments of these functions are
indexes of pixels (pixel coordinate) and their values belong to
the colors space. The colors of orthoimage pixels c ' : (i ' , j ' ) is
received on the basis of color pixels of digital photo
This relation can be described as the function
c': (i ' , j ' ) → c(e( g ( f (i ' , j ' ))))
c : (i, j ) .
(2)
According to the function 2 the process of orthoimage
generation
can
be
shown
in
the
following
steps (Paszotta, et al. 2010). The function f presented the
coordinates of the center of the orhtoimage pixel in the ground
coordinate system.
f (i ' , j ' ) ⇒ X , Y
(3)
The next step was to determine Z ( X , Y ) based on Digital
Terrain Model.
g : ( X , Y , Z ) ⇒ ( x, y )
Figure 4. Algorithm of image matching
The diagram of image matching process is shown in the figure
4. We assumed there that the goal function has the form
d (c' c" ) = 1 − r (c' c" )
where
r (c' c" )
- correlation coefficient
(1)
(4)
The function g could be described by collinearity equation. It
allowed to transform ground coordinates of the point into its
digital photo coordinates in the fiducial marks coordinates
system.
Then based on the function e the digital photo coordinates were
transformed to digital photo pixel coordinate.
e : ( x, y ) ⇒ (i, j )
(5)
The last step was calculated the color of digital photo pixel used
one of the resampling method c : (i, j ) ⇒ c (i, j )
As a result of the ortorectification process the image that show
cartometric view of the Earth’s surface is recorded in BMP
format.
5. THE EXAMPLE OF ONLINE DTM AND
ORTHOIMAGE GENERATION
The presented web application has consisted of applets and
servlets that was written in the JAVA programming language
and has worked on the Department of Photogrammetry and
Remote Sensing serverhttp://www.kfit.uwm.edu.pl/zp1/or.html.
Data that is necessary for constructing orthoimage has been
obtained from several sources: parameters of photos
orientations from the database, photos and their fragments from
a directory of photos on the dataserver, and other data – initial
parameters of process of DTM and orthoimage generation have
been delivered by the client. The application has started
working on the client side after downloading the mentioned
above web site. User has had to select the stereopair and
appropriate photo pyramid level, indicate the area of interest on
the selected photos and send to application server request for
preparation of photos fragment. After that the web browser
windows looked like in the figure 5.
The next step is DTM generation. The main task of this stage
concentrate on homologous point measurement. The measure of
similarity between the digital images is the correlation
coefficient. To perform this operation, pixel color values from
RBG color space should be transformed to monochromatic
color space. The user defines also a threshold for correlation
coefficient, the target size (pattern), and step changes in the
coordinates (in pixels) on the right photo (size of search
window). After selecting a starting point on the left and right
photos – identifications of all other conjugate points is
performed automatically. The result of this operation is shown
in the figure 6. It should be emphasize that the image matching
is executed on the original images on the server side.
Simultaneously the terrain coordinates of points that were used
to create digital terrain model (DTM) were calculated in the
automatic way.
Figure 6. Results of image matching shown
in the web browser window
Since the area of the orthophotomap is small and limited by
dimension of the window of the web browser. Thus, in the
process of orthorectification over the Internet we assumed a
simplified DTM. The proposed method of digital terrain model
is approximated it in the form of the plane.
Z = AX + BY + C
Figure 5. View of the web browser window with the running
web application of DTM and orthoimage generation.
(6)
Figure 7. Points selection for plane approximation.
Control point for finding the plane equation coefficients are
selected by the user through assignments them the weight
equal 1 (figure 7). The coefficients of the plane equation are
defined by deploying a least squares adjustment method.
Accuracy assessment of the model is also implemented.
Conformity between the established model and remaining point
was determined by using RMS error. In presented example the
RMS is equal 0.9m. (figure 7).
The last stage of our web application is ortorectification
process.
For the orthoimage generation, user needs to
interactively setup the extent of the working area and define a
scale of the result, as it is shown in figure7. As a result of
orthorectification process the carthometric image is recorded in
BMP format. Additionally the compressed orthoimage is
produced in JPEG format and through the applet was
automatically forwarded to the client to be displayed in the web
brower window.
Because of resampling, the created
orthoimage has a worse quality than a source photo. Therefore,
the source photograph with the system of coordinates is also
presented.
7. REFERENCES
Dai, N., Mandel, L., Ryman, A., 2007 Eclipse Web Tool
Platform. Developing JAVA Web Applications. Addison
Wesley, Stoughton, Massachusetts, USA
Graba, J., 2003. An introduction to network programming with
Java, Addison Wesley, ISBN 0 321 11614 3
Harold, E.R., 2004. Java Network Programming, 3rd Edition.
O’Reilly Media Inc. ISBN 978-0596007205
Paszotta, Z., 2000a , Teoretyczne podstawy metody spasowania
obszarów obrazów cyfrowych.
Archiwum Fotogrametrii,
Kartografii i Teledetekcji Vol. 10 pp. 47-56.
Paszotta Z. 2000b. Method Exterior Orientation of Aerial
Images by matching orthoimages. Wydawnictwo UWM,
Olsztyn , pp 6.
Paszotta, Z., Szumilo, M., 2006, Weryfikacja Numerycznego
Modelu Terenu.
Archiwum Fotogrametrii, Kartografii i
Teledetekcji Vol. 16 pp. 145-152.
Paszotta, Z., Levin, E., et al., 2010 Networed approach for rapid
geospatial imagery orthorectification. – in press
Peng, Z.,Tsou, M., 2003. Internet GIS, Distributed Geographic
Information services for the Internet and Wireless Networks.
John Wiley & Sons, New Jersey, pp. 120-123.
Petersen,
J.,
2009
ColdFusion
Article
“Benefits
of using the n-tiered approach for web applications”,
http://www.adobe.com/devnet/coldfusion/articles/ntier.html
Figure 8. Figure placement and numbering
Orthorectification was made on the server side but the grid
coordinate system was superimposed on the orthoimage by
means of applet on the client side. In both cases the image and
ground coordinates of point shown by the cursor are calculated
and printed in the header of the Internet browser window.
6. CONCLUSIONS
The process of creating orthophoto image together with DTM
from aerial photographs is complex and requiring the specialist
software on the digital photogrammetric station. However, it
turns out that this process with certain limitations can be
executed over the Internet. Even, if there is a simplified
solution, its advantages are great. This paper presented the
algorithm and web application for constructing DTM and
orthoimage online. The majority advantege of a such solution is
the ability to update and maintain it without distributing and
installing software on potentially thousands of client computers.
Download