September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Conformance testing methodology for SDI components based on ISO 19105 including pilot implementation in Slovakia
Tomas KlimentPhD studentSlovak University of Technology in BratislavaDepartment of Theoretical Geodesy
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Outlines
• Motivation & Objectives• SDI architecture overview from the network services
perspective• Conformance testing methodology according to ISO
19105• Conformance testing methodology for SDI components
via network services• Testing environment design• Testing environment initial development efforts • Testing of the SDI components provided by Slovak
Environmental Agency (SEA)• Results – conformance test report & Future work
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Motivation & Objectives• Interoperability enhancement of SDI’s on the national and European
level • ISO and INSPIRE documentation study related to conformance
testing preparation, execution, analysis and reporting for individual SDI components
• Contribution to the performing work within a persistent geospatial test-bed (PTB) established within the European research community on behalf of Slovakian involvement
• Conformance testing methodology proposals to be implemented on national level (in-house testing) based on ISO 19105 framework, concepts and methodology specification
• Test campaign execution on SDI components implementations from Slovak Environmental Agency
• Analysis of the results to provide statements (verdicts) for the conformance test report content template
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
SDI architecture overview from the network services perspective
• Data & Metadata• Network services
– Discovery– View– Download– Transformation– Processing
• Geoportal client– Discovery client– View client– Download client– Processing client
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Conformance testing methodology according to ISO 19105
• ISO 19105:2000 Geographic information - Conformance and testing– Standard specifies the framework, concepts and methodology
for testing and criteria to be achieved to claim conformance to the family of ISO geographic information standards
– Conformance may be claimed for data or software products or services or by specifications including any profile or functional standard
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Conformance testing methodology according to ISO 19105
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Conformance testing methodology for SDI components via network services
• Testing requirements • Testing scope• Testing scenarios• Testing execution, results processing and reporting
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Testing environment design act SUTSEAT_testing
SDI components tester
SDI components prov ider
testingEnv ironment
defineServ iceURL
displayResults
communicate
setupTestingScenarios
executeTests
reportResults
configureTest
sendReport
downloadReport
selectScenario defineTemporalCov erage
notifyByEmail
printReport
SDI component user
«include»
«invokes»
«invokes»
«include»«include»
«include»
• Actors:– SDI component tester– SDI component provider– SDI component user
• Use cases:– Setup testing scenario– Configure test– Execute test– Report results– Send report– Display results – Download report – Print report– Communicate
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Testing environment initial development efforts• webtest – web application for web service testing
– developed at Department of Theoretical Geodesy with Java and JSP technologies
– enables single, multiple, simultaneous GET and POST requests– Measures 2 times:
• Between RQ and the first byte of the RS download• Between RQ and the last byte of the RS download
– Counts presence of predefined string– Configuration based on XML files:
• Service endpoint definition• Testing scenario definition (request to service)
– Provides results in the tabular form– Does not provide statistics for long term testing yet– Online accessible on: http://geo.vm.stuba.sk:8080/webtest/
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Testing environment initial development efforts – webtest GUI
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Testing environment initial development efforts• MDValidator – desktop application for batch MD validation
– Developed by testers at SUT as Java application– Executes batch validation of MD as XML files from local dir– Invokes online REST Web INSPIRE validator service – Provides results in XML/HTML form– Does not validate against ISO gmd schema yet– Useful after batch MD transformation (xslt)
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Testing environment initial development efforts – MDValidator GUI
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
SDI components provided by SEA for testing
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
SEA SDI components testing
• IUT – tested 7 network services operating on metadata & data from 6 INSPIRE spatial data themes
• ATS – prepared all modules according to INSPIRE conformance requirements
• 4 test modules defined for every network service– Test module A: Network service interface (operations¶meters)– Test module B: Network service quality parameter testing– Test module C: Network service other characteristics & criteria – Test module D: Network service content validity
• ETS – only some of ATS executed
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Results – conformance test report
• Reports results from raw test outcomes
• 4 test modules included • Only partial testing model
executed
• SDI components conformance test report proposal against INSPIRE requirements
• Proposed the proforma according to ISO 19105 recommendations
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Future work
• Discussions, proposals, suggestions on presented testing methodology within the expert groups dealing with testing on both European and National levels
• Testing scenarios extensions – ETSs have to be derived from all the required ATS
• Common testing report content agreement based on proposal shown in the results
• Continuation of the testing environment development according to the proposed design
• Download Service content conformance validation
September 6-8, 2011, Cracow – ZakopaneSeptember 6-8, 2011, Cracow – Zakopane
Many thanks for your attention!
Contact info:SUT in Bratislava, Dept. of Theoretical GeodesySEA in Banská Bystrica, Dept. of Environmental informaticsSUA in Nitra, Dept. of Landscape Planning and Ground Design
