Keynote SIGOS Product Guide

PRODUCT GUIDE

All trademarks and registered trademarks are the property of their respective owners.

Keynote SIGOS 

Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 

Company . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 

Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 

USE CASES 12 

Service Quality Monitoring 

Periodic QoS and QoE Testing . . . . . . . . . . . . . . . . . 14 

On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 15 

Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 

Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . 17 

Content Testing / Handset Simulation . . . . . . . . . 18 

Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 

Roaming Testing 

Inbound Roaming Testing . . . . . . . . . . . . . . . . . . . . 20 

Outbound Roaming Testing . . . . . . . . . . . . . . . . . . . 21 

SLA Testing according to GSMA (GRQ) . . . . . . . . . 22 

Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . 23 

Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . 24 

International Carrier Quality Testing 

Dedicated carrier route selection . . . . . . . . . . . . . 25 

Revenue Leakage & Fraud Detection 

SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 

Early Charging Detection . . . . . . . . . . . . . . . . . . . . . 27 

Revenue Assurance 

Test Call / Event Generation . . . . . . . . . . . . . . . . . . . 28 

CDR Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 

Tari� Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 

Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . 31 

Fixed & IP Network Testing 

Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . 32 

IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 

Core Network Testing 

Testing without Radio Access . . . . . . . . . . . . . . . . . 34 

Regression Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 

Nomadic & Indoor Testing . . . . . . . . . . . . . . . . . . 35 

Contents 

TEST SYSTEMS 36 

GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 

World-Wide Coverage . . . . . . . . . . . . . . . . . . . . . . . . 39 

Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 

SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 

The Unique Test Platform . . . . . . . . . . . . . . . . . . . . . 42 

Hardware Components & Interfaces . . . . . . . . . . . 46 

Test Tools for SITE and GlobalRoamer . . . . . . 48 

Reporting & Alarming . . . . . . . . . . . . . . . . . . . . . . . . 50 

Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 

Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 

Test Applications for SITE and GlobalRoamer . . 54 

Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . 56 

Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 

Voice Advanced . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 

Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 

Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 

Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 

Value Added Services . . . . . . . . . . . . . . . . . . . . . . . . . 68 

Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . 70 

PROFESSIONAL SERVICES 72 

Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 

Consulting Services . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Project Management & Implementation . . . 77 

Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 

INDEX 79 

REFERENCES 80 

5

6 

With a customer base of more than 

260 operators around the world in over 100 countries... 

With over 50 representations around the world, covering 

sales and post sales services... 

With expert sta� from more than 30 nationalities... 

...your world-wide partner in 

telecommunications testing: 

Keynote SIGOS

Introduction 

Company 

Portfolio 

SITE – Active end-to-end test system 

GlobalRoamer – Managed world-wide system 

Professional Services – Consulting and more 

Testing is our Competence 

7

8 


Industry 

Introduction > Company 

1985 1987 1989 1990 

First ISDN 

communication 

system is 

established 

SITE Testing Environment 

now includes mobile 

network End-to-End testing 


Industry 

The idea for 

GSM is born 

(“Memorandum 

of Understanding”) 

Foundation of 

SIGOS Systemintegration 

GmbH 


The Company 

What we do 

Keynote SIGOS provides scalable and fully 

integratable telecommunications testing 

solutions to service network operators 

(mobile and � xed line as well as MVNOs), 

content providers, carriers and regulators. 

Our solutions and services are designed to 

give our customers the full picture on Quality 

of Service from an end-user perspective. 

But we do not stop there: our customers 

enjoy the most comprehensive range of 

scalable active end-to-end testing solutions 

available on the market. 

3G starts: First CDMA2000 

commercial system 

is launched in 

South Korea 

SIGOS provides test and 

integration support to all 

German GSM networks 

First commercial 

UMTS network 

is launched 

in Norway 

Testing and integration 

support for the � rst 

German GSM network 

Active participation in 

standardization process 

as full member of ETSI 

1991 

First GSM network is 

launched in Finland (“2G”) 

Service Quality testing and monitoring 

Roaming testing 

International Carrier Quality testing 

Revenue Assurance and Billing veri� cation 

Revenue Leakage and Fraud Detection 

solutions 

Drive Service testing 

Fixed and IP network testing 

Test creation, diagnosis and reporting 

tools 

Core Network testing solutions 

Handset simulation 

GlobalRoamer 

goes online 

1 Billion of 

mobile phone 

subscribers 

world-wide 

Launch of BlackBerry, 

PoC, Video Testing 

1997 2000 2001 2002 

2005 

HSDPA is introduced 

www.keynote-sigos.com

SMS is introduced 

World Wide Web 

(www) is born 

Keynote acquires 

SIGOS GmbH 

VoIP is now 

established as 

communications 

platform 

SITE End-to-End testing 

environment for � xed line 

networks is born 

First commercial 

website 

HSUPA is 

introduced 

Launch of Billing 

Veri� cation and 

Drive Service Test 

SIGOS plans a GSM 

core network 

HSPA + is 

introduced 

Mobile Connections 

hit 4 Billions world-wide 

Introduction > Company 

SITE DECT for 

type approval 

tests introduced 

VoIP in its infancy 

is used for the 

� rst time 

Introduction of 

GlobalResource Pool 

GlobalRoamer to cover 

¾ of the world countries 

LTE Test System 

HSPA + rollouts Beginning of 

LTE era (“4G”) 

SITE ISUP for 

conformance test 

for C7 networks 

1992 1993 1994 

1995 1996 

Who we are 

Founded in 1989 under the name of SIGOS 

Systemintegration GmbH, Keynote SIGOS 

brings in more than two decades of broad 

experience to the telecommunications 

industry, helping our customers to be even 

more successful in today’s highly 

competitive environment. 

Keynote SIGOS is a truly international 

company: bringing people from multiple 

cultural backgrounds together to outstandingly 

serve our global customer base with 

what Keynote SIGOS employees all have in 

common: true passion for telecommunications! 

SITE provides 

test environment 

for VoIP, ADSL, 

DSL, HSUPA 


celebrates 

its 20 Years’ 

Anniversary 

GPRS / EDGE (“2.5G”) 

ADSL allows high-speed 

communication 

over phone lines 


introduces IPv6 

test cases and 

test interfaces 

2006 2007 2008 2009 2010 2011 

www.keynote-sigos.com 

Keynote SIGOS is headquartered in Germany where our solutions are being developed 

under highest standards. Representations on multiple continents and our strong partner 

network distributed all over the world rounds up our world-wide presence. 

20 


YEARS 

1989 - 2009 

IPv4 addresses 

to run out by the 

end of the year 

9

Introduction > Portfolio 

GlobalRoamer 

SITE TEST SYSTEM 

Professional Services 

Roaming 

Testing 

Core Network 

Testing 

The Portfolio 

Outbound 

Roaming 

Testing 

Clients 

Training 

Steering of 

Roaming 

Testing 

Fraud Detection 

SITE 

Central Unit 

LAN / WAN WWAN 

LU CLU 

LU 

CLU 

LU 

SIM 

Multiplexer 

Multiplexer 

CLU 

Fixed IP Networks Mobile 

QoS Tools for 

Diagnosis & Reporting 

QoS Tools 

for Diagnosis & Reporting 

WLU 

MLU 

Managed 

Services 

Revenue 

Assurance 

Tool 

Project Management & 

Project Implementation 

Fraud Detection for 

National & International 

Tra�c 

Drive Service 

Testing 

Handset 

Speci�c Speci�c 

QoS Testing 

International 

Carrier 

Testing 

Billing Testing 

for International 

Tra�c 

World-wide 

Handset Speci�c 

QoS Testing 

GO GO GLOBAL GLOBAL with with GGRP 

Consulting 

Services 

10 www.keynote-sigos.com

The Managed Global Infrastructure and Test System 

For The World-Wide Telecommunications Industry 

With GlobalRoamer, Keynote SIGOS offers 

the most extensive infrastructure 

for automated telecommunication testing 

world-wide. We provide our customers with 

an extensive network of testing facilities 

around the globe, hosted by Keynote 

SIGOS. GlobalRoamer customers can use 

this sophisticated testing infrastructure 

through a web based user interface. 

Your Own Scalable and Highly Flexible Testing Infrastructure 

With the Keynote SIGOS SITE Test System 

– comprising sophisticated hardware and 

software solutions – network operators 

are enabled to host and work with their 

own testing facilities. The key is the ability 

to easily integrate into the existing network 

infrastructure realities. Interfaces to 

complementary solutions, e.g. monitoring 

systems, are provided so that SITE can be 

exactly matched to your specific requirements. 

Solution Consulting, Managed Services and More – 

Flexible and Customizable 

We at Keynote SIGOS are always here for 

our customers: in each phase of your 

testing requirements we provide you with 

well experienced and specifically trained 

personnel, whether it be for project 

implementation, maintenance, managed 

services, training or solution consulting. All 

our Professional Services can be customized 

to your specific needs. 


All that is required is a web browser and 

access to the internet. Simply log on with 

your password and set up your test schedules 

without worrying about a thing. However, 

Keynote SIGOS can also provide fully 

managed test services so that all that you 

really need to do is: look at the results. 

The SITE Test System’s architecture is completely 

modular. Only the modules that 

are needed for the given tasks need to be 

purchased. 

Your local SITE system can go global by 

connecting to the world-wide Global- 

Roamer probes with our „GlobalResource 

Pool“ feature - all in one go! 

For instance, with di� erent levels of Managed 

Services, we can help our customers 

with the management, operation and 

administration of tests. Our services are 

completely customizable and scalable: we 

are handling complete SITE systems for 

customers as well as we manage small 

occasional testing projects. Just as you 

please. 

The on-demand 

world-wide test 

platform hosted 

by Keynote SIGOS 

One platform for 

all your end-to-end 

test requirements 

Expert sta� gives 

assistance at all 

project phases 

11

12 

Versatility is key! 


solutions in action.

The Use Cases 


> Periodic / On-Demand Testing 

> Network Diagnosis 

> Drive Service Testing 

> Content Testing / Handset Simulation 

> Benchmarking 

Roaming Testing 

> Inbound Roaming Testing 

> Outbound Roaming Testing 

> SLA Testing according to GSMA (GRQ) 

> Roaming Hubbing Testing 

> Roaming Steering Testing 


> Dedicated Carrier Route Selection 


> SIM Box Detection 

> Early Charging Detection 


> Test Call/Event Generation 

> CDR Comparison Testing 

> Tariff Testing 

> Prepaid SIM Recharging 

Fixed & IP Network Testing 

> Fixed Network Testing 

> IP Network Testing 


> Testing without Radio Access 

> Regression Testing 

Nomadic & Indoor Testing 

> Nomadic Testing 

> Indoor Testing 

13

14 

Use Cases > Service Quality Monitoring 

See your network 

through the eyes of 

your customer 


Periodic QoS and QoE testing 

Slow setup time, service outages or unsuccessful data downloads are experienced in 

every network. In order to manage daily operations standardized matrices should be 

deployed by several divisions, e.g. Service Operations, Service Quality Assurance, 

Network Operations, International Roaming and Revenue Assurance. 

In a highly competitive market, such as 

the telecommunications industry, providing 

and maintaining highest quality to 

end customers is the key to a sustainable 

competitive advantage. 

With customers having multiple options 

at hand, poor quality – even the occasional 

drop in quality – can have immediate 

consequences. Switching between operators 

never has been easier through mobile 

number portability. 

First class service quality has many in� uencing 

factors not all being under the 

immediate control of the operator. Identi� 

cation of weak points can be di� cult 

and some may remain undiscovered even 

while their e� ects are still evident in the 

market. 

Active testing bene� ts 

Testing time 

Continuous heartbeat tests 

End user experience 

Best re� ection of end user experience: E2E service quality tests 

Test Quality of Service and Quality of Experience 

Keynote SIGOS o� ers accurate measurements 

of end-to-end quality for voice and 

data services by measuring KPIs like call 

setup success rates, HSDPA, HTTP average 

throughput or service degradation of 

BlackBerry services. 

Taking round the clock automated measurements 

at the end user’s interface (rather 

than in network nodes) operators obtain 

in-depth insight into end-user’s perception 

of the network. 

Generation of active test calls 24/7 – 

without the cost of 24/7 sta� - covering all 

aspects of the network and the upload of 

KPIs to a centralized alarming 

system provides excellent 

real-time feedback on 

the service levels of the 

network. 

Time to detect issues 

Identi� cation and localization of service and network issues can be achieved before 

actual service degradation and threat of revenue loss 

Operating costs 

Reduced operating costs by automating monitoring, testing, and reporting; 

increased personnel e� ciency; costs not correlated with network size and growth 

Testing scope 

Pro-active test approach can be realized; in control of testing scope 


On-Demand Testing 

Perform reproducible ad-hoc testing! 

The customer service desk keeps getting complaints about certain service scenarios like 

‘BlackBerry e-mail service not reliable’, ‘basic voice calls not possible’ in certain locations, 

in the home country as well as abroad. Quick action needs to be taken! 

World-wide Testing 

Keynote SIGOS hosts the largest and 

most comprehensive world-wide test 

infrastructure, currently covering 4/5 of 

the world‘s countries. GlobalRoamer users 

bene� t from the availability and � exibility 

of the GlobalRoamer test network without 

the e� ort of running their own system. 

GlobalRoamer account holders log on and 

schedule their tests whenever the demand 

occurs. Being able to perform tests independently 

and without the usual hassles 

connected with doing business globally 

like time-zones is an invaluable asset! 

“If a real time test is needed, and it´s too 

late to contact a roaming partner, I can 

re-produce the test scenario identically.” 

The test call can be replicated repetitively 

in order to check whether service has 

been re-established. 

GlobalRoamer is deployed to survey 

speci� c services over roaming partners’ 

networks managing both post-paid and 

prepaid SIMs across the di� erent technologies. 

The SIMs are co-located in Keynote 

SIGOS’ premises in Nuremberg, Germany. 


Root causes can be localised easily when 

used in tandem with Keynote SIGOS’s 

integrated analysis tools. 

Time zone and business hours di� erences 

often make it di� cult to run tests with 

the co-operation of roaming partners. 

GlobalRoamer o� ers an easy and instant 

solution to this problem. 

“There is no time lost as we do not have to get in touch with the roaming partner. We can execute 

tests via GlobalRoamer in a matter of a few minutes anywhere in the world where SIGOS has coverage. 

Before we started to use GlobalRoamer sometimes we had to wait more than 3 months for 

execution of a roaming test because partners were occupied with other roaming partners’ tests.” 

“The SIGOS test system helps us to manage our test SIMs e� ciently as we do not have to send the 

SIMs to multiple countries for roaming testing. It provides us with a fully controlled test platform. 

We can perform multiple test cases easily and simultaneously.“ 


Home Network Testing 

SITE enables network operators to test all 

relevant services in their network with a 

private test system. All locations covered 

by the private SITE system can be used for 

� exible end-to-end testing. Due to their 

modular structure, SITE test systems can 

range from a small local system to geographically 

widely distrubuted areas as well. 

The unique feature‚ ‘Global Resource Pool‘ 

however, enables operators to expand the 

capability of their SITE system – no matter 

how small or big it may be – to reach out 

to world-wide test locations covering 4/5 

of the world‘s countries! In fact, they are 

enabled to utilize the huge network of 

GlobalRoamer test probes – all in one go! 



your customer 

15

16 




your customer 

Network Diagnosis 

Model your network & � nd the root cause 

of service outages! 

Once periodic heartbeat testing for the services has been set up, very often Service 

Operations is the � rst team to detect service outages through the results of this active 

testing. But what network entity has caused the fault? 

SITE proves not only to be a good re� ection 

of real customer experience but also 

shows up bottlenecks in the network 

infrastructure via its solution Service 

Alarm Map (SAM). 

By supervision of all relevant end-customer 

services and correlation of network 

events it becomes possible to both 

anticipate and analyze service a� ecting 

network problems. A clear and comprehensive 

mapping of service problems to 

the performance of individual network 

MSC 4 

BSC 12 

LocationUpdate2G 

SGSN 2 

GPRS_Attach2G 

GGSN 

INTERNET 

PDP_ContextActivation VPN Tunnel 

Internet 

DL_Duration 

HttpAv 

elements and systems can then signi� - 

cantly drive down time back to service. 

Service Alarm Map helps to reduce the 

time for root cause identi� cation and 

supports the technical service teams with 

additional information like error-id, trace 

details & measurement values. This important 

drill-down functionality from service 

chain visualization to raw measurement 

values and trace information improves 

reaction times in the event of tra� c 

congestion and network element failures. 

“The number of customer complaints have been reduced signi� cantly due to network 

issues being identi� ed faster by the Keynote SIGOS test system. Real-time alerts and 

reports of incidents lead to faster resolution of the network issues identi� ed. Subscribers 

are “not fast enough” to call our Customer Care to lodge a complaint.” 

GPRS backbone 

Opera server 

DL_Duration 

HttpAv 

Router 

Example: The Service Alarm Map (SAM) indicates a problem on BSC12 


Drive Service Testing 

Test mobile subscriber experience on the move! 

SITE has already been widely deployed for periodic QoS testing and KPI generation. 

Quality of subscriber experience however is not only driven by static service use but 

also by service deployment on the move. Testing during moving is an important 

complementary approach in addition to stationary testing. 

SITE is a powerful tool for the delivery 

of Service Assurance and generation of 

leading Key Performance Indicators (KPIs) 

for operator networks, not only for static 

testing but also for mobility, simulating 

end user experience. 

Equivalent to the behavior of static Local 

Units, the SITE System collects a variety 

of network measurements from moving 

subscriber probes, known simply as Mobile 

Local Units (MLUs). These mobility tests 

are geared for vehicles like taxis, trucks or 

trains. Consequently they are called SITE 

‘Drive Service Tests’. The raw information 

is processed into KPIs and displayed in a 

Google Maps view or on a color coded 

geographic map. 

Drive Service Testing provides you with 

Service QoS KPIs (Voice Quality etc.) as 

well as many speci� c measurments 

(RxLevel, Handover, Call ID, MAIO...) 

Investment Protection 

Drive Service Tests are fully SITE compatible 

and can be performed as an 

extension to existing SITE systems 

securing current investment into 

Keynote SIGOS service assurance 

products. 



Unattended System 

SITE Drive Service Test is a completely 

autonomous system after installation. 

No engineer needs to be present in the 

vehicle for test setup, modi� cation or 

analysis. 

Easy Installation and Removal 

MLU is shipped fully pre-con� gured 

and only needs to be connected to the 

electronic on-board system. No further 

human interaction, not even switch-on 

is required. 

Geographic View 

SITE system delivers graphical views on 

your network quality. A comprehensive 

set of KPIs enriched with further information 

like speed of moving vehicle, altitude 

and position can be displayed on 

a map. Google Maps or WMS maps, e.g. 

operator’s own coverage map, display 

KPIs customizable by operator. 



your customer 

17

18 




your customer 

Content Testing / Handset Simulation 

Do all handsets work perfectly in your mobile network? 

The opportunity for mobile operators and advertisers to sell exciting new mobile 

content is enormous. However, the variety of available services like MMS, Video Streaming 

and Web Browsing may cause problems when using di� erent handsets, since 

the service platforms of the network react individually to each mobile phone type! 

Picture and text in wrong position 

Handset Simulation Test Concept Features: 

Data Services like Web and WAP browsing, 

streaming, MMS or video telephony are 

ARPU driving services. 

Premium content download is another 

huge revenue driver. Subscribers‘ expectations 

on quality of service are legitimately 

high. 

At the same time, handset speci� c behavior 

plays an important role in the delivery 

of this content and services. 

Delivered content not displayed in the expected 

format causes a de� nite negative 

impact on customers‘ Quality of Experience 

(QoE). 

How can new devices and services be 

properly tested in a cost-e� ective way 

that ultimately leads to customer satisfaction 

and increased revenue? 

The answer is automated testing while 

taking handset speci� cs into account – 

handset simulation. 

Keynote SIGOS provides a powerful handset 

simulation tool, integrated into the 

SITE and GlobalRoamer test systems. 

More than 1,000 virtual handsets are 

available from a ready-to-use and expandable 

library. Simulate the large variety 

of handsets without the e� ort of labor 

intensive manual testing. 

Simulation of real subscriber behavior, taking handset speci� cs into account 

Automated testing of services like Web and WAP browsing, MMS, streaming, video 

telephony, content download 

Interfaces: GSM/GPRS Um, GSM Gb, UMTS Uu, HSDPA, HSUPA, EDGE, Iu PS 

Real End-to-End mobile content testing of various handsets 

Validation of received content with mobile pro� les 

Database with more than 1,000 mobile device pro� les and their relevant parameters 

New customer or country speci� c handsets can easily be integrated 


Benchmarking 

Who is the best performer? 

KPIs for own network are regularly reported to senior management. But how does your 

network perform compared to the competitors? Who has the best performance? 

Who o� ers the highest quality of service (QoS)? What is the quality situation for your 

international tra� c? 

In the competitive mobile environment, 

consistently high QoS is the deciding key. 

Benchmarking is an important dimension 

in making sure your services are competitive. 

National Approach 

Most measurement projects start o� with 

a national performance investigation and 

comparison after national network rollout 

has been completed. Operators have to 

� nd innovative ways to outperform their 

competition on network and service 

quality. 

With the SITE test system, network services 

can be benchmarked against the competition, 

measuring internationally approved 

and recognized Key Performance Indicators 

(KPIs) in a fast and easy way. 

International Approach 

In order to get a comprehensive overview 

of multinational or group-wide benchmarks, 

GlobalRoamer’s extensive global 

footprint can perform international benchmark 

tests and ensure improved cost 

e� ciencies. 

Benchmarking of international carriers is 

an important step in ensuring high quality 

of service for the international tra� c 

impacting your revenue. 



Static Test Approach 

Network benchmark assessment is 

executed using an active end-to-end test 

scenario to observe the performance of 

your network from a subscriber point of 

view. 

Typical static benchmarking tests are 

performed at airports, city centres, mega 

sports or social event venues and hotspots 

where masses of people congregate. 

“On-the-Move” Test Approach 

Drive Service tests have the ability to cover 

di� erent geographical areas of locally 

competing networks rather than being 

focused on static locations. 

This simulates subscriber behavior 

moving from one cell to another and 

provides a comprehensive performance 

overview of the complete network. 

Service performance is benchmarked 

with national competitors as well as 

international operators: 

Static testing 

Drive service testing 

Outbound roaming testing (e.g. GRQ) 



your customer 

19

Use Cases > Roaming Testing 

Get the full picture of 

your roaming services 

Inbound Roaming 

Provide best service to visitors in your network! 

Today, subscribers expect all frequently used mobile services to work reliably everywhere 

in the world. Thus, the quality and availability of services inside and outside the home 

network becomes increasingly important in the battle for customers! 

Inbound roaming has a big impact on your revenue and a long list of international 

roaming agreements may be desireable. It comes at a cost: each and every roaming 

agreement with a new roaming partner requires intense testing according to GSMA 

standards. In addition, periodic roaming tests with the most important roaming partners 

need to be performed. How can e� orts be reduced? 

Testing according to GSMA IREG standards 

is required whenever a new 

roaming partner is added. It can be a very 

time-consuming and exhaustive task. It 

may absorb your most expert sta� and 

repetitive testing can be just as expensive 

as the initial test setup – if performed 

manually! 

Therefore, test automation is key for cost 

e� ectiveness and operational e� ciency. 

With the SITE system your sta� will perform 

IREG speci� c tests in much shorter 

times with less e� ort – and the results will 

be easily reproducible! 

Implementation of testing for new roaming 

partners could not be easier: the 

SIM card is implemented into SITE‘s SIM 

Multiplexer which can be expanded to a 

capacity of more than 2,000 SIM cards. 

As soon as the SIM card has been implemented, 

sta� can run the necessary tests. 

Features for inbound roaming testing: 

Ready-to-use test cases are available for 

the execution of tests, according to IR 24, 

26, 27, 29,32, 35, 50, 60. These tests can be 

repeated at any given time! 

The test results are automatically processed 

into GSMA conformant reports 

ready for evaluation. 

SITE o� ers the right concept for inbound roaming testing: 

Core network test interfaces (A, Gb, IUCS, IUPS) for testing roaming, independently 

of radio speci� c problems 

Air interface testing for measuring real end-to-end behavior and experience 

SIM Multiplexer: SIM cards can be managed centrally and securely for all roaming 

partners (as many as 2,000 SIM cards) 

Detailed KPI test reports according to GSMA standards 

Test sets according to IREG 24, 26, 27, 29, 32, 35, 50, 60 from GSM MoU 


Outbound Roaming Testing 

Assure QoS abroad to optimize and develop 

outbound roaming revenue 

The possiblility to travel the world quite easily is perceived as a matter of course nowadays. 

Traveling subscribers take availability and proper operation of all mobile services for granted. 

Outbound roaming contributes considerable revenue and therefore requires QoS assurance. 

Operators require information on service 

quality beyond their own network. To 

subscribers, perceived mobile quality 

when traveling abroad is vital, especially 

for corporate customers. 

Mobile operators need to ensure subscribers 

are able to log onto preferred roaming 

partners’ networks when traveling, 

whilst preserving consistently high levels 

of QoS to maintain long term business 

sustainability. 

When your subscribers arrive at a foreign 

destination, they expect their mobile 

service to work at all times. 

All relevant services need to be tested 

with at least each top roaming partner. If 

you depend on these partners to execute 

these required tests, it will be a huge task, 

considering availability of sta� , time zone 

di� erences and the like. 

The solution is the world‘s largest automated 

on-demand test network: Global- 

Roamer. Tests can be executed in more 

than 500 networks in three quarters of the 

world‘s countries. GlobalRoamer is hosted 

by Keynote SIGOS and can be accessed 

from anywhere in the world by logging on 

through a web interface. 

Why risk losing subscribers and roaming 

revenue, when the ability to test the performance 

of all your roaming partners is 

at your � ngertips? 

Standard services as well as complex 

technologies and services like Video Telephony, 

MMS and UMTS/HSDPA networks 

can be tested without the need for cooperation 

with your roaming partners and 

independently of time zone. 


Use GlobalRoamer, the most extensive 

global infrastructure for automated active 

End-to-End testing hosted by Keynote 

SIGOS. With GlobalRoamer you can access 

an ever increasing number of world-wide 

networks through a web interface. 

“Thanks to GlobalRoamer we were able 

to increase our outbound roaming 

capability dramatically in very short 

time.“ 




LUP-avail. GPRS-avail. Speech SMS 

21

22 




SLA Testing according to GSMA GRQ 

Consistency & comparability of roaming QoS testing 

Since the tra� c in outbound roaming has a big value for operator revenue, it is important 

to monitor the most frequently visited roaming operators. The GSM Association has 

designed the right concept: GRQ. 

Roaming tra� c may be a low percentage 

of the entire network tra� c, but remains 

a signi� cant pro� t contributor. 

How to gain a global perspective on 

roaming quality with consistent measurements 

and thus comparability between 

home network and visited networks? 

And how to achieve this goal in a 

cost e� cient manner? 

GRQ Parameters, de� ned by GSMA 

# GRQ Parameter 

name 

The Global Roaming Quality (IR.81) 

standards – developed by the GSMA in 

cooperation with selected partners like 

Keynote SIGOS – provide an answer to 

this question regardless of the monitoring 

and testing methods used. 

GRQ is a comprehensive framework for 

pro-active testing and assurance of 

end-to-end roaming services quality. 

With SITE and GlobalRoamer you have a 

unique tool to monitor your SLA agreements 

with numerous roaming partners. 

Keynote SIGOS is a self-certi� ed vendor of 

the GSMA GRQ compliant test systems. 

27 Active QoS parameters on voice, 

data and SMS tra� c 

KPIs for � ve di� erent categories: 

Network access 

Service Accessibility 

Connection Establishment 

Connection Substainability 

Connection Quality 

Why GRQ? 

Category Description Major 

target 

Common understanding about the 

criteria for measuring Quality 

of Service in outbound situations 

Developed and de� ned by GSMA 

Focus on periodic testing of service 

quality 

Applied for monitoring of top roaming 

partners 

Key Bene� ts: 

Cost-e� cient co-operation with 

roaming partners by adherence to a 

shared set of QoS KPIs 

Improve operational cost e� ectiveness, 

by automated testing and realtime 

reporting 

Increased Roaming revenue through fast 

resolution of home and visited 

networks’ SLA violations 

Minor 

target 

KPI 

alarm 

1 CS LU SR Voice Circuit Switched Location Update Success Rate 

Network Accessibility Circuit Switched 

95% 98% yes X 

2 CS LU Delay Voice Circuit Switched Location Update Delay 50s 10s 

... 

10 CLI Voice CLI Transparency 95% 98% x 

11 SpQ Voice Speech Quality 2.5 3 x 

12 SA-MO SMS Service Accessibility SMS MO 95% 98% yes X 

13 SA-MT SMS Service Accessibility SMS MT 95% 98% yes X 

14 AD-MO SMS Access Delay SMS MO 10s 4s 

15 AD-MT SMS Access Delay SMS MT 10s 4s 

... 

24 Throughput Data Throughput (kbit/s) X 

25 Goodput Data Goodput (kbit/s) X 

26 Roundtrip Time Data Roundtrip Time 

27 Packet Loss Data Packet Loss 2% 1% 

Trend 

report 


Roaming Hubbing Testing 

Connecting the world with a single roaming relationship 

Roaming hubs safeguard multi-lateral roaming and interworking relationships. 

How can a roaming hub concentrate on managing the key roaming priorities? 

Open Connectivity (OC) is replacing 

multiple bilateral roaming relationships 

between operators with a more e� cient 

hub-based approach. Open Connectivity 

enables multi-lateral roaming and interworking 

relationships via SMS hubbing 

and roaming hubbing. 

Keynote SIGOS’ world-wide, on-demand 

test platform caters for roaming hubs. 

It enables them to perform tests of Outbound 

Roaming services, IREG testing for 

Inbound Roaming, and QoS Monitoring, 

as well as GRQ testing. 

It improves operational and cost e� ciencies 

because of the automated test 

approach and real time reporting feature. 

Roaming hubbing providers are often 

tasked to actively monitor service availability 

and service quality on all their 

multilateral relations. 

GlobalRoamer allows the activation and 

testing of Roaming Hubbing customers’ 

SIMs. It helps them to work more e� ciently 

to improve the quality of voice, data 

and SMS services for their customers. 

Keynote SIGOS’ GlobalRoamer can add 

value to many aspects of the Roaming 

Hub business model. GlobalRoamer is an 

ideal enhancement to hubs. 


PMN B PMN A PMN C 

One agreement 

Clearing 

Roaming SMS-IW 

Reduced complexity Coordination & MMS-IW 

Increased availability 

Signalling 

One relation 

Data Services 

CAMEL 

PMN PMN PMN PMN PMN PMN 




23

24 




1 

2 

3 

4 

9 

MSC/VLR 

Non-Preferred VPMN 1 

Location Updating Request 

Location Updating Reject 

4x 

Location Updating Reject 

Preferred VPMN 1 

Location Updating Request 

Location Updating Accept 

Roaming Steering Testing 

Are subscribers roaming with preferred roaming 

partners abroad? 

Steering of Roaming (SoR) has been rolled out by Operators in order to direct their outbound 

roamers to preferred VPMNs in the roaming destinations. Does it work? 

Steering of Roaming (SoR) solutions have 

been implemented by mobile operators 

in order to direct their outbound roamers 

to preferred VPMNs in each country. In 

some cases just one preferred VPMN in 

a country is chosen, in other cases SoR 

is about managing the proportion of 

revenue and tra� c shares between two or 

more VPMNs. 

SoR is the logical result of roaming/IOT 

agreements which are linked to volumes 

and percentages for one or more preferred 

VPMNs. On one hand it is a signi� cant 

commercial matter to detect short- or 

long-term deviations from these target 

distributions, on the other hand it is 

worthwhile to test potential deterioration 

of customer experience caused by SoR. 

Detection of Anti-Steering of Roaming is 

essential as operators may lose subscribers 

to non-preferred networks resulting 

in margin losses. Anti-steering is not only 

a breach to roaming agreements but may 

also lead to a bad roaming experience 

as the subscribers could be left without 

any coverage. Subscribers will not blame 

MAP messages 

Update Location 

UpdateLocation.error 

4x 

UpdateLocation.error 

Update Location 

InsertSubscriberData 

HPMN 

SoR node HLR/ 

AuC 

5th attempt is on next VPMN; 

in this case the preferred PMN 

InsertSubscriberData.ack 

UpdateLocation.ack 

the VPMN but their subscribed home 

network. Subscribers will also not be able 

to bene� t from the special roaming retail 

tari� s that have been o� ered to them. 

By detecting anti-steering activities, higher 

roaming costs can be avoided. 

Operators’ primary business goal is to 

streamline roaming steering mechanisms 

such that outbound roaming revenues are 

optimized while maintaining high levels 

of end user satisfaction. 

Preferred! Preferred! 

VPMN B 

VPMN A 

VPMN C 

Outbound 

Roaming 

Outbound 

Roaming 

Outbound 

Roaming 

KPIs (examples): 

Location Update Duration also delivering 

indication of deterioration of end 

user experience 

Number of PMNs rejected number of 

quad attempts or roaming not allowed 

rejects 

List of rejected PMNs non-preferred 

PMNs tried 

PMN after successful steering also 

indicating successful SoR at all 

LUP mode (automatic/manual) testing 

correct behavior of SoR Server for 

manual selection 

Reject Causes (i.e. Network Failure, 

PLMN) 


HPMN

Use Cases > International Carrier Quality Testing 


Who is the best international carrier of choice? 

Setting up a call to a subscriber in a foreign country involves the choice of the relevant 

international interconnection carrier. How much impact has the interconnection carrier 

on QoS? Who is the best interconnection carrier partner? 

There is a need for both mobile and � xed 

operators to get a global perspective on 

interconnection service quality in order to 

maintain high levels of QoS to subscribers. 

The international interconnection quality 

experience is heavily in� uenced by the 

choice of the international carrier at the 

national boundary. 

Example of international CLI quality testing 

Testing with pre� xed called numbers requires 

knowledge about the current setup 

at the international gateway exchange. 

The deployment of an SS7 LU directly 

at the international gateway Exchange 

ensures dedicated interconnection carrier 

testing. 

Poor CLI and voice quality would inevitably 

decrease revenue and market share. 

Private SITE 

System 

International 

Gateway 


Dedicated carrier 

route selection 

By testing international carriers with an 

active monitoring system, you can not 

only monitor if the right calling number 

is displayed abroad but also the voice 

quality and call setup time, which can be 

e� ectively measured and reported. 

In addition, international carrier quality 

testing can be coupled with False Answer 

and SIM Box Detection. 


Received CLI on destination side 

CLI Indicator distinguishing the following 

cases: 

CLI from CgPN (“OK”) 

No CLI (“N”) 

Wrong CLI (“W”) 

Mean Opinion Score (PESQ MOS) for 

Voice Quality (ITU-T P.862.1) 

Call Setup Time 

For example, if no CLI is received, there 

would be no possibility to call back and 

poor voice quality would result in short 

and frustrating conversations. 

Maximising revenue is essential in an environment 

of falling wholesale prices. This 

objective can only be achieved if you have 

consistently high quality on your network 

and on your international interconnection. 

KPI / SLA monitoring 

Interconnection 

Carriers 

Global Resource Pool 

Stay in control of communication 

beyond 

your network 

25

26 

Use Cases > Revenue Leakage & Fraud Detection 

Identify leaks in your 

revenue stream 


Make sure your roaming revenues are not being detoured 

“Fraud“ - the word sounds quite exciting when it appears on a cinema billboard or a TV 

programme schedule but when it hits you personally, professionally, or in a corporate 

environment, it is much less enticing. Fraud will never be completely eliminated but, unless 

fraud management countermeasures are undertaken, it is unlikely that it will be reduced to 

a manageable level. 

SIM Box Detection 

The business goal is to gradually “clean” incoming tra� c terminating through SIM boxes 

by disconnecting all SIM Box numbers detected and to protect the network from any 

potential fraudulent upsurge in their use. 

SIM boxes have multiple negative e� ects 

on operators, roaming hub providers and 

customers alike, e.g.: 

revenue loss due to call redirection - 

roaming calls are intercepted, redirected 

and terminated via fraudulent SIM Box 

equipment. 

unnecessary investment due to service 

inaccessibility as a result of SIM Boxes 

creating false network congestion 

issues. 

revenue loss through CLI Quality 

Problems; immediate impact is the 

in-ability to „call back“. 

image loss through bad QoS as SIM 

Boxes often redirect calls over inadequate, 

highly compressed IP connections, 

resulting in poor voice quality. 

Call setup time is extended which leads 

to the impression of bad call quality 

from the home network operator. 

Fraud Bypass Detection Features: 

Reliable detection of SIM boxes 

Safeguard your revenues 

Cost-e� ective concept for fraud 

bypass detection 

Ensure � rst-class end user experience 

through quick elimination of SIM boxes 

High test density possible while 

avoiding network congestion 

Originating Network 

SIM 

SIM Box 

Operators 

Terminating Network 

Local Retail rate 

(A) 0,14€ 

Local SIMs are used to terminate 

international incoming tra�c BTS 

Air interface 

(B) 0,10€ 

GMSC 

Originating Networks: 

> PSTN 

> Mobile 

> VoIP 

> Carrier Select (CS) 

> Calling Cards 

> Carrier Pre Select (CPS) 

(C) 0,15€ 

Regular 

Transit 

Keynote SIGOS SIM Box Detection 

is BABT certif ied. 

(D) 0,13€ 

International Interconnect 

Termination rate 

Terminating network operator loses 

0,03€ per minute, i.e. (B) - (D) 


Early Charging Detection 

Get it right for your customers 

Use Cases > Revenue Leakage & Fraud Detection 

A common phenomenon is the scenario of Early or False Answer during voice call setup 

procedures. How do you detect and � ght these cases? 

Calls are being charged as if connected, 

without ever reaching the called party. 

The lack of Active End-to-End monitoring 

has led to millions of minutes being 

inaccurately billed to the originating 

calling parties worldwide. These fraudulent 

billings sometimes go unnoticed 

because the incremental billed call 

duration per user may be in the fraction 

of seconds. 

Prepaid SIMs used in GSM Gateways (SIM 

Boxes) could lead to false answers when 

the fraudulent SIM Box SIM credit has 

been consumed resulting in an announcement 

being played. In this instance the 

caller has to pay for the call connection 

leading to customer complaints and dissatisfaction 

with the service rendered. 

Answer 

International 

carrier(s) 

Fight fraudulent charges to your customers’ 

accounts with GlobalRoamer, the 

world-wide distributed test infrastructure 

for end-to-end testing. 

Bene� ts: 

Reduce revenue leakage caused by 

early charging / false answers 

Ensure billing accuracy and � ght 

interconnect fraud 

Improve quality of calls leading to a 

reduction in customer complaints and 

dissatisfaction 

Active end-to-end monitoring ensures 

consistency in billing 

International carrier(s) releases answer message even though call(s) are not setup 

Originating Network 

(CUSTOMER) 


Setup 

Setup 

Fraudulent early return of Answer message resulting 

Setup is not even sent to B-Party 

in charging record for non-delivered service 

Call is not established 

Unexpected answer on A-side detected and NO incoming setup on B-side 

International carrier(s) releases answer message even though call(s) are not setup 


CUSTOMER´s SIMs 

(CUSTOMER) 

on Roaming 

Setup 

International 

carrier(s) 

Answer 

Setup is not even sent to B-Party 

Fraudulent early return of Answer message 

Call is not establised 

resulting in charging recod for non-delivered 

service 

Unexpected answer on A-side detected and NO incoming setup on B-side 


Setup 

Identify leaks in your 

revenue stream 

27

28 

Use Cases > Revenue Assurance 

Ensure correct billing, 

for you and your 

customers 


Money makes the world go round – what happens if your 

network rating and billing is not correct? 

For all network operators validation of 

billing is of major importance. Operators 

must provide fair and accurate billing 

to the customer and also avoid revenue 

leakage or overcharges caused by services 

being incorrectly rated and invoiced. In 

most countries accuracy of metering and 

billing is mandatory to comply with legal 

regulations. 

As markets have become increasingly 

competitive, operators have used innovative 

tari� s, product and service bundles 

and discounts to di� erentiate themselves. 

Complex and fast changing tari� s inevitably 

create challenges in ensuring correct 

billing. 

How to guarantee correct billing? 

Three Revenue Assurance concepts 

are highlighted: 

Test Call/Event Generation 

CDR Testing 

Tari� Testing 

Test Call/Event Generation 

Test call and event generation can be as 

basic as creating network events by generating 

calls to test the correct function of a 

network or its subsystems. 

SITE is ideally suited as a Test Call/Event 

Generator for Revenue Assurance projects 

generating its CDRs to be referenced with 

the network’s ‘live ‘CDRs. 

Operators need to recognize the value of 

more than just test call generation; you 

need to be able to store CDRs to perform 

veri� cation and detection for errors 

AUTOMATICALLY. 

Testing that is both end-to-end and independent 

can provide the assurance that 

the customers are being correctly billed 

as well as satisfying compliance requirements. 

Today, manual tests not only provide inaccurate, 

untrustworthy but in most cases 

cost ine� cient testing. To ensure correct 

billing, a precise and reliable Revenue 

Assurance system is essential. With a 

SITE test system, continuous testing of 

all services provides maximum assurance 

that all calls are being correctly billed as 

each network element can be tested and 

veri� ed. 

The reliable Revenue Assurance 

solution comprising CDR 

generation, CDR comparison and 

tari� modeling is BABT certi� ed. 

New product pre-launch testing – 

can we bill accurately and reliably for 

the product? 

Testing of correct function after 

product updates – does the 

mediation system still summarize 

all CDRs correctly? 

Testing of software patching on 

switches and other infrastructure – 

are we still producing correct CDRs 

for all call classes? 

Testing new infrastructure during 

and after roll out, e.g. new base 

stations. 

Testing of roaming tari� updates – 

are roamers, still being billed? 


CDR Testing 

Timely detection of revenue leakages 

You want a solution which compares CDRs generated by network nodes like the MSC or 

SGSN in a highly automated way and sends alarms mismatches. 

SITE acts as a Test Call/Event Generator, it 

is capable of importing ‘live’ CDRs from the 

network and comparing them with the 

reference CDRs generated by SITE. 

The ‘live’ CDRs of the generated test calls 

are extracted at a chosen point in postprocessing 

for automated comparison by 

the test system. 

CDRs can be veri� ed and erroneous CDR 

� elds such as faulty time stamps and call 

duration can be detected. 

Test Call 

Generation 

SITE SITE System 

Virtual SIM SIM Transfer 

Automated E2E Call Processing 

Live Network 

CDR Structure 

Record Type: e.g. TimeBased, 

VolumeBased, EventBased 

Service Type: e.g. SPEECH, FAX, GPRS 

Begin of event: timestamp in milli- 

seconds 

A Number 

B Number 

Call Duration (Time based calls) 

Data Volume (Volume based calls) 

Event Count (Event based calls) 

CDR 

Postprocessing 

(unrated) SITE CDRs 

(rated or unrated) 

Operator CDRs 

CDR Import CDR Import* 

Reference CDRs derived from SITE test results Live CDRs imported via e.g. csv-�les 

Reference 

CDRs 

CDRs 

unrated CDR Comparison 

Mediation 

System 

Filter* 

Live CDRs 


Billing 

Rated CDRs 

Unrated CDRs 

* Customization required 

Are Core Network nodes like MSC or SGSN generating the right CDR data? Deploy a test 

event generator which generates CDRs that you can compare with your network CDRs. 




customers 

29

30 




customers 

Tari� Testing 

Proactively monitor tari� plans against variety of test cases 

You want a solution which not only compares CDRs but also detects billing errors before 

they turn into customer complaints or revenue losses. 

Rating 

At the heart of the billing system is the 

rating engine. This takes the CDRs (call 

detail records) or IPDRs (internet protocol 

detail records) from the network, and 

then applies the appropriate rating plans 

to turn this information into rated CDRs 

ready to be associated with the customer. 

Test Call 

Generation 

SITE System 

Invoice comparison 

Resource allocation for di� erent users 

or groups 

Detailed test reports 

Revenue stream audit 

Virtual SIM Transfer 

Automated E2E Call Processing 

Covering billing aspects of outbound 

roaming 

Live Network 

Billing Veri�cation 

Rating 

Tari� Model* 

Billing 

Once a CDR has been rated it is applied to 

the customer‘s account, where discounts 

can be applied and from which a bill is 

created. Operators usually produce bills in 

cycles, spreading the load over a month 

or quarter and also evening out cash � ow. 

Within SITE your tari� model can be replicated. 

Thus, not only the raw data of CDRs 

can be compared but in addition also the 

correct billing of a service can be veri� ed. 

Thanks to SITE, fast regression testing 

of new pricing plans against a variety of 

test cases can be performed, detecting 

potential � aws in the billing process at a 

very early stage. 

Tari� 

CDR Model 

Postprocessing 

(unrated) SITE CDRs 

(rated) 

Operator CDRs 

CDR Import CDR Import* 

Reference 

CDRs 

CDRs 

unrated CDR Comparison 

Mediation 

System 

Filter* 

Live CDRs 

Billing 

Rated CDRs 

Unrated CDRs 

* Customization required 


Prepaid SIM Recharging 

With prepaid subscribers you make substantial pro� ts 

Prepaid subscribers expect correct voucher recharging. 

Keynote SIGOS provides a tool to verify 

Prepaid SIM Card Recharging. 

SITE or GlobalRoamer have the ability to 

check if recharging procedures of prepaid 

cards has been performed successfully. 

Test Cases collect information about the 

current account balance and establish a 

call in the same way a subscriber does. 

That means entering vouchers using 

DTMF tones for navigating IVR menus or 

using USSD commands where supported. 

After a SIM card recharging attempt the 

account balance of a dedicated prepaid 

SIM card is re-checked and compared to 

balance before recharging attempt. 


Besides using single vouchers (e.g. from 

scratch cards) for a single test, Keynote 

SIGOS Test Systems support comprehensive 

voucher repository functionality 

managing numerous numbers. 

Further customer speci� c account veri- 

� cation methods (e.g. via SMS) are also 

supported on request. 

Sample Features 

Detection of revenue leaks due to SIM card 

recharging errors 

Increase of customer satisfaction and spending 

due to error free SIM card recharging 

Simpli� ed prepaid SIM card handling in 

the central SIM Multiplexer 

Sample KPIs 

Initial account balance 

Account balance after recharge 

Used Voucher for recharge 

Received USSD response string 

USSD process duration 




customers 

31

32 

Use Cases > Fixed & IP Network Testing 

Beyond mobile – the 

other kind of 

telecommunications 

Fixed Network Testing 

NGN evolution calls for multi-technology testing 

With the explosive growth in the mobility arena, one could almost believe that the 

future of � xed networks was doomed. However, � xed networks continue to maintain 

their relevance, with technological evolution requiring new test approaches. 

Technological advances and the complex changeover from established technologies to 

new ones triggers the need for ensuring consistency of service quality over all underlying 

technologies. 

Poor service quality inevitably leads to loss of pro� t – if, for example, the line is bad the 

conversation will be short. 

With the SITE test system, Keynote SIGOS provides ONE platform for testing all technologies 

– � xed, mobile and IP-based, either within one technology or across technologies. 

Fixed network operators bene� t from SITE through: 

Periodic service quality testing 

Ad-hoc service quality testing 

SITE supports all interfaces required for � xed network testing: 

PSTN 

ISDN 

DSL 

IP (VoIP) 

KPIs for � xed network testing (examples): 

Delay 

Echo Delay 

MOS Value 

Testing in all network technologies, mobile, � xed and IP 


IP Network Testing 

Optimize your data network performance 

Slow access, error pages and unsuccessful orders? Just started VoIP services? Are you relying 

on your customers to � nd out about incidents, availability, speed and load issues? 

Mobile has made its impact on connecting 

the ‘last mile‘, particularly for voice 

communications, but has yet to make its 

impact on higher speed links and at least 

one mobile company has admitted that 

it cannot deliver the speeds contained in 

the 3G speci� cations. 

So where do � xed networks with IP connections 

beat radio-mobile? When capacities 

and speeds are high, where Internet 

access is required or where there are large 

� les to be downloaded, then the optical 

� bre link remains supreme, whether it 

is a link to a corporate client, a national 

backbone network or an international 

submarine cable system. 

Web Browsing (HTTP) 


Duration between the �rst and last http data packet 

HTTP Data Size 

Duration of web browsing session 

HTTP Valid Page Content 

SOAP 


Response Time of SOAP 

server in seconds 


TCP/IP Command 


TCP/IP command 

Duration of TCPIP command 

Use Cases > Fixed & IP Network Testing 

SITE measures the user perception 

of your services 

SITE checks the quality of your calls 

in real time 

Use SITE for proactive supervision! 

Secure your IT with SITE End-to-End 

monitoring! 

SITE measures and alerts you in real 

time! 

Ping (ICMP) 


Round-trip time (min, mean, max) 

Packet loss 

Size of Ping packet 

FTP 


Network Non-Accessibility 

File Size 

Download Duration 

Upload Duration 

IP Service Failure Ratio 

DNS 


DNS Query Duration (min, average, max) 

DNS Host Name Resolution Time 

DNS Host Name Resolution Failure Ratio 

Beyond mobile – the 

other kind of 

telecommunications 

33

34 

Use Cases > Core Network Testing 

Inside out – core network 

testing can save 

money 

Mobile Core 

Network Interfaces 


Service Testing independent from Radio Problems 

Testing without Radio Access 

In some cases the active test approach 

of using test mobiles on an air interface 

can be counterproductive because radio 

speci� c problems can disturb results without 

adding any value. A typical example 

is roaming testing, where the problems 

come from the core network. For such 

cases there is bene� t in testing the services 

by means of simulating the radio 

access part, connecting directly to the 

core components such as the MSC, SGSN 

etc. without involving the radio access 

components. 

Typical use cases for testing 

without radio access part: 

Mobile Core Network 

Interactive Voice Response incl. 

interactive announcement tests 

Testing of Supplementary Services 

Testing of IN Services 

Inbound Roaming tests 

Load Tests on Core Network 

components 

Billing Testing via CDR tests 

Data Content Testing 

Handset Simulation 

etc. 

see page 2 

Regression Testing 

Another instance where connection direct 

to core network components is required is 

where tests need to be executed in a very 

short time. This is typically the case when 

network components like the MSC or 

SGSN have been updated or where the in- 

� uence of a high number of concurrently 

connected subscribers has to be checked 

immediately and automatically. Such 

kinds of regression testing can usually be 

executed in less than 20 minutes whilst 

still covering all services and subscriber 

pro� les. 

Typical use cases for regression 

testing without radio access part: 

Automated regression testing after 

upgrade/updates on: 

MSC (via GSM A) 

MSC and � xed network switches 

(via ISUP) 

SGSN (2.5G) via Gb 

MSC-Server via IuCS 

SGSN via IuPS 

SMSC, MMSC 

WAP-, Web-, Mail-Server 

SCP testing including IN services 

and prepaid services 

etc. 

Typical advantages of 

core network testing: 

Not in� uenced by radio speci� c 

problems 

Fast execution of mass tests 

(e.g. thousands of tests in an hour) 

Quick results 

Detailed trace analyses with 

protocol stack information 


Use Cases > Nomadic & Indoor Testing 

Nomadic & Indoor Testing 

Portable local unit for � exible deployment and mass testing 

Indoor: Shopping and Exibition Centers or Airports – places of communication. 

But do mobile services work properly everywhere? 

There are a lot of interesting and revenue 

generating use cases for indoor testing. 

Especially in international airports where 

testing of inbound roaming characteristics 

is crucial to secure lucrative business. 

Also exhibition centers and shopping 

centers are typical buildings where 

subcribers very often experience lack of 

service. Furthermore it is worthwhile to 

mass-deploy the cost-e� cient nomadic 

units in o� ce towers with a lot of business 

customers. For indoor testing either the 

air interfaces or direct LAN connection can 

be recommended. 

Sports and Social Events: Testing campaign of short time frame and short notice. 

The Nomadic local unit is also ideally 

suited for short-term campaigns like 

sport events. A lot of sports fans gather at 

top level events like Formula 1 or soccer 

championships and expect high levels 

of service quality. Due to its fast installation 

the nomadic units can be quickly 

rolled out even at short notice. After easy 

deployment at temporary locations this 

autonomous system sends network information 

back via its air interfaces. 

Rural Areas: Where there are people there should be communication. 

Especially in remote areas it is often impossible 

to install local units, as no � xed 

IP connection is available. In this case the 

nomadic local unit is capable of establishing 

a permanent IP connection via 

GPRS/EDGE/HSPA modem. The connection 

is upheld via IPSec tunneling. By this 

means, test probes can be quickly installed 

in rural areas where you cannot rely 

on wired IP connections. The Nomadic 

local unit is the ideal solution for � exible 

deployment in the � eld. 


Reach out to remote 

and temporary 

locations 

35

36 

Invest in the future! 


test systems adapt to your demands.

The Test Systems 

Outbound 

Roaming 

Testing 

Roaming 

Testing 

Core Network 

Testing 

Steering of 

Roaming 

Testing 

GlobalRoamer 

The Reference System for world-wide testing 

Largest footprint of world-wide test probes 

Managed and serviced by Keynote SIGOS 

Extensive set of test case applications 

Clients 

QoS Tools 



SITE 

Central Unit 

LAN / WAN W 

LU CLU 

LU 

CLU 

SITE 

The Unique Test Platform for various technologies 

Mobile / Fixed / IP testing 

Core Network testing 

Globalize with GRP 

LU 

SIM 

Multiplexer 

CLU 


QoS Tools for 




Tra�c 

WLU 

MLU 

Revenue 

Assurance 

Tool 

International 

Carrier 

Testing 



Tra�c 

World-wide 


QoS Testing 

Drive Service 

Testing 

Handset 

Speci�c Speci�c 

QoS Testing 

GO GLOBAL with GRP 

37

38 

Test Systems > GlobalRoamer 

GlobalRoamer 

The On-Demand world-wide test platform! 

Challenge 

End users demand and expect a high 

quality, reliable service from their chosen 

network operator and a similar experience 

regardless of where in the world they are. 

Therefore, permanent surveillance of the 

roaming network is indispensable but 

extremely di� cult due to a lack of operational 

visibility of the roaming partners’ 

networks. 

How does it work? 

Solution 

GlobalRoamer allows you to verify that all 

services are available to your customers 

who are traveling world-wide. With test 

probes in 180+ countries you have your 

world wide testing platform without 

investing in infrastructure. Just buy your 

testing package and run your tests worldwide. 

Managed Services are on o� er to all Operators looking for an e� cient solution! 

For testing in mobile networks, by means of Keynote SIGOS SIM Multiplexing technology, 

your SIMs are capable of being virtually transmitted to any of GlobalRoamer’s extensive 

network of remote test stations in more than 230 locations, where tests simulating end 

customer experience are performed. Complete, real time visibility of the resulting network 

messaging allows rapid fault resolution. GlobalRoamer also allows you to perform tests 

across technologies, e.g. Fixed and IP networks as Fixed Mobile Convergence (FMC) becomes 

more prevalent! 

Automated active End-to-End 

Testing and Monitoring 

Get the full picture on what your 

customers experience world-wide 

Initiate reproducible test cases which 

cannot be done with passive monitoring 

solutions 

Unique SIM Multiplexing Technology 

SIM cards are hosted centrally from 

where they are virtually transmitted to 

any of GlobalRoamer’s remote test 

stations where the actual test is 

performed 

Global Testing Network 

GlobalRoamer’s extensive global 

network of test stations allows access 

to three quarters of the world’s 

countries and is continuously being 

expanded 


All you need to do 

Order your account at Keynote SIGOS 

For testing in mobile networks: 

send your test SIM cards to Keynote 

SIGOS! 

Access the world-wide test network 

via the internet! 

De� ne and set your tests running! 

Collect the results! 


GlobalRoamer Login 

The World at Your Fingertips 

NETWORKS 

630 

631 

632 


COUNTRIES 

180 

181 

182 

LOCATIONS 

239 

240 

241 

Enter the most extensive global network test system from your desk and gain access to: 

How to access 

GlobalRoamer? 

GlobalRoamer is growing continuously. 

Please contact us for the current footprint and more details. 

Q2 2012 

39

40 

What is 

GlobalRoamer? 


The High Performance Global Test Infrastructure 

On-Demand End-to-End Test System for Roaming Situations and More… 

Get access to test 600+ networks in 

more than 90% of the world’s countries 

Continuous growth of telco networks 

accessible through GlobalRoamer 

Fully hosted and continuously 

expanded by Keynote SIGOS 

2G, 2.5G, 3G and LTE network probes 

Fixed network probes available 

The Cost-e� ective Testing 

Solution 

Take Advantage of Deploying 

GlobalRoamer – Without Having to 

Think About Labor Intensive Operations 

Simply start using GlobalRoamer – no 

maintenance, no CAPEX 

No setup or exit fees for 

GlobalRoamer use 

Flexible packages available (‘prepaid’ 

for ad-hoc testing / ‘� at-rate’ for 

periodic testing) 

Pay-as-you-use concept 

The Time-Saving and 

Customizable Tool-Box 

Enjoy the Convenience of Prede� ned 

Tests and Reports – Whilst Keeping the 

Option to Customize 

Comprehensive libraries of test cases 

and report templates – save valuable 

time 

Customer-speci� c test cases and 

reports allow for full � exibility 

User-friendly web-based graphical 

user interface 

The Independent Round-the- 

Clock Event Generator 

Bene� t from Availability and 

Accessibility to the Whole World – 

Anytime, Anywhere 

Easy web access allows 24/7 

availability, irrespective of time-zones 

Independence and convenience 

through pre-scheduled 

automated test execution 

Massive world-wide test capacity, 

your SIMs can be used almost 

anywhere at any time 

The Reliable Sentinel – 

Always on Duty 

Keep Track of Your Network – On-time 

and Relevant Information Delivery at 

your Fingertips 

Extensive alarming, performance 

noti� cation and reporting 

functionality 

Customizable alarms to alert you to 

any network issues 

Adjustable information-depth (from 

high-level overview to deepest-deep 

details) 

Continuous network surveillance with 

reports (several styles, from graphical 

to plain text) 


Use Cases 

Service Quality in outbound roaming 

(on-demand testing / periodic testing) 

Full range of QoS applications 

(Voice / SMS / Data) (page 14) 

Outbound Roaming Testing GRQ 

GSMA compliant testing (page 22) 

Steering of Roaming (SoR) Testing 

Evaluation of proper application of 

Steering of Roaming and detection 

of Anti-Steering activities (page 24) 

Fraud Detection for International 

Tra� c 

SIM Box Detection, False Answer 

Detection (page 26) 


Full range of QoS applications 

(Voice / SMS / Data) (page 25) 

Outbound 

Roaming 

Testing 

Mobile Network Operators 

Fixed Network Operators 

Mobile Virtual Network Operators 

(MVNO) 

Carriers 

Content Providers 

Regulators 


Steering of 

Roaming 

Testing 

Clients from all over the 

world rely on GlobalRoamer 

QoS Tools 


Revenue Assurance in an international 

context 

CDR Comparison, Roaming Tari� 

Model Testing (page 28) 

International Interconnect 

Management 

CLI Veri� cation, Voice Quality (MOS), 

Call Setup Time, Call Attempt Success 

rate…etc. (page 25) 

Benchmark Testing in operator groups 

See how your network performs 

within one operator group (page 19) 

Service Level Agreement (SLA) 

Veri� cation 

Verify the ful� lment of Service Level 

Agreements (page 22) 

Handset speci� c Testing in outbound 

roaming 

Automated content testing with a 

broad selection of simulated handsets 

(page 18) 



Tra�c 

Departments (Examples): 

Service Quality Management 

Operation and Maintenance 

Roaming 

Billing 

Fraud Management 

Marketing 

Interconnect 

International Business 



International 

Carrier 

Testing 



Tra�c 

World-wide 


QoS Testing 

Use Cases for 

GlobalRoamer 

Who bene� ts from 

GlobalRoamer? 

41

42 

Why SITE? 

Test Systems > SITE 

SPEECH DATA 

Voice 

Voice Quality 

Suppl. Services 

IVR 

Push-to-Talk 

VoIP 

Echo 

SITE 

One platform for all your End-to-End test requirements 

Challenge 

Today, network operators are confronted 

with an extremely dynamic market and 

the challenges of keeping up with new 

technology, permanent surveillance of 

Service Level Agreements (SLA) and reducing 

cost – whilst also maintaining customer 

satisfaction. Since these tests can be 

both, labor-intensive and costly they are 

too often neglected. To meet these challenges 

preventive and permanent Service 

Quality Assurance by means of End-to-End 

testing is essential. 

Get the full picture of your end users’ 

experience (QoE) and act, instead of 

reacting to customer complaints 

Continuously monitor service 

availability, test and measure quality 

(KQI) and performance (KPI) 

Upfront testing ensures a smooth 

roll-out for new services and new 

technologies 

Initiate reproducible test cases which 

cannot be done with passive 

monitoring solutions 

Comprehensive network diagnosis, 

reporting and alarming 

Services can be tested before 

commercial release 

Solution 

Keynote SIGOS has developed the most 

advanced automated test system available 

on the market. SITE is the proven and � exible 

test platform for cost- and time-saving 

automated Active End-to-End testing. 

With SITE, telecommunication operators 

all around the world bene� t from its 

unique versatility. SITE’s modular structure 

and scalability ensure it can always be 

matched exactly to your requirements. In 

addition, your local SITE system can go 

global by connecting to the world-wide 

GlobalRoamer probes with our ‘Global 

Resource Pool’ feature – all in one go! 

Why Automated Active Testing and Monitoring with SITE? 

SITE Solution Tests ALL 

Network Services Network Interfaces 

DATA IP (CS/PS) 

Web/Wap Browsing 

E-mail 

Streaming 

Video Telephony 

Video Quality 

Digital Rights Mgmt. 

Identi� cation and localization of 

service and network can be achieved 

before actual service degradation and 

threat of revenue losses 

Reduced time and risks to install or 

modify network infrastructure by 

providing extensive recursive testing 

capability 

Reduced operating costs by 

automating monitoring, testing, and 

reporting; increased personnel 

e� ciency; costs not correlated with 

network size and growth 

Number of test cycles is � exible 

MESSAGING FIXED RADIO IP CORE 

SMS 

MMS 

Mobile IM 

iPhone 

BlackBerry 

ISDN S0 ISDN PRI S2m PSTN a/b 

LTE Uu HSPA+ / DC 

UMTS U u 

EDGE 

GSM U m 

CDMA 2000 

GSM-R 

WLAN 

DSL 

Ethernet 

MM7 

SMPP, UCP, CIMP 

SMTP / IMAP 

POP3 

I u CS / I u PS 

GSM G b 

GSM A 

ISUP 

SS7 

IN / CAMEL 

MAP (HLR/VLR) 

S1 


Open, Modular and Customizable – Just the Right System, Always 

SITE is an open system and can be easily integrated into existing test environments 

Existing equipment can be directly linked to SITE and controlled and monitored 

through the SITE system 

Software updates, con� guration modi� cations and problem resolution are quickly 

and reliably performed by Keynote SIGOS 

SITE’s modular structure – software and hardware – guarantees maximum 

� exibility in service and protocol testing 

From portable and Stand-Alone Systems in test laboratories to distributed systems 

covering the geography of an entire live network, everything is possible 

ONE Test System, ENDLESS Testing Options 

SITE uniquely combines Quality of Service (QoS) testing with the ability to deliver 

Core Network Testing – all in ONE test system 

Mobile, Fixed, VoIP testing 

Protocol test interfaces 

SITE enables both, single technology testing as well as cross technology testing 

Mobile / Fixed / IP-based - all kind of combinations can be tested 

2G, 2.5G, 3G and beyond – all mobile network technologies can be tested 

SITE enables thorough testing of all relevant mobile and BlackBerry services, even 

taking handset speci� c characteristics into account if desired 

Voice 

Messaging 

Data 

Video 

Value Added Services 

SITE provides test solutions for billing veri� cation and other revenue assurance related 

applications 

Roaming 

Testing 

Core Network 

Testing 


Clients 


SITE 

Central Unit 

LAN / WAN 

LU CLU 

LU 

CLU 

SIM 

Multiplexer 


QoS Tools for 


LU 

CLU 

WLU 

MLU 

Revenue 

Assurance 

Tool 

Handset 

Speci�c 

QoS Testing 

Drive Service 

Testing 


What is SITE? 

43

44 


How does it work? 

Central SIM Multiplexing Technology – an Unparalleled ‘Teleporter’ for SIM Cards 

SIM cards are centrally hosted and virtually transmitted to any of the system’s remote 

test stations where the actual test is performed. 

SITE can handle thousands of SIM, USIM or Micro-SIM cards in cascade-style boards. 

Subscriber information from a SIM card is read out by the system and transmitted via a 

LAN/WAN network to any test location required. 

The SIM authentication procedure is handled virtually between the wireless interface in 

any location and the real SIM stored in the central SIM Multiplexer unit. 

Intuitive Workbench – Tailored to Users’ Speci� c Demands 

Comprehensive set of tools are available for Test Creation, Diagnosis as well as 

Alarming and Reporting to adapt SITE exactly to user demands. (see page 50) 

Con� gurable user access rights 

User-friendly and intuitive Graphical User Interface which can be accessed from 

Windows and Linux platforms alike through the Inter- or Intranet. 

Role-based GUI views provide the right level of information and tools depending on 

the user’s role (Test / Report / GIS / Admin). 

Network 

Expert 

Test 

Analysis 

Test/Report 

Test 

Manager 

Test 

Admin 

Test Case 

Designer 

Test 

Design 

GIS 

The SITE Architecture – Ensuring High-Performance, Security and Stability 

SITE runs on a stable, Linux based server solution o� ering highest standards 

of redundancy. 

SITE client workstations can be either Windows or Linux based. 

To ensure maximum performance, the SITE System uses an open SQL database. 

All con� guration information, test results, measurements and KPIs are stored logically, 

to provide clear measurement and reporting capabilities. 

Using powerful � lter functionality any database listing can be easily modi� ed and a 

multi-format export function allows the sharing of data with other network support 

tools. 

Behind the Scenes – SITE’s Unique Test Management 

GIS 

System 

Administrator 

System 

Health 

Admin 

Data 

Bases 

User role-based GUI 

always gives the right 

level of information to 

the user 

SITE can execute tests at any time desired. Via the scheduler window a single or group 

of tests can be de� ned once or periodically, based on very � exible selection criteria of 

date, day, time, frequency and number of repetitions. 

To avoid any resource con� ict, an intelligent resource management system controls 

access to interfaces and SIM cards, assuring smooth operation and maximum test 

parallelism. 

The self-management checks system components regularly and generates an alarm 

(SNMP-Trap) in the event of any failure. 


Globalize your SITE system and take o� with GRP! 

With Global Resource Pool your SITE system gets access to test probes all over the world 

Most SITE solutions are deployed for 

testing networks within national boundaries. 

Some existing SITE installations cover 

international testing by deploying SITE 

Local Units in neighboring countries for 

purposes of outbound roaming testing 

and fraud detection. 

The unique ‘Global Resource Pool’ (GRP) 

feature now allows users to connect private 

SITE systems with the world-wide network 

of GlobalRoamer test probes. By this, 

it means your local SITE system can get 

access to Keynote SIGOS hosted probes in 

more than 580 networks world-wide! 

As GRP connects to GlobalRoamer, 

which comes as a scalable pre-deployed 

infrastructure owned and managed by 

Keynote SIGOS, Operators are liberated 

from cumbersome manual implementation, 

operations and maintenance of these 

Remote Test Interfaces. 

GRP currently contains GSM Um and 

UMTS Uu interfaces which are all available 

for testing. 

Connect your local SITE system to the world-wide GlobalRoamer probes 

with the unique „Global Resource Pool“ feature! 



GO GLOBAL with GRP 

45

46 

Main Hardware 

Components 

Test Systems > SITE > Hardware Components & Interfaces 

Sample Interfaces 

Hardware Components & Interfaces 

Scalable and highly � exible infrastructure! 

Central Unit 

This is the base of the whole Keynote 

SIGOS Test System SITE. Everything important 

is integrated: O&M Manager, Scheduler, 

Resource Manager and Test Execution 

Manager. 

Central Unit Extensions (CUX) are important 

to give the possibility to increase the 

number of parallel running test cases. 

SIM Multiplexer 

The SITE SIM Multiplexer has the capacity 

to handle up to 225 SIM cards at a time. 

There is no limit to the number of SIM 

Multiplexers connected to the SITE System, 

resulting in an unlimited capacity to manage 

thousands of SIM cards. 

Any SIM authentication procedure is 

handeled between the real SIM stored in 

the Multiplexer and the relevant interfaces 

(wireless / core). 

Test Interfaces 

SIM Card Board 

Keynote SIGOS’ SITE Test System supports 

the whole range of today’s telecommunication 

networks. Testing them needs 

multiple interfaces which are integrated 

in the SITE systems. 

19” (rack mount) 

100 V - 240 V, max 8A – 4A, approx. 450 W 

SIM Server 100-240 V 1A, 50/60 Hz 

Low power consumption 

Compact design, only 3HU 

Compatible for SIM, Micro SIM, USIM, 

R-UIM 

Automated voltage negotiation for 

each SIM card position 


Remote Components 

The remote units, also called local units, 

are installed wherever they are needed for 

2G, 2.5G, 3G and LTE or core network tests. 

1) stationary: to be used in a static location 

2) portable: can be moved from one location toanother 

3) mobile: can be used along the way 

Nomadic 

Device Gateway 

As extension to an existing SITE System the 

Device Gateway enables the connection 

of real devices (USB data sticks and Smart 

Phones) for QoE testing. 

All Components: 

Developed by Keynote SIGOS, made in Germany. 


Test Systems > SITE > Hardware Components & Interfaces 

CLU5 / WLU5 

Local Unit 

Remote Components 

MLU 

47

48 

Deliver high performance! 

Keynote SIGOS puts the optimum 

instruments in your hands.

The Test Tools 

On SITE and GlobalRoamer 

Reporting & Alarming 

> Dashboard 

> Matrix Report 

> GIS 

Test Creation Tools 

> Test Case Editor 

> SITE Recorder 

> Test Sequence 

> Control Structure 

Diagnosis Tools 

> Service Alarm Map 

> 3G Layer 3 Tracing 

49

50 

Reporting 

Alarming 

Test Systems > Test Tools > Reporting & Alarming 

Reporting & Alarming 

Fully integrated in GlobalRoamer and SITE 

SITE and GlobalRoamer Reporting enables 

users to create, view and forward multiple 

reports. These reports are generated from 

measurements collected in the KPI database. 

These reports can either be based 

on Keynote SIGOS standard Key Performance 

Indicators (KPIs), customized KPIs 

or KPIs according to ETSI standards. 

Report creation is done by means of an 

easy drag-and-drop arrangement. SITE 

and GlobalRoamer Reporting o� ers the 

possibility to visualize test results using 

various graphical tools, serving even very 

speci� c presentation and monitoring 

needs. 

Test Executions 

Raw-Measurements 

(Input and Output) 

Test Execution on di�erent locations 

Measurements 

Strategy / KPI design 

KPI Database 

Flexible standard charts and diagrams 

as well as enhanced functionalities like 

“histograms”, “percentile”, “ad hoc reporting” 

and “derive to” can be immediately 

generated from recorded KPI data. 

Real time alarming is also embedded: 

resulting alarm noti� cations are automatically 

distributed via SMS, e-mail, SNMP, 

etc. to de� ned recipients. Users can de� ne 

threshold-settings, counters, severity 

triggering points, etc. which control when 

alarms should be generated or cleared. 

Reports can be illustrated in di� erent 

ways, either charts in various formats; 

markers, bars, lines etc, or by matrix tables 

to provide a fast color coded overview of 

vital services or speci� c KPIs. 

Online 

Reporting 

Measurement processing: from test execution to test reports 

All solutions of SITE and GlobalRoamer Reporting allow the users to observe KPI performance 

in an optimal way: analysis of trends / analysis of incidents based on locations or 

based on service problems. 

Who bene� ts from reporting functionality? 

real time 

reporting 

alarming 

Post 

Reporting 

Report 

De�nition 

Telco Service Manager, who read service performance reports 

Network Experts, who analyze test results and trace information 

Report Designer, who set up reports 


Dashboard 

This Graphical User Interface (GUI) system 

tool provides a simpli� ed intelligent 

interface to SITE and GlobalRoamer reporting. 

It is of special interest to the people 

responsible for the service, who want 

to work intuitively without any training 

e� ort. KPIs can easily be � ltered and individually 

stored in a few clicks. Individual 

con� gurations allow additional, more 

customer-oriented, data analysis. Fast 

and easy drill down to individual traces is 

possible directly from the Dashboard. 

Matrix Report 

The Matrix Report environment allows the 

user to view Key Performance Indicator 

(KPI) data as a numerical value, which can 

be easily color coded to provide a quick, 

easy to understand overview of network 

performance. Service KPIs can therefore 

be displayed in a format which is especially 

useful for Network Management 

and Operations personnel. 

GIS 

For service testing “on the move”, a Google 

Maps based Geographical Information 

System (GIS) is integrated into SITE. 

Each drive test case collects position data 

from a GPS receiver during ”visibility“ of 

GPS satellites. These are displayed in a 

GIS. This means that after service testing 

a rich set of KPIs according to GPS data 

locally analysed, displayed on operator´s 

individual geographic maps or on Google 

Maps. 


Test Systems > Test Tools > Reporting & Alarming 

Dashboard 

Matrix 

GIS 

51

Test Systems > Test Tools > Test Creation Tools 

Test Case Editor 

SITE Recorder 

Test Sequence 

Control Structure 

Test Creation Tools 

Easy and time saving con� guration! 


SITE provides large libraries of Test Cases 

for main network services in various formats 

with detailed parameter options. It is also 

possible to create customized test cases by 

means of the assembly of various test steps 

via a user-friendly drag-and-drop mechanism 

that SITE provides in its Test Case 

Editor environment. Complex scenarios 

can be quickly built to enable the testing 

of new network services. 

SITE Recorder 

This Tool allows intuitive automated recording 

of browsing actions taking handset 

characteristics into account. 

Mobile and provider speci� c web and 

WAP pages are retrieved from the network 

via the test probes during recording 

sessions to get a feel for real download 

behavior and latency. Traces are shown 

live while the developer is browsing. 

The test case can be evaluated before 

saving the entire browsing session for replay. 

Full feature support by the Test Case 

Editor makes later adaptation of recorded 

browsing sessions easy. It is like having 

full and instant remote control access to 

a speci� c handset or browser in a remote 

location – with no need to travel anywhere 

to use it. 

Control Structure 

The Control Structure enables test users 

to easily create tests at various locations 

and with di� erent SIM cards. It uses the 

logical operators: 

list based ”FOR EACH“ 

condition based “REPEAT” 

time based ”WAIT“ 

Test Sequence 

The goal of the test sequence concept is 

to save execution time by avoiding the 

resource consuming location update process 

being repeated for each subsequent 

test case. 

Usually a test case starts with a switched 

o� mobile terminal. The side-e� ect of this 

approach is that each test case has the 

following procedure: 

location update 

make a call (service test 1) 

switch o� 

Each of these steps often require more 

than one minute each to complete. 

For saving test execution time, an arbitrary 

number of service tests can be combined 

in one test sequence, which requires only 

a single location update. 

This e� ectively simulates typical mobile 

user behavior e.g.: 

switch on a mobile (location update) 


send an SMS (service test 2) 

web browsing (service test 3) 


switch o� 


Diagnosis Tools 

Keep the overview or go into details! 

Service Alarm Map 

The Service Alarm Map is used to visualize 

mobile network services that target 

a speci� c service area. Alarms that are 

generated by the failure or degraded 

performance of services can be linked 

to a speci� c network element within the 

operator’s infrastructure. 

This function is implemented by careful 

correlation between the speci� c elements 

used within a test case execution and the 

overall network topology which has supported 

the test scenario that generated 

the alarms. 

Layer 3 Tracing 

Deeper insight into message � ow with Layer 3 tracing 

Keynote SIGOS o� ers SIGOS o� ers Layer 

3 tracing for 2G, 3G and LTE which is very 

important for telecommunication network 

testing. The primary goal is to get a 

deeper insight into the message � ow and 

the protocol data exchanged between 

mobile station and network. 

On Qualcomm-based mobile probes 

Keynote SIGOS records traces of the Layer 

3 Non-Access Stratum (NAS) signalling 

messages sent and received by the mobile. 

The information contained in these traces 

is vital for monitoring and trouble- 


Test Systems > Test Tools > Diagnosis Tools 

An example could be a WAP test initiated 

from a wireless interface located at latitude 

(x), longitude (y). The topology for this scenario 

would use speci� c BTS/node B, BSC/ 

RNC infrastructure, assigned to an MSC/ 

SGSN � nally reaching a speci� c content 

portal. 

Each piece of network information and 

trace is processed to provide signi� cant 

data on the actual network performance 

and functionality, � nally the data is combined 

to give a total service area view. 

SERVICE View 

With Service view you get 

an easy high level overview 

about the status of the whole 

network. 

DETAILS View 

The Details view is accessed via 

single network elements of the 

Service view. It shows exactly 

which test case leads when to 

which failures. 

shooting the communication between 

mobile station and core network. 

Optionally, the NAS traces are supplemented 

with traces of Radio Resource 

Control (RRC) signalling messages 

exchanged between the mobile and the 

radio access network. These RRC 

traces provide valuable additional 

information, facilitating monitoring and 

troubleshooting of the Access Stratum 

(AS) as well. 

For 2G and LTE, Non-Access Stratum (NAS) 

Layer 3 tracing is supported. 

Service Alarm Map 

3G Layer 3 Tracing 

53

54 

Always at your service! 

Keynote SIGOS allows you to 

test the full range of services.

The Test Applications 

Network Registration 

> Location Update 

> GPRS Attach 

Voice / Voice Advanced 

> Voice 

> Interactive Voice Response 

> Push-to-Talk 

> Supplementary Services 

> Voice Quality 

Messaging 

> SMS 

> MMS 

> Mobile IM 

Data 

> Data IP 

> E-mail 

> WAP / Web Browsing 

Video 

> Video Telephony 

> Video Quality 

> Streaming 


> Ring Back Tone 

> Digital Rights Management 

Handset oriented testing 

> BlackBerry 

> iPhone 

> Handset Simulation 

55

56 

Test Systems > Applications > Network Registration 


Location Update 

GPRS Attach 


Fundamental for all mobile services! 

Each mobile subscriber wants to be able 

to communicate in the cellular telecommunications 

network without having to 

consider whether the network technology 

is 2G, 2.5G or 3G. 

This requires a successful mobile device 

registration on the base station subsystem 

(BSS). This is always the � rst step for 

further communication. 

Even if a call is not set up, the network 

needs to be able to communicate with 

the mobile handset to pinpoint where it 

is. Hence, a mobile network is divided into 

multiple cells (Base (Base Transceiver Transceiver Stations - 

BTS). And a a group group of cells is considered a a 

location area. 

A A mobile device in in motion keeps the the 

network network informed about changes in di� di� erent 

location areas. If the handset moves 

from a a cell in one location location area to a cell in 

another location area, area, the mobile device 

should perform a location area update to 

inform the network about the new locatilocation of the mobile device. 

Each Keynote SIGOS test case requires this 

successful network registration. 

Sample KPIs 

Location Update Duration 

Received Signal Code Power 

RX Level 

Service Type 

GPRS Attach Duration 

PDP Context Activation Duration 

Location Update procedure is performed: 

when the mobile device has been 

switched o� and wants to become 

active, or 

when it is active but not involved in a 

call, and it moves from one location area 

to another, or 

after a regular time interval because of 

signal fade 

Some aspects of the registration procedure: 

make contact with the base station 

the mobile device registers to the 

network for access 

to start a voice and/or data session 

Network location registration is not 

only necessary for each call, but 

also for location based services like 

“friends-� nder”! 


Ciphering Mode-Activation 


Request 

Ready for circuit 

switched services (Voice...) 

GPRS Attach 

Request 

Identi� Identi� cation 

Authentication 

Ciphering Mode-Activation 

GPRS Attach 

Request 

PDP Context 

Activation 

Ready for packed 

switched services (Data...) 


Mobile switch on 


Request 

Identi� Identi� cation 

Authentication 

Test Systems > Applications > Network Registration 

Location Update for CS / PS 

Domain Registration 

Whenever a mobile device wants to obtain 

service from a cell, it must make sure 

beforehand that its subscriber’s SIM can 

be registered for that cell. 

By switching on the mobile device, it 

directly requests to update its current location 

information in the network. If this is 

performed successfully, the network acknowledges 

this with a message “Location 

Update Accept”. During this process, the 

network can ask for the mobile device’s 

identity and check it against reference 

data (Identi� cation and Authentication). 

When the service “con� dential subscriber 

identity” has been activated, a new Temporary 

Mobile Subscriber Identity (TMSI) 

assignment becomes a component of the 

location update. In this case enciphering 

of user data is activated and the new TMSI 

is transmitted together with the message 

“Location Update Accept”. 

The TMSI is used for security purposes, so 

that the International Mobile Subscriber 

Identity (IMSI) does not have to be transmitted 

over the air interface. The TMSI is 

a randomly assigned identity, which is 

updated each time the mobile device is 

in motion. 

GPRS Attach for mobile data 

connection 

GPRS Attach is the process during which 

the mobile device informs the packet 

core network about its presence in the 

network. The device usually initiates the 

GPRS attach after power on. The message 

sent to the new Serving GPRS Support 

Node (SGSN) contains the last assigned 

TMSI, location area information, etc. 

After the GPRS Attach, procedure when 

the mobile device is attached to SGSN 

and has been authorized, the mobile device 

is prepared for data communication. 

So when the mobile starts communication, 

it initiates establishing of Packet Data 

Protocol Context (PDP context activation). 



GPRS Attach 

57

Voice 

Test Systems > Applications > Voice 

Push-to-Talk 

Interactive Voice 

Response 


Voice Services 

The basic elements for telecommunication! 

Voice 

Do not ignore your core services! 

Voice services are fundamental to telecommunications 

companies. It is vital 

that the user experience of these services 

is measured continuously by active testing. 

Only this can assure the quality 

of this core service. 

Veri� cation of various KPIs are performed 

on basic voice parameters, such as checking 

B-channel availability, measuring call 

establish duration and call success rate 

alerts, to name a few. 

Sample KPIs 

Call Duration 

Received CLI 

Establish Duration 

Alert Duration 

Sample KPIs 

Stop-Talking Timer Failure Ratio 

Stop-Talking Time 

Session Cut-o� Ratio 

Session Setup Time 

Voice Delay (in session) 

Voice Delay (� rst) 


CLI Check 

Call establishment to external party 

Call establishment between two parties 

Call establishment without answer on 

external side (no connective costs) 

B-Channel check 

Check of all available PLMNs 

Push-to-Talk 

Back to the Future with Push-to-Talk! 

The “push-to-talk” services turn mobile 

phones into walkie-talkies with unlimited 

range. 

The bene� t of radio-style communication, 

especially broadcasting to multiple users, 

makes it much more convenient than 

making many phone calls or even call 

conferencing. 


Test 1-to-1 or 1-to-many communication 

Play and record speech data 

Emulating PTT mobiles 

Real End-to-End Testing of 

real-time-always-on voice service 

Check SIP (Session Initiated Protocol) 

Control Plane 

Check RTP (Real-time Transfer Protocol) 

User Plane 

58 www.keynote-sigos.com Photo © T-Mobile AG

Interactive Voice Response (IVR) 

Do your voice response services work correctly? 

IVR services are deployed during Voicemail 

access and are a common feature 

of everyday life such as phone banking, 

ticketing and customer hotline services. 

Testing these systems is essential for 

network operators (and their customers) 

to assure the quality of their services. IVR 

systems are sophisticated and extremely 


Testing IVR trees 

Voice mailbox tests 

Resource allocation for di� erent users 

or groups 

Announcement comparison based on 

new voice prompts 

Easy integration of new voice prompts 

DTMF and voice stimulation 

Customer speci� c extension 

Several languages available 

Supplementary Services 

Compliments on your supplementary services? 

Supplementary services like call forwarding, 

call waiting, call barring, call hold, 

CLIP/CLIR are multi-switched services 

which require complex interaction 

within the network and its elements. 

Other supplementary services, like prepaid 

customers checking their current account 

balance, involves the GSM protocol 

USSD (Unstructured Supplementary Service 

Data). At the same time, seamless and 

instant operation of all supplementary 


Supplementary Service tests e.g. 

‘Call Forwarding’ ‘Call Hold’ 

‘Call Barring’ ‘CLIP’ / ‘CLIR’ 

‘Call Waiting’ ‘Multi Party Call’ 

DTMF and voice stimulation testing 

USSD testing 


di� cult to test on an active and reliable 

basis. 

Keynote SIGOS innovation has created a 

tool that can wholly automate this task. 

The IVR tester is designed so that even 

the most sophisticated speech menus 

may be recorded and recognized based 

on a library of voice prompts. 

Sample KPIs 

Call Duration 

Duration of played audio � le 

Length of recognized reference prompt 

Duration of recognition process 

Recognition con� dence of best 

recognized 

Reference prompt 

Recorded audio � le location 

Real duration of recording 

services, including noti� cations and 

coding of all relevant information are 

vital for a satisfying end-user experience. 

Keynote SIGOS Test Systems provide you 

with a comprehensive range of test cases 

for all relevant KPIs and the ability to 

test USSD protocol commands as well as 

operator speci� c extensions, so that your 

customers will pay you compliments on 

your supplementary services! 

Sample KPIs 

Forward Erase Duration 

Forward Register Duration 

Received CLI 

Barring Activation Duration 

Call Hold Duration 

USSD Received Response 

Test Systems > Applications > Voice 

Voice 

Push-to-Talk 

Interactive Voice 

Response 


59

Test Systems > Applications > Voice Advanced 

Voice Quality 

Referenced VQ 

(PESQ/POLQA) 

Unreferenced VQ 

(3 SQM) 

Echo Testing 

Voice over IP 

Quality Testing 

Voice Advanced 

Do you o� er excellent Voice Quality? 

Voice Quality 

Do you o� er excellent Voice Quality? 

Voice Quality is, and will remain, the 

major key performance indicator for each 

operator’s network quality. This is recognized 

by subscribers and operators alike. 

Bad voice quality represents noise, echo, 

degraded tele-conversations and immediately 

sets a poor level of user satisfaction. 

International Carrier Voice Quality tests 

can reveal crucial quality information of 

di� erent network carriers and if it has 

been impacted by the usage of IP routing 

or SIM boxes. Therefore, veri� cation of 

voice quality is essential. 

Automated test methods with the intention 

to mimic subjective tests, allow for a 

cost e� ective and consistent alternative to 

subjective testing, either on a referenced 

or an unreferenced algorithm. 

Echo Testing 

In the course of the migration of 2G/3G 

Core Network (CN) and Radio Access 

Network (RAN) towards IP based transport 

solutions the importance of Echo measurements 

raises considerably. 

In SITE, the echo itself is generated 

arti� cially and its characteristics can be 

con� gured by the user. This allows for 

the simulation of well de� ned (acoustic) 

echoes that enables users to check whether 

the echo cancellers are con� gured 

correctly. 

Sample KPIs 

Echo Return Loss (ERL) in dB 

Echo Delay in ms 

Echo Classi� cation 

(acceptable, unacceptable, side tone) 

Referenced Voice Quality 

Testing (PESQ and POLQA) 

Referenced Voice Quality testing is based 

on the ITU-T P.862 standard via the PESQ 

algorithm (Perceptual Evaluation of Speech 

Quality) and the ITU-T P.863 standard 

via the POLQA algorithm (Perceptual 

Objective Listening Quality Analysis). 

Both form the state-of-the-art techniques 

and international standards for automated 

advanced perceptual voice quality 

analysis, comparing actual test results 

with audio references. Referenced voice 

Quality Testing provides a very high level 

of accuracy. 

Sample KPIs 

POLQA MOS value (P.863) 

PESQ MOS-LQO value (P.862.1) 

Background noise 

Average delay 

Attenuation 

Signal to noise ratio 


Reference speech quality 

assessment model 

Accurate full-reference model 

Customer speci� c audio reference � les 

are easy to integrate 

Objective Mean Option Score / Perceptual 

Evaluation of Speech Quality (MOS-LQO / 

PESQ) 

MOS Voice Quality result values 

from 1-5 

Support of super-wide-band signals 

up to 14kHz 


Unreferenced Voice Quality Testing (3SQM) 

Keynote SIGOS Test Systems also support 

the Single Sided Speech Quality Measure 

3SQM (ITU-T P.563) for advanced nonintrusive 

voice quality testing. The technology 

behind 3SQM is based on a 

generic perceptual approach and so is 

independent from any original reference 

signal. 


Perceptual analysis of degradations in 

voice signals 

Non-intrusive, single ended 

analysis method 

Output score correlates well with 

subjective MOS 

Available as DLL/Library or Source 

Voice over IP Quality Testing 

Voice Quality is vitally important for any 

type of network that routes voice tra� c. 

With the shift from dedicated circuits to 

the e� ciency of IP based tra� c, it brings 

its inherent issues with regard to the 

end customer’s satisfaction with quality 

performance. 

Additional PESQ KPIs such as Real-time 

Transport Protocol (RTP), Jitter and Packet 

Loss are actively monitored. 

Performing checks on a comprehensive 

set of voice quality metrics ensures that 

IP networks run smoothly and problems 

are detected before they cause major 

disturbances leading to customer dissatisfaction. 


Test Systems > Applications > Voice Advanced 

In comparison to intrusive measurement 

techniques, such as PESQ, 3SQM is based 

on single ended measurements. In consequence, 

accuracy may not be as high 

but measurements can be worked on an 

analysis of the digital bit stream on an IP 

packet level. The measurement is limited 

to the transport stream analysis. 

Sample KPIs 

3SQM MOS value 

Noise level 

Background noise 

Beeps 

Signal to noise ratio 

Additional KPIs 

RTP Jitter 

RTP Packet Loss 

Voice Quality 

Referenced VQ 

(PESQ/POLQA) 

Unreferenced VQ 

(3 SQM) 

Echo Testing 

Voice over IP 

Quality Testing 

61

SMS 

MMS 

Mobile IM 

Test Systems > Applications > Messaging 

Messaging 

Are your Messaging Services delivered reliably and on time? 

Short Message Service (SMS) 

Still the favored message service! 

SMS is the world-wide killer application 

for network operators. 

This simple network application results 

in large percentages of revenue for every 

mobile network operator. Therefore, this 

critical revenue stream would require constant 

active monitoring so as to achieve 

consistently high quality of service. 

SMS often su� ers from long delivery 

durations, modi� cation of content or 

missing text with multiple SMS messages. 

Due to roaming complexities, SMS messages 

may be “lost” resulting in non-delivery 

of the service paid for by the subscribers. 


Check functionality of SMSC 

Check SM Service functionality at 

peak times 

Check SMS transmission time 

Sample KPIs 

SMS send duration 

SMS deliver duration 

SMS end-to-end duration 

SMS Success ratio 


Multimedia Messaging Service (MMS) 

When words are not enough! 

MMS are vital to the network operators’ 

younger and higher ARPU (Average 

Revenue Per User) customers. With its 

complex functional combination of SMS 

and GPRS, it is easy for the service to 

become unavailable in a complex mobile 

network that is often being upgraded or 

optimized. 

In order to gain acceptance as a reliable 

service frequently used by the subscribers, 

network errors must be avoided and 

uncovered by performing active continuous 

tests. 

This will safeguard the reputational health 

of the operators and ensure high quality 

standards. 

Mobile IM 

Can your customers chat via Mobile Instant Messaging? 

The real time text based communication 

between two or more participants is popular 

on PC devices, e.g. Skype, ICQ, MSN, 

Yahoo, Google… etc. This instant messaging 

platform has made the leap from 

the PC to the mobile device, connecting 

friends, peers and colleagues while they 

are on the go. 

To get connected to either � xed or mobile 

IM users, Java applets are installed on 

mobile devices delivering branded IM 

user interfaces. A single device client may 

provide access to multiple IM systems 

which transmit and receive presence 

information. 

The device clients have to be compliant 

to the Open Mobile Alliance (OMA) Instant 

Messaging and Presence Service (IMPS). 


Test Systems > Applications > Messaging 


No MM storage limitations 

MM to legacy handset tests 

User de� nable test messages 

MO/MT transmission of multipart MMs 

Segmentation and reassembly supported 

Expandable library of MMS test messages 

Logging 

Sample KPIs 

MMS send duration 

MMS fetch duration 

MMS push arrival to receive MMS Duration 

MMS connection to send duration 

MMS send to push arrival duration 

MMS end-to-end duration 

MMS Success ratio 


Registration at the IM server 

Successful login 

“Get presence”-information of other users 

and whether two parties can “see” each 

other 

Text message receipt from IM server 

Successful logout from the IM server 

Sample KPIs 

Time of OMA IM Login Request 

Session ID given from IM server 

Time when a party sends the message 

Time of OMA IM Logout Request 

SMS 

MMS 

Mobile IM 

63

64 

Test Systems > Applications > Data 

Handset Agent 

Data IP 

E-Mail 

Web / WAP Browsing 

Data 

Boost your trusted data communication! 

Data IP 

Do you meet your subscribers’ demands with GPRS, EDGE, UMTS 

and HSPA Data Services? 

Mobile IP data services o� er subscribers 

a highly e� ective way to connect to a 

dynamically rich world � lled with internet 

based services such as Email, Instant 

Messaging, websites, VoIP and much 

more. 

GPRS represents the � rst step towards 

faster access provided via EDGE, UMTS, 

HSPA+ (HSDPA / HSUPA). To maintain this 

� exibility in speed, network operators 

have to deal with the operation and 

maintenance of multiple technologies. 

This complexity drives up costs. 

Sample KPIs 

PS: GPRS Attach Duration 

GPRS access point 

PDP context activation Duration 

PDP setup Connect Duration 

PDP IP UP Duration 

CS: CSD Dialin Duration 

CSD connect assign IP Duration 

HTTP Download: 

Duration 

Throughput 

FTP: Downloading Duration 

Uploading Duration 

Mean Download Rate 

TCP Handshake (Duration) 

Handset Agent (mobiQ speed) 

The f irst Keynote SIGOS App! 

The SITE mobiQ speed measures the 

connection speed straightaway from your 

mobile device, right from where you are. 

Complementary to Keynote SIGOS QoE 

solutions, the Handset Agent delivers KPIs 

measured from any location. 

These results are pushed to the SITE 

system for further analysis and comparison 

to other data collected in SITE. In the 

SITE GIS, visualization in Google Maps or 

WMS maps is possible. 

To increase revenue and service quality, 

SITE and GlobalRoamer o� er data tests 

to access all available technologies via 

dedicated interfaces to discover service 

performance and functionality problems. 


DNS request 

Download URL 

HTTP browsing 

FTP upload / download 

Ping a host 

TCP/IP command 

Transfer rates measuring 

Sample KPIs 

Data Amount Download 

Data Amount Upload 

GPS 

Mean Download Rate 

Mean Upload Rate 

Network Type 

SIM Network Name

E-Mail 

Modern life is unthinkable without E-Mail! 

Subscribers not only need voice communication, 

they also want be in contact with 

friends and colleagues via mobile E-mail. 

In order to gain acceptance as a reliable 

service frequently used by the subscribers, 

network errors must be avoided and 

uncovered by performing active continuous 

tests. 

The question is, whether mobile E-mails 

are delivered on time to the receivers’ 

designated email addresses. 

Keynote SIGOS Test Systems provide 

E-mail testing via multiple interfaces, like 

GSM Um, GSM Gb, 3G UMTS Uu or Iu PS. 

It can be checked whether a mobile E-Mail 

can be sent and received via a POP3 / IMAP / 

SMTP server. The mobile E-Mail would be 

sent via Simple Mail Transfer Protocol 

(SMTP) to an E-Mail server and fetched via 

Post O� ce Protocol version 3 (POP3) or 

Internet Message Access Protocol (IMAP). 

WAP / Web Browsing 

What about mobile Internet browsing? 

The combination of high throughput 

protocols such as WLAN, EDGE and HSPA 

along with the variety of today’s multifunctional, 

big screen handsets have greatly 

enhanced the mobile internet browsing 

experience. The network operators need 

to ensure access to the internet directly 

via HTTP, HTTPS and FTP via a mobile 

device. 

Response, accessibility and data throughput 

are the major performance indicators 

for monitoring the quality of service. In 

addition, Web Browsing tests can access 

websites, � ll in forms, receive cookies, 

initiate secure transactions, download 

contents and much more! 



Mobile E-mail upload and download from 

an E-mail server 

Interfaces: GSM Um, GSM Gb, 3G UMTS Uu 

or Iu PS 

SMTP server 

POP3/IMAP server 

Sample KPIs 

Mobile E-mail address 

Mobile E-mail size 

Mobile E-mail fetch duration 

Mobile E-mail send duration 

Mobile E-Mail End-to-End Transaction 

Time with Noti� cation 

Mobile E-mail success ratio 


Chains of user interaction on a web 

application, e.g. a full ecommerce session 

HTTP post/get request methods 

HTTPS (SSL) for secure transactions 

Cookie handling 

Follow links both by name or URL 

Sample KPIs 

HTTP data packet duration 

HTTP data size 

Web Browsing duration 

GPRS access point 

PDP context activation duration 

PDP setup connect duration 

PDP IP UP duration 

Test Systems > Applications > Data 

Data IP 

E-Mail 

Web / WAP Browsing 

65

Test Systems > Applications > Video 


Video Quality 

Streaming 

Video Services 

Provide your customers more than moving color pixels! 


Do you provide reliable video telephony in 3G UMTS? 

High quality for Video Telephony using 3G 

UMTS is an absolute must, without which 

it is used perhaps once, and then never 

again by your subscribers! 

The premium cost paid for the use of 

UMTS service will most often increase 

customer‘s expectations regarding quality 

of service rendered. 

Due to competitive pressure, it is mandatory 

for wireless service providers to 

increase their subscribers’ average revenue 

quickly by successfully launching new 

services such as video telephony. 

At the same time, they must maintain the 

consistent high quality their customers 

have come to expect. 

Sample KPIs 

Video send duration 

Video call duration 

Video � le size 

Audio send duration 

CS Bearer establish duration 

The implementation of this technology 

often involves complex interaction between 

network nodes supplied by di� erent 

manufacturers and therefore constant 

automated testing should be applied 

to check initial con� gurations, and then 

provide active continuous monitoring of 

the service. 


Real End-to-End (mobile-to-mobile) 


Usage of standard 3G UMTS interfaces 

– no special hardware required 

Usage of standardized or customer 

speci� c video/audio sequences 

Usage of a market leading protocol stack 


Video Quality 

Is your network Video Quality excellent? 

3G UMTS opened a world of possibilities 

with multimedia applications. Customized 

infotainment like streaming video, video 

messaging, mobile TV and video telephony 

o� er a unique opportunity to create a 

market for highly personalized and truly 

inimitable mobility services. For mobile 

customers the quality of services is decisive 

for acceptance; especially for motion 

picture based services, quality is the key 

factor of success. 

Keynote SIGOS Test Systems deliver 

perceptual quality measurements to 

reproduce subscribers’ quality impression 

mapped to the mean opinion score 

(MOS), similarly to other quality tests. 

Be sure that your network’s new multimedia 

applications are more than just 

moving color pixels. 

Streaming 

What about your Streaming service? 

Today, almost every major event, e.g. 

sport, news or society events can be 

accessed via real-time multimedia streams 

on a mobile phone. These multimedia 

applications become more and more 

important in the wireless and mobile 

community. 

To make sure that customers can enjoy 

these exciting premium services, it is most 

important to guarantee an impeccable 

streaming service. Using the industry 

standard protocols RTP and RTSP, the Keynote 

SIGOS Test Systems are up-to-date 

with the latest technology. Scheduled 

and continuous active testing ensure that 

multimedia streams deliver the desired 

contents and the required quality even to 

the largest possible groups. 


Sample KPIs 

MOS value 

Delays 

Brightness 

Contrast 

Distortion indicators 

Test Systems > Applications > Video 


Real End-to-End Testing of real-time 

video services (video telephony, 

video streaming, video messaging) 

Objective MOS Video Quality result values 

from 1 - 5 (1-bad, 2-poor, 3-fair, 4-good, 

5-excellent) 

PEVQ analysis is based on human model 

of visual perception 


Parallel subsessions per stream, 

e.g. video and audio 

Send streamed multimedia over IP 

TCP or UDP transport protocols 

Measurement interval in multiple 

of 100 milliseconds 

Used industry standard RTP/RTSP 

Sample KPIs 

RTSP packets loss percent video 

RTSP packets loss percent audio 

RTSP packets received video 

RTSP packets received audio 


Video Quality 

Streaming 

67

Value Added 

Services 

Test Systems > Applications > Value Added Services 

Digital Rights 

Management 


Today’s driver of ARPU! 

Value Added Services (VAS) 

Is your ARPU driver up and running? 

Value Added Services (VAS) are considered 

today’s driver of ARPU. Operators or 

third-party value-added service providers 

(VASP), also known as content providers, 

add value to standard service o� erings, 

encouraging subscribers to optimise their 

mobile phone usage. With subscribers 

spending money on VAS, they naturally 

expect highest quality. 

Therefore, successful new VAS launch is 

mandatory while maintaining the consistently 

high quality customers have 

come to expect. The implementation of 

new VAS often involves complex interaction 

between network elements supplied 

by di� erent application content providers 

and, therefore, constant automated 

testing should be applied to check initial 

con� gurations, and then provide active 

continous monitoring of service quality. 

VAS Examples and Features 

Ring tone download by sending 

request SMS to external number 

Logo download by sending 

request SMS to external number 

Ring back tone, which enables users to 

select a melody or to record a short 

greeting that the caller will hear. These 

activations are done per SMS, per IVR 

or per Web Browsing 

Customized new value added services 


Digital Rights Management 

Make Premium Content download a premium customer 

experience and test your DRM! 

Digital Rights Management (DRM) is an 

important enabler for billing of premium 

priced content, e.g. ring tones. To cater for 

fast and � exible service creation the Open 

Mobile Alliance (OMA) de� ned application-level 

protocols and behaviors needed 

to provide powerful as well as reliable 

content download functionality. 

The scheme is implemented on most 

multi-media phones and is intended to 

be used by mobile content providers to 

control access to their products. 

The whole Digital Rights Management 

process is relatively complex and could 

introduce multiple risks of malfunction. 

At the same time, the e� ect of a possible 

error can be disastrous: unhappy customers 

if a fault occurs during the download 

and billing process of the premium priced 

content. 


Test Systems > Applications > Value Added Services 


The purpose of DRM is to enable 

controlled purchase and usage of 

digital media objects 

The Open Mobile Alliance (OMA) has 

de� ned Digital Rights Management 

speci� cations for the mobile world: 

Forward Lock (prevents the user from 

unlawful forwarding of protected 

content) 

Combined Delivery (combined rights 

object / media object) 

Separate Delivery (separated rights 

object + encrypted media object) 

Sample KPIs 

Media Download Purchase Time 

Download Session Time 

Download Media Object Access Time 

Value Added 

Services 

Digital Rights 

Management 

69

BlackBerry 

iPhone 

Test Systems > Applications > Handset Oriented Testing 


Handset oriented testing 

So many features for each new device! 

BlackBerry 

Your network`s sweetest fruit 

BlackBerry is one of today‘s leading 

wireless connectivity solutions for a large 

number of mobile business professionals 

found in enterprise and governmental 

organizations world-wide. 

It allows users to stay connected with 

secured wireless access to e-mail, corporate 

data, calendar and web, to easily 

manage all their communication and 

information from a single BlackBerry 

device whenever and wherever required. 

BlackBerry eliminates the hassles of 

dialup by moving mobile data to a “push” 

architecture. 

Especially for mobile professionals, it is 

vital that the network operator provides 

the highest levels of quality and reliability. 

Sample KPIs 

Send time 

Receive time 

Round trip time 

Battery level of the device 

Battery temperature of the device 

iPhone 

Up with the hype on iPhone tests 

For many users, the iPhone and the 3G 

iPhone represents a new era of mobile 

phone interaction and services. 

The unique combination of multimedia 

content, intuitive multi-touch display 

controls, accelerometer and much more 

created strong demand for new operator 

services dedicated only for a unique 

group of users. 

Operators around the world specify this 

group of iPhone users as high-tech – high 

potential customers with distinctive technology 

and quality demands. 


Real End-to-End testing of BlackBerry 

‘push’ service 

Testing carried out using a commercial 

BlackBerry device 

Check sending and receiving e-mails 

Check the BlackBerry device integrated 

email features 

Check BlackBerry Messenger service 

Using BlackBerry devices with a java 

application for re� ector code – for 

sending emails 

Management noti� cation and reporting 

The unique services o� ered for this 

iPhone customer base like the Visual Voice 

Mailbox create additional quality process 

demands at each network operator. 


Keynote SIGOS Test Systems o� er dedicated 

iPhone tests to � t simply into all QoS 

test procedures performed via SITE or 

GlobalRoamer without any additional effort. 

At the same time, measurements and 

KPIs provide clear evidence of the service 

availability and performance focussed on 

this group of high-tech – high potential 

customers. 

Sample KPIs 

Duration 

Failure Rates 


Do handsets work perfectly in your mobile network? 

The opportunity for mobile operators 

to sell exciting new mobile content and 

handsets is enormous, but the variety 

of available services like MMS, Video 

Streaming and Web Browsing may cause 

problems when using di� erent handsets. 

How can these new devices and services 

be properly tested in a cost-e� ective way 

that ultimately leads to increased revenue 

and customer satisfaction? 

We can help you with a powerful tool to 

test all your services, simulating the large 

variety of handsets in your network. No 

labor intensive and high-cost manual 

testing! 


Test Systems > Applications > Handset Oriented Testing 

SITE tests speci� c handset characteristics 

against network services and device 

speci� c monitoring of pages with � xed 

content/ URLs. The following important 

content questions are validated: 

Color Support: Check if device is capable 

of displaying colored images 

Image Size: Comparison of all downloaded 

images with maximum height and 

width of the device 

Content Support: Check (based on HTTP/ 

WTP accept header) if device can decode 

downloaded content 

Data Format: Check if the downloaded 

content is valid 


Intuitive Recording of browsing actions 

No drag ‘n’ drop anymore 

Support of HTML forms 

SMS noti�cation: new message 

Call the Mailbox 

Download message from Mailbox 

Easy creation and adaptation of browsing 

sessions 

Received page content at a glance 

KPIs for each browsing action 

User de� ned measurements / KPIs can be 

added with ‘Test Case Editor’ 

Whole session can be ‘Replayed’ during 

development to evaluate the test case 

Visual voice 

Mailbox 

BlackBerry 

iPhone 


71

72 

We take the load off your shoulders! 

Keynote SIGOS provides flexible 

and customizable services.

The Professional Services 

Training 

Managed 

Services 

Project Management & 

Project Implementation 

Consulting 

Services 

73

Professional Services > Managed Services 

Test Operations 

Management 

Test Infrastructure 

Management 

Managed Services 

We take the load o� your shoulders! 

– Flexible and Customizable 


Management 

Reduce your e� ort in system 

administration with TIM 

Administration & Management of your 

SITE test system 

Providing & hosting of GlobalRoamer, 

Keynote SIGOS world-wide test 

environment 

Test 

Infrastructure 

Management 

(System Hosting) 

GlobalRoamer 

World-wide test 

infrastructure 

SITE 

System Hosting 

Administration 

Maintenance 

GlobalRoamer 

Keynote SIGOS hosts, maintains and constantly 

expands the world‘s extensive test 

infrastructure, GlobalRoamer. Customers 

simply log on to the system via web interface 

and get access to an ever-increasing 

number of networks and locations for 

their outbound roaming testing. 

SITE 

If you are looking for the bene� ts of the 

most comprehensive active end-to-end 

test system but don’t want to look after 

the infrastructure, let us do the job for 

you. Keynote SIGOS experts take care of 

the administration of your SITE testing 

infrastructure while you can fully concentrate 

on your business. We o� er a 

fully hosted service at the Keynote SIGOS 

premises (e.g. hosting and maintaining 

your SITE Central Unit and other core 

components). 

Test Operations Management 

Reduce your e� ort in test execution 

with TOM 

Periodic managed services 

Campaign-based managed services 

Test 

Operations 

Management 

(Full Managed Service) 

Roaming 

Steering 

Tests 

GRQ 

Tests 

Carrier 

Quality 

Tests 

Fraud 

Bypass 

Detection 

Performance 

Tests 

QoS 

Monitoring 

Performance Tests 

Ensure end-to-end Quality of Service 

through delivery of Key Performance 

Indicators (KPIs) prepared for you by 

Keynote SIGOS. To reach a “snapshot” like 

view, a large number of tests in a short 

period of time (a few days or weeks) is 

executed and analyzed by Keynote SIGOS. 

The results are presented as combination 

of reports, graphs and text documents and 

can be the foundations for your benchmarks. 

QoS Monitoring 

With Keynote SIGOS you can easily prepare 

a long-term testing environment to ensure 

and monitor your Quality of Service. As 

an example, many customers constantly 

monitor the 50 to 100 most important 

roaming partners. Automatic tests and 

reports on Key Quality Indicators (KQIs) 

are prepared according to the customer’s 

wishes. Trained Keynote SIGOS experts 

manage 

reports for troubleshooting and provide 

test results in an easy to read format. SITE 

Tools like Dashboard and Service Alarm 

Map give signi� cant data on the actual 

network performance and functionality. 

Quality of Service monitoring with Keynote 

SIGOS is an indispensable way for 

all departments of an operator to ensure 

high-class quality at all times. 


Roaming Steering Tests 

Test the functionality of steering programs. 

A number of location update tests 

in steered countries/networks are performed. 

The tests are examined by Keynote 

SIGOS to discover whether the steering 

works as expected. From the distribution 

of tests over di� erent networks it is 

determined whether the planned steering 

ratios between di� erent networks are 

ful� lled. 

(page 24) 

Carrier Quality Tests 

It is of primary importance that Operators 

and Carriers o� er high quality transmission 

services. Operators can use Keynote 

SIGOS to help ensure that their end 

customers enjoy the best possible quality 

services. By constantly monitoring the 

transmission quality of all connected carriers, 

tra� c can be routed intelligently to 

the best available. Carriers are interested 

to manage their SLAs with the Operators 

and to maximise the volume of tra� c 

coming from each operator. Since Operators 

may well route tra� c away from any 

carrier delivering poor quality transmission 

then the carriers have a vested interest 

in measuring their transmission quality. 

Keynote SIGOS can support carriers in 

understanding and monitoring the transmission 

quality of tra� c to more than 500 

operator networks world-wide. 

(page 25) 

Professional Services > Managed Services 

GRQ Tests 

Based on general experience of the 

outbound roaming market 80% of outbound 

roaming revenue comes from the 

top 20 roaming partners. For this reason 

the GSM Association recommends regular 

monitoring of service quality during outbound 

roaming with these top roaming 

partners. Keynote SIGOS has implemented 

a world-wide test system capable of 

measuring, reporting and alarming all 

aspects of roaming service quality using 

standard prepared test scenarios which 

can be used to regularly test, monitor 

and report on service quality in these top 

roaming partner networks using the SIM 

cards of the interested operators. 

Keynote SIGOS supported several operators 

during the GRQ trial phase and has 

successfully proven to be fully compliant 

to the GRQ framework. 

(page 22) 

Fraud Bypass Detection 

The internationally installed Keynote 

SIGOS Test Systems can be used for Interconnect 

Fraud Bypass detection services. 

Access to alerts and detailed trace information 

is possible in real time allowing 

blocking of SIM Box numbers rapidly. 

All tests are provided as a fully managed 

service. Powerful reporting techniques 

allow benchmarking of SIM Box issues 

against historical values. 

(page 26) 

Bene� ts of Managed Services 

Get the bene� t of the know-how of our experienced engineers in the testing area. 

Low or no resources from customer side required. 

Our customers can focus energy on using the results to perform network 

troubleshooting and other meaningful tasks. 

The biggest attraction for operators is Cost Savings. A Managed Services contract can 

take upfront CAPEX out of the budget as well as cut OPEX in the long run. 

Increase your ‘time to market’ and bene� t from the intangibles and the innovation 

that Keynote SIGOS Managed Services is performed for multiple Operators and Carriers. 

We have the in-house skills, experience and sta� to tackle dedicated projects. 



Management 


Management 

75

Professional Services > Consulting Services 


Management 


Management 

Consulting Services 

Customized for all your speci� c needs! 

Strategic Consulting 

With two decades of experience in the 

� eld of telecommunications testing we 

can provide you with the unique service 

of high-level strategic consulting. Our 

Senior Telecommunications Experts are 

available for strategic assessments and 

solutions development workshops to 

provide thorough and comprehensive 

answers to the question like: 

„How does end-to-end testing � t into 

our service quality assurance 

procedures?“ 

Book this service as an approximately 

2-day workshop. 

Senior Consulting 

Get the most out of your Keynote SIGOS 

test system right from the start. With our 

Engineering Consulting services, our 

system experts assist your team during the 

introduction phase of your Keynote SIGOS 

solution. Our system experts share their 

knowledge with your team ‘on the job’ 

especially for a question like: 

„How to implement service testing or 

fraud testing into our business 

processes?“ 

Book Senior Consulting service for the 

duration of weeks or months, depending 

on the suitable concept. 

Support 

SITE Warranty 

E-mail Support - A fast and reliable way 

to get clear answers and step-by-step 

instructions should you experience 

problems 

Support Hotline – direct communication 

with Keynote SIGOS professionals 

(Monday – Friday during business hours 

(CET); 24/7 for premium service 

subscribers) 

Engineering Consulting 

If you have the concept and the right 

tools, you need an e� cient implementation 

for your business. Therefore Keynote 

SIGOS o� ers: 

Support of customers for the 

OPERATION of SITE or GlobalRoamer 

scheduling of periodic & ad hoc tests 

according to customer regulations 

scheduling of periodic & ad hoc reports 

analyses of failures 

analyses of trends 

preparation of speci� c reports (e.g. test 

campaigns, management reports, 

department speci� c reports) 

Support of customers for the 

ADMINISTRATION of SITE *) 

administration of the SITE system 

data base management 

alarm management 

hard- and software maintenance 

backup and software-updates 

*) For GlobalRoamer, engineering consulting 

in administration is not required since 

GlobalRoamer is fully hosted and administered 

by Keynote SIGOS. 

Fax to Keynote SIGOS Support 

Keynote SIGOS Trouble Ticket System 

(OTRS) – Web based access for 

monitoring customer ticket status 

online 


Once the right solution for your situation 

has been identi� ed during the counseling 

phase, the actual project begins. 

To minimize our customers’ e� orts, our 

experienced Project Management team 

takes on responsibility of the organization, 

execution, control and reporting of 

the project, from the beginning to the end. 

With our expertise gained over two decades 

in the implementation of large-scale 

as well as niche projects we will help you 

� nd the optimal solution for e� cient and 

successful project realization. 

Regular tests are therefore required to 

maintain a high standard of quality and to 

improve customer satisfaction. 

Professional Services > Project Management & Implementation 

Project Management & Implementation 

Always � exible and customizable! 

Kick O� Meeting 

Planning 

On-site installation 

Included Services: 

Implementation 

Project management 

Project engineering 

Commissioning and installation of 

soft- and hardware components 

System implementation and network 

integration 

Coordination and roll-out of system 

components 

Project controlling 

Project reporting 

Typical Keynote SIGOS Project Management Process 


System Roll-Out 

Acceptance 

Put into Operation 


Management 


Management 

77

Training 

Professional Services > Training 

Training 

Wherever you want, with specially trained experts! 

Training 

On-site at your locations or at our 

training center! 

Keynote SIGOS o� ers a comprehensive 

range of training to users of SITE and 

GlobalRoamer. Training can be scheduled 

on demand on your own site or at the 

Keynote SIGOS training center in Nuremberg, 

Germany. Keynote SIGOS training is 

designed for maximum e� ciency. That’s 

why we limit the seats for each session. 

Reporting & Diagnosis - Base 

User Training - Base 

Users Strategic Users Administrator Test Case Developer 

Scheduling tests 

(ad hoc) 

Reporting & 

Diagnosis 

- Advanced 

User Training 

- Advanced 

Scheduling tests 

Scheduling reports 

Defi ning alarms 

Administrator 

Training 

Administrator of 

infrastructure, access 

rights management 


Training 

Developer of test 

cases 


Index 

Keyword Page Keyword 

Page 

3 G Layer 3 Tracing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 

3SQM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 

Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Alarming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 

Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 

Benchmarking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 

Billing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 

BlackBerry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 

Carrier Quality Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 

Carriers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 

CDR Comparison Testing . . . . . . . . . . . . . . . . . . . . . . . . . 29 

Central Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 

Compact Local Unit (CLU) . . . . . . . . . . . . . . . . . . . . . . . . 46 

Consulting Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Content Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 

Control Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 

Core Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 

Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 

Data IP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 

Device Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 

Diagnosis Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 

Digital Rights Management . . . . . . . . . . . . . . . . . . . . . . 69 

Drive Service Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 

Early Charging Detection . . . . . . . . . . . . . . . . . . . . . . . . . 27 

Echo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 

Email Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 

Engineering Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Fixed Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 

Fraud Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 

Gb Local Unit (Gb LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 

GIS (Geographical Information System) . . . . . . . . . . . 51 

Global Ressource Pool (GRP) . . . . . . . . . . . . . . . . . . . . . . 45 

GlobalRoamer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 

GPRS Attached . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 

GPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 

GRQ Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 

GSMA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 

GUI (Graphical User Interface) . . . . . . . . . . . . . . . . . . . . 51 

Handset Agent . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . 64 

Handset Oriented Testing . . . . . . . . . . . . . . . . . . . . . . . . 70 

Handset Simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 

Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 

Hotline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Inbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 

Indoor Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 

Interactive Voice Response (IVR) . . . . . . . . . . . . . . . . . . 59 

Interconnection Carriers . . . . . . . . . . . . . . . . . . . . . . . . . 39 

Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 

International Carrier Quality Testing . . . . . . . . . . . . . . 25 

International Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 

IP Network Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 

iPhone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 

IREG 24, 26, 27, 29, 32, 35, 50, 60 . . . . . . . . . . . . . . . . . . 20 

ISDN PRI Local Unit (ISDN PRI LU) . . . . . . . . . . . . . . . . . 46 

Local Unit (LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 

Location Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 

lu Local Unit (lu LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 

LTE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 

Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Managed Services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 

Matrix Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 

Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 

MMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63 

Mobile Instant Messaging (Mobile IM) . . . . . . . . . . . . 63 

Mobile Local Unit (MLU) . . . . . . . . . . . . . . . . . . . . . . . . . . 46 

Mobile Network Operators . . . . . . . . . . . . . . . . . . . . . . . 39 

Mobile Virtual Network Operators (MVNO) . . . . . . . . 39 


mobiQ speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64 

Network Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 

Network Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56 

Network Structure (of SITE) . . . . . . . . . . . . . . . . . . . . . . . 2 

Nomadic Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 

On-Demand Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 

Open Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 

Outbound Roaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 

Performance Tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 

Periodic QoS Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 

PESQ/POLQA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 

PEVQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 

Portfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 

Prepaid SIM Recharging . . . . . . . . . . . . . . . . . . . . . . . . . . 31 

Project Engineering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 

Project Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . 77 

Project Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 

Push-to-Talk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 

QoE Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 

QoS Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 

Regression Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 

Regulators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 

Reporting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 

Revenue Assurance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 

Revenue Leakage & Fraud Detection . . . . . . . . . . . . . 26 

Ring back tone . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 

Ring tone download . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 

Roaming Hubbing Testing . . . . . . . . . . . . . . . . . . . . . . . . 23 

Roaming Steering Testing . . . . . . . . . . . . . . . . . . . . . . . . 24 

Roaming Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 

Senior Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Service Alarm Map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 

Service Quality Monitoring . . . . . . . . . . . . . . . . . . . . . . . 14 

SIM Box Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 

SIM Multiplexer (Hardware) . . . . . . . . . . . . . . . . . . . . . . 46 

SIM Multiplexing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 

SITE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 

SITE Recorder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 

SLA Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 

SMS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 

Speech . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 

SS7 Local Unit (SS7 LU) . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 

Strategic Consulting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Streaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 

Supplementary Services . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 

System Hosting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74 

Tari� Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 

Test Call / Event Generation . . . . . . . . . . . . . . . . . . . . . . 28 

Test Case Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 

Test Creation Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 

Test Infrastucture Management (TIM) . . . . . . . . . . . . . 74 

Test Operations Management (TOM). . . . . . . . . . . . . . 74 

Test Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52 

Test Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 

Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 

Value Added Services (VAS) . . . . . . . . . . . . . . . . . . . . . . 68 

Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 

Video Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67 

Video Telephony . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 

Voice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 

Voice over IP Quality Testing . . . . . . . . . . . . . . . . . . . . . . 61 

Voice Quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 

WAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 

Warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 

Web Browsing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65 

Wireless Local Unit (WLU) . . . . . . . . . . . . . . . . . . . . . . . . 46 

Index 

79

More than 260 operators rely on Keynote SIGOS solutions. 

Some of our world-wide customers 

Keynote SIGOS GmbH 

Klingenhofstrasse 50d 

90411 Nuremberg 

Germany 

Fon +49 (0)911 9 51 68-0 

Fax +49 (0)911 9 51 68-355 

info@keynote-sigos.com 


anoris. 06.2012

Keynote SIGOS Product Guide

Create successful ePaper yourself

Delete template?

Save as template?