Agenda

Agenda 

1. Introduction 

� Database Systems 

� XML, XSLT 

� Communication 

Model 

2. Lotus Notes 

� XML Support 

� Import/Export 

© P.Hennies & H.Nottelmann 

Web Service based 

Communication between 

Semi-structured and 

Relational Database Systems 

A Solution on the Example of 

PAVONE TimeTracking 

and Microsoft Project 

23/03/04 

3. .NET 

� ADO.NET 

� DataSets 

4. Web Services 

� Concept 

� Components 

� Client/Server 

5. Demonstration 

TTviaWS 

2


•Introduction 

•Lotus 

• Database Notes 

Systems 

•.NET • XML 

•Web • Schemas Service 

• XSLT 

• Com Model 

•Lotus Notes 

•.NET 

•Web Service 



•Lotus 

• Database Notes 

Systems 



• XSLT 

• Com Model 


•.NET 


Database Systems 

� Relational (e.g MS SQL Server) 

�Underlying mathematical theory 

�Normalized relations 

�Widely deployed 

�Performant 

�Easy extensibility 

�Efficient handling of large data 



23/03/04 

Database Systems (Cont.) 

23/03/04 

TTviaWS 

3 

TTviaWS 

� Semi-structured (e.g. Lotus Notes) 

�Gain importance through emergence 

of XML for data exchange 

�Set of nodes, label graph structure 

�Manage heterogeneous data without 

an associated schema 

4



•Lotus 

• Database 

Notes 

Systems 



• XSLT 

• Com Model 


•.NET 




•Lotus 

• Database 

Notes 

Systems 


•Web • Schemas 

Service 

• XSLT 

• Com Model 


•.NET 


XML 


23/03/04 

TTviaWS 

� Describes (semi-)structured information 

� Meta Language without preconceived 

semantics 

� Semantics can be defined by 

applications or via stylesheets 

� Separates content from presentation 

� Self explanatory 

� Can embed existing data 

� Platform and language independent 

XML Schema 

� Defines the structure of all following 

documents 

� Written in XML 

� Simpler than DTD 

� Replaces DTD as most common 

used 

� Self-Validating 


23/03/04 

5 

TTviaWS 

6



•Lotus 

• Database 

Notes 

Systems 



• XSLT 

• Com Model 


•.NET 




•Lotus 

• Database 

Notes 

Systems 



• XSLT 

• Com Model 


•.NET 


Schema Datatyping 


23/03/04 

TTviaWS 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

XSL Transformations (XSLT) 

� Language to transform XML into other 

XML-based documents 

� XSLT Processor required 

� Template rules must “match” to be 

applied 

� XPath used to select doc. sections 

XML file 

XSL file 


XSLT-Processor New XML file 

23/03/04 

7 

TTviaWS 

8

LS 

DXL, XSLT 

DOM 

NSF 

Pavone 




•.NET •• XML 

Support 

•Web • DOM Service 

• DXL 

• XSLT 

• Import 

• Pipelines 

• Export 

•.NET 


Communication Model 

XML 

Client 



Web Service 

DIME 

Soap 

XML 

23/03/04 

23/03/04 

Server 

XML 

TTviaWS 

Project 

SQL 

.NET 

C#, DataSet 

DataAdapter 

XML Support in Lotus Notes 

NotesDOMParser 

NotesDXLImporter 

NotesDXLExporter 

NotesSAXParser 

NotesXSL- 

Transformer 

Transforms XML into a 

(Document Object Model) tree 

structure. 

Uses Lotus Notes own DTD 

to define a Domino XML file 

Processes an XML file as a 

series of events 

Transforms XML data into 

differently structured XML by 

applying templates 

9 

TTviaWS 

10





Support 

•Web • DOM 

Service 

• DXL 

• XSLT 

• Import 

• Pipelines 

• Export 

•.NET 






Support 


• DXL 

• XSLT 

• Import 

• Pipelines 

• Export 

•.NET 


Notes DOM Parser 

� Document Object Model to represent XML 

document structure 

� DOM-Tree structure allows access to 

object nodes 

� Notes DOM Tree Structure: 

NextSibling() 



NodeType 

Object node 

sibling sibling sibling 

23/03/04 

Attributes() 

Attributes 

Attributes Attributes Attributes 

Domino XML (DXL) 

� Importer and Exporter classes 

� User-defined NotesCollections allow 

selective exporting 

� A whole Notes Database can be 

represented in DXL 

NSF 

Notes Database 

NoteCollection 

DocumentCollection 

Notes Document 

23/03/04 

DXL 

representation of 

(partial) database 

TTviaWS 

11 

TTviaWS 

12





Support 


• DXL 

• XSLT 

• Import 

• Pipelines 

• Export 

•.NET 






Support 


• DOM 

• DXL 

• XSLT 

• Import 

• Pipelines 

• Export 

•.NET 


XSLT in Lotus Notes 

� Stylesheet Element, XML Output 

 

 

� Template rules 

 

 

 

 



23/03/04 

23/03/04 

Pattern, e.g. /, *, text(), 

node() or ancestor//node 

XSLT in Lotus Notes (Cont.) 

� Creating Elements with Attributes 

 

 

 

 

 

� Looping & Conditional Processing 

 

 

 

text 

 

 

 

TTviaWS 

13 

TTviaWS 

14

XML input 





Support 


• DXL 

• XSLT 

• Import 

• Pipelines 

• Export 

•.NET 


Timesheet Import from XML 

XSL Transformer 

XSL Transformer 

DXL 

Stylesheet 

Dom Parser 

Stylesheet 


Pipelining 


DXL Importer 

Dom Parser 

Standardised 

LotusScript 

methods 

23/03/04 

23/03/04 

Pipeline #1 

Pipeline #2 

Preliminary 

Timesheet 

TTviaWS 

Final 

Timesheet 

15 

TTviaWS 

� Create Processing Elements in pipeline 

� Intermediary objects are not explicitly 

created 

Set transformer = session.CreateXSLTransformer (inputStream, 

Stylesheet) 

Set domParser=session.CreateDOMParser(transformer) 

transformer.Process 

The process call 

is only done 

for the first pipe object 

Using the XSLTransformer 

as Pipeline object 

makes it unnecessary 

to define an outout 

The XSLTransformer 

is specified as the 

DomParser output 

16





Support 


• DXL 

• XSLT 

• Import 

• Pipelines 

• Export 

•.NET 


LS 

DXL, XSLT 

DOM 

NSF 

Pavone 

Timesheet Export to XML 

� Item values are stored in arrays 

� Conversion methods are deployed 

e.g. for tasks, datetime 

� Schema corresponding to MSP tables 

is written to XML file 

� Timesheet data is transposed 

� Separate entries for each array element 

� Aggregation of elements corresponding to 

MSP tables 

…and stored in the output file 


23/03/04 


XML 

Client 


Web Service 

DIME 

Soap 

XML 

23/03/04 

Server 

XML 

TTviaWS 

17 

TTviaWS 

Project 

SQL 

.NET 

C#, DataSet 

DataAdapter 

18

Connection 


.NET Architecture 

VB.NET C# Perl Python VC++ … 

Web Services 

ASP.NET 

XML ADO.NET DataSets 

.NET Framework Class Library 

Common Language Runtime 

23/03/04 

UI 

Com+ Win 32 

IIS 

Data Providers 


ADO.NET 

ADO.NET Data Flow 

DataAdapter 

Command 

DataReader 

23/03/04 

DataSet 

Data Consumers 

Web Forms 

Web Service 

TTviaWS 

19 

TTviaWS 

20

Code Sample 


23/03/04 

TTviaWS 

baseConnection = new SqlConnection("server=(local);database=“Database” ;Trusted_Connection=yes"); 

resourceAdapter0 = new SqlDataAdapter ("SELECT * FROM MSP_PROJECTS", updateConnection); 

resourceAdapter0.Fill(DataSet,”Tablename”); 

Select relevant Database 

Tables and write them into 

the DataSet. 

SqlCommand resourceAdapter0DeleteCmd = new SqlCommand("DELETE FROM MSP_PROJECTS 

WHERE PROJ_ID = @pPROJ_ID", resourceAdapter0.SelectCommand.Connection); 

resourceAdapter0DeleteCmd.Parameters.Add(new SqlParameter("@pPROJ_ID", SqlDbType.Int)); 

resourceAdapter0DeleteCmd.Parameters["@pPROJ_ID"].SourceVersion = DataRowVersion.Default; 

resourceAdapter0DeleteCmd.Parameters["@pPROJ_ID"].SourceColumn = "PROJ_ID"; 

resourceAdapter0.DeleteCommand = resourceAdapter0DeleteCmd; 




•.NET •.NET 

•Web 

• Framework 

Service 

• ADO.NET 

• DataSets 


DataSets 

� Written in XML 


23/03/04 

Open Connection 

to target 

Database. 

Define Commands to Insert, 

Delete and Update Databasetables 

after work on the 

DataSet is finished. 

� Cache representation of Database 

� Support both (limited) relational 

operations as well as XML-based 

handling 

� Inlay-Schema defines Datatypes 

21 

TTviaWS 

22


DataSet Structure 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

TeconeProject 

 

 

 

LS 

DXL, XSLT 

DOM 

NSF 

Pavone 

23/03/04 


XML 

Client 


Web Service 

DIME 

Soap 

XML 

23/03/04 

Server 

XML 

TTviaWS 

23 

TTviaWS 

Project 

SQL 

.NET 

C#, DataSet 

DataAdapter 

24




•.NET 


•• Concept 

• Operations 

Sequence 

• Components 

• Attachments 

• Server Side 

• Lotus Client 






•• Concept 


Sequence 





Web Services 

� Self-describing & modular 

� Provide access to remote objects 

� Open,Internet-oriented, standardbased 

Interfaces 

� Platform, language and OS 

independent 



23/03/04 

Web Services (Cont.) 

UDDI 

Service 

Requester 

Client 

Application 

Service 

Broker 

23/03/04 

SOAP 

UDDI 

Registry 

WSDL 

Service 

Provider 

Web 

Service 

TTviaWS 

25 

TTviaWS 

26




•.NET 


• Concept 


Sequence 










• Concept 


Sequence 





Operations Sequence 

1. Client 

� Supplies parameters and calls method 

� Formats call as SOAP message 

� Sends request via HTTP POST 

2. Server 

� Unwraps SOAP envelope 

� Runs method 

� Returns results as SOAP response 

3. Client 

� Unwraps response & reads results 


Components 

� SOAP 


23/03/04 

� Composed in XML 

� Distributed but deliberately simple 

� „Wraps“ request and response 

� Transfers via HTTP 

� WSDL 

� Public contact Interface 

� Service description in XML 

� Publishes methods, parameters and types 

23/03/04 

TTviaWS 

27 

TTviaWS 

28




•.NET 


• Concept 


Sequence 










• Concept 


Sequence 





SOAP Message Structure 



23/03/04 

23/03/04 

TTviaWS 

29 

TTviaWS 

WSDL Code Sample 

[Namespace Definitions] 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

30




•.NET 


• Concept 


Sequence 










• Concept 


Sequence 





Compound SOAP Structure 


23/03/04 

TTviaWS 

� Abstract concept for Attachments 

� A representation of a compound SOAP 

structure must describe: 

1. an encapsulation mechanism 

2. a mechanism for identifying all parts using 

URI (Unique Reference Identifier) 

3. interactions between the underlying 

transport protocol 

� Unique identification of primary SOAP 

message must be ensured 

Compound SOAP (Cont.) 

� Encapsulation implementations: 

�MIME developed for emailing 


� Simple but… 

� Heavyweight, and streaming impossible 

�DIME (what we used) 

� Developed by Microsoft & IBM 

� Much lighter than MIME 

� Encapsulates the SOAP envelope 

23/03/04 

31 

TTviaWS 

32






• Concept 


Sequence 





Attached (binary) 

data 



DIME-Record 

23/03/04 

Identifier (URI) 

Type of payload 

Server Side Solution 

� Components 

�C# Web Service 

� Namespace 

� Class Library 

�„Web Config“ 

� Web Interface settings 

� Many implementation details 

hidden 

�[WebMethod] 

23/03/04 

TTviaWS 

33 

TTviaWS 

34




•.NET 


• Concept 


Sequence 





Server Side - Attachments 

� Web Service Extensions (WSE) 

Enable processing of DIME 

Attachments 

� SOAPContext 

Allows Attachment access 

independent of request message 

� SOAP Response 

Client can be informed of processing 

errors 


Code Sample 

[WebMethod] 

public string Insert() 

{ 

23/03/04 

SoapContext myContext = HttpSoapContext.RequestContext; 

if (myContext.Attachments.Count >0) 

{ 

SaveFile("temp.xml",myContext.Attachments[0].Stream); 

[….] 

DimeAttachment attachment = new DimeAttachment(„FileType", 

TypeFormatEnum.Unknown, 

Server.MapPath(@"\Tecone_Project\answer.xml")); 

HttpSoapContext.ResponseContext.Attachments.Add(attachment); 

return "answer.xml"; 

[…] 

} 


Defines Method as 

Web accessible 

23/03/04 

Creates Attachment 

and adds it to the 

response context 

Gets the 

SOAP context 

and checks for 

available 

Attachments 

TTviaWS 

35 

TTviaWS 

Streams 

Attachment 

payload to 

SaveFile 

method 

36




•.NET 


• Concept 


Sequence 










• Concept 


Sequence 





Lotus Notes as a WS Client 

� Java classes (SOAP4J) 

� Java Agents or LotusScript calling Java 

(LS2J) 

� Superseded by Apache SOAP/Axis 

� SOAP Connect 

� Free LotusScript utility from Lotus 

� Java background classes 

� Lotus Script calling Microsoft Objects 

(Windows only) 

� MS SOAP Toolkit 

� .NET client objects 



23/03/04 

Lotus Notes as a WS (Cont.) 

23/03/04 

TTviaWS 

37 

TTviaWS 

� Consuming web service with COM 

Notes 

LS 

Agent 

SOAP COM API 

MS 

SOAP 

Toolkit 

HTTP 

WSDL 

Web 

Service 

38

Code Sample 

HTTP binding 

Holds 

attachment 

Compose 

DIME message 

LS 

DXL, XSLT 

DOM 

NSF 

Pavone 

EndPointURL = "http://131.234.76.190/Tecone_Project/Tecone.asmx" 

Set connector = CreateObject("MSSOAP.HttpConnector30") 

connector.Property("EndPointURL") = EndPointURL 

connector.Property("SoapAction") = "http://tempuri.org/Insert" 

connector.Connect 

Set FileAttach = CreateObject("MSSOAP.FileAttachment30") 

FileAttach.FileName = "C:\dxl\timesheet.xml" 

connector.BeginMessage 

Set composer = CreateObject("MSSOAP.DimeComposer30") 

Set Serializer = CreateObject("MSSOAP.SoapSerializer30") 

Serializer.InitWithComposer connector.InputStream, composer 

Serializer.StartEnvelope 

[...] 

Serializer.AddAttachment FileAttach 

[…] 

Serializer.Finished 

connector.EndMessage 

Sends request 


23/03/04 


XML 

Client 


Web Service 

DIME 

Soap 

XML 

23/03/04 

Server 

XML 

TTviaWS 

Builds SOAP 

message 

Initializes the 

serializer with a 

composer capable of 

including attachments 

39 

TTviaWS 

Project 

SQL 

.NET 

C#, DataSet 

DataAdapter 

40


Questions? 

23/03/04 

Thank you 

for your Attention! 


23/03/04 

TTviaWS 

41 

TTviaWS 

42

Agenda

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?