PAL is still a good friend of mine

A new colleague of mine was experiencing some issues with performance in our BizTalk test environment. They hadn't heard of PAL before so I gave them a quick walk through. When I launched the PAL site I noticed that Clint Huffman had recently updated his tool.

The current version of PAL is 1.3.4.1, when I initially blogged about PAL the version that I was running was 1.1.8.

The tool's purpose has remained unchanged. PAL continues to provide empirical data based upon defined Performance Counters that are related to your Product(s). Green/Yellow/Red indicators are used to tell you when your counters are "Safe/Warning/Critical".

From looking at the GUI and the feature's list, here are some of the changes that stuck out for me. This is a non-exhaustive list(some points copied from official site):

• The ID Process (PID) for each of the BizTalk 2006 host instances has been added to make it easier to identify them. A side note is that if you want to see the name of the BizTalk host as long as you know the PID you can execute the following from a command prompt: tasklist /svc /fi "imagename eq btsntsvc.exe


• Some of the analyses in the other Exchange 2007 threshold files did not make it into the single file.


• The PAL installation wizard now detects if Microsoft Office Web Components 2003 is installed and if Microsoft Log Parser v2.2 is installed. If they are not installed, then the installer points the user to the installation URL for the respective product.


• A Windows Server 2008 Hyper-V threshold file has been added to PAL. This is a beta release of this threshold file pending review from other subject matter experts.


• The ability to "queue" multiple vbs instances so they are run as a group instead of you executing individually.


• The UI now supports time range restrictions - meaning the perfmon log can be restricted to a time range


• UI is now "wizard based" - what can I say Clint works for Microsoft. :-). It is cool though, it is more intuitive than the previous version.

Below I have included some images that highlight some of these new features.

Testing Web Services - .Net WebService Studio

I am currently engaged in a project which involves integration with a 3rd party using Web Services. A colleague recommended a tool to me called ".Net WebService Studio" for testing Web Services. He was using this tool on his project and had nothing but good things to say about the tool. The tool itself is available for free on Codeplex by Adnan Masood.

Within my project, I am hosting a Web Service and the 3rd party is hosting several Web Services. So during some of my unit testing and before I exchanged WSDLs with the 3rd party I wanted to be able to submit messages to BizTalk via my Web Service. My BizTalk Web Service was generated by the "Expose Orchestration as Web Service Wizard" and is a traditional two/way, request/response service.

In the past I have built my own 'stubs' that would allow me to send in messages that satisfy my testing scenarios. This resulted in a lot of code that eventually is just thrown away. Using .Net Web Studio allows for a Proxy to be download "on the fly". So you basically point the tool at your Web Services and start submitting messages without writing any code!

The first thing you are going to want to do is launch the application and input your Web Service URL in the WSDL EndPoint dropdown. A list of recently used URLs is kept so you don't have to remember a long list of URLs.




The next thing you are going to want to do is click on the "Get" button. This will generate the Web Service Proxy for you and is required in order for you to invoke the Web Service.

You are now in a position to invoke the Web Service. The application is capable of sending some basic data to the Web Service based upon the expected data types. It works similar to the way the "Generate Instance" works when wanting to generate a sample message from a Schema in BizTalk/Visual Studio . In order to Invoke the Web Service you need to select the Operation(or Web Method) that you want to invoke and click the "Invoke" button. Once you have clicked the button, the Response of the Web Service will be displayed in the "Output" text box in the lower left corner.

From this screen you can also modify the "default" values that Web Service Studio is going to use by clicking on an element and then updating the value in the top right "quadrant".

By clicking on the "Request/Response" button, you are able to see, and modify, the actual SOAP request that is being sent to the Web Service and the SOAP Response that is being returned to your client.

This screen also allows you to tweak your SOAP request in case you have some additional security, content type or Proxy requirements.

Overall I think the tool is great and definitely a worth having in your "toolbox".

Canadian Tech Days Update

For those of you that are interested, the Tech Days site has been updated. Do note that the Early Bird prices are in effect until October 15th, 2008.

The sessions, tracks and presenters are also listed on the web site so check it out!

TechDays_CA

BizTalk Mapper: Ensuring that Node Exists before calling scripting Functoid

A scenario that I have recently encountered is that I have an optional element coming in that, if present, requires some manipulation before it can be assigned on the outbound message. The problem that I encountered is that an exception is raised when the map is executed and has nothing to pass to the scripting functoid.


Below is an image of my original map. All elements are required except Operation. The Operation element is of type long and a third party system will be sending this so we don't have total control over the data types. The equivalent element on the destination message is VORNR which happens to be part of an SAP IDoc. The element on the IDoc is also optional, but if it is provided, it needs to have padded values to make it a 4 digit string. So if 220 is provided by the source system then 0220 needs to be passed to the IDoc.


Below is an image of a message sent in without the Operation element. The issue is that if the element doesn't exists, then BizTalk will generate the following exception(truncated for readability):
Exception type: OverflowExceptionSource: mscorlibTarget Site: Int64 System.IConvertible.ToInt64(System.IFormatProvider)The following is a stack trace that identifies the location where the exception occurred


So to get around this, I have added some checks in the Map to ensure that the scripting functoid is only called when the Operation element exists.

The checks come in the form of Logical Existence and Value Mapping functoids. The Logical Existence functoid will return "True" or "False" based upon whether or not the element/attribute that you connect it to exists. You then use this output to feed the Value Mapping functoid. The Value Mapping functoid requires two inputs:

1. An boolean indicator that if True will output the 2nd input
2. The 2nd input will be passed to the next functoid(or element) should the 1st input be true.
   

Without the scripting functoid, BizTalk takes care dealing when elements exist and when they do not. The addition of the scripting functoid creates some issues when the Optional element is not provided in the message. But, with a couple standard functoids, a check can be made that only calls the scripting functoid when the element is provided.

Microsoft - Dublin

No this isn't an announcement for a new Microsoft office in Ireland, but rather the latest technology announcement coming out of Redmond. Microsoft has publicly released some information regarding .Net 4.0 and the new "Application Server Extensions". This announcement is significant as Dublin will allow for:

• A standard host for WF/WCF applications
• Tooling and Managment for the application server
• Support for scale-out durable messaging
• Scalable monitoring and diagnostics
• Message based correlation
• Long Running applications
• Management functions via IIS Manager

Much like the BizTalk Server 2009 announcement that occurred a few weeks back, I think Microsoft wants to clear the air and provide a glimpse into what the future holds before developers make their way to PDC in LA later this month.

As much as I am a "BizTalk guy", I am very encouraged with where Microsoft is taking the Connected Systems Division. If nothing else, I feel that the WCF/WF technologies provide options for developers when implementing solutions. Microsoft has already announced their committment to BizTalk, so it is not disappearing any time soon. It should be interesting to see some of the solutions that people come up with using Dublin.

For more information regarding this annoucenemt, please visit Steve Martin's blog.

BizTalk SAP Adapter and Extended SAP IDocs

I recently ran into an interesting scenario when generating the BizTalk schema for an IDoc. I have generated several schemas from SAP in the past but was having trouble "finding" this particular IDoc.


SAP Background:
I do not confess to being an SAP expert, but this is the way that I understand IDocs. Out of the box, SAP provides lots of IDocs that relate to particular modules within SAP. These modules include Finance, HR, Plant Maintenance among many others. You can also buy separate packages that relate specifically to your industry. For instance I am in the energy industry so my organization heavily uses that ISU module. Generally organizations like to limit the amount of customization that they do to their SAP system but it is usually impossible to have no customizations.

When you want to customize one of these "out of the box" IDocs you have a couple options:

• Creating an IDoc based upon a "copy" of an original IDoc. Kinda like a copy-paste, rename scenario. The naming convention for custom Idocs is to place a 'Z' in front of the IDoc that you just customized. For instance if you were to customize the 'CONF32' (Confirmation IDoc) you would name your IDoc ZConf32.


• Extending an IDoc. You can think of this more like inheritance. You start by inheriting the "base" Idoc and adding, or extending, any segments that satisfy your needs.

My experience in the past primarily involved generating schemas for custom IDocs. So when I input the IDoc that I am looking for in the BizTalk Adapter Meta Generation wizard I would type in ZConf32* and it would return a result. The problem that I ran into is that when I typed this name as the IDoc that I was looking for, no results were returned.

At one point it was suggested by someone on our SAP team that perhaps BizTalk could not download Extended IDocs. I was not too surprised that the suggestion was made since BizTalk often mis-understood. On the flip side, BizTalk resources generally do not have a lot of SAP knowledge so I couldn't initially confirm whether BizTalk could or couldn't. However, I wasn't quite ready to throw in the towel.

Microsoft has done a pretty good job of abstracting the "little" details away from us by providing wizards that allow us to generate schemas. This is definitely a value-add offering by Microsoft and a key driver in organizations using middleware like BizTalk. It allows integration projects to turn around solutions faster and cheaper.

So I started by querying with a "wider" search criteria via wild cards. What I found was that since this IDoc was extended, I needed to find the "Standard" SAP IDoc and then drill down from there to find the extension.

Error returned while searching for "Custom Name" ZConf32

When I changed my query to include the "Standard" SAP Conf32 IDoc and drilled down a level I was presented with both the SAP Idoc and the version that had been extended. Since I wanted the extended version, I selected the entry called Conf32-ZConf32. The naming convention follows that of Custom IDocs in that "Z" is used to indicate that the extension is custom and not something provided out of the box.

Success! IDoc is found with the "Standard" SAP version.

The two preceding examples used the BizTalk Server 2006 (R1) Adapter. I was curious to see if the behaviour was similar with the WCF based SAP adapter that can be used with BizTalk Server 2006 (R2).

When searching for my Extended IDoc called ZConf32 I was presented with an "IDoc not found" message. Not the same message as the R1 error, but in essence the same meaning.



The next step I did was provide a search that included the "Standard" SAP IDoc Conf32 to see if the extended IDoc was hanging out with the original. While the experience in the Wizard is a little different, the end result is the same. The Extended IDoc is available for download by the Adapter Meta Data Generation wizard


So hopefully this post will help someone out. I know myself and a SAP resource were scratching our heads for a bit but in the end we got the result that we were looking for.

Another Canadian Microsoft Event - BizTalk/SOA

For more info, visit Peter Kelcey's blog


The Canadian Connected Systems Conference 2008
Canada’s Connected Systems Road show: Can’t make it to PDC but would like to hear more about BizTalk and how it relates to broader connected systems and SOA initiatives? Please join us at one of these locations for a day. We’ll be putting out a registration link & agenda soon but for now please note these locations/dates:

a. Vancouver – 30 October 2008
b. Toronto – 4th November 2008
c. Montréal – 6th November 2008

Overview: In a service-oriented world, effective business processes unite people and systems. Find out how BizTalk® Server builds on the Business Process Management and SOA capabilities in prior releases to help your organization extend core process management technologies even further.

We will share the latest on Microsoft’s SOA offering - as well as details of the strategies and technologies that Microsoft is delivering today, over the next year, and into the future. At this event, you will learn:
· BizTalk today and through FY’09
· Microsoft’s Roadmap for the future
· Microsoft’s “Real world” SOA vision, positioning and messaging
· Service Virtualization & ESB guidance 2.0
· RFID & mobility of BizTalk

These events will provide further insight for customers and technology partners into best practices for building SOA and BPM solutions, guidance for advancing SOA, and using the latest Microsoft-based technologies for connecting people, processes and information.Agenda

8:00 Breakfast
8:30 Connected Systems Overview
9:00 BizTalk today, over the next year & Roadmap for the future
10:00 Adapter Pack
11:00 Break
11:15 Self Service SOA
12:30 Lunch
1:30 Service Virtualization & ESB 2.0
2:30 RFID stack & Mobility
3:30 Break
3:45 Connected Systems Assessment
5:00 Reception
6:00 End

Target Audience:This event will be of value to Technical Decision Makers, Developers and Architects interested in BizTalk, enterprise integration, and SOA solutions.
To RegisterSpace is limited so register today to ensure your attendance at this event. Click the city name below to register:

Vancouver: October 30, 2008 (Thurs)
Toronto: November4, 2008 (Tues)
Montreal: November 6, 2008 (Thursday)



It is too bad that there is nothing being held in Alberta. Last year the Canadian BPM/SOA conference came to Calgary and it was a good event.