Welcome!

Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal

Related Topics: Weblogic

Weblogic: Article

A Dynamic Implementation Framework for SOA-Based Applications

The key to SOA Software and Enterprise Apps of the Future

Today's IT environments are increasingly characterized by heterogeneous and complex applications, tight schedules, budgetary constraints, and an ever-changing landscape of business requirements.

Few businesses have been agile enough to enhance their existing infrastructures to meet and overcome these challenges in an effective manner. Even so, to deal with a continuous flow of highly complex and dynamic set of business requirements rapidly and cost effectively, businesses need a flexible and dynamic approach to automate, build, and manage critical business processes.

Solution Approach

Service-oriented architecture (SOA) is often touted as a feasible solution approach to solving the business challenges mentioned above. SOA is a method of conceptualizing, designing, and building applications by using and assembling building blocks, each of which is usually represented as a reusable service. Many current approaches to SOA simply involve wrapping pieces of business functionality and using them within applications, often in ad hoc, static, and inflexible ways. The proposed approach to develop applications and business processes of the future is to employ a formal SOA implementation framework that is dynamic, flexible, and scalable enough to meet changing and complex business requirements. Regardless of whether you buy or build a framework for your SOA implementation, the functionality of this framework will hold good for your solution.

SOA Implementation Framework Overview

The SOA implementation framework is the enabling technology for efficiently building applications and business processes using SOA principles. It provides architects, developers, and administrators with an operational framework and tools to configure, use, and manage enterprise services that form the building blocks for applications and business processes. This framework uses a service-centric approach at all levels and stages of the implementation process and has the following generic characteristics:
  • Ability to dynamically connect clients with services in a highly secure, protocol-independent manner
  • Ability to reliably handle synchronous and asynchronous modes of service execution
  • Ability to define and handle events in a declarative manner
  • Ability to dynamically convert between data formats of clients and services
  • Ability to manage distributed SOA resources (services, configurations, policies, etc.) in a centralized manner
  • Ability to capture and handle exceptions in the service execution process
  • Ability to log and monitor various events and metrics as they arise during the client-service transaction
  • Provide a unified and reusable service invocation code library for use across client applications in the enterprise
  • Support for Web services standards stack to promote wide-scale adoption and interoperability

Framework Components

Service Registry
The service registry is a foundational piece of the SOA-enabled solution for the enterprise. It is used to define, configure, and virtualize business services used by applications in a centralized manner. Most companies fail to realize the full potential of SOA due to the lack of a well-designed and managed service registry. It includes crucial information needed for defining and provisioning the services - services, providers, consumers, service interactions, policies, and all associated configurations. The service registry resides in a high performance data store and can be viewed and managed using the service manager, which is described later.

Service Bus
The service bus is a high-performance component that mediates between client applications and services and adds value by providing generic pieces of functionality on behalf of the clients, as well as the services aimed at promoting unified and reusable technical functionality - a key to real SOA implementations. It enables clients to focus mainly on business logic by providing a standard mechanism to connect to services and encapsulating service implementation details.

The service bus uses a pipeline approach, where the bus can be visualized as a sequence of components - a pipeline. Each stage in the pipeline is essentially a value-add component that takes in a set of inputs, where applicable, from the previous stage, processes the data, and passes on the outputs to the next stage.

The following are the features of the service bus:

  • Dynamic connectivity and routing: Dynamic connectivity is the ability to connect to Web services dynamically without using a separate static API or proxy for each service. Most enterprise applications today operate on a static connectivity mode, requiring some static piece of code for each service. Dynamic service connectivity is key to enterprise agility. The dynamic connectivity API is the same regardless of the service implementation protocol (Web services, JMS, EJB/RMI, POJO, etc.). Client applications access services via URI interfaces that may either directly map to services or be routed based on the context or content of the service request.

  • Reliable messaging: Reliable messaging is the ability to queue service request messages and ensure guaranteed delivery of these messages to the destination. It also includes the ability to respond, if necessary, back to the requestor with response messages. Primarily used for handling events, this capability is crucial for responding to clients in an asynchronous manner, and for a successful SOA implementation. This is typically implemented using reliable JMS queues with store and forward as well as guaranteed delivery capabilities.

  • Security: Generically handling and enforcing security is a key success factor for SOA implementations. The following are the main considerations:
    - Federated authentication: This feature intercepts service requests and adds the appropriate username and credentials. It is also capable of authenticating service requests before dispatching the request for service execution.
    - Authorization: Validates each service request and authorizes it to make sure that the sender has the appropriate privilege to access the service.
    - Encryption/decryption: Encrypts XML content at the element level for both request and response messages and performs decryption for the reverse scenario.

  • Transformation: Needed when a client and a service use different data formats, it is the ability to transform a given source of data into a target format based on specified transformation rules.

  • Caching and performance strategies: Important to improve the performance and quality of services and eventually to enhance overall customer service. It is performed at various levels, including service configurations, service response data services, and other SOA resources, depending on where optimization is needed to achieve high performance. Overall performance can also be improved by using compressed XML-based messages when transporting them across the nodes; the result is reduced bandwidth utilization. To accomplish this, compression and decompression agents are installed at the edges of the SOA grid.

  • Logging: Needed to trace system execution and performance for auditing, troubleshooting, and monitoring purposes. Logging can be done for any of the services and can be done at various severity levels.

  • Monitoring: The ability to track service activities that take place via the bus and provide visibility into various metrics and statistics. Of particular significance is the ability to be able to spot problems and exceptions in the business processes and move toward resolving them as soon as they occur.

  • Service-level agreement (SLA): SLAs specify performance guarantees associated with Web services operations and business processes -such as response times and service availability - that are essential for business-critical operations. Service providers can use SLAs to advertise and create service-level agreements with consumers. This helps them to provide the appropriate amount of resources and prioritize the servicing of requests.

  • Versioning: The ability to version Web services and to proactively assist in the migration of the client applications to use new versions of the Web service as soon as they become available. Versioning support includes being able to register different versions of the same service, to provide the client with the necessary APIs and libraries for all versions, and to help in migrating clients to the new versions. The versioning component has the ability to transform requests to older versions of the service to the newer version using XLST-based transformation.

  • Exception management: Ability to track and handle exceptions as they occur when clients access business services. Exception details such as the exception code, name, reason, and description are captured and logged. Exceptions are also handled appropriately by retrying the connection a predefined number of times, routing to an alternate service, or by simply returning a reason for execution failure.

  • Custom business logic processing: Provides the flexibility to insert custom business logic during service processing. For instance, a specific business logic can be performed either on the service request, prior to submitting the service request for execution, or on the service response, prior to sending the service response back to the client.

    The service bus is itself implemented as a service, using Web service or EJB technologies. This service is deployed to a server pool or cluster and is designed to scale horizontally. Each of the components mentioned above must conform to the corresponding Web services standards.

    Service Manager
    The service manager is a UI-based administration tool that empowers administrators and business managers to define, configure, manage, and monitor business services and related SOA resources used within the applications. It can be thought of as the control center for the SOA implementation, used mainly to provision and monitor services. The following are the two key functions of the service manager:

  • Service configuration management: Using this feature, administrators can onboard and configure services housed in the service registry. Users can define services, locations, binding information, and service configuration settings such as security, cache, transformation, logging, and monitoring. They can also define service providers and consumers and associated service contracts.

  • Service activity monitoring: Provides a dashboard for business managers and administrators to view key metrics and statistics in relation to service activities that take place via the Bus. Users can view and monitor service usage, response times, service exceptions, activity logs, messages, etc.

    The service manager is delivered as a Web-based application and can be accessed without any client-side installation requirements.

    Client SDK
    The Client SDK is software that is needed to connect with the service bus. The SDK - downloadable from the service manager - is packaged and provided in the form of an API. It is an easy-to-use library that application developers can use to discover, access, and utilize business services from their applications and business processes. This significantly enhances developer productivity as it offloads developers from message plumbing tasks that are, in turn, performed by the service bus. The client API does not use service location-dependent, hardwired proxies and stubs to access services. Instead, it uses a dynamic mechanism to connect to the services via the bus.

    SOA Implementation Framework Usage

    The SOA Implementation Framework can be used to develop robust applications and business processes. Figure 2 presents a usage scenario that uses the SOA implementation framework to build a customer self-service application consisting of order management and customer support functions. The application uses the client SDK to connect - via the bus - to core business services in the order and support process, such as purchase order submission, third-party credit verification, order status, support case entry, and support case status. These functions are exposed as either Web services or other Java API by wrapping business logic from existing applications - SAP Order Management and a custom-built customer support application. Further, the credit service is a Web service that is hosted at a partner site.

    This example illustrates the ability for client applications to easily connect to heterogeneous services in a unified and service logistics-independent manner.

    SOA Implementation Best Practices

    Any successful SOA implementation - in addition to using a robust and flexible SOA implementation framework - will require a set of guidelines and best practices at various stages of the development cycle. A core set of guidelines is provided below:
    • The process of onboarding new services must be configuration and discovery process-driven as opposed to having a lengthy and manual process cycle. This ensures that the overall system can scale to future requirements with minimal efforts.
    • An SOA implementation is only as successful as the method used to design the business services. Each service must abstract a coarse-grained piece of business functionality and is designed in a way that is coherent and reusable across the enterprise.
    • Services must be designed as asynchronous where applicable to improve response times and overall user experience.
    • Client applications must use a unified mechanism to access services in a protocol-independent manner and regardless of whether the services are local or remote. Further, the clients must focus mainly on the business logic and any service connectivity logic must be abstracted in the client SDK. This ensures centralized plumbing logic, high levels of application developer productivity, and ease of maintenance.
    • The generic components of the SOA implementation framework must be exposed in standard ways to promote code unification and reuse.
    • Use configuration where possible, instead of customization and code-based business logic. This improves the ability to scale to future business requirements with minimal effort and time.
    • Reuse and wrap existing legacy business application logic with more coarse-grained business-level services. Avoid rewriting legacy implementation logic.

    Conclusion

    This article presented a flexible, dynamic SOA implementation framework for building service-oriented applications and business processes of the future. This approach aims to provide enterprises with a highly scalable and dynamic framework for defining, configuring, accessing, and managing enterprise services.
  • More Stories By Arun Candadai

    Arun Candadai is cofounder and CTO of GridScope (www.gridscope.com), and is responsible for the company's technology strategy and product development. Prior to founding GridScope, he was lead architect at BEA Systems where he pioneered the use of Web services and SOA for its enterprise infrastructure. Prior to BEA, he held senior engineering management roles at companies including Asera, Covad, and Lockheed Martin. He holds three software patents and has helped develop key Web services standards.

    Comments (0)

    Share your thoughts on this story.

    Add your comment
    You must be signed in to add a comment. Sign-in | Register

    In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


    @ThingsExpo Stories
    "Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
    "MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
    SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
    "IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
    SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
    Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
    "Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
    Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
    "Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
    In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
    It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
    "There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
    WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
    Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
    A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
    SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
    Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
    To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
    An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...
    When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things’). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing? IoT is not about the devices, it’s about the data consumed and generated. The devices are tools, mechanisms, conduits. In his session at Internet of Things at Cloud Expo | DXWor...