Welcome!

Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal

Related Topics: Java IoT, IBM Cloud, Weblogic, Machine Learning

Java IoT: Article

Systems Integration with Openadaptor

Business system integration with little or no custom programming

To overcome these limitations and accommodate appropriate standards and technologies that have since emerged, the framework has recently been completely overhauled. The rewritten version comes with a much cleaner, smaller codebase and architectural improvements throughout:

  • Improved performance achieved partially through a strategy of minimal interference with payload data as it traverses adaptors, including the elimination of the rigid internal data representation format (DataObjects) and consequent, possibly unnecessary conversions.
  • Spring framework (see Resources) based XML configuration - typically adaptors are assembled via simple Spring XML configuration files rather than having to write and compile Java code. This also makes adaptors easy to embed into Spring applications.
  • Better extensibility - writing custom components does not require extensive knowledge of the framework. Interfaces for custom components are few and simple. Bespoke behavior, previously only possible through custom code, can now often be achieved through scripting.
  • Lighter - the framework adds only a thin layer between the JVM (or a user process that runs an adaptor) and the actual components that read and process the data. The overhead is minimal, and apart from a JVM being installed in the target environment, system requirements are minimal.
  • Flexible execution and embedding - adaptors may be run as standalone processes, be embedded within other processes, or deployed to JEE or other application servers. The flexibility makes it easy to introduce Openadaptor into existing projects.
  • Not reinventing the wheel - Openadaptor delegates responsibility wherever possible to external, well-accepted industry standard mechanisms. For example, it allows users to leverage the Spring framework's dependency injection (while not requiring it), to use well-accepted JTA implementations for transaction management, or to deploy adaptors to JEE application servers and use their resources.
  • Flexible internal data representation - so-called ordered maps (which are standard Java Maps, see Internal Data Representation sidebar for details) and XML are often used for internal data representation and manipulation, but users are free to use a representation of their choosing - such as an organization's bespoke format - for communication between their custom processors.
  • Pragmatic - it is here to do a real job, it is used in critical high-volume, low-latency production systems; in the financial domain it processes hundreds of millions of Euros worth of trades daily.
  • Cross platform - as a Java-based framework, it benefits from platform neutrality. At the same time, by offering connectors such as Web services, it does not assume the integrated systems are written in any particular programming language or are running on any specific platform.
  • Easy management and monitoring - supports instrumentation through JMX.
  • Comprehensive and modular - Openadaptor has a component architecture, allowing the inclusion of functionality as per user requirements.
  • Easy to test - replacing connectors to external resources such as databases, messaging solutions, or bespoke systems with file-based connectors allows for the easy creation of debugging environments or the ability to craft automated system tests. It also facilitates decoupling of producers and consumers of data in MOM environments.

In addition, it was designed to permit a reasonable migration path from legacy Openadaptor, which will be of relevance to users of previous versions of the framework.

The essence of the framework remains unchanged. What exactly can Openadaptor be used for? Essentially it excels in two areas.

First, Openadaptor can be a link between a system and a Message Oriented Middleware (MOM). When used in combination with MOM, Openadaptor can loosely be classified as an Enterprise Service Bus (ESB) and constitute part of an organization's messaging backbone.

Second, it can be a link between two systems, not involving MOM. To illustrate this, Openadaptor might query a Web service, perhaps filter or modify the returned data, and eventually persist it to a relational database. As a subset of this category, the framework could be used as a file processing tool, perhaps to convert comma-delimited files to XML documents.

Openadaptor is primarily targeting system integrators and Java developers, who will often have come across the need to achieve tasks like these:

  • Read in an XML document from a flat file, find XML elements of interest using XPath, and use the content of those elements to run an SQL update query on a database.
  • Start a Web service to accept data from a .NET system. When the service receives a request, use a JavaScript-based filter to discard irrelevant data. The discarded data is to be written to a dedicated flat file while the data that passes through the filter is to be sent to an MQSeries topic.
  • Periodically query a relational database after looking up a data source in JEE application server's JNDI tree. Save the query results to a comma-delimited text file. Expose a JMX console that allows for the monitoring of details, such as the number of database queries run or the size of the output file, through a web page.
  • Collect data from a bespoke front-end trading application and validate, filter, and reformat it using a simple scripting language. Pass the data on to a bespoke back-end booking system. Both systems are transaction-aware and every message is required to be processed as part of a distributed global transaction.
  • Subscribe to a JMS messaging backbone and on receipt of a correct message update a relational database. On receipt of an erroneous message send an e-mail to a system administrator.

In each of the above situations, Openadaptor could significantly increase efficiency and reduce implementation time. All tasks would require nothing but a short XML configuration file.

Java developers may find that by providing many ready-to-use components, the framework offers an alternative to programming in the large; it can reduce the need to repeatedly write code to connect to various interfaces using different, sometimes complicated APIs. At the same time it doesn't prevent users from adjusting (either programmatically or through configuration) components to their needs or writing custom components with custom Java code from scratch. By commoditizing the tedious task of integration, it frees the developer to concentrate on more interesting problems.

More Stories By Kris Lachor

Kris Lachor is a senior software developer at Dresdner Kleinwort.

Comments (2)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


IoT & Smart Cities Stories
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
Whenever a new technology hits the high points of hype, everyone starts talking about it like it will solve all their business problems. Blockchain is one of those technologies. According to Gartner's latest report on the hype cycle of emerging technologies, blockchain has just passed the peak of their hype cycle curve. If you read the news articles about it, one would think it has taken over the technology world. No disruptive technology is without its challenges and potential impediments t...
If a machine can invent, does this mean the end of the patent system as we know it? The patent system, both in the US and Europe, allows companies to protect their inventions and helps foster innovation. However, Artificial Intelligence (AI) could be set to disrupt the patent system as we know it. This talk will examine how AI may change the patent landscape in the years to come. Furthermore, ways in which companies can best protect their AI related inventions will be examined from both a US and...
Bill Schmarzo, Tech Chair of "Big Data | Analytics" of upcoming CloudEXPO | DXWorldEXPO New York (November 12-13, 2018, New York City) today announced the outline and schedule of the track. "The track has been designed in experience/degree order," said Schmarzo. "So, that folks who attend the entire track can leave the conference with some of the skills necessary to get their work done when they get back to their offices. It actually ties back to some work that I'm doing at the University of San...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...