Welcome!

Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal

Related Topics: Weblogic

Weblogic: Article

Benchmarking, Tuning, and Manageability

Benchmarking, Tuning, and Manageability

This month, I'll look at benchmarking and tuning your applications, and how to make your Java runtime more manageable. And, I offer some advice on how your developers can keep their focus on development work.

Q. Can you recommend a process for benchmarking and tuning applications?
A.
To establish baselines on a production application, you need to determine its performance characteristics prior to deployment. The end result of this process is twofold. First, it allows you to tune the application to defined business objectives and verify it against a set of load tests that closely match expected production conditions. Second, it helps you to identify the application components that are critical to performance so that they can be monitored and tracked in production. The next step is critical to any capacity planning efforts as the expected load on the application grows.

I suggest that you take the following steps:
1.   Create a set of test scripts that mimic user interactions.
2.   Identify a performance characteristic to monitor (e.g., response time, CPU time, I/O activity).
3.   Determine the characteristic's target performance level.
4.   Using the test scripts, generate load on the application to establish a baseline for the performance characteristic under investigation.
5.   Identify components of the application driving the performance characteristic and apply methods, one by one, to improve them.
6.   After each applied performance improvement, rerun the tests to determine the level of improvement, if any, from the baseline.
7.   Repeat steps 5 and 6 until the target performance level is achieved.

The importance of steps 3 and 4 cannot be overstated. Without a performance baseline, investigators cannot determine the effectiveness of any improvements nor can they judge if the performance goals can reasonably be attained. When both the generated load and the test environment sufficiently mirror production circumstances, I have found this process to be highly successful in helping ensure high application performance over the long run.

Q. How will the Java runtime become more manageable over time?
A.
Historically, Java has done a great job of servicing the needs of the developer by rapidly rolling out new APIs and services developers need to build functionality and get the application functioning rapidly. However, when it comes to manageability the JVM is one area where there is room for improvement. For example, the Java runtime does not provide APIs for notification about garbage collection or for measuring thread performance.

What organizations need are APIs for performance and availability that specifically target production environments and incur minimal overhead. Those APIs are currently being specified - there are some new JSRs, such as JSR 174, that focus on exactly these issues. While the standards bodies address performance and availability, some JVM vendors have begun efforts to make their JVMs more manageable because they understand that there's an immediate need for a solution like this at the JVM level itself. (JRockit, for example, offers extra features for manageability.)

JMX offers some performance and availability management functionality, and organizations should consider coding APIs that allow them to utilize it. The primary strength of JMX, however, is in making the application servers themselves more manageable, and that's the focus of much of the current JMX research and implementation. Over time, manageability will become more and more a part of the standard Java runtime. This will be enabled by the emergence of new JSRs that make the JVM more manageable with low overhead in a production environment and that focus on performance, availability, and resource utilization.

Q. I'm a developer and I keep getting pulled into meetings to solve PRODUCTION application performance and availability problems regardless of their cause. What can I do to get out of this and get back to developing software?
A.
This is a problem that many developers have asked me about. Too often, software developers get pulled in to solve production problems without much information about what the cause of the problem is. As a result, they spend needless time looking through thread dumps and log files trying to find a needle in the haystack, rather than spending their time developing software.

There is a need for a specific role within the company called a Level II application support manager. This person serves as a complement to the day-to-day operations people who handle typical management duties such as making sure the hardware boxes are rebooted on time or that DNS servers are available. When there's a problem with an application, the primary role of the application support manager is to perform triage. He or she should know the right person to call to get the problem fixed and be able to provide that person with information about why they were called in and why their area of expertise is needed. For example, they should be prepared to offer some trending information, some historical performance information, or some real-time performance information to whomever they call so that person isn't thrown into complete darkness.

If you have an application support manager to monitor the application and who can perform triage quickly and accurately when there's a problem, then the developers will be taking fewer calls, and the ones they do take will legitimately require their expertise. This will result in serious productivity gains for the development organization as well as serious gains in application availability on the operations side.

*  *  *

As always, I invite you to send an e-mail to [email protected] if you have any performance-related questions about JVMs, Java applications, WebLogic Server, or connections to back-end systems.

More Stories By Lewis Cirne

Lew Cirne is the founder of New Relic, the first provider of on-demand (SaaS) application management tools for cloud or datacenter applications. A seasoned entrepreneur, technologist, and enterprise software pioneer, he has been focused on application performance management for more than ten years. Cirne holds seven patents related to application performance technology. Most recently he was an Entrepreneur in Residence at Benchmark Capital. He founded and was first CEO of Wily Technology and earlier held senior engineering positions at Apple and Hummingbird Communications.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
Organizations do not need a Big Data strategy; they need a business strategy that incorporates Big Data. Most organizations lack a road map for using Big Data to optimize key business processes, deliver a differentiated customer experience, or uncover new business opportunities. They do not understand what’s possible with respect to integrating Big Data into the business model.
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities – ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups. As a result, many firms employ new business models that place enormous impor...
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Taica manufacturers Alpha-GEL brand silicone components and materials, which maintain outstanding performance over a wide temperature range -40C to +200C. For more information, visit http://www.taica.co.jp/english/.
SYS-CON Events announced today that Dasher Technologies will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Dasher Technologies, Inc. ® is a premier IT solution provider that delivers expert technical resources along with trusted account executives to architect and deliver complete IT solutions and services to help our clients execute their goals, plans and objectives. Since 1999, we'v...
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, will discuss how they b...
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
SYS-CON Events announced today that TidalScale, a leading provider of systems and services, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale has been involved in shaping the computing landscape. They've designed, developed and deployed some of the most important and successful systems and services in the history of the computing industry - internet, Ethernet, operating s...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant tha...
SYS-CON Events announced today that TidalScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale is the leading provider of Software-Defined Servers that bring flexibility to modern data centers by right-sizing servers on the fly to fit any data set or workload. TidalScale’s award-winning inverse hypervisor technology combines multiple commodity servers (including their ass...
As hybrid cloud becomes the de-facto standard mode of operation for most enterprises, new challenges arise on how to efficiently and economically share data across environments. In his session at 21st Cloud Expo, Dr. Allon Cohen, VP of Product at Elastifile, will explore new techniques and best practices that help enterprise IT benefit from the advantages of hybrid cloud environments by enabling data availability for both legacy enterprise and cloud-native mission critical applications. By rev...
Infoblox delivers Actionable Network Intelligence to enterprise, government, and service provider customers around the world. They are the industry leader in DNS, DHCP, and IP address management, the category known as DDI. We empower thousands of organizations to control and secure their networks from the core-enabling them to increase efficiency and visibility, improve customer service, and meet compliance requirements.
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
Amazon is pursuing new markets and disrupting industries at an incredible pace. Almost every industry seems to be in its crosshairs. Companies and industries that once thought they were safe are now worried about being “Amazoned.”. The new watch word should be “Be afraid. Be very afraid.” In his session 21st Cloud Expo, Chris Kocher, a co-founder of Grey Heron, will address questions such as: What new areas is Amazon disrupting? How are they doing this? Where are they likely to go? What are th...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, will lead you through the exciting evolution of the cloud. He'll look at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering ...
Digital transformation is changing the face of business. The IDC predicts that enterprises will commit to a massive new scale of digital transformation, to stake out leadership positions in the "digital transformation economy." Accordingly, attendees at the upcoming Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA, Oct 31-Nov 2, will find fresh new content in a new track called Enterprise Cloud & Digital Transformation.
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp emp...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, will discuss how given the magnitude of today's applicati...