Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal

Related Topics: Java IoT

Java IoT: Article

Creating a Push Strategy for Your Web Site

Creating a Push Strategy for Your Web Site

What if you built a Web site and nobody came? Or they came once and forgot to check in again to see all the latest stuff you built? One of the problems with the Web is that it has been hard to get people to become regular users of your site. You're either on the Favorites List or you're not. And even if you're there, there's no promise that people will think to call up your site each day.

Push technology allows you to reach back out to individual users and give them content without them remembering to come and look for it. If you do it right, you'll also remind them to come back to see the rest of the great stuff you've been working on.

Push technology has been around for a few years on the Internet. PointCast delivered the first broadly successful solution in 1995. They created a custom Internet application that ran on the user's machine and pulled material off the server. But the system was proprietary and there was no way for you to participate without working directly with PointCast.

Now, the leading browser vendors are bringing the power of Push to site producers everywhere. Both Internet Explorer 4.0 and Netscape Communicator have great solutions that allow you to deliver your content directly to those who want it.

Push technology comes in a number of different forms. At MSNBC, we've been experimenting with a number of these technologies for the last year. In this article, I'll share some of what we've learned and provide some tips and tricks for making Push technologies work for you on your Web site.

Personalized Content
Push technologies are very tempting for site producers. You have so much to tell customers that you just know they are dying to hear about. The idea of a system that automatically forces your message down your customer's throat - willing or not - seems like a great idea. That's why telemarketers have so many companies paying them to call you when you're at dinner.

But before you interrupt the user's day with your message, you'd better have something interesting to say. Users quickly tire of interruptions that are irrelevant to their needs. That's why we've focused so much attention on building elegant personalization into our site. Users can easily tell us what their preferences are and we can use that information to deliver only the news they want to see.

MSNBC centers its personalization on the Personal Front Page. This is a server-side script page that assembles the user's choice of leading news stories from around the world, sports scores, stock tables, weather and local news. Users can customize this page to their preferences. We use the Active Server Page (ASP) system in Microsoft's Internet Information Server to build these pages for each user. The ASP script checks a cookie on the user's machine to find the correct customization settings. These settings are kept on the server in a SQL Server database. The ASP script then assembles a page of HTML from a series of "mini-pages" and text files to produce the final Personal Front Page.

A Range of Delivery Options
Push technologies are intrusive. To a greater or lesser extent, they interrupt the user's daily work flow and try to grab attention. We manage these interruptions by creating a range of tools with different levels of intrusiveness.

One way to characterize these tools is by how much they interrupt the user:

  • Low - The site can construct pages on the fly that appear when the user chooses to come to the site. This is still "push" in the sense that particular content is being given to the user, but it only happens once they've decided to come to your site.
  • Medium - Sites can send e-mail. This will wait in the user's Inbox until they choose to look at it. This level also includes some forms of cached content where the material is read from the site and kept on the users' local hard drive until they are ready to read it.
  • High - There are separate applications that constantly scan for information and interrupt the user immediately when something interesting happens "out there".

    We give the customer the ability to select the tools they want to use and the opportunity to personalize the news that is delivered through each of those tools. Delivery options and Personalization work together to provide the customer with the highest value for the interruptions that we create.

    Let's look at these delivery options in more detail.

    Cached Content
    Push technology is driven by cached content. Content is read from a server and stored on the user's local machine. Then the viewing tools can spend more time on formatting and presentation. PointCast is the most common early example of this.

    Last year, MSNBC built a similar system - MSNBC News Off-line - that relies on HTML for the presentation. The user loads a custom client application and then can select what types of stories to keep current. These choices are managed down to the sub-category level (e.g., golf and baseball within the broader category of Sports). The client runs in the background and loads new HTML pages from the site on a schedule selected by the user. Instead of getting the standard front pages authored by the editorial staff, MSNBC News Off-line presents a view by category, sub-category and story.

    This system has been in place for seven months. It is about to be supplanted by a more general implementation provided by the upcoming Internet Explorer 4.0 release. IE 4.0 manages an off-line cache based on the notion of channels. Sites can easily author a channel by maintaining a single index file. This index file uses the new Channel Definition Format to describe the parts of the site that should be downloaded to the user's local hard drive. The Channel Guide then allows the user to see when new material is loaded and easily switch among the channels to which they have subscribed.

    The IE 4.0 Channel Guide model has advantages for both the site producer and the end user. The producer doesn't need to maintain a separate tool or do much unique authoring for the system. Users have a single model that organizes all the content they care about the most and allows them to browse it quickly.

    Personal Delivery
    Many sites already use mailing lists to "get the word out" about their site. Pathfinder, the LA Times, Berkley Systems and Microsoft's Slate magazine are all examples of sites that use standard e-mail list servers to tell users when material changes on the site. The advantage of this approach is that it's easy to set up. It's also easy for the user to ignore. Text-based e-mail doesn't provide much opportunity to grab the user's attention. Also, since the material is usually simple promotion, users quickly learn to ignore them unless they are deeply interested in the material.

    MSNBC has a different approach to using mail, called Personal Delivery. We built a series of proprietary server-based solutions to deliver individual HTML pages to each user at the time they want it. A scheduling application keeps track of users who have signed up for the service and when they want to receive their pages. At the appointed time, a second server application builds the HTML page, encodes it as a standard MIME e-mail attachment and mails it to the user. The user is given a custom decoder application that reads the attachment, breaks it into a series of HTML pages and opens the browser of choice on the page.

    The advantage of this solution is that it brings real HTML-based content to the user directly through the tool many people use the most on the Internet - e-mail. The material is pulled directly off the real Web site so it is current and doesn't require a separate editorial process to maintain. Also, since the entire page, including graphics, is encoded, users can read their news even when they are disconnected from the network. Since it uses regular MIME attachments, it works with any modern e-mail reader. In the next year, many e-mail readers will handle HTML directly so the extra encode/decode step will not be necessary.

    One disadvantage of this solution is that it requires extensive server code to implement. Internet Explorer 4.0 provides an easy way to replicate almost the same behavior as part of a Channel implementation. The site producer can set which pages from the site should be e-mailed directly to the user. This is handled on the client side so that no additional server software is needed.

    News Alert
    MSNBC News Alert is a small Win32 application. It runs all the time on the user desktop and every ten minutes (or at an interval selected by the user) goes out to the Web. It checks the timestamp on a text file that we maintain that is an index of all the stories currently on the site. If the file has changed, it copies it to the user's machine and scans it for stories users have said they care about.

    When a story is found, News Alert triggers an animated icon in the Win95 Task Bar. If the user clicks on the animated icon, a small window appears with the headline. The user can dismiss the box, cycle through any other headlines that News Alert downloaded or just click on the headline itself to go on to the Web to see the full story.

    The stories that appear in News Alert are selected in three different ways. MSNBC editors select the top stories in each section of the site all day long. By default, News Alert brings these headlines to the user. Even more interesting, editors have a tool that allows them to immediately place a breaking news headline into the central index file. Users who have News Alert running on their machines will see that headline at their desks the next time News Alert checks the file. This allows us to deliver breaking headlines as soon as they happen, instead of just when the user remembers to check the site.

    The Microsoft Investor Web site uses News Alert to announce major moves in stock prices to their users. The user selects the stocks they want to track and the percentage movement that is significant to them.

    News Alert also delivers an ad with each alert delivered. News Alert loads the ad in the background and reports back how many times the alert ad was presented. MSNBC sells the spot on a daily or weekly basis to premium advertisers who are looking for new ways to capture attention. In this way, News Alert draws users to the site and creates its own revenue stream.

    MSNBC maintains a ticker of the latest sports scores and sports headlines. This ticker appears in the MSNBC Sports section and, if the user has Internet Explorer 4.0, it can be pulled off the Web page and placed directly on the user's desktop. This same engine will be used for news and business headlines in the future.

    For portability, this ticker is implemented in Java. The applet makes a straightforward get call to a fixed URL. The URL is a server-side script that accesses a SQL database which receives a constant stream of updated scores. The server-side script builds an HTML page with all the latest scores. The Ticker applet reads and formats these scores.

    Think Like the User
    Now let's talk about how to put these all together.

    One of the first rules in any site design is to think like the user. What does your customer want and need? Because you are so close to your site every day, it's easy to imagine that your users want everything dropped right onto their desktop. After all, you went to a lot of trouble to produce that material, shouldn't they do you the courtesy of studying it all? You have to take a more detached view of your product and understand it from your user's point of view. Build a model of your users' behavior. How often do they come to the site? Once a day? Once a week? Once a month? Do they return regularly? How many pages do they look at? What do they look at? There are a number of tools on the market that can interpret your site logs and give you detailed information on what your users are doing. We've used these tools along with regular surveys on the site to gather an understanding of how our users behave.

    Now, imagine what information you have that the user most wants. How often does that information change and update? How urgent is that change to the user? Stock prices are an obvious example of changes that are urgent to some users, but even the most dedicated stock follower can't be distracted by every hiccup in hundreds of stocks. Determine what level of information and what degree of significance it will have for your user.

    We've designed our most intrusive applications, like News Alert, to deliver quick snips of information that are truly important. This is both a technical and editorial issue. The editors must have the discipline not to mark every new story as a breaking headline. We've found that when we interrupt with anything less than truly breaking headlines our users complain. We've also found that customers love to take control of the News Alert application and set their own keywords to tune the headlines to their own tastes.

    Think Like the Producer
    Successful product design starts with the user in mind. But still, you have to remember what the goals of your organization are as well. As a news site, MSNBC feels strongly that there are some stories that people just need to hear about. We reserve the top part of our Personal Front Page for our editors to lead with the top five stories of the day. Sometimes these are news-driven headlines and sometimes they are the most interesting and elaborate features we've built that day. By combining this editorial sensibility with the user-driven personalization, we build a product that is tuned to the user and still has the unique voice of our editorial staff.

    At MSNBC, we're trying to run a business. We get most of our revenue from advertising. All this Push technology is wasted if it doesn't somehow drive up these advertising revenues. In some cases, the relationship is very obvious: We sell a special advertising slot with News Alert that runs at a premium because it comes up when headlines are breaking. Most of the increase in revenue comes from increased customer loyalty, increased return visits and our ability to drive people from the push-delivered news back to the full site.

    Until now, it took a strong development team to design, implement and maintain a push technology solution for your Web site. With the latest round of browsers, these tools are now available to sites of all sizes. Therefore, it is now more important than ever that a solid strategy accompany the use of this technology.

  • More Stories By Keith Rowe

    Keith Rowe is the Director of Technology at MSNBC on the Internet. He has worked at Microsoft Corp. for seven years, starting in Language Design. In 1994, he transferred to lead the prototyping and development efforts for Microsoft's interactive television applications. As Director of Technology, Keith is in charge of the creation of tools and platforms for creating and distributing MSNBC's new products on the Internet.

    Comments (0)

    Share your thoughts on this story.

    Add your comment
    You must be signed in to add a comment. Sign-in | Register

    In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

    @ThingsExpo Stories
    A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
    Imagine if you will, a retail floor so densely packed with sensors that they can pick up the movements of insects scurrying across a store aisle. Or a component of a piece of factory equipment so well-instrumented that its digital twin provides resolution down to the micrometer.
    In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settle...
    Product connectivity goes hand and hand these days with increased use of personal data. New IoT devices are becoming more personalized than ever before. In his session at 22nd Cloud Expo | DXWorld Expo, Nicolas Fierro, CEO of MIMIR Blockchain Solutions, will discuss how in order to protect your data and privacy, IoT applications need to embrace Blockchain technology for a new level of product security never before seen - or needed.
    BnkToTheFuture.com is the largest online investment platform for investing in FinTech, Bitcoin and Blockchain companies. We believe the future of finance looks very different from the past and we aim to invest and provide trading opportunities for qualifying investors that want to build a portfolio in the sector in compliance with international financial regulations.
    Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
    Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
    No hype cycles or predictions of a gazillion things here. IoT is here. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, an Associate Partner of Analytics, IoT & Cybersecurity at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He also discussed the evaluation of communication standards and IoT messaging protocols, data...
    Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
    In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, provided a fun and simple way to introduce Machine Leaning to anyone and everyone. He solved a machine learning problem and demonstrated an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intelligence and B...
    "IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
    When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
    Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
    We are given a desktop platform with Java 8 or Java 9 installed and seek to find a way to deploy high-performance Java applications that use Java 3D and/or Jogl without having to run an installer. We are subject to the constraint that the applications be signed and deployed so that they can be run in a trusted environment (i.e., outside of the sandbox). Further, we seek to do this in a way that does not depend on bundling a JRE with our applications, as this makes downloads and installations rat...
    Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
    DX World EXPO, LLC, a Lighthouse Point, Florida-based startup trade show producer and the creator of "DXWorldEXPO® - Digital Transformation Conference & Expo" has announced its executive management team. The team is headed by Levent Selamoglu, who has been named CEO. "Now is the time for a truly global DX event, to bring together the leading minds from the technology world in a conversation about Digital Transformation," he said in making the announcement.
    In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lead...
    Digital Transformation (DX) is not a "one-size-fits all" strategy. Each organization needs to develop its own unique, long-term DX plan. It must do so by realizing that we now live in a data-driven age, and that technologies such as Cloud Computing, Big Data, the IoT, Cognitive Computing, and Blockchain are only tools. In her general session at 21st Cloud Expo, Rebecca Wanta explained how the strategy must focus on DX and include a commitment from top management to create great IT jobs, monitor ...
    "Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
    The IoT Will Grow: In what might be the most obvious prediction of the decade, the IoT will continue to expand next year, with more and more devices coming online every single day. What isn’t so obvious about this prediction: where that growth will occur. The retail, healthcare, and industrial/supply chain industries will likely see the greatest growth. Forrester Research has predicted the IoT will become “the backbone” of customer value as it continues to grow. It is no surprise that retail is ...