Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal

Blog Feed Post

How to host Media Files on Amazon S3 with CloudBerry Explorer (part 1)

In this post we will discuss the advantages of storing media content of your website on Amazon S3 and how CloudBerry Explorer can help.  


If you want to learn how to get your Amazon S3 account you can read our previous post here

One of the typical ways to improve scalability of high traffic website is to serve it contents from several web servers. For example you may want to store your html files and dynamic script files at http://www.mysite.com/ while multimedia content such as images, video and audio files at http://media.mysite.com/ This way all request for html pages will go to first sever and requests for media content will go to the second one allowing each server to perform better under high load.

Let’s see how you can employ Amazon S3 as your second server. Amazon S3 offers you unlimited scalability and pay as you go model. You pay only for what actually is stored on your S3 account and pay only for the actual traffic. If the amount of data grows you pay more if it decreases you pay less. Same is with the traffic.

Amazon S3 can also act as a web server serving static content and this is where it comes handy. So instead of ordering another server to store your media content from your hosting provider you can sign-up for Amazon S3 account and move your images and video files there.

How to get Amazon S3 account and CloudBerry Explorer


It takes just a couple of minutes to create your own Amazon S3 account. We have a special blog post about it that you can find here

You can download CloudBerry Explorer freeware S3 client here

Copying files

Obviously if you want to serve your media files from Amazon S3 you will have to copy your files to your Amazon S3 account.  This is where you will need a client tool. There are many client tools available out there, but in this post we will talk about CloudBerry Explorer freeware.

Creating a bucket

First you will have to create a bucket that will have the same name as your domain name. for our example we will create a bucket called media.mysite.com,  this will help us to configure a CNAME for the bucket and you will learn more about it later.  Also make sure the name of the bucket is in lowercase – this is a requirement if you want to serve files from your bucket.

Copying files


Now you can copy files to your newly created bucket. Just select files on your local disk and click copy button on the toolbar.


Configuring access rights


To be able to serve your media files to internet users you will have to allow anonymous access to the files. You can do it easily by selecting the bucket and clicking the ACL Editor button in the toolbar.

ACL Editor will come up and you will have to grant “All Users” Read access to the bucket. “All Users” built-in group represents anonymous Internet users.  Make sure the check box “Apply for all subfolders and files” is checked off as it will automatically propagate access rights to all files in the bucket and you won’t have to set them up one by one. 

The ability to apply access rights to all objects in the bucket is one of the advantages of CloudBerry Explorer over other tools.  

Another cool feature is that you don’t have to care about access rights anymore - CloudBerry Explorer will apply bucket’s ACL to any new files copied to the bucket.

Generating URL


Now you have everything you need to start serving your files from Amazon S3. The syntax of the URL should conform to the following rule


your files URLs will look like the following



CloudBerry Explorer has an easy way to generate URLs for multiple files. Just select multiple files and click “Web URL” button on the toolbar.

In the dialog box you can see URLs for all your files and you can click Copy to clipboard button to copy them and paste wherever you like.


Configuring CNAMEs


Would you like to be able to use simpler link to your media files? Something like

http://media.mysite.com /Picture004.jpg

Is that possible? Yes! This is where CNAME comes. I am not going to get into DNS internal but simply speaking CNAME is a way to create a sub domain and refer it to another location. In our case we will refer a domain to Amazon S3 bucket.

All you have to do is to configure appropriate CNAME in your hosting provider control panel. I use 1&1 but every hosting provider offers a way to create CNAMEs and you will just have to find out the details.

To create a CNAME record you will have to specify an alias media and s3.amazonaws.com domain. This is how it looks like in 1&1 control panel:

It usually takes some time for DNS configuration to take effect, so the changes will not be available immediately.

Generating URLs with CNAME


Now you can start generating nice URLs using your newly created CNAME. Open the Web URL dialog box that you are already familiar with and type CNAME as indicated on the screen.  You will see that all URLs will be automatically updated to include the CNAME.


That’s it. Now you are ready to update your html code with new URLs and improve the scalability of your web server by taking advantage of Amazon S3.


Automating upload with PowerShell command line interface


If you are wondering how you can automate the process of copying the files to Amazon S3 you can check out CloudBerry Explorer PowerShell command line interface here It can automate most of the tasks available in CloudBerry Explorer GUI.

There is also an open source C# library called Resourceful that you can use to automate date transfer to S3. You can download the library at here

There is a huge number of 3rd party libraries for Amazon S3 available and those two are just examples.

Looking ahead to part 2

In the second part of our article we will look at how you can employ Amazon CloudFront content delivery service to make your files available in multiple locations and how to configure CloudFront using CloudBerry Explorer.

Another area that we will explore is how to reduce your monthly bills by configuring cache-control headers. 


As you could see Amazon S3 offers a great solution for hosting your media content while decreasing the load of your primary web server. There are some obvious advantages including pay as you go model and unlimited scalability. On the other hand CloudBerry Explorer freeware can help copy files to S3 account, configure your files to be accessible by web browser and automate the whole process.

Want to know how much it may cost to host videos on Amazon S3? Check out this blog post 

Read the original blog entry...

More Stories By Alexandra Brown

Marketing Manager at CloudBerry Lab, the company that specialize on tool that makes Cloud Computing adoption easier. CloudBerry Lab is established in 2008 by a group of experienced IT professionals with the mission to help organization in adopting Cloud computing technologies by closing the gap between Cloud vendors propositions and consumer needs through development of innovative low costs solutions.

@ThingsExpo Stories
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, examined the regulations and provided insight on how it affects technology, challenges the established rules and will usher in new levels of diligence arou...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
As IoT continues to increase momentum, so does the associated risk. Secure Device Lifecycle Management (DLM) is ranked as one of the most important technology areas of IoT. Driving this trend is the realization that secure support for IoT devices provides companies the ability to deliver high-quality, reliable, secure offerings faster, create new revenue streams, and reduce support costs, all while building a competitive advantage in their markets. In this session, we will use customer use cases...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
DXWorldEXPO LLC announced today that "Miami Blockchain Event by FinTechEXPO" has announced that its Call for Papers is now open. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expe...
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by FinTechEXPO. ICOHOLDER give you detailed information and help the community to invest in the trusty projects. Miami Blockchain Event by FinTechEXPO has opened its Call for Papers. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Miami Blockchain Event by FinTechEXPO also offers s...