Posted in Microsoft, Microsoft, Microsoft Azure

How to Scale Queries Using Azure Stream Analytics


Learn how to scale queries using Streaming Units and partitions in this tutorial by Krishnaswamy Venkataraman, a big data and cloud architect.

In a traditional static data scenario, a query can be executed against a fixed data set and results will be available after a known interval. On the other hand, with a streaming data scenario involving constant changes to a dataset, the queries will run for a longer duration or might not even complete.

Additionally, a constant stream of data will increase the volume of the data, and the query might drain the working memory. One way to draw a data boundary is through the context of time. For example, with a streaming dataset, you can specify a data boundary that resides within the start and end time. This will restrict the query execution between known boundaries. There are two types of timing constraints you can use to set time boundaries for the streaming data, application and arrival time.

Continue reading “How to Scale Queries Using Azure Stream Analytics”

Advertisements
Posted in Cloud Computing, Cloud Security, Private Cloud

Life Science Application, FDA and Cloud Computing


Life science application comes under Life sciences industry.

Life sciences consist of all fields of science that involve the scientific study of living organisms such as human beings, plants, and animals. The study of behaviour of organisms is only included in as much as it involves a clearly biological aspect. Biology and medicine remain main parts of the life sciences, having said that technological advances in molecular biology and biotechnology have directed it to a burgeoning of specializations and new interdisciplinary fields.

Cloud Computing – Download Free EBooks and Whitepapers

R&D process in the life science can be a long and expensive undertaking. The product development process follows basic steps at a very high level as described below:

• Phase 1 – recognition of the particle, initial testing, and toxicology studies

• Phase 2 – more development, formulation, and human testing

• Phase 3 – double blind clinical trials to test efficacy and submission for FDA approval

Life science industry operates under the regulatory guidelines put forward by the Food & Drug Administration (FDA).

Food and Drug Administration is a federal agency in the Department of Health and Human Services. It is established to regulate the release of new foods and health related products.

The IT organizations in life science companies must adhere to the FDA guidelines put forth in the Code for Federal Regulations 21 Part 11 (CFR 21 Part 11). It defines how systems managing electronic records in life science firms must be validated and verified to ensure that the operation of and the information in these systems can be trusted.

Title 21 CFR Part 11 of the Code of Federal Regulations deals with the Food and Drug Administration (FDA) guidelines on electronic records and electronic signatures in the United States. CFR Part 11, as it is called, defines the criteria under which electronic records and signatures are considered to be reliable and equivalent to paper records.

Part 11 requires drug makers, manufacturers, biologics developers, biotech companies, and other FDA-regulated industries to implement controls such as audits, system validations, audit trails, electronic signatures, and documentation for software and systems involved in processing electronic data that are (a) required to be maintained by the FDA predicate rules or (b) used to demonstrate compliance to a predicate rule with some specific exceptions.

The actual Part 11 compliance process for any application includes software, hardware, and operational environment for the system itself. This allows an IT Team to answer the questions.

To prove these things the system validation process has three primary components, the Installation Qualification (IQ), the Operational Qualification (OQ), and Performance Qualification scripts. Organizations manage IT environment separately for the life science applications and with proper controls placed.

CFR does not ask organization on How to do it? but it states What needs to be done.

It all comes to convincing the FDA auditor whether the Cloud environment conforms to the FDA compliance requirements or not.

Cloud computing can improve and speed up process by reducing IT complexity and cost while allowing R&D organizations to focus on the ‘what’ of the R&D process in stead of the ‘how’.

But, how Cloud Computing and FDA can be brought on a same table is the biggest issue because:

Audit / Track of following items are needed.

Ø      Hardware serial number

Ø      System configuration

Ø      Equipment location

Ø      Exact versions off all installed software

FDA compliance in Public Cloud is impossible till now because you must be aware about the detailed information on the hardware and software that your system will be running on and even the exact physical location of the resources as well.

In Private Cloud, owner has control over all resources (Hardware, Software) and thus it is still possible.

In a nutshell, public cloud model just does not fit for the current practices for validation in FDA regulated organizations. However private cloud environment could be leveraged to provide life science companies with a short cut to completing overall system validation Public Cloud’s benefit “Economy of Scale” will be out of reach in this case.

A community cloud may be established where several organizations have similar requirements and seek to share infrastructure so as to realize some of the benefits of cloud computing. With the costs spread over less users than a public cloud (but more than a single tenant) this option is more expensive but may offer a higher level of privacy, security and/or policy (FDA) compliance.

What’s latest?

Amazon EC2 Dedicated Instances

Dedicated Instances are Amazon EC2 instances launched within your Amazon Virtual Private Cloud (Amazon VPC) that run hardware dedicated to a single customer.

NOTE: hardware dedicated to a single customer

Dedicated Instances let you take full advantage of the benefits of Amazon VPC and the AWS cloud – on-demand elastic provisioning, pay only for what you use, and a private, isolated virtual network, all while ensuring that your Amazon EC2 compute instances will be isolated at the hardware level.

You can easily create a VPC that contains dedicated instances only, providing physical isolation for all Amazon EC2 compute instances launched into that VPC, or you can choose to mix both dedicated instances and non-dedicated instances within the same VPC based on application-specific requirements

To get started using Dedicated Instances within an Amazon VPC, perform the following steps:

  • Open and log into the AWS Management Console
  • Create an Amazon VPC if you do not already have one on the Amazon VPC tab
  • Click on Launch Instance from the EC2 Dashboard
  • Select Launch Instances Into Your Virtual Private Cloud
  • Modify the instance tenancy from Default to Dedicated in the Request Instances Wizard
  • Start using your instance with the knowledge it will not share hardware with instances launched by other customers

Dedicated Instances certainly does help in building a case for FDA compliance and step in a RIGHT direction.
Reference:

http://www.hpcinthecloud.com/blogs/Cloud-Infrastructure-and-FDA-Compliance-92894189.html

http://www.hpcinthecloud.com/blogs/The-Possibilities-of-Cloud-in-the-Life-Sciences-Industry-91439669.html

http://www.hpcinthecloud.com/blogs/Negotiating-IT-in-the-FDA-Regulatory-Environment-92093279.html

http://aws.amazon.com/dedicated-instances/

http://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfcfr/cfrsearch.cfm

Posted in Cloud Computing, Private Cloud

Where Are The Disaster Recovery Solutions Heading?


Most of the global organizations across the world are relying on the IT than ever before to run their businesses successfully. With so much of critical data present inside the servers, it has become imperative ensure that it is secure and available at all times. This very need has underscored the importance of the disaster recovery solutions. So what are the various advantages of these solutions? Let’s take a look:

DevOps for Web Development
Implementing DevOps with Microsoft Azure
DevOps Bootcamp
Jenkins Essentials

Continue reading “Where Are The Disaster Recovery Solutions Heading?”

Posted in AWS, Cloud Computing, Cloud Management, Community Cloud, Microsoft Azure, PaaS, Private Cloud, Public Cloud

Cloud computing: A Disaster Recovery platform for small businesses


Cloud computing is one of the most popular high-end technologies that allows businesses to manage their data, business activities, and tasks more effectively and efficiently. The software keeps on introducing advanced features that helps both the large as well as small-scale businesses. Continue reading “Cloud computing: A Disaster Recovery platform for small businesses”

Posted in Cloud Computing, Cloud NEWS, Private Cloud

Where Websites Live Biggest data centers in the world


According to Internet research company Netcraft, as of last spring there were around 177 million active websites and the total number of websites worldwide is expected to reach 1 billion sometime this year. That is a lot of data to store. Businesses both large and small are migrating to the cloud and in doing so, they are creating tons of data for their web hosts to manage. Instead of buying, setting up, and managing their own servers to house their websites, many large companies are beginning to take advantage of third party web hosting services, which is resulting in a huge upsurge in the number — and size — of data centers being built, worldwide. Continue reading “Where Websites Live Biggest data centers in the world”

Posted in Cloud Computing, Cloud Governance, Cloud Management, Cloud NEWS, Cloud Security, Community Cloud, Hybrid Cloud, PaaS, Private Cloud

Ways in which cloud could change our business and personal lives


Everyone can agree that the world we live in is technology-based, and while there are a lot of technologies that would make everything a lot duller if they were to suddenly disappear overnight, there’s one specific piece of tech that’s simply indispensable, and would leave everything in chaos if it was to dissipate – the cloud. Cloud technology is the backbone to pretty much everything that’s technology-driven nowadays, and by the looks of it, it’s only going to become more popular moving forward. Even though the base concept for the cloud was contoured in the 70s, and businesses started using and perfecting it right away, its real potential only became apparent around 2010, when companies such as Microsoft, IBM and Oracle joined in the cloud bandwagon. The cloud has since matured, and changed the way we do pretty much everything, with no signs of stopping. Here’s how the cloud changed our live so far, and ways in which cloud could change our business and personal lives even further. Continue reading “Ways in which cloud could change our business and personal lives”

Posted in AWS, Cloud Computing, Cloud Management, Hybrid Cloud, PaaS, Private Cloud, Public Cloud

Five ultimate reasons to consider Cloud Computing for your business


When it comes to technology, you can never really know right from the start which trend is going to stick and which one will fade, so it’s not really a surprise that a lot of people were skeptical when cloud computing made an entry to the scene. Sure, the technology was still in its infancy and implementation was far from what we know today, but even so, cloud computing proved that the concept has a tremendous potential, and that it will forever change the world of technology and business. Fast forward to today, cloud computing is the ultimate technology to use in any field of work, with the most noticeable results in business environments. Simply put, whoever uses cloud computing in their business today has the upper hand. If you’re not convinced, here are the five ultimate reasons to consider cloud computing for your business. Continue reading “Five ultimate reasons to consider Cloud Computing for your business”